All insights

Strategy · Jan 2, 2026 · 1 min read

From rules to reasoning: a CTO's pivot playbook

Pivoting a clinical product from a rules-based core to an LLM- and agent-based core is a six-month organizational change, not a six-week refactor. Here's the playbook for sequencing the work without breaking the business.

When I joined Altitude in 2025, the company had a working rules-engine product and a thesis that LLMs would let it serve more conditions, more workflows, and more enterprise customers. The pivot from a rules-based core to an LLM-and-agent core was the year's defining technical bet.

The pivot took longer than a refactor and shorter than a rebuild. The shape of the work, in order:

  1. Stabilize the existing rules engine. Don't refactor what you're about to replace. Freeze it where you can. Triage incoming work into "do in old system" and "wait for new system."
  2. Design the new substrate end to end. Skill files, retrieval, governance, evaluation, logging. On paper, before code.
  3. Migrate one scenario. The simplest, least-clinical, lowest-stakes one. Build the substrate around it.
  4. Migrate three more in parallel. Same substrate. Each scenario shakes out a different gap.
  5. Reach pivot threshold. Half the volume on the new substrate, golden cases passing, governance running. The rules engine is now a fallback, not the system of record.
  6. Sunset the rules engine scenario by scenario, on a schedule the business can plan around.

The full playbook — including the org changes (who owns what during transition), the budget shape, the milestone cadence, and the way to communicate the pivot to the board — is in the Healthcare AI Automation Playbook.

If your team is staring at a similar pivot, book a call. I'll tell you what's two months of work and what's a year of work, on the call.

pivotleadershiprules engineLLM

Next step

Want me to build something like this for your team?

Thirty-minute call. We'll look at the workflow you most wish was already automated and decide if it's a fit.