Two strands run alongside the rungs: infrastructure & trust — dormant at rungs 1–2, switched on at rung 3, running to the top — and the managed workplace — how the whole framework lands when you climb it inside an organization.
Rungs 1 and 2 are a sealed box: the model touches nothing, so questions about servers, credentials, and attack surfaces simply do not arise. You can live at rung 2 forever knowing none of this.
Crossing into rung 3 changes that in one stroke. The moment the AI acts outside the chat, you inherit responsibility for what makes that safe — not as an optional enrichment, but as part of what standing on rung 3 means. This track is that inheritance, organized. The half-joking summary: everyone becomes a little bit devops. Not everyone becomes an engineer — but everyone using tool-connected AI ends up needing a working vocabulary for where software runs, where data flows, and what can go wrong in between.
1. Where the model lives
A model is software running somewhere, and where is a decision with consequences: closed weights, cloud/API (the model is a service you call; your data makes a round trip to the provider's machines) · open weights (published for anyone to download and run — open weights ≠ open source) · cloud/SaaS vs. on-prem/self-hosted (consume someone's hosted service, or run it on machines you control) · local inference (run the model on your own device; data never leaves — quantization is what makes this practical) · data residency / sovereignty (where data physically and legally lives, and whose law applies — the question that forces all the above choices to be made deliberately).
2. Data, trust, and the attack surface
What can go wrong once an AI reads the world and acts on it: prompt injection (rung 3) escalating to indirect prompt injection (rung 4, when an autonomous agent reads content with no human watching) · data poisoning · jailbreaks (a user pushing the model past its rules — distinct from injection, which is third-party content subverting it against the user) · data exfiltration / leakage · least privilege (rung 4) · sandboxing (rung 4) · credentials/secrets — never in a chat window, ever; minimal grants everywhere.
3. Ops literacy
The recognition-level vocabulary of running software, because tool-connected AI lives in that world: deployment and rollback, environments (dev/staging/prod), containers, endpoints, version control (Git), logging/monitoring. All defined in the glossary.
Everything above is inventory. These two are the point:
How much of this track you personally carry is not fixed by how high you climb. It is the product of two dials: your rung, and your hosting choice.
| Managed cloud service | Self-hosted / local | |
|---|---|---|
| Rung 3 | Very little ops: connect approved integrations, mind your data and credentials | Substantial ops: you run the model, the connectors, the logs |
| Rungs 4–5 | Still modest: the provider runs the machinery; you own goals, gates, and audits | The full stack: deployment, sandboxing, monitoring, rollback — all yours |
A rung-4 user on a managed platform may carry less operational burden than a rung-3 user self-hosting. Devops is a dial you choose, not a wall you hit. Nobody should stay off rung 4 out of fear of servers; choosing managed hosting is choosing to rent that burden out.
Open-vs-closed weights and cloud-vs-on-prem look like two separate technical choices. In practice they are one decision wearing two hats, and the decision is about trust, not technology. Closed weights in the cloud: maximum capability, minimum operational work, minimum control — your data leaves, and you trust the provider's handling of it. Open weights on your own machines: maximum control — data never leaves — bought with operational work and, typically, some capability. Every configuration between the poles is a point on the same axis: how much do you need to control, and what are you willing to trust others with? Answer the trust question first — what data is in play, what happens if it leaks, whose rules govern it — and the technical configuration usually picks itself.
The ladder itself does not change: five rungs, one moving part, judgment at every level. What changes is how the infrastructure & trust track lands on you. If you work somewhere with an IT department, approved tools, and acceptable-use policies, a large share of that track has already been carried by someone else — and a different share has quietly become more important, not less.
Anything you would have had to build or run, the organization has absorbed. Anything about what data moves where, you still own — and own harder.
The individual thesis shifts accordingly: less "everyone becomes a little devops," more ops-aware, governance-fluent.
This reallocation is role-dependent. If you build or operate systems for your organization, the full infrastructure track is yours at full weight — nothing here is abbreviated for you. The recognition-only compression applies to the majority whose job is to use AI inside the environment others maintain. And compression applies to attention, never to the reference: every term stays in the glossary at full definition.