Compose Spec Updated with <models> for AI Workloads

by pplougon 7/2/25, 3:19 PMwith 10 comments
by AsmodiusVIon 7/2/25, 3:50 PM

Just saw this in the release notes, super excited to try it out.

Compose supporting an AI agent stack out of the box could be a big deal. I just saw a Reddit thread around using compose in production and I'm thinking I can put these two together. The idea of spinning up a whole multi-container setup for an LLM app (like a vector DB, orchestrator, backend, etc.) with a single compose up could work to actually get stuff to prod. I’ve been hacking around and struggling with this. Curious to see how far I can push this, might finally be the clean setup I can share.

by mikesir87on 7/2/25, 3:26 PM

Excited to see models get first-class support! Will be interesting to see what opportunities this opens with this being formalized (other tooling/integrations, etc.).

Note that Compose files using the previous model declarations (using providers) will still work.

by pplougon 7/2/25, 3:30 PM

The big question is still - how will the models reach production?

by djdtoon 7/2/25, 3:33 PM

Following this.

by asuarezfron 7/2/25, 3:30 PM

That sounds interesting

by pianoswimon 7/2/25, 5:10 PM

super pumped to see models get this support through docker

by nunezon 7/2/25, 6:44 PM

This is brilliant.