Flox reposted this
We just launched Flox AI Stacks-as-Code, run anything across any machine, accelerated, with a 0mb image... (imagine what NixOS can do in AI land) If it runs accelerated on your MacBook using Apple's MPS or MLX frameworks, it now always works on your colleague's Linux box running NVIDIA CUDA. Instead of wrapping an entire operating system to run a RAG pipeline or a model server, like with fat OCI images, you declare the runtime software, environment variables, and hardware-accelerated packages in a single text file. One text file works across macOS, Linux, and Windows with WSL2, on ARM or x86, MPS/MLX or CUDA. Under the hood, we built this on Nix. Absolute, cryptographically locked determinism in your agentic stack. Where it's creating value today for us and a bunch of folks in the ecosystem building autonomous agents and their own AI stacks: ❄️ Zero Container Tax: No multi-gigabyte images to store, move, or rebuild just to patch a CVE. ❄️ Sub 500ms Activation: Environments materialize natively on bare metal almost instantly. ❄️ Flawless Sim-to-Real Parity: If an agent or a model runs locally in your text-declared environment, it behaves exactly the same way in a production cluster. The Flox engineering team just open-sourced our first production reference patterns - including a complete modular RAG stack and a llama.cpp model serving environment integrated with Anthropics Claude Code. You don't need to change anything on your system to try it. Just run: flox activate -s flox-labs/ask-flox-llamacpp Link to the full breakdown and GitHub repos in the comments below. Image of James Bayer, Daniel Sauble & Gil Mishal showing it off (early access) at AI Engineering World Fair!