Dev Tools · 2h ago
Portable AI Agent Fits on a USB Stick
A developer packaged a full AI agent with Python, Ollama, and memory into a 340MB self-contained package that runs on any x86_64 Linux machine. The bundle strips GPU libraries to save 5GB and uses relative paths for portability. It includes a CPU-only Ollama binary, a standalone Python venv, and memory persistence across sessions.
Meridian48 take
While clever, the CPU-only inference limits performance, and the first-run model download requires internet access, making it less truly portable than advertised.
portable-aiusb-stick-ai