Dev Tools · 2h ago
Open-Source Tool Runs Transformers on Apple Neural Engine
Espresso is a new open-source library that enables training and inference of transformer models directly on Apple's Neural Engine. It bypasses the CPU and GPU for faster, more efficient AI processing on Apple devices. The project is available on GitHub with 14 points and 3 comments on Hacker News.
Meridian48 take
While promising, the library's real-world performance and compatibility with major frameworks remain unproven beyond initial benchmarks.
apple-neural-engineopen-source-ai