AI · 1h ago
French AI startup ZML open-sources tool to slash inference costs
ZML, a French AI startup backed by Yann LeCun, released ZML/LLMD, a free software that speeds up AI inference across multiple chips. The tool aims to reduce the cost of running large language models by optimizing parallel processing. ZML/LLMD is now available as an open-source project.
Meridian48 take
While ZML/LLMD could lower inference costs, its impact depends on adoption and whether it outperforms existing solutions like vLLM or TensorRT.
Read the full reporting
Hot French startup ZML releases free product to speed inference across lots of AI chips →
TechCrunch AI
ai-inferenceopen-source