New Method Distills Black-Box LLMs Without Access to Internals

Researchers propose a technique to distill knowledge from black-box large language models using only their outputs. The method achieves competitive performance while reducing model size and computational cost. This could enable smaller teams to leverage powerful models without direct access to proprietary systems.