DiScoFormer: Single Transformer Model Handles Both Density and Score Estimation

Allen AI researchers introduce DiScoFormer, a unified transformer architecture that jointly learns density and score functions across multiple distributions. The model achieves state-of-the-art results on density estimation and score-based generative modeling benchmarks. This approach reduces computational overhead by eliminating the need for separate models for each task.