Dev Tools · 1h ago
New Python Library yasbd Boosts Sentence Segmentation Accuracy to 98.9%
spaCy's default Sentencizer achieves only 55.4% accuracy on a challenging English benchmark due to its simplistic rule-based approach. A new pure-Python library, yasbd, can be dropped into spaCy pipelines and reaches 98.9% accuracy by handling abbreviations, URLs, and complex punctuation. The upgrade requires minimal code changes and dramatically improves downstream NLP tasks.
Meridian48 take
While yasbd's accuracy gain is impressive, its real-world impact depends on how often edge cases like abbreviations and URLs appear in your specific text corpus.
Read the full reporting
Replacing spaCy's Sentencizer with yasbd: From 55.4% to 98.9% Accuracy →
DEV Community
nlpsentence-segmentation