|SpaCy Natural Language Processing Library Released|
|Written by Alex Denham|
|Tuesday, 15 October 2019|
There's a new release of SpaCy, a natural language processing library in Python that the developers describe as industrial strength and blazingly fast with a simple and productive API.
The development team says spaCy excels at large-scale information extraction tasks. It's written from the ground up in memory-managed Cython, the superset of Python that aims to provide C-like performance with code that is written mostly in Python. Independent research in 2015 found spaCy to be the fastest syntactic parser in the world. spaCy can be used to prepare text for deep learning and it interoperates with TensorFlow, PyTorch, scikit-learn, and Gensim.
The new release is described as being leaner, cleaner and even more user-friendly, with new model packages and features for training, evaluation and serialization. It has improved performance over lower-cased texts to overcome any problems due to the models having been trained on well formed data in terms of casing and formality, then being used for real on texts which have inconsistent casing and punctuation. The developers are overcoming this via a new data augmentation system, and the first feature to be introduced in the v2.2 models is a word replacement system that also supports paired punctuation marks, such as quote characters.
New pretrained models have been added for Norwegian and Lithuanian, though the developers say accuracy on both these languages should improve in subsequent releases, as the current models make use of neither pretrained word vectors nor the SpaCy pretrain command.
New CLI features for training have been added, especially for text categorization. Error messages have been improved, the documentation is updated, and the evaluation metrics are more detailed. Integrated support has been added for the text categorizer in the CLI, so you can now write commands in the same way you would when training the parser, entity recognizer or tagger.
or email your comment to: firstname.lastname@example.org