Discover projects, groups and snippets. Share your projects with others
Manipulate any modification of any string without loss of information. Useful for cleaning, normalizing, de-noising, filtering, ... any work when insertion and deletion from and to a string are in use
Splits a string into sub-string in a versatile way. Allows discontinuous part of a string to be collected as a Span. Allows several strategies of string-splitting at the same time, for a given string. Does not modify the initial string.
Tokenizer classes for several NLP tasks: splitting a text on white space, using a REGEX expression, ... This package is based on the tokenspan package, see https://framagit.org/nlp/tokenspan