Open Hub
Open Hub

 Settings |  Report Duplicate

1
I Use This!
Low Activity

Commits : Listings

Analyzed 1 day ago. based on code collected 1 day ago.
Oct 17, 2024 — Oct 17, 2025
Commit Message Contributor Files Modified Lines Added Lines Removed Code Location Date
* Begin work on full PTB-compatible English tokenization
Matthew Honnibal
More... over 11 years ago
* Compile string_tools module
Matthew Honnibal
More... over 11 years ago
* Tests passing for reorganized version
Matthew Honnibal
More... over 11 years ago
* Tests passing for reorganized version
Matthew Honnibal
More... over 11 years ago
* Reorganized, moving language-independent stuff to spacy. The functions in spacy ask for the dictionaries and split function on input, but the language-specific modules are curried versions that use the globals
Matthew Honnibal
More... over 11 years ago
* Working tokenization. en doesn't match PTB perfectly. Need to reorganize before adding more schemes.
Matthew Honnibal
More... over 11 years ago
* Reading in tokenization rules correctly. Passing tests.
Matthew Honnibal
More... over 11 years ago
* Rejigged tests. Working possessives, but no other contractions
Matthew Honnibal
More... over 11 years ago
* Fixes to tokenization. Now segment sequences of the same punctuation.
Matthew Honnibal
More... over 11 years ago
* Possessive test passing
Matthew Honnibal
More... over 11 years ago
* Initial commit. Tests passing for punctuation handling. Need contractions, file transport, tokenize function, etc.
Matthew Honnibal
More... over 11 years ago
* Add ext stuff, while I figure out how to get it working as a different project
Matthew Honnibal
More... over 11 years ago
* Add gitignore
Matthew Honnibal
More... over 11 years ago
* Add initial docs stuff
Matthew Honnibal
More... over 11 years ago
* Add build/setup stuff
Matthew Honnibal
More... over 11 years ago
Initial commit
honnibal
More... over 11 years ago