npmchart

unicode-tokenizer

Unicode Tokenizer for line breaking.

v1.1.0 5 versions Maintained by bramstein
  • tokenizer
  • tokens
  • unicode
  • line breaking
  • tr14
  • natural language processing
  • nlp
npm github
Weekly downloads
13
vs previous week
Last 30 days
26
Latest version
1.1.0
14 years ago
Stars
—
Last commit
—
Open issues
—
includes pull requests

Downloads

Activity

102 total · Jun 6, 2026 – Sep 3, 2026

Versions

Downloads by version

Last 7 days

Releases

5 releases published since Aug 20, 2012

Commits

bramstein/unicode-tokenizer →

Issues

Pull requests