Implementation of today's most used tokenizers
Version | RDEPEND | DEPEND | BDEPEND | IDEPEND | PDEPEND |
---|---|---|---|---|---|
dev-lang/python | |||||
dev-python/gpep517 | |||||
dev-python/pytest | |||||
dev-python/setuptools-rust | |||||
dev-util/maturin | |||||
sci-libs/datasets | |||||
virtual/rust |
Version | RDEPEND | DEPEND | BDEPEND | IDEPEND | PDEPEND |
---|---|---|---|---|---|
dev-lang/python | |||||
dev-python/gpep517 | |||||
dev-python/pytest | |||||
dev-python/setuptools-rust | |||||
dev-util/maturin | |||||
virtual/rust |