PackagesImplementation of today's most used tokenizers
| Version | RDEPEND | DEPEND | BDEPEND | IDEPEND | PDEPEND |
|---|---|---|---|---|---|
| dev-lang/python | |||||
| dev-lang/rust | |||||
| dev-lang/rust-bin | |||||
| dev-libs/oniguruma | |||||
| dev-python/gpep517 | |||||
| dev-python/pytest | |||||
| dev-python/setuptools-rust | |||||
| dev-util/maturin | |||||
| sci-ml/datasets |