Search results

Can I use a user dictionary?

Status: Open.

#65 In WorksApplications/SudachiTra;

· mumumu09chi opened on May 12, 2023

The entry of \n in vocab.txt is causing token index shifting

Status: Open.

#64 In WorksApplications/SudachiTra;

· hiroshi-matsuda-rit opened on May 8, 2023

Introduce token-based authentication for PyPI

Status: Open.

#63 In WorksApplications/SudachiTra;

· mh-northlander opened on Mar 17, 2023

setup.py install is deprecated.

Status: Open.

#62 In WorksApplications/SudachiTra;

· mh-northlander opened on Mar 15, 2023

Vocabulary file handling

Status: Open.

#57 In WorksApplications/SudachiTra;

· mh-northlander opened on Mar 10, 2023

tokenizer.model_max_length is incorrect

Status: Open.

#51 In WorksApplications/SudachiTra;

· mh-northlander opened on Jan 31, 2023

Tokenizer initializations behave differently

Status: Open.

#43 In WorksApplications/SudachiTra;

· mh-northlander opened on Feb 9, 2022

Add to the test for alignments of encoded tokens by JapaneseBertWordPieceTokenizer

bugSomething isn't workingSomething isn't working

Status: Open.

#42 In WorksApplications/SudachiTra;

· t-yamamura opened on Jan 26, 2022

use pathlib instead of os.path

Status: Open.

#41 In WorksApplications/SudachiTra;

· t-yamamura opened on Jan 25, 2022