mirror
/
devilutionX
mirror of https://github.com/diasurgical/devilutionX.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
9206 Commits
44 Branches
22 Tags
292 MiB
Branch: codeql
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'codeql'
${ noResults }
devilutionX/tools/segmenter/segment_all.py

19 lines
629 B
Raw Permalink Normal View History Unescape

Add a Japanese segmenter
4 years ago
#!/usr/bin/env python
import pathlib
import segment_zh
import segment_ja
import segmenter_lib
root = pathlib.Path(__file__).resolve().parent.parent.parent
zh_tokenizer = segment_zh.ZhTokenizer()
Segmenter: Use gettext to line-wrap po files The line wrapping algorithm of gettext is somewhat complicated. Rather than trying to approximate it, use `msgcat` from gettext directly. This is also what poedit does.
4 years ago
segmenter_lib.ProcessPoFile(tokenizer=zh_tokenizer,
input_path=root.joinpath("Translations/zh_CN.po"))
segmenter_lib.ProcessPoFile(tokenizer=zh_tokenizer,
input_path=root.joinpath("Translations/zh_TW.po"))
Add a Japanese segmenter
4 years ago
ja_tokenizer = segment_ja.JaTokenizer()
Segmenter: Use gettext to line-wrap po files The line wrapping algorithm of gettext is somewhat complicated. Rather than trying to approximate it, use `msgcat` from gettext directly. This is also what poedit does.
4 years ago
segmenter_lib.ProcessPoFile(tokenizer=ja_tokenizer,
input_path=root.joinpath("Translations/ja.po"))