You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Tree:
fd66f7cdc0
WIP-hometown-skip-link
dariusk-working/4_3_0
dariusk-working/4_4_0
dariusk-working/4_5_0
hometown-1.0.8-security
hometown-3.5.10-merge
hometown-3.5.14-merge
hometown-4.0.10-merge
hometown-4.0.4
hometown-4.0.6-merge
hometown-4.2-merge
hometown-dev
hometown-rich-text
lets-bump-hometown-to-mastodon-4.2
v4.2.17+hometown-1.1.1
v4.2.17+hometown-1.1.2
2019-06-18
pre-release-0.1.0
v0.0.1.0
v0.1.0
v0.1.1
v0.1.2
v0.6
v0.7
v0.8
v0.9
v0.9.9
v1.0
v1.0.0+2.9.3
v1.0.1+2.9.3
v1.0.2+2.9.3
v1.0.3+3.0.1
v1.0.3+3.1.2
v1.0.4+3.1.4
v1.0.4+3.1.5
v1.0.5+3.2.0
v1.0.5+3.3.0
v1.0.5+3.4.0
v1.0.5+3.4.6
v1.0.5+3.5.2
v1.0.6+3.5.2
v1.0.7+3.5.4
v1.0.7+3.5.5
v1.1
v1.1.1
v1.1.2
v1.2
v1.2.1
v1.2.2
v1.3
v1.3.1
v1.3.2
v1.3.3
v1.4.1
v1.4.2
v1.4.3
v1.4.4
v1.4.5
v1.4.6
v1.4.7
v1.4rc1
v1.4rc2
v1.4rc3
v1.4rc4
v1.4rc5
v1.4rc6
v1.5.0
v1.5.0rc1
v1.5.0rc2
v1.5.0rc3
v1.5.1
v1.6.0
v1.6.0rc1
v1.6.0rc2
v1.6.0rc3
v1.6.0rc4
v1.6.0rc5
v1.6.1
v2.0.0
v2.0.0rc1
v2.0.0rc2
v2.0.0rc3
v2.0.0rc4
v2.1.0
v2.1.0rc1
v2.1.0rc2
v2.1.0rc3
v2.1.0rc4
v2.1.0rc5
v2.1.0rc6
v2.1.1
v2.1.2
v2.1.3
v2.2.0
v2.2.0rc1
v2.2.0rc2
v2.3.0
v2.3.0rc1
v2.3.0rc2
v2.3.0rc3
v2.3.1
v2.3.1rc1
v2.3.1rc2
v2.3.1rc3
v2.3.2
v2.3.2rc1
v2.3.2rc2
v2.3.2rc3
v2.3.2rc4
v2.3.2rc5
v2.3.3
v2.4.0
v2.4.0rc1
v2.4.0rc2
v2.4.0rc3
v2.4.0rc4
v2.4.0rc5
v2.4.1
v2.4.1rc1
v2.4.1rc2
v2.4.1rc3
v2.4.1rc4
v2.4.2
v2.4.2rc1
v2.4.2rc2
v2.4.2rc3
v2.4.3
v2.4.3rc1
v2.4.3rc2
v2.4.3rc3
v2.4.4
v2.4.5
v2.5.0
v2.5.0rc1
v2.5.0rc2
v2.5.1
v2.5.2
v2.6.0
v2.6.0rc1
v2.6.0rc2
v2.6.0rc3
v2.6.0rc4
v2.6.1
v2.6.2
v2.6.3
v2.6.4
v2.6.5
v2.7.0
v2.7.0rc1
v2.7.0rc2
v2.7.0rc3
v2.7.1
v2.7.2
v2.7.3
v2.7.4
v2.8.0
v2.8.0rc1
v2.8.0rc2
v2.8.0rc3
v2.8.1
v2.8.2
v2.8.3
v2.8.4
v2.9.0
v2.9.0rc1
v2.9.0rc2
v2.9.1
v2.9.2
v2.9.3
v2.9.4
v3.0.0
v3.0.0rc1
v3.0.0rc2
v3.0.0rc3
v3.0.1
v3.0.2
v3.1.0
v3.1.0rc1
v3.1.0rc2
v3.1.1
v3.1.2
v3.1.3
v3.1.4
v3.1.5
v3.2.0
v3.2.0rc1
v3.2.0rc2
v3.2.1
v3.2.2
v3.3.0
v3.3.0rc1
v3.3.0rc2
v3.3.0rc3
v3.3.1
v3.3.2
v3.3.3
v3.4.0
v3.4.0rc1
v3.4.0rc2
v3.4.1
v3.4.2
v3.4.3
v3.4.4
v3.4.5
v3.4.6
v3.4.7
v3.5.0
v3.5.0rc1
v3.5.0rc2
v3.5.0rc3
v3.5.1
v3.5.10+hometown-1.0.8
v3.5.14+hometown-1.0.8
v3.5.17+hometown-1.0.8
v3.5.19+hometown-1.0.8
v3.5.2
v3.5.5+hometown-1.0.8
v4.0.10+hometown-1.1.1
v4.0.13+hometown-1.1.1
v4.0.14+hometown-1.1.1
v4.0.15+hometown-1.1.1
v4.0.2+hometown-1.1.0
v4.0.2+hometown-1.1.1
v4.0.4+hometown-1.1.1
v4.0.4+hometown-1.1.1-patch
v4.0.5+hometown-1.1.1
v4.0.6+hometown-1.1.1
v4.2.10+hometown-1.1.1
v4.2.17+hometown-1.1.2
v4.5.6+hometown-1.2.0
v4.5.7+hometown-1.2.0
${ noResults }
Compact Language Detector v3 (CLD3) is the successor of CLD2, which was used in the previous implementation. CLD3 includes improvements since CLD2, and supports newer compilers. On the other hand, it has additional requirements and cld3-ruby, the FFI of CLD3 for Ruby, is still new and may be still inmature. Though CLD3 is named after CLD2, it is implemented with a neural network model, different from the old implementation, which is based on a Naïve Bayesian classifier. CLD3 supports newer compilers, such as GCC 6. CLD2 is not compatible with GCC 6 because it assigns negative values to varibales typed unsigned. (see internal/cld_generated_cjk_uni_prop_80.cc) The support for GCC 6 and newer compilers are essential today, when some server operating system such as Ubuntu Server 16.10 has GCC 6 by default. On the one hand, CLD3 requires C++11 support. Environments with old compilers such as Ubuntu Server 14.04 needs to update the system or install a newer compiler. CLD3 needs protocol buffers as a new dependency. However,it is not considered problematic because major server operating systems, CentOS and Ubuntu Server provide them. The FFI cld3-ruby was written by me (Akihiko Odaki) for use in Mastodon. It is still new and may be inmature, but confirmed to pass existing tests. |
9 years ago | |
|---|---|---|
| .. | ||
| atom_serializer_spec.rb | Revert "Use PostgreSQL inheritance for blocks and mutes (#2520)" (#2634) | 9 years ago |
| feed_manager_spec.rb | Add more FeedManager#filter? tests (#2413) | 9 years ago |
| formatter_spec.rb | Fixed bug that timeline can not be displayed by InvalidURIError (#2947) | 9 years ago |
| language_detector_spec.rb | Use CLD3 (#2949) | 9 years ago |
| tag_manager_spec.rb | Stop trying to shoehorn all Salmon updates into the poor database-connected | 9 years ago |
| user_settings_decorator_spec.rb | Clean up settings/preferences controller (#2237) | 9 years ago |
| webfinger_resource_spec.rb | Fix tests issue introduced in #1607 (#1639) | 9 years ago |