aboutsummaryrefslogtreecommitdiffstats
path: root/native (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Fix: BoS prediction after inputting just once.Keisuke Kuroyanagi2014-11-011-2/+10
| | | | Change-Id: Ib69569ab6b6edfcc8c1d2c621b95de4127789ab6
* Merge "Update v4 format version from 402 to 403."Keisuke Kuroyanagi2014-10-317-25/+25
|\
| * Update v4 format version from 402 to 403.Keisuke Kuroyanagi2014-10-317-25/+25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Without personalization: Total words: 1134774, Success Num: 899230, Success Percentage: 79.243% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1871, Bad Failure Percentage: 0.165% Failures, with auto-correction (F-C): 29084, F-C Percentage: 2.563% Max Keystrokes: 6072959, Min Keystrokes: 4436090, Keystroke Saving Percentage:26.953% Before: Total words: 1134646, Success Num: 925194, Success Percentage: 81.540% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1316, Bad Failure Percentage: 0.116% Failures, with auto-correction (F-C): 28288, F-C Percentage: 2.493% Max Keystrokes: 6072831, Min Keystrokes: 3946188, Keystroke Saving Percentage:35.019% After Total words: 1134659, Success Num: 944746, Success Percentage: 83.263% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1258, Bad Failure Percentage: 0.111% Failures, with auto-correction (F-C): 28016, F-C Percentage: 2.469% Max Keystrokes: 6072844, Min Keystrokes: 3387333, Keystroke Saving Percentage:44.222% Change-Id: I3af42ec37a11847c0429c28616e726f6a339247f
* | Merge "Add hacks for better handling count value during migration."Keisuke Kuroyanagi2014-10-312-1/+4
|\|
| * Add hacks for better handling count value during migration.Keisuke Kuroyanagi2014-10-312-1/+4
| | | | | | | | | | Bug: 14425059 Change-Id: Ib050574aa7c4babd4285322a11c3af9be9fbab1e
* | Merge "Change v403 historical info format."Keisuke Kuroyanagi2014-10-316-11/+9
|\|
| * Change v403 historical info format.Keisuke Kuroyanagi2014-10-316-11/+9
| | | | | | | | | | | | count -> 2B, level -> 0B. Change-Id: I3b241126f56eb33cdf09cb1ebfed04f534e4ec48
* | Merge "Initial commit for native dicttoolkit."Keisuke Kuroyanagi2014-10-318-0/+284
|\ \
| * | Initial commit for native dicttoolkit.Keisuke Kuroyanagi2014-10-318-0/+284
| | | | | | | | | | | | | | | | | | Bug: 10059681 Change-Id: Ib730af8ebc944e08aaada869c0626724a499747c
* | | Further fixes to treat 0-frequency wordsAdrian Velicu2014-10-317-12/+47
| |/ |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Previously, when both legitimate 0-frequency words (such as distracters) and offensive words were encoded in the same way, distracters would never show up when the user blocked offensive words (the default setting, as well as the setting for regression tests). When b/11031090 was fixed and a separate encoding was used for offensive words, 0-frequency words would no longer be blocked when they were an "exact match" (where case mismatches and accent mismatches would be considered an "exact match"). The exact match boosting functionality meant that, for example, when the user typed "mt" they would be suggested the word "Mt", although they most probably meant to type "my". For this reason, we introduced this change, which does the following: * Defines the "perfect match" as a really exact match, with no room for case or accent mismatches * When the target word has probability zero (as "Mt" does, because it is a distracter), ONLY boost its score if it is a perfect match. By doing this, when the user types "mt", the word "Mt" will NOT be boosted, and they will get "my". However, if the user makes an explicit effort to type "Mt", we do boost the word "Mt" so that the user's input is not autocorrected to "My". Bug: 11031090 Change-Id: I92ee1b4e742645d52e2f7f8c4390920481e8fff0
* | Block offensive words in multi-word suggestionsAdrian Velicu2014-10-313-13/+65
| | | | | | | | | | | | | | | | | | If the user has chosen to block offensive words and types "aaaxbb", where "aaa" is an offensive word and "bb" is not, we should not suggest "aaa bb". Bug: 11031090 Change-Id: Ie23b8dd5d347bc26b1c046c3f5e8dfbc259bf528
* | Merge "Using "blacklist" flag as "possibly offensive""Adrian Velicu2014-10-318-26/+26
|\ \
| * | Using "blacklist" flag as "possibly offensive"Adrian Velicu2014-10-318-26/+26
| | | | | | | | | | | | | | | Bug: 11031090 Change-Id: I5cc0d006ab003656498eb82b0875eb9c051d331e
* | | Fix: native unit test build.Keisuke Kuroyanagi2014-10-311-2/+2
|/ / | | | | | | Change-Id: Id2bd4b60d6a4023815a630ebb3059a435b72c193
* | Enable count based dynamic ngram language model for v403.Keisuke Kuroyanagi2014-10-306-89/+128
| | | | | | | | | | | | Bug: 14425059 Change-Id: Icc15e14cfd77d37cd75f75318fd0fa36f9ca7a5b
* | Add DynamicLanguageModelProbabilityUtils.Keisuke Kuroyanagi2014-10-303-0/+152
| | | | | | | | | | Bug: 14425059 Change-Id: Ia58ab3f0ead02798046d182a9464dcbd95f086bc
* | Add method to encode probability.Keisuke Kuroyanagi2014-10-304-0/+73
| | | | | | | | | | Bug: 14425059 Change-Id: I3e5d359ba5fa38f1669f0e98dfae792ff53efbf8
* | Fix: TRT and ime-simulator bulid.Keisuke Kuroyanagi2014-10-301-0/+2
| | | | | | | | Change-Id: I1697a907562d1ed6aff2b001763d1594263ba0d3
* | Merge "Add a class to have global counters for LanguageModelDictContent."Keisuke Kuroyanagi2014-10-298-7/+209
|\ \
| * | Add a class to have global counters for LanguageModelDictContent.Keisuke Kuroyanagi2014-10-298-7/+209
| |/ | | | | | | | | Bug: 14425059 Change-Id: I08ec19903432356b6028853fd73b4eefce20218e
* | Merge "Improve space substitution error correction."Keisuke Kuroyanagi2014-10-286-11/+14
|\ \
| * | Improve space substitution error correction.Keisuke Kuroyanagi2014-10-286-11/+14
| |/ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Bug: 17432052 [Category diff] +1 262 -1 93 +2 2 -2 18 +3 18 -3 2 +4 111 -4 148 +5 295 -5 217 +6 51 -6 276 +7 139 -7 124 [Weighted category diff] +1 276 -1 100 +2 4 -2 20 +3 20 -3 4 +4 118 -4 160 +5 309 -5 225 +6 52 -6 298 +7 163 -7 135 show diff for ./en_user_log_phones_2011_08.csv +1 173 -1 28 +2 2 -2 17 +3 17 -3 2 +4 63 -4 82 +5 120 -5 51 +6 24 -6 220 +7 88 -7 87 Change-Id: I9d673acb0ff632828ae2e0ead56e76e3a20411c6
* / Fix: deleted PtNode handling in v403.Keisuke Kuroyanagi2014-10-271-0/+3
|/ | | | | | | If a word is once deleted, the word never gets into the personalized dictionaries due to this bug. Change-Id: Ife4e3fe1ba0615b4135e6291d2151b0db7d3f940
* Merge "Enable Address Sanitizer for native host test 2nd try"Yohei Yukawa2014-10-231-0/+4
|\
| * Enable Address Sanitizer for native host test 2nd tryYohei Yukawa2014-10-231-0/+4
| | | | | | | | | | | | | | | | This CL enables Address Sanitizer for native host test. Note that production build is not affected with this change. ASan is enabled only in static lib for test executables. Change-Id: I2c8e99b8c55e611e86f74579f24a63ac949bb02d
* | Merge "Fix: Personalized dicts suggest invalid words with v403."Keisuke Kuroyanagi2014-10-231-2/+3
|\ \ | |/ |/|
| * Fix: Personalized dicts suggest invalid words with v403.Keisuke Kuroyanagi2014-10-231-2/+3
| | | | | | | | | | Bug: 14425059 Change-Id: I45ae00069dd3b7c461dd9a1f3558b96af0a1c975
* | Merge "Stop building host native test in unbundled build"Yohei Yukawa2014-10-232-1/+14
|\ \ | |/ |/|
| * Stop building host native test in unbundled buildYohei Yukawa2014-10-232-1/+14
| | | | | | | | | | | | | | | | | | | | It turned out that building native code for host environment is not supported in NDK build. Hence this CL makes the host native test available only as a part of platform build to avoid accidental build breakage in unbundled build. BUG: 18095678 Change-Id: If608da166d5a478358e6890b8db526b4c2c0ab41
* | Use trigrams for personalization dict.Keisuke Kuroyanagi2014-10-232-84/+49
|/ | | | | 5Bug: 14425059 Change-Id: I73cf6904e569d60996a3b079f16ea6df0cb90f02
* Merge "Revert "Enable ASan (Address Sanitizer) for native host test""Yohei Yukawa2014-10-221-4/+0
|\
| * Revert "Enable ASan (Address Sanitizer) for native host test"Yohei Yukawa2014-10-221-4/+0
| | | | | | | | | | | | | | This reverts commit af2673f17d89c0ea8d61266ce92e55a77218b494 because of build failure in tapas build. Change-Id: Ib02931116181c98b35ce938e42d2376225e9b255
* | Merge "Enable ASan (Address Sanitizer) for native host test"Yohei Yukawa2014-10-221-0/+4
|\|
| * Enable ASan (Address Sanitizer) for native host testYohei Yukawa2014-10-221-0/+4
| | | | | | | | | | | | | | | | This CL enables Address Sanitizer for native host test. Note that production build is not affected with this change. ASan is enabled only in static lib for test executables. Change-Id: Idbe1f2e4502dfce9b6fb0253d7ebda8d37fbf84e
* | Support dumping ngram entries.Keisuke Kuroyanagi2014-10-225-25/+50
|/ | | | | Bug: 14425059 Change-Id: Ib03a0c3d166ed6f1e60c67127b28006d55143b6b
* Support ngram entry migration.Keisuke Kuroyanagi2014-10-226-43/+131
| | | | | Bug: 14425059 Change-Id: I98cb9fa303af2d93a0a3512e8732231c564e3c5d
* Fix debug build.Keisuke Kuroyanagi2014-10-212-4/+4
| | | | Change-Id: Id94636714d04a8828718b87741c0ee62a14cb3b4
* Merge changes I210acb81,Ie9508788Keisuke Kuroyanagi2014-10-2115-150/+188
|\ | | | | | | | | | | * changes: Make NgramProperty have NgramContext. Create .cpp file for NgramContext.
| * Make NgramProperty have NgramContext.Keisuke Kuroyanagi2014-10-2112-43/+48
| | | | | | | | | | Bug: 14425059 Change-Id: I210acb816b122857dbbe1ee4dd6a35c5335bf2bf
| * Create .cpp file for NgramContext.Keisuke Kuroyanagi2014-10-213-107/+140
| | | | | | | | | | | | Bug: 14425059 Change-Id: Ie950878817b9c80cc9c970e1a84880c9b9ab228a
* | Merge "Use EntryCounters during GC."Keisuke Kuroyanagi2014-10-215-65/+54
|\|
| * Use EntryCounters during GC.Keisuke Kuroyanagi2014-10-215-65/+54
| | | | | | | | | | Bug: 14425059 Change-Id: I61eb798686dc753fb6c0fe99a0719c1732198f30
* | Merge "Renaming "blacklist" flag to "possibly offensive""Adrian Velicu2014-10-2114-59/+107
|\ \ | |/ |/|
| * Renaming "blacklist" flag to "possibly offensive"Adrian Velicu2014-10-2114-59/+107
| | | | | | | | | | | | | | | | | | No behaviour changes. Unified the overloaded FusionDictionary::add method to always take an isPossiblyOffensive argument. Bug: 11031090 Change-Id: I5741a023ca1ce842d2cf10d4f6c926b0efabaa78
* | Introduce EntryCounters to count entries in a dictionary.Keisuke Kuroyanagi2014-10-2116-89/+230
|/ | | | | | Bug: 14425059 Change-Id: Ic13ba827d96fa4a147485ba92fdb37e23e04e8e8
* Change entry count limit.Keisuke Kuroyanagi2014-10-202-3/+7
| | | | | | Unigram 10K, Bigram 30K, Trigram 30K. Change-Id: Ibd19c6a2b618499df1c70000bad7b47498187f0a
* Merge "Update useless n-gram entry detection logic during GC."Keisuke Kuroyanagi2014-10-152-21/+32
|\
| * Update useless n-gram entry detection logic during GC.Keisuke Kuroyanagi2014-10-152-21/+32
| | | | | | | | | | Bug: 14425059 Change-Id: Ib939deae5b60167751dee07965bb1ef1a43c4625
* | Merge "Use better conditional probability for ngram entries."Keisuke Kuroyanagi2014-10-152-11/+26
|\|
| * Use better conditional probability for ngram entries.Keisuke Kuroyanagi2014-10-152-11/+26
| | | | | | | | | | | | | | | | | | | | | | | | Old: P(W | W_prev) = f(W, W_prev) + C New: P(W | W_prev) = f(W, W_prev) / f(W_prev) Bug: 14425059 Bug: 16547409 Change-Id: I4d13be6de2c6bad6bad7fb22320a23ba4ecd361c
generated by cgit v1.2.3-83-g751a (git 2.47.1) at 2025-05-04 22:50:51 +0000