aboutsummaryrefslogtreecommitdiffstats
path: root/native (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Merge "Improve space substitution error correction."Keisuke Kuroyanagi2014-10-286-11/+14
|\
| * Improve space substitution error correction.Keisuke Kuroyanagi2014-10-286-11/+14
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Bug: 17432052 [Category diff] +1 262 -1 93 +2 2 -2 18 +3 18 -3 2 +4 111 -4 148 +5 295 -5 217 +6 51 -6 276 +7 139 -7 124 [Weighted category diff] +1 276 -1 100 +2 4 -2 20 +3 20 -3 4 +4 118 -4 160 +5 309 -5 225 +6 52 -6 298 +7 163 -7 135 show diff for ./en_user_log_phones_2011_08.csv +1 173 -1 28 +2 2 -2 17 +3 17 -3 2 +4 63 -4 82 +5 120 -5 51 +6 24 -6 220 +7 88 -7 87 Change-Id: I9d673acb0ff632828ae2e0ead56e76e3a20411c6
* | Fix: deleted PtNode handling in v403.Keisuke Kuroyanagi2014-10-271-0/+3
|/ | | | | | | If a word is once deleted, the word never gets into the personalized dictionaries due to this bug. Change-Id: Ife4e3fe1ba0615b4135e6291d2151b0db7d3f940
* Merge "Enable Address Sanitizer for native host test 2nd try"Yohei Yukawa2014-10-231-0/+4
|\
| * Enable Address Sanitizer for native host test 2nd tryYohei Yukawa2014-10-231-0/+4
| | | | | | | | | | | | | | | | This CL enables Address Sanitizer for native host test. Note that production build is not affected with this change. ASan is enabled only in static lib for test executables. Change-Id: I2c8e99b8c55e611e86f74579f24a63ac949bb02d
* | Merge "Fix: Personalized dicts suggest invalid words with v403."Keisuke Kuroyanagi2014-10-231-2/+3
|\ \ | |/ |/|
| * Fix: Personalized dicts suggest invalid words with v403.Keisuke Kuroyanagi2014-10-231-2/+3
| | | | | | | | | | Bug: 14425059 Change-Id: I45ae00069dd3b7c461dd9a1f3558b96af0a1c975
* | Merge "Stop building host native test in unbundled build"Yohei Yukawa2014-10-232-1/+14
|\ \ | |/ |/|
| * Stop building host native test in unbundled buildYohei Yukawa2014-10-232-1/+14
| | | | | | | | | | | | | | | | | | | | It turned out that building native code for host environment is not supported in NDK build. Hence this CL makes the host native test available only as a part of platform build to avoid accidental build breakage in unbundled build. BUG: 18095678 Change-Id: If608da166d5a478358e6890b8db526b4c2c0ab41
* | Use trigrams for personalization dict.Keisuke Kuroyanagi2014-10-232-84/+49
|/ | | | | 5Bug: 14425059 Change-Id: I73cf6904e569d60996a3b079f16ea6df0cb90f02
* Merge "Revert "Enable ASan (Address Sanitizer) for native host test""Yohei Yukawa2014-10-221-4/+0
|\
| * Revert "Enable ASan (Address Sanitizer) for native host test"Yohei Yukawa2014-10-221-4/+0
| | | | | | | | | | | | | | This reverts commit af2673f17d89c0ea8d61266ce92e55a77218b494 because of build failure in tapas build. Change-Id: Ib02931116181c98b35ce938e42d2376225e9b255
* | Merge "Enable ASan (Address Sanitizer) for native host test"Yohei Yukawa2014-10-221-0/+4
|\|
| * Enable ASan (Address Sanitizer) for native host testYohei Yukawa2014-10-221-0/+4
| | | | | | | | | | | | | | | | This CL enables Address Sanitizer for native host test. Note that production build is not affected with this change. ASan is enabled only in static lib for test executables. Change-Id: Idbe1f2e4502dfce9b6fb0253d7ebda8d37fbf84e
* | Support dumping ngram entries.Keisuke Kuroyanagi2014-10-225-25/+50
|/ | | | | Bug: 14425059 Change-Id: Ib03a0c3d166ed6f1e60c67127b28006d55143b6b
* Support ngram entry migration.Keisuke Kuroyanagi2014-10-226-43/+131
| | | | | Bug: 14425059 Change-Id: I98cb9fa303af2d93a0a3512e8732231c564e3c5d
* Fix debug build.Keisuke Kuroyanagi2014-10-212-4/+4
| | | | Change-Id: Id94636714d04a8828718b87741c0ee62a14cb3b4
* Merge changes I210acb81,Ie9508788Keisuke Kuroyanagi2014-10-2115-150/+188
|\ | | | | | | | | | | * changes: Make NgramProperty have NgramContext. Create .cpp file for NgramContext.
| * Make NgramProperty have NgramContext.Keisuke Kuroyanagi2014-10-2112-43/+48
| | | | | | | | | | Bug: 14425059 Change-Id: I210acb816b122857dbbe1ee4dd6a35c5335bf2bf
| * Create .cpp file for NgramContext.Keisuke Kuroyanagi2014-10-213-107/+140
| | | | | | | | | | | | Bug: 14425059 Change-Id: Ie950878817b9c80cc9c970e1a84880c9b9ab228a
* | Merge "Use EntryCounters during GC."Keisuke Kuroyanagi2014-10-215-65/+54
|\|
| * Use EntryCounters during GC.Keisuke Kuroyanagi2014-10-215-65/+54
| | | | | | | | | | Bug: 14425059 Change-Id: I61eb798686dc753fb6c0fe99a0719c1732198f30
* | Merge "Renaming "blacklist" flag to "possibly offensive""Adrian Velicu2014-10-2114-59/+107
|\ \ | |/ |/|
| * Renaming "blacklist" flag to "possibly offensive"Adrian Velicu2014-10-2114-59/+107
| | | | | | | | | | | | | | | | | | No behaviour changes. Unified the overloaded FusionDictionary::add method to always take an isPossiblyOffensive argument. Bug: 11031090 Change-Id: I5741a023ca1ce842d2cf10d4f6c926b0efabaa78
* | Introduce EntryCounters to count entries in a dictionary.Keisuke Kuroyanagi2014-10-2116-89/+230
|/ | | | | | Bug: 14425059 Change-Id: Ic13ba827d96fa4a147485ba92fdb37e23e04e8e8
* Change entry count limit.Keisuke Kuroyanagi2014-10-202-3/+7
| | | | | | Unigram 10K, Bigram 30K, Trigram 30K. Change-Id: Ibd19c6a2b618499df1c70000bad7b47498187f0a
* Merge "Update useless n-gram entry detection logic during GC."Keisuke Kuroyanagi2014-10-152-21/+32
|\
| * Update useless n-gram entry detection logic during GC.Keisuke Kuroyanagi2014-10-152-21/+32
| | | | | | | | | | Bug: 14425059 Change-Id: Ib939deae5b60167751dee07965bb1ef1a43c4625
* | Merge "Use better conditional probability for ngram entries."Keisuke Kuroyanagi2014-10-152-11/+26
|\|
| * Use better conditional probability for ngram entries.Keisuke Kuroyanagi2014-10-152-11/+26
| | | | | | | | | | | | | | | | | | | | | | | | Old: P(W | W_prev) = f(W, W_prev) + C New: P(W | W_prev) = f(W, W_prev) / f(W_prev) Bug: 14425059 Bug: 16547409 Change-Id: I4d13be6de2c6bad6bad7fb22320a23ba4ecd361c
* | Merge "Move entry updating method to language model dict content."Keisuke Kuroyanagi2014-10-157-72/+115
|\|
| * Move entry updating method to language model dict content.Keisuke Kuroyanagi2014-10-157-72/+115
| | | | | | | | | | Bug: 14425059 Change-Id: I710055490d141539458cbf968adf5a7ccffd9552
* | Quit using weightChildNode for ADDITIONAL_PROXIMITY and SUBSTITUTION.Keisuke Kuroyanagi2014-10-144-9/+14
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | [Category diff] +1 0 -1 1 +2 0 -2 0 +3 0 -3 0 +4 1 -4 1 +5 8 -5 7 +6 0 -6 1 +7 1 -7 0 [Weighted category diff] +1 0 -1 1 +2 0 -2 0 +3 0 -3 0 +4 1 -4 1 +5 8 -5 7 +6 0 -6 1 +7 1 -7 0 Bug: 13756409 Change-Id: I6ac3567545676bbefbee3e87dda54bc083c15fb6
* | Merge "Remove shouldBlockAutoCorrectionBySafetyNet"Keisuke Kuroyanagi2014-10-141-17/+0
|\ \ | |/ |/|
| * Remove shouldBlockAutoCorrectionBySafetyNetKeisuke Kuroyanagi2014-10-141-17/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Bug: 13756409 [Category diff] +1 27 -1 0 +2 0 -2 0 +3 0 -3 1 +4 11 -4 0 +5 51 -5 0 +6 0 -6 38 +7 0 -7 50 [Weighted category diff] +1 28 -1 0 +2 0 -2 0 +3 0 -3 1 +4 11 -4 0 +5 51 -5 0 +6 0 -6 39 +7 0 -7 50 show diff for ./en_user_log_phones_2011_08.csv +1 4 +4 5 +5 7 -6 9 -7 7 The increase of false positives comes from the spaceless typing test cases that are synthetic data. Change-Id: I4ea77aa56ebfaa5518c71107169e1d2332de6327
* | Fix: BoS bigram from user history dictionary is too strong.Keisuke Kuroyanagi2014-10-132-4/+10
| | | | | | | | | | | | | | They can be always stronger than BoS predictions from the contextual dictionary. Bug: 17961731 Change-Id: I70297d82436c10c790bdfad6f3dfefdb4bb2f852
* | [ML23] Introduce a different accuracy/performance tradeoffJean Chalard2014-10-106-6/+43
| | | | | | | | | | Bug: 11230254 Change-Id: Ic09518c818ae7b68942b1c63160dd462e5922cb5
* | Merge "Make members of classes that are used with std::vector const"Keisuke Kuroyanagi2014-10-103-21/+19
|\ \
| * | Make members of classes that are used with std::vector constKeisuke Kuroyanagi2014-10-093-21/+19
| | | | | | | | | | | | Change-Id: Id93fb87f5630230fc3f9cd339e12f3b0e2006ea9
* | | Merge "Rename prev_words_info.h to ngram_context.h"Keisuke Kuroyanagi2014-10-0910-9/+9
|\| |
| * | Rename prev_words_info.h to ngram_context.hKeisuke Kuroyanagi2014-10-0910-9/+9
| | | | | | | | | | | | | | | Bug: 14425059 Change-Id: I0e906631ecad2361a8198b3f9e3394bb22c5bf83
* | | Merge "Rename PrevWordsInfo to NgramContext."Keisuke Kuroyanagi2014-10-0915-114/+114
|\| |
| * | Rename PrevWordsInfo to NgramContext.Keisuke Kuroyanagi2014-10-0915-114/+114
| | | | | | | | | | | | | | | Bug: 14425059 Change-Id: I30703fc80e9450d4e2dbfec965e7f9f4468f6a11
* | | Fixing misspelled wordAdrian Velicu2014-10-094-5/+5
|/ / | | | | | | Change-Id: I51d77e271143d40256b39e5c60a3065d9fdf63fb
* | Rename updateCounter to updateEntriesForWordWithNgramContext.Keisuke Kuroyanagi2014-10-0910-28/+33
| | | | | | | | | | Bug: 14425059 Change-Id: Id9b0dd7e32c711ed4292981517c3febd5fe9e897
* | Extend jni method to dump ngram entries.Keisuke Kuroyanagi2014-10-091-4/+6
|/ | | | | Bug: 14425059 Change-Id: Ib03b58525fae12f254b45630bee31ecbdde227b1
* Merge "Improve bigram probability computation for decaying dicts."Keisuke Kuroyanagi2014-10-066-98/+83
|\
| * Improve bigram probability computation for decaying dicts.Keisuke Kuroyanagi2014-10-066-98/+83
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Without personalization: Total words: 1079345, Success Num: 819749, Success Percentage: 75.949% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1754, Bad Failure Percentage: 0.163% Failures, with auto-correction (F-C): 28463, F-C Percentage: 2.637% Max Keystrokes: 6074285, Min Keystrokes: 4649326, Keystroke Saving Percentage:23.459% With current probability computing logic: Total words: 1079382, Success Num: 838329, Success Percentage: 77.667% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1332, Bad Failure Percentage: 0.123% Failures, with auto-correction (F-C): 28558, F-C Percentage: 2.646% Max Keystrokes: 6074503, Min Keystrokes: 4474102, Keystroke Saving Percentage:26.346% Remove isof files. With new probability computing logic: Total words: 1079356, Success Num: 844954, Success Percentage: 78.283% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1306, Bad Failure Percentage: 0.121% Failures, with auto-correction (F-C): 27214, F-C Percentage: 2.521% Max Keystrokes: 6074477, Min Keystrokes: 4243021, Keystroke Saving Percentage:30.150% Remove isof files. Bug: 16547409 Change-Id: I3d2a49c7aaa2c0f6835c52ef72d22466ee225789
* | Merge "Make sure to suppress BoS prediction until input twice."Keisuke Kuroyanagi2014-10-061-1/+4
|\ \
| * | Make sure to suppress BoS prediction until input twice.Keisuke Kuroyanagi2014-10-061-1/+4
| | | | | | | | | | | | Change-Id: I98d91f264d5d1d3f5bcda1fd9ec885779ba2f746