| Commit message (Expand) | Author | Age | Files | Lines |
* | Use enum to specify ngram type.•••Change-Id: Ie28768ceadcd7a2d940c57eb30be7d4c364e509f
|  Keisuke Kuroyanagi | 2014-11-25 | 14 | -251/+218 |
* | Fix the base character of D with stroke•••Bug: 18436480
Change-Id: Ic92cae7c85c07c8f62a5b6e69d2b71e204aff50d
|  Jean Chalard | 2014-11-19 | 1 | -1/+6 |
* | Implement IntArrayView::split for dicttoolkit.•••Bug: 10059681
Change-Id: Ic29e79d049bb532727cf5cb1e529fec5d35156ed
|  Keisuke Kuroyanagi | 2014-11-11 | 1 | -0/+23 |
* | Merge "Use reference instead of pointer for WordProperty()." |  Keisuke Kuroyanagi | 2014-11-10 | 4 | -11/+16 |
|\ |
|
| * | Use reference instead of pointer for WordProperty().•••Change-Id: Idf03e97661d64186c752e35964d641a5528be5b1
|  Keisuke Kuroyanagi | 2014-11-10 | 4 | -11/+16 |
* | | Make profiler use getTimeInMicroSec().•••Bug: 17797064
Change-Id: Ie992c9454edfc3bf93d5ea367c3a4427b513a205
|  Keisuke Kuroyanagi | 2014-11-11 | 3 | -73/+96 |
|/ |
|
* | Fix: BoS prediction after inputting just once.•••Change-Id: Ib69569ab6b6edfcc8c1d2c621b95de4127789ab6
|  Keisuke Kuroyanagi | 2014-11-01 | 1 | -2/+10 |
* | Merge "Update v4 format version from 402 to 403." |  Keisuke Kuroyanagi | 2014-10-31 | 6 | -21/+21 |
|\ |
|
| * | Update v4 format version from 402 to 403.•••Without personalization:
Total words: 1134774, Success Num: 899230, Success Percentage: 79.243%
Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1871, Bad Failure Percentage: 0.165%
Failures, with auto-correction (F-C): 29084, F-C Percentage: 2.563%
Max Keystrokes: 6072959, Min Keystrokes: 4436090, Keystroke Saving Percentage:26.953%
Before:
Total words: 1134646, Success Num: 925194, Success Percentage: 81.540%
Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1316, Bad Failure Percentage: 0.116%
Failures, with auto-correction (F-C): 28288, F-C Percentage: 2.493%
Max Keystrokes: 6072831, Min Keystrokes: 3946188, Keystroke Saving Percentage:35.019%
After
Total words: 1134659, Success Num: 944746, Success Percentage: 83.263%
Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1258, Bad Failure Percentage: 0.111%
Failures, with auto-correction (F-C): 28016, F-C Percentage: 2.469%
Max Keystrokes: 6072844, Min Keystrokes: 3387333, Keystroke Saving Percentage:44.222%
Change-Id: I3af42ec37a11847c0429c28616e726f6a339247f
|  Keisuke Kuroyanagi | 2014-10-31 | 6 | -21/+21 |
* | | Merge "Add hacks for better handling count value during migration." |  Keisuke Kuroyanagi | 2014-10-31 | 2 | -1/+4 |
|\| |
|
| * | Add hacks for better handling count value during migration.•••Bug: 14425059
Change-Id: Ib050574aa7c4babd4285322a11c3af9be9fbab1e
|  Keisuke Kuroyanagi | 2014-10-31 | 2 | -1/+4 |
* | | Merge "Change v403 historical info format." |  Keisuke Kuroyanagi | 2014-10-31 | 4 | -3/+5 |
|\| |
|
| * | Change v403 historical info format.•••count -> 2B, level -> 0B.
Change-Id: I3b241126f56eb33cdf09cb1ebfed04f534e4ec48
|  Keisuke Kuroyanagi | 2014-10-31 | 4 | -3/+5 |
* | | Further fixes to treat 0-frequency words•••Previously, when both legitimate 0-frequency words (such as
distracters) and offensive words were encoded in the same
way, distracters would never show up when the user blocked
offensive words (the default setting, as well as the setting
for regression tests).
When b/11031090 was fixed and a separate encoding was used
for offensive words, 0-frequency words would no longer be
blocked when they were an "exact match" (where case
mismatches and accent mismatches would be considered an
"exact match"). The exact match boosting functionality meant
that, for example, when the user typed "mt" they would be
suggested the word "Mt", although they most probably meant
to type "my".
For this reason, we introduced this change, which does the
following:
* Defines the "perfect match" as a really exact match, with
no room for case or accent mismatches
* When the target word has probability zero (as "Mt" does,
because it is a distracter), ONLY boost its score if it is a
perfect match.
By doing this, when the user types "mt", the word "Mt" will
NOT be boosted, and they will get "my". However, if the user
makes an explicit effort to type "Mt", we do boost the word
"Mt" so that the user's input is not autocorrected to "My".
Bug: 11031090
Change-Id: I92ee1b4e742645d52e2f7f8c4390920481e8fff0
|  Adrian Velicu | 2014-10-31 | 7 | -12/+47 |
|/ |
|
* | Block offensive words in multi-word suggestions•••If the user has chosen to block offensive words and types
"aaaxbb", where "aaa" is an offensive word and "bb" is not,
we should not suggest "aaa bb".
Bug: 11031090
Change-Id: Ie23b8dd5d347bc26b1c046c3f5e8dfbc259bf528
|  Adrian Velicu | 2014-10-31 | 3 | -13/+65 |
* | Using "blacklist" flag as "possibly offensive"•••Bug: 11031090
Change-Id: I5cc0d006ab003656498eb82b0875eb9c051d331e
|  Adrian Velicu | 2014-10-31 | 8 | -26/+26 |
* | Enable count based dynamic ngram language model for v403.•••Bug: 14425059
Change-Id: Icc15e14cfd77d37cd75f75318fd0fa36f9ca7a5b
|  Keisuke Kuroyanagi | 2014-10-30 | 6 | -89/+128 |
* | Add DynamicLanguageModelProbabilityUtils.•••Bug: 14425059
Change-Id: Ia58ab3f0ead02798046d182a9464dcbd95f086bc
|  Keisuke Kuroyanagi | 2014-10-30 | 2 | -0/+151 |
* | Add method to encode probability.•••Bug: 14425059
Change-Id: I3e5d359ba5fa38f1669f0e98dfae792ff53efbf8
|  Keisuke Kuroyanagi | 2014-10-30 | 2 | -0/+38 |
* | Fix: TRT and ime-simulator bulid.•••Change-Id: I1697a907562d1ed6aff2b001763d1594263ba0d3
|  Keisuke Kuroyanagi | 2014-10-30 | 1 | -0/+2 |
* | Merge "Add a class to have global counters for LanguageModelDictContent." |  Keisuke Kuroyanagi | 2014-10-29 | 6 | -7/+147 |
|\ |
|
| * | Add a class to have global counters for LanguageModelDictContent.•••Bug: 14425059
Change-Id: I08ec19903432356b6028853fd73b4eefce20218e
|  Keisuke Kuroyanagi | 2014-10-29 | 6 | -7/+147 |
* | | Merge "Improve space substitution error correction." |  Keisuke Kuroyanagi | 2014-10-28 | 6 | -11/+14 |
|\ \ |
|
| * | | Improve space substitution error correction.•••Bug: 17432052
[Category diff]
+1 262
-1 93
+2 2
-2 18
+3 18
-3 2
+4 111
-4 148
+5 295
-5 217
+6 51
-6 276
+7 139
-7 124
[Weighted category diff]
+1 276
-1 100
+2 4
-2 20
+3 20
-3 4
+4 118
-4 160
+5 309
-5 225
+6 52
-6 298
+7 163
-7 135
show diff for ./en_user_log_phones_2011_08.csv
+1 173
-1 28
+2 2
-2 17
+3 17
-3 2
+4 63
-4 82
+5 120
-5 51
+6 24
-6 220
+7 88
-7 87
Change-Id: I9d673acb0ff632828ae2e0ead56e76e3a20411c6
|  Keisuke Kuroyanagi | 2014-10-28 | 6 | -11/+14 |
| |/ |
|
* / | Fix: deleted PtNode handling in v403.•••If a word is once deleted, the word never gets into the
personalized dictionaries due to this bug.
Change-Id: Ife4e3fe1ba0615b4135e6291d2151b0db7d3f940
|  Keisuke Kuroyanagi | 2014-10-27 | 1 | -0/+3 |
|/ |
|
* | Fix: Personalized dicts suggest invalid words with v403.•••Bug: 14425059
Change-Id: I45ae00069dd3b7c461dd9a1f3558b96af0a1c975
|  Keisuke Kuroyanagi | 2014-10-23 | 1 | -2/+3 |
* | Use trigrams for personalization dict.•••5Bug: 14425059
Change-Id: I73cf6904e569d60996a3b079f16ea6df0cb90f02
|  Keisuke Kuroyanagi | 2014-10-23 | 1 | -0/+3 |
* | Support dumping ngram entries.•••Bug: 14425059
Change-Id: Ib03a0c3d166ed6f1e60c67127b28006d55143b6b
|  Keisuke Kuroyanagi | 2014-10-22 | 4 | -23/+47 |
* | Support ngram entry migration.•••Bug: 14425059
Change-Id: I98cb9fa303af2d93a0a3512e8732231c564e3c5d
|  Keisuke Kuroyanagi | 2014-10-22 | 5 | -41/+130 |
* | Fix debug build.•••Change-Id: Id94636714d04a8828718b87741c0ee62a14cb3b4
|  Keisuke Kuroyanagi | 2014-10-21 | 2 | -4/+4 |
* | Merge changes I210acb81,Ie9508788•••* changes:
Make NgramProperty have NgramContext.
Create .cpp file for NgramContext.
|  Keisuke Kuroyanagi | 2014-10-21 | 13 | -139/+178 |
|\ |
|
| * | Make NgramProperty have NgramContext.•••Bug: 14425059
Change-Id: I210acb816b122857dbbe1ee4dd6a35c5335bf2bf
|  Keisuke Kuroyanagi | 2014-10-21 | 11 | -33/+40 |
| * | Create .cpp file for NgramContext.•••Bug: 14425059
Change-Id: Ie950878817b9c80cc9c970e1a84880c9b9ab228a
|  Keisuke Kuroyanagi | 2014-10-21 | 2 | -106/+138 |
* | | Merge "Use EntryCounters during GC." |  Keisuke Kuroyanagi | 2014-10-21 | 5 | -65/+54 |
|\| |
|
| * | Use EntryCounters during GC.•••Bug: 14425059
Change-Id: I61eb798686dc753fb6c0fe99a0719c1732198f30
|  Keisuke Kuroyanagi | 2014-10-21 | 5 | -65/+54 |
* | | Merge "Renaming "blacklist" flag to "possibly offensive"" |  Adrian Velicu | 2014-10-21 | 13 | -52/+99 |
|\ \
| |/
|/| |
|
| * | Renaming "blacklist" flag to "possibly offensive"•••No behaviour changes.
Unified the overloaded FusionDictionary::add method to always take an
isPossiblyOffensive argument.
Bug: 11031090
Change-Id: I5741a023ca1ce842d2cf10d4f6c926b0efabaa78
|  Adrian Velicu | 2014-10-21 | 13 | -52/+99 |
* | | Introduce EntryCounters to count entries in a dictionary.•••Bug: 14425059
Change-Id: Ic13ba827d96fa4a147485ba92fdb37e23e04e8e8
|  Keisuke Kuroyanagi | 2014-10-21 | 16 | -89/+230 |
|/ |
|
* | Change entry count limit.•••Unigram 10K, Bigram 30K, Trigram 30K.
Change-Id: Ibd19c6a2b618499df1c70000bad7b47498187f0a
|  Keisuke Kuroyanagi | 2014-10-20 | 2 | -3/+7 |
* | Merge "Update useless n-gram entry detection logic during GC." |  Keisuke Kuroyanagi | 2014-10-15 | 2 | -21/+32 |
|\ |
|
| * | Update useless n-gram entry detection logic during GC.•••Bug: 14425059
Change-Id: Ib939deae5b60167751dee07965bb1ef1a43c4625
|  Keisuke Kuroyanagi | 2014-10-15 | 2 | -21/+32 |
* | | Merge "Use better conditional probability for ngram entries." |  Keisuke Kuroyanagi | 2014-10-15 | 2 | -11/+26 |
|\| |
|
| * | Use better conditional probability for ngram entries.•••Old:
P(W | W_prev) = f(W, W_prev) + C
New:
P(W | W_prev) = f(W, W_prev) / f(W_prev)
Bug: 14425059
Bug: 16547409
Change-Id: I4d13be6de2c6bad6bad7fb22320a23ba4ecd361c
|  Keisuke Kuroyanagi | 2014-10-15 | 2 | -11/+26 |
* | | Merge "Move entry updating method to language model dict content." |  Keisuke Kuroyanagi | 2014-10-15 | 7 | -72/+115 |
|\| |
|
| * | Move entry updating method to language model dict content.•••Bug: 14425059
Change-Id: I710055490d141539458cbf968adf5a7ccffd9552
|  Keisuke Kuroyanagi | 2014-10-15 | 7 | -72/+115 |
* | | Quit using weightChildNode for ADDITIONAL_PROXIMITY and SUBSTITUTION.•••[Category diff]
+1 0
-1 1
+2 0
-2 0
+3 0
-3 0
+4 1
-4 1
+5 8
-5 7
+6 0
-6 1
+7 1
-7 0
[Weighted category diff]
+1 0
-1 1
+2 0
-2 0
+3 0
-3 0
+4 1
-4 1
+5 8
-5 7
+6 0
-6 1
+7 1
-7 0
Bug: 13756409
Change-Id: I6ac3567545676bbefbee3e87dda54bc083c15fb6
|  Keisuke Kuroyanagi | 2014-10-14 | 4 | -9/+14 |
|/ |
|
* | Fix: BoS bigram from user history dictionary is too strong.•••They can be always stronger than BoS predictions from the
contextual dictionary.
Bug: 17961731
Change-Id: I70297d82436c10c790bdfad6f3dfefdb4bb2f852 |  Keisuke Kuroyanagi | 2014-10-13 | 2 | -4/+10 |
* | [ML23] Introduce a different accuracy/performance tradeoff•••Bug: 11230254
Change-Id: Ic09518c818ae7b68942b1c63160dd462e5922cb5
|  Jean Chalard | 2014-10-10 | 6 | -6/+43 |
* | Merge "Make members of classes that are used with std::vector const" |  Keisuke Kuroyanagi | 2014-10-10 | 3 | -21/+19 |
|\ |
|
| * | Make members of classes that are used with std::vector const•••Change-Id: Id93fb87f5630230fc3f9cd339e12f3b0e2006ea9
|  Keisuke Kuroyanagi | 2014-10-09 | 3 | -21/+19 |