aboutsummaryrefslogtreecommitdiffstats
path: root/native/jni/src/suggest/policyimpl/dictionary (follow)
Commit message (Expand)AuthorAgeFilesLines
* Move dictionary code to top level dictionary dir.•••Bug: 18725954 Change-Id: Ia442ba4b5d84311057d83edf6e7aeb151d6a820b Keisuke Kuroyanagi2014-12-17120-16802/+0
* Remove needless include.•••Bug: 18725954 Change-Id: I3c823fda1b7daf41d82b118d9495f5f2356a1a5e Keisuke Kuroyanagi2014-12-151-1/+0
* Add missing error check in TrieMap.•••Bug: 18725954 Change-Id: I8fcb0d15dda3f823a4575fe707bcdec57ff5e89b Keisuke Kuroyanagi2014-12-151-0/+6
* Enable Quadgram for personalized dicts.•••Before: Total words: 1134659, Success Num: 944709, Success Percentage: 83.259% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1258, Bad Failure Percentage: 0.111% Failures, with auto-correction (F-C): 28013, F-C Percentage: 2.469% Max Keystrokes: 6072844, Min Keystrokes: 3347332, Keystroke Saving Percentage:44.880% After: Total words: 1134665, Success Num: 945026, Success Percentage: 83.287% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1271, Bad Failure Percentage: 0.112% Failures, with auto-correction (F-C): 27756, F-C Percentage: 2.446% Max Keystrokes: 6072850, Min Keystrokes: 3290996, Keystroke Saving Percentage:45.808% Change-Id: I16af52a3e9c371b95fd6f0741f45ee6b2443bea6 Keisuke Kuroyanagi2014-11-254-8/+10
* Use enum to specify ngram type.•••Change-Id: Ie28768ceadcd7a2d940c57eb30be7d4c364e509f Keisuke Kuroyanagi2014-11-2513-251/+156
* Use reference instead of pointer for WordProperty().•••Change-Id: Idf03e97661d64186c752e35964d641a5528be5b1 Keisuke Kuroyanagi2014-11-103-3/+3
* Fix: BoS prediction after inputting just once.•••Change-Id: Ib69569ab6b6edfcc8c1d2c621b95de4127789ab6 Keisuke Kuroyanagi2014-11-011-2/+10
* Update v4 format version from 402 to 403.•••Without personalization: Total words: 1134774, Success Num: 899230, Success Percentage: 79.243% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1871, Bad Failure Percentage: 0.165% Failures, with auto-correction (F-C): 29084, F-C Percentage: 2.563% Max Keystrokes: 6072959, Min Keystrokes: 4436090, Keystroke Saving Percentage:26.953% Before: Total words: 1134646, Success Num: 925194, Success Percentage: 81.540% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1316, Bad Failure Percentage: 0.116% Failures, with auto-correction (F-C): 28288, F-C Percentage: 2.493% Max Keystrokes: 6072831, Min Keystrokes: 3946188, Keystroke Saving Percentage:35.019% After Total words: 1134659, Success Num: 944746, Success Percentage: 83.263% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1258, Bad Failure Percentage: 0.111% Failures, with auto-correction (F-C): 28016, F-C Percentage: 2.469% Max Keystrokes: 6072844, Min Keystrokes: 3387333, Keystroke Saving Percentage:44.222% Change-Id: I3af42ec37a11847c0429c28616e726f6a339247f Keisuke Kuroyanagi2014-10-316-21/+21
* Add hacks for better handling count value during migration.•••Bug: 14425059 Change-Id: Ib050574aa7c4babd4285322a11c3af9be9fbab1e Keisuke Kuroyanagi2014-10-312-1/+4
* Change v403 historical info format.•••count -> 2B, level -> 0B. Change-Id: I3b241126f56eb33cdf09cb1ebfed04f534e4ec48 Keisuke Kuroyanagi2014-10-313-3/+4
* Using "blacklist" flag as "possibly offensive"•••Bug: 11031090 Change-Id: I5cc0d006ab003656498eb82b0875eb9c051d331e Adrian Velicu2014-10-318-26/+26
* Enable count based dynamic ngram language model for v403.•••Bug: 14425059 Change-Id: Icc15e14cfd77d37cd75f75318fd0fa36f9ca7a5b Keisuke Kuroyanagi2014-10-304-89/+123
* Add DynamicLanguageModelProbabilityUtils.•••Bug: 14425059 Change-Id: Ia58ab3f0ead02798046d182a9464dcbd95f086bc Keisuke Kuroyanagi2014-10-302-0/+151
* Add method to encode probability.•••Bug: 14425059 Change-Id: I3e5d359ba5fa38f1669f0e98dfae792ff53efbf8 Keisuke Kuroyanagi2014-10-302-0/+38
* Fix: TRT and ime-simulator bulid.•••Change-Id: I1697a907562d1ed6aff2b001763d1594263ba0d3 Keisuke Kuroyanagi2014-10-301-0/+2
* Merge "Add a class to have global counters for LanguageModelDictContent."Keisuke Kuroyanagi2014-10-296-7/+147
|\
| * Add a class to have global counters for LanguageModelDictContent.•••Bug: 14425059 Change-Id: I08ec19903432356b6028853fd73b4eefce20218e Keisuke Kuroyanagi2014-10-296-7/+147
* | Fix: deleted PtNode handling in v403.•••If a word is once deleted, the word never gets into the personalized dictionaries due to this bug. Change-Id: Ife4e3fe1ba0615b4135e6291d2151b0db7d3f940 Keisuke Kuroyanagi2014-10-271-0/+3
|/
* Support dumping ngram entries.•••Bug: 14425059 Change-Id: Ib03a0c3d166ed6f1e60c67127b28006d55143b6b Keisuke Kuroyanagi2014-10-222-9/+7
* Support ngram entry migration.•••Bug: 14425059 Change-Id: I98cb9fa303af2d93a0a3512e8732231c564e3c5d Keisuke Kuroyanagi2014-10-224-41/+119
* Fix debug build.•••Change-Id: Id94636714d04a8828718b87741c0ee62a14cb3b4 Keisuke Kuroyanagi2014-10-212-4/+4
* Merge changes I210acb81,Ie9508788•••* changes: Make NgramProperty have NgramContext. Create .cpp file for NgramContext. Keisuke Kuroyanagi2014-10-216-18/+24
|\
| * Make NgramProperty have NgramContext.•••Bug: 14425059 Change-Id: I210acb816b122857dbbe1ee4dd6a35c5335bf2bf Keisuke Kuroyanagi2014-10-216-18/+24
* | Merge "Use EntryCounters during GC."Keisuke Kuroyanagi2014-10-215-65/+54
|\|
| * Use EntryCounters during GC.•••Bug: 14425059 Change-Id: I61eb798686dc753fb6c0fe99a0719c1732198f30 Keisuke Kuroyanagi2014-10-215-65/+54
* | Merge "Renaming "blacklist" flag to "possibly offensive""Adrian Velicu2014-10-2110-38/+54
|\ \ | |/ |/|
| * Renaming "blacklist" flag to "possibly offensive"•••No behaviour changes. Unified the overloaded FusionDictionary::add method to always take an isPossiblyOffensive argument. Bug: 11031090 Change-Id: I5741a023ca1ce842d2cf10d4f6c926b0efabaa78 Adrian Velicu2014-10-2110-38/+54
* | Introduce EntryCounters to count entries in a dictionary.•••Bug: 14425059 Change-Id: Ic13ba827d96fa4a147485ba92fdb37e23e04e8e8 Keisuke Kuroyanagi2014-10-2116-89/+230
|/
* Change entry count limit.•••Unigram 10K, Bigram 30K, Trigram 30K. Change-Id: Ibd19c6a2b618499df1c70000bad7b47498187f0a Keisuke Kuroyanagi2014-10-202-3/+7
* Update useless n-gram entry detection logic during GC.•••Bug: 14425059 Change-Id: Ib939deae5b60167751dee07965bb1ef1a43c4625 Keisuke Kuroyanagi2014-10-152-21/+32
* Use better conditional probability for ngram entries.•••Old: P(W | W_prev) = f(W, W_prev) + C New: P(W | W_prev) = f(W, W_prev) / f(W_prev) Bug: 14425059 Bug: 16547409 Change-Id: I4d13be6de2c6bad6bad7fb22320a23ba4ecd361c Keisuke Kuroyanagi2014-10-152-11/+26
* Move entry updating method to language model dict content.•••Bug: 14425059 Change-Id: I710055490d141539458cbf968adf5a7ccffd9552 Keisuke Kuroyanagi2014-10-157-72/+115
* Fix: BoS bigram from user history dictionary is too strong.•••They can be always stronger than BoS predictions from the contextual dictionary. Bug: 17961731 Change-Id: I70297d82436c10c790bdfad6f3dfefdb4bb2f852Keisuke Kuroyanagi2014-10-132-4/+10
* Merge "Rename prev_words_info.h to ngram_context.h"Keisuke Kuroyanagi2014-10-093-3/+3
|\
| * Rename prev_words_info.h to ngram_context.h•••Bug: 14425059 Change-Id: I0e906631ecad2361a8198b3f9e3394bb22c5bf83 Keisuke Kuroyanagi2014-10-093-3/+3
* | Merge "Rename PrevWordsInfo to NgramContext."Keisuke Kuroyanagi2014-10-095-39/+39
|\|
| * Rename PrevWordsInfo to NgramContext.•••Bug: 14425059 Change-Id: I30703fc80e9450d4e2dbfec965e7f9f4468f6a11 Keisuke Kuroyanagi2014-10-095-39/+39
* | Fixing misspelled word•••Change-Id: I51d77e271143d40256b39e5c60a3065d9fdf63fb Adrian Velicu2014-10-094-5/+5
|/
* Rename updateCounter to updateEntriesForWordWithNgramContext.•••Bug: 14425059 Change-Id: Id9b0dd7e32c711ed4292981517c3febd5fe9e897 Keisuke Kuroyanagi2014-10-095-17/+20
* Merge "Improve bigram probability computation for decaying dicts."Keisuke Kuroyanagi2014-10-066-98/+83
|\
| * Improve bigram probability computation for decaying dicts.•••Without personalization: Total words: 1079345, Success Num: 819749, Success Percentage: 75.949% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1754, Bad Failure Percentage: 0.163% Failures, with auto-correction (F-C): 28463, F-C Percentage: 2.637% Max Keystrokes: 6074285, Min Keystrokes: 4649326, Keystroke Saving Percentage:23.459% With current probability computing logic: Total words: 1079382, Success Num: 838329, Success Percentage: 77.667% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1332, Bad Failure Percentage: 0.123% Failures, with auto-correction (F-C): 28558, F-C Percentage: 2.646% Max Keystrokes: 6074503, Min Keystrokes: 4474102, Keystroke Saving Percentage:26.346% Remove isof files. With new probability computing logic: Total words: 1079356, Success Num: 844954, Success Percentage: 78.283% Bad Failures, with auto-correction (typed word == expected word, output word != expected word): 1306, Bad Failure Percentage: 0.121% Failures, with auto-correction (F-C): 27214, F-C Percentage: 2.521% Max Keystrokes: 6074477, Min Keystrokes: 4243021, Keystroke Saving Percentage:30.150% Remove isof files. Bug: 16547409 Change-Id: I3d2a49c7aaa2c0f6835c52ef72d22466ee225789 Keisuke Kuroyanagi2014-10-066-98/+83
* | Make sure to suppress BoS prediction until input twice.•••Change-Id: I98d91f264d5d1d3f5bcda1fd9ec885779ba2f746 Keisuke Kuroyanagi2014-10-061-1/+4
* | Fix: BoS prediction is shown after inputting just once.•••Change-Id: Ibba209f47cb5b1a4b08281689d607711b8dcfad4 Keisuke Kuroyanagi2014-10-061-1/+4
|/
* Fix: ProbabilityDictContent can be wrongly large.•••It can be twice as large as it should be (80KB larger). Change-Id: If94f748f8c48a442b3c95ac989099aaed2aa2f86 Keisuke Kuroyanagi2014-10-061-3/+1
* Implement updateCounter() by using existing entry adding methods.•••Bug: 14425059 Change-Id: I0b6cb80e1fb8f738e9c7d9e80fbc0c479546b879 Keisuke Kuroyanagi2014-10-016-9/+75
* Move HistoricalInfo to property and use it in *Property.•••Bug: 14425059 Change-Id: Icccccabad98fb543c6a6be2844cfc0086d80b739 Keisuke Kuroyanagi2014-10-0115-95/+29
* Rename BigramProperty to NgramProperty.•••Remaining work is changing bigram to ngram for supporting ngram entry counting, dumping, and migration. Bug: 14425059 Change-Id: Ifba288a1166996d62a5e57698f63537ea0a2a8ee Keisuke Kuroyanagi2014-09-2919-69/+63
* Quit reading unigram probability in Ver4PatriciaTrieNodeReader.•••Bug: 14425059 Change-Id: I4fc7b0e236151a2c64e7131772264024c6597633 Keisuke Kuroyanagi2014-09-256-38/+20
* Use std::move for dictionary properties.•••Change-Id: I15056b36b7493f4bac1dbcbb46a0b44343ede153 Keisuke Kuroyanagi2014-09-253-22/+20
* Use CodePointArrayView in WordProperty.•••Change-Id: I45a9755c413003831788d190beb499fee8ce63aa Keisuke Kuroyanagi2014-09-243-9/+3