| Commit message (Collapse) | Author | Age | Files | Lines |
|---|
| |
|
|
|
|
|
|
|
|
|
|
|
| |
Correctly encoding possibly offensive words with their correct
frequency and the possibly_offensive flag set.
Continuing to encode with zero frequency only distracters or
words that should never come up.
https://paste.googleplex.com/5167060875214848
Bug: 11031090
Change-Id: Ia394b1827f292ff8d4791cc2f3e6e50b5aff4cbe
|
| |
|
|
|
| |
Bug: 13164302
Change-Id: I8dc1a839c7dcfaa08a53e26cb6600e9f871447ce
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This change has no effect on TRT results.
>>> dictionaries/en_US_wordlist.combined.gz
Header :
date : 1381226409 <=> 1389654051
version : 42 <=> 43
Body :
Added: dialogue 120
Added: dialogues 94
>>> dictionaries/fr_wordlist.combined.gz
Header :
date : 1381226409 <=> 1389654052
version : 42 <=> 43
Body :
Deleted: d'Orange 114
Added: d'orange 114
>>> dictionaries/it_wordlist.combined.gz
Header :
date : 1380519383 <=> 1389654052
version : 40 <=> 43
Body :
Freq changed: ciao 85 -> 180
>>> java/res/raw/main_fr.dict
Header :
date : 1381226409 <=> 1389654052
version : 42 <=> 43
Body :
Deleted: d'Orange 114
Added: d'orange 114
>>> java/res/raw/main_it.dict
Header :
date : 1380519383 <=> 1389654052
version : 40 <=> 43
Body :
Freq changed: ciao 85 -> 180
Bug: 12487270
Bug: 12344108
Change-Id: I94768e223d05ad2551a5508e9e01222a028665c4
|
| |
|
|
|
|
|
|
|
|
|
|
| |
Add KitKat to all dictionaries.
Version
da, fi, pl : 29 → 40
cs, de, hr, it, lt, lv, nb, nl, sl, sr, sv, tr : 35 → 40
es : 36 → 40
en_gb, en_us, en, fr, pt_br, pt_pt : 39 → 40
Bug: 10958192
Change-Id: I14436616285ced5eb3b70b8c44b9243da94eed4f
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
>>> dictionaries/cs_wordlist.combined.gz
Header :
date : 1355802831 <=> 1372393817
version : 29 <=> 35
Body :
Added: LTE 25
>>> dictionaries/de_wordlist.combined.gz
Header :
date : 1355802835 <=> 1372393817
version : 29 <=> 35
Body :
Added: LTE 25
>>> dictionaries/en_GB_wordlist.combined.gz
Header :
date : 1366272052 <=> 1372393817
version : 31 <=> 35
Body :
Deleted: Sea 126
Added: LTE 25
>>> dictionaries/en_US_wordlist.combined.gz
Header :
date : 1366272093 <=> 1372393817
version : 31 <=> 35
Body :
Added: LTE 25
>>> dictionaries/en_wordlist.combined.gz
Header :
date : 1366272977 <=> 1372393837
version : 31 <=> 35
Body :
Deleted: Sea 126
Added: LTE 25
>>> dictionaries/es_wordlist.combined.gz
Header :
date : 1355802832 <=> 1372393817
version : 29 <=> 35
Body :
Added: LTE 25
>>> dictionaries/fr_wordlist.combined.gz
Header :
date : 1366272255 <=> 1372393818
version : 31 <=> 35
Body :
Deleted: R'n'B 95
Deleted: count 60
Deleted: d'Inti 34
Added: beurk 25
>>> dictionaries/hr_wordlist.combined.gz
Header :
date : 1355802836 <=> 1372393818
version : 29 <=> 35
Body :
Added: LTE 25
>>> dictionaries/it_wordlist.combined.gz
Header :
date : 1355802836 <=> 1372393818
version : 29 <=> 35
Body :
Added: LTE 25
>>> dictionaries/lt_wordlist.combined.gz
Header :
date : 1355802843 <=> 1372393818
version : 29 <=> 35
Body :
Added: LTE 25
>>> dictionaries/lv_wordlist.combined.gz
Header :
date : 1355802843 <=> 1372393818
version : 29 <=> 35
Body :
Added: LTE 25
>>> dictionaries/nb_wordlist.combined.gz
Header :
date : 1366003450 <=> 1372393818
version : 31 <=> 35
Body :
Added: LTE 25
>>> dictionaries/nl_wordlist.combined.gz
Header :
date : 1355802844 <=> 1372393818
version : 29 <=> 35
Body :
Added: LTE 25
>>> dictionaries/ru_wordlist.combined.gz
Header :
date : 1370244430 <=> 1372393835
version : 34 <=> 35
Body :
Freq changed: связывание 93 -> 0
>>> dictionaries/sl_wordlist.combined.gz
Header :
date : 1355802835 <=> 1372393835
version : 29 <=> 35
Body :
Added: LTE 25
>>> dictionaries/sr_wordlist.combined.gz
Header :
date : 1355802853 <=> 1372393835
version : 29 <=> 35
Body :
Added: LTE 25
>>> dictionaries/sv_wordlist.combined.gz
Header :
date : 1366003804 <=> 1372393836
version : 31 <=> 35
Body :
Added: LTE 25
>>> dictionaries/tr_wordlist.combined.gz
Header :
date : 1355802858 <=> 1372393837
version : 29 <=> 35
Body :
Added: LTE 25
>>> java/res/raw/main_de.dict
Header :
date : 1355802835 <=> 1372393817
version : 29 <=> 35
Body :
Added: LTE 25
>>> java/res/raw/main_en.dict
Header :
date : 1366272977 <=> 1372393837
version : 31 <=> 35
Body :
Deleted: Sea 126
Added: LTE 25
>>> java/res/raw/main_es.dict
Header :
date : 1355802832 <=> 1372393817
version : 29 <=> 35
Body :
Added: LTE 25
>>> java/res/raw/main_fr.dict
Header :
date : 1366272255 <=> 1372393818
version : 31 <=> 35
Body :
Deleted: R'n'B 95
Deleted: count 60
Deleted: d'Inti 34
Added: beurk 25
>>> java/res/raw/main_it.dict
Header :
date : 1355802836 <=> 1372393818
version : 29 <=> 35
Body :
Added: LTE 25
>>> java/res/raw/main_ru.dict
Header :
date : 1370244430 <=> 1372393835
version : 34 <=> 35
Body :
Freq changed: связывание 93 -> 0
Bug: 9301610
Bug: 9607966
Change-Id: I1117ed85d97fbb0ee50f11bc31776f1970b56f12
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
cs, da, de, el, es, fi, fr, hr, it, lt, lv, nb, nl, pl,
pt_BR, pt_PT, sl, sr, sv, tr : rescale frequencies to match
spec. This has no large effect in the practice except the
dictionary will become stronger vs spatial model (especially in
lower count corpora, like lt, lv, sr)
en* : Small changes (rounding going the other way essentially)
ru : the above rescaling, and remove the following words:
Дре, ОСТа, Планше, легкими, легком, легкому, легкости,
легкую, нелегкие, нелегкий, нелегким, нелегкое, нелегкой,
нелегкую, полулегком and add нелёгкие, нелёгкое, нелёгкую;
other accented forms were already in the dictionary.
Change-Id: I40386c2ebd4d2be38874e822bde89db7cb512ae6
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
- Combined de dict :
Remove digraph shortcuts that were in by mistake.
- Combined en dict :
Set freq of "baton" "batons" "mace" "puff"
"puffs" and "tasers" to zero. They are offensive
in en_GB.
- Combined en_GB dict :
Change freq of "il" to 0 and flag it "not a word". Still
in the dict as a whitelist entry for "I'll"; for some
reason it had freq 99.
Add "milk:122" and "practice:143"
- Combined fr dict :
Add missing words : "Nostradamus:40" "défendais:30"
"gmail:50" "générale:140" "hm:0" "hmm:0" "y'en:130"
"l'apocalypse:31" "m'épuise:30" "recontacter:80"
"t'annonce:30"
Set freq of non-word shortcuts for digraphs to 1 instead
of 0, allowing to gesture them.
- Combined ru dict :
Remove a lot of two-character non-words.
- Binary de dict :
Remove the obsolete "options" header, and add the "dictionary"
header.
- Binary en dict :
Flag "hoe" "hoes" "il" "shel" as non-words.
Also drop freq of "il" and "shel" to 0
Add the "locale" header that was missing.
- Binary es dict :
Add the "dictionary" header.
- Binary fr dict :
Add the same words as above. Non-word shortcuts were already
set to 1.
- Binary it dict :
Add a "dictionary" header. Also change freq of
"Šarapova" from 50 to 37; not sure why it was 50.
- Binary pt_BR dict :
Add a "dictionary" header.
- Binary ru dict :
Add a "dictionary" header and remove the same words as above.
For all dictionaries : bump the version to 27.
Change-Id: I94fe7f8f42b31fdad223085c00a94115e14d2276
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
New dictionaries :
- Danish
- Greek
- Finnish
- Lithuanian
- Latvian
- Dutch
- Polish
- Russian
- Slovene
- Serbian
- Swedish
- Turkish
Also, compress those files to reduce the footprint in the
repository.
Also, update and improve English and French dictionaries, and
add the ligatures shortcut into the French dictionary.
Finally, move the Russian binary dictionary here now that it
can at last be open sourced.
Bug: 5587752
Bug: 6775251
Bug: 6995793
Bug: 7149666
Change-Id: Iec9831d4dce425a2b5b0657571e4448436610525
|
| |
|
|
|
|
|
|
| |
- English dict scrubbed for distractors
- EN, FR, IT, DE include improvements from user feedback
Bug: 6394369
Change-Id: I9af5415d0b6a5edfea2956657b0fee7906ebb344
|
| |
|
|
| |
Change-Id: Ia6bb1f9d6df4a9f859f132affc9cb030f14effd9
|
| |
|
|
|
|
| |
Bug: 6517432
Bug: 6525702
Change-Id: I47a8c4612bffb16971575b59e9e20fd0276a2f92
|
|
|
Bug: 6458744
Change-Id: If28aeb7360ee7ec7408f55934ca2a684f032e338
|
Adrian Velicu
Jean Chalard