aboutsummaryrefslogtreecommitdiffstats
path: root/tools/dicttool/tests (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Fix the build : move offdevice tests in an off device fileJean Chalard2014-11-061-1/+92
| | | | | | Also fix a failing test Change-Id: I280aa6b5836c7332da08a88f1258546edeb25a37
* Genericize getting a raw dictionaryJean Chalard2014-11-061-3/+3
| | | | | | | This will allow for not copying the whole dictionary when only the header is needed. Change-Id: Ie4a649b507ccd4a430201824ed87b8b8bbf55e9f
* Large simplification in obtaining a raw dictionaryJean Chalard2014-11-051-8/+2
| | | | | | | | | | | That is where the last refactorings were leading. This code is simpler, but it's far more flexible. Importantly, it only makes a single copy instead of making a full disk copy for every intermediate step. Next we're going to make the "copy" part modular for processes that don't need to copy the whole file. Change-Id: Ief32ac665d804b9b20c44f443a9c87452ceb367a
* Some more simplification of DecoderSpec worksJean Chalard2014-10-231-1/+1
| | | | Change-Id: I23fa4e4ed96228406e70aa94d84fd7b8d3f69347
* Simplify handling of steps in DecoderChainSpecJean Chalard2014-10-231-2/+3
| | | | | | | This is a preliminary refactoring change to improve performance in dicttool diagnostic tools. Change-Id: I9a59328af62e336809246be5bebbbf2e154366b3
* Fix some compiler warningsTadashi G. Takaoka2014-10-211-5/+6
| | | | | | | | | | | | | | | | | | | | | This CL fixes the following compiler warnings. - Indirect access to static member - Access to a non-accessible member of an enclosing type - Parameter assignment - Method can be static - Local variable declaration hides another field or variable - Value of local variable is not used - Unused import - Unused private member - Unnecessary 'else' statement - Unnecessary declaration of throw exception - Redundant type arguments - Missing '@Override' annotation - Unused '@SuppressWarning' annotations Bug: 18003991 Change-Id: Icfebe753e53a2cc621848f769d6a3d7ce501ebc7
* Renaming "blacklist" flag to "possibly offensive"Adrian Velicu2014-10-213-11/+22
| | | | | | | | | No behaviour changes. Unified the overloaded FusionDictionary::add method to always take an isPossiblyOffensive argument. Bug: 11031090 Change-Id: I5741a023ca1ce842d2cf10d4f6c926b0efabaa78
* Refactor dicttool with try-with-resourceTadashi G. Takaoka2014-06-221-14/+14
| | | | | | This CL must be checked in together with Idd7c744d0f. Change-Id: Ia0ff09a054c1852b39cdce22a4377108afb254e2
* Use Java 7 diamond operatorTadashi G. Takaoka2014-05-242-4/+2
| | | | Change-Id: If16ef50ae73147594615d0f49d6a22621eaf1aef
* Do not call exit 1 when loaded with source commandYohei Yukawa2014-04-021-1/+1
| | | | | BUG: 13754552 Change-Id: I3d5e4c0786547521325405100c175dd1b21754df
* Move code only used for dicttool and tests under tests.Keisuke Kuroyanagi2014-03-271-1/+3
| | | | | Bug: 13035567 Change-Id: I13c6df013ef2b67c9bf67455d9c32d283bf9ea2e
* Fix: dicttool build.Keisuke Kuroyanagi2014-03-073-3/+3
| | | | Change-Id: I5c3bcbe9f3054bdd1a760398fe11344e0e05ac6a
* Correctly read the header of APK-embedded dictsJean Chalard2014-02-241-1/+2
| | | | | Bug: 13164518 Change-Id: I8768ad887af8b89ad9f29637f606c3c68629c7ca
* Remove unused argument from readDictionaryBinary.Keisuke Kuroyanagi2014-02-141-3/+2
| | | | | Bug: 12810574 Change-Id: Ice415ebd8d11162facca3fe8927ef8a616b11424
* Make PtNode have ProbabilityInfo instead of raw value.Keisuke Kuroyanagi2014-02-103-12/+13
| | | | | | Bug: 11281877 Bug: 12810574 Change-Id: Id1cda0afc74c4e30633c735729143491b2274a7b
* Consolidate WordProperty and Word.Keisuke Kuroyanagi2014-02-061-3/+3
| | | | | | Bug: 11281877 Bug: 12810574 Change-Id: I9dc99188f80f25a8780c1860dab46e4aa80a23e5
* Separate header class from FormatSpec.Keisuke Kuroyanagi2014-02-041-6/+7
| | | | | Bug: 12810574 Change-Id: Iacf1cd05a268bf690ab864b5e32a18a4b0ccc693
* [HD03] Straighten out attribute key names in Java.Jean Chalard2014-01-311-6/+6
| | | | | Bug: 11281748 Change-Id: I1d813bdacd45bcfd9c4cc73ac1d67c5c89854e86
* Make the bad header a checked exception and fix dicttool testJean Chalard2013-12-161-2/+15
| | | | Change-Id: If780a2a1cb722aee83d910904c0a6315add9552d
* Have dicttool use the native library to generate v4 dicts.Jean Chalard2013-12-131-2/+2
| | | | | | Yay ! Change-Id: Iea8ced9e81031b9ab7eff05ad9ef7215be248de9
* Remove flags from Java side.Jean Chalard2013-12-133-6/+3
| | | | | | | | | | | | This simplifies the code quite a bit. - GERMAN_UMLAUTS are now handled through a key-value attribute. The dictionary generator does not need to know about it any more. - FRENCH_LIGATURES are deprecated as we handle them with shortcuts now. - CONTAINS_BIGRAMS is deprecated. Bigram processing is always applied regardless of this flag. Bug: 11281748 Change-Id: If567e52e245a9342adc7f3104a0f7d8d782df8c1
* Make dicttool read the compressed combined format.Yuichiro Hanada2013-09-301-3/+3
| | | | Change-Id: Ib39fa110402895a655f4e705caae53397ace9259
* Add getDictDecoder.Yuichiro Hanada2013-09-121-2/+2
| | | | | Bug: 9618601 Change-Id: I173100ac704c03f7d5d0d53477e83cab5d1110d4
* Add a flag to readDictioanryBinary in DictDecoder.Yuichiro Hanada2013-09-111-1/+2
| | | | Change-Id: I356adb72047ebc43c924fbff1ff45e7460508a31
* Rename CharGroup to PtNode.Yuichiro Hanada2013-08-261-3/+3
| | | | | Bug: 10233675 Change-Id: I7b0eb07d195cd386cd0d9e97cd59bf48fcf24107
* Add DictDecoder.readDictionaryBinary.Yuichiro Hanada2013-08-231-5/+3
| | | | | Bug: 10434720 Change-Id: I14690a6e0f922ed1bab3a4b6c9a457ae84d4c1a4
* Add DictEncoder.Yuichiro Hanada2013-08-221-3/+5
| | | | Change-Id: I41049b9118b58838e5dedf8e5618d939ca70c5ef
* Rename BinaryDictEncoder to BinaryDictEncoderUtils.Yuichiro Hanada2013-08-212-4/+5
| | | | Change-Id: I4dabf17da7003b1d8204a83dbd10e5be6e8fd805
* Rename BinaryDictDecoder to Ver3DictDecoder.Yuichiro Hanada2013-08-201-3/+3
| | | | Change-Id: Ibf9b95b658df6e2c2218bdb62e2380f326a03832
* [Refactor] Rename BinaryDictReader and BinaryDictDecoder.Yuichiro Hanada2013-08-191-4/+5
| | | | | | | BinaryDictReader -> BinaryDictDecoder. BinaryDictDecoder -> BianryDictDecoderUtils. Change-Id: Iadf2153b379b760538ecda488dda4f17225e5f37
* Rename Node to PtNodeArrayJean Chalard2013-08-163-10/+11
| | | | | Bug: 10247660 Change-Id: I1a0ac19f58f96adb5efac5fd35c6404831618c99
* Remove unused imports.Yuichiro Hanada2013-08-161-5/+1
| | | | Change-Id: Ib46da6efeaa8f83a9cda24c947fc2e667a1468e8
* [Refactor] Divide BinaryDictInputOutput into BinaryDictEncoder and ↵Yuichiro Hanada2013-08-154-9/+10
| | | | | | BinaryDictDecoder. Change-Id: I7c3269d77e3e3b567e459dcaa1bc029903941744
* Revert "[Refactor] Divide BinaryDictInputOutput into BinaryDictInputUtils ↵Ken Wakasa2013-08-153-7/+6
| | | | | | | | and BinaryDictOutputUtils." This reverts commit 4c63d0614e7ed7aea4bcbab3a17090d841661d92. Change-Id: I1fa277d720bab4d895259df7d6d82eebfa5eb6c5
* [Refactor] Divide BinaryDictInputOutput into BinaryDictInputUtils and ↵Yuichiro Hanada2013-08-153-6/+7
| | | | | | BinaryDictOutputUtils. Change-Id: I0d476abe763c11ba9005152f928e8dccf15ac9de
* Add BinaryDictReader.Yuichiro Hanada2013-08-131-5/+4
| | | | | | Bug: 9618601 Change-Id: Ief07fa0c3c4f7f5999a3fafcef4e47b6b6fd8143
* Add tests to dicttool test.Jean Chalard2013-06-201-4/+0
| | | | | Bug: 8526576 Change-Id: Idd6f9cd076d5915361c68f5c29afbba67dd54eba
* Fix two nasty bugs with surrogate pairs.Jean Chalard2013-04-011-0/+114
| | | | | | | | | | | | | | | | The important bug is in findWordInTree. The problem, which is not obvious, is that we were calling codePointAt() with the code point index in the string, instead of the char index. The other bug this change fixes was harmless in the practice, because it's in the iteration which is only used for debug and pretty printing purposes. It's very similar in that it would substract a length in code point to a length in chars and truncate a StringBuilder at that length, so it would fail in a quite similar manner. This changes the meaning of the "length" attribute in Position, but it's clearer this way anyway. Bug: 8450145 Change-Id: If396f883a9e6449de39351553ba83f5be5bd30f0
* Clean up dependency for dicttoolKen Wakasa2012-11-291-0/+11
| | | | | bug: 7635215 Change-Id: Ie50297ab592261390885c593341b6c46161b2e63
* Cleanup after dicttoolJean Chalard2012-10-301-0/+3
| | | | | | | Arrange for temporary files to be deleted. Also, add a security on stack overflows. Change-Id: I9da2ebefb06409a71b235243ea835ce10d6a9b81
* Add auto detection and decoding of dictionary files. (A2)Jean Chalard2012-10-252-0/+107
| | | | | Bug: 7388852 Change-Id: I25e755fc15f5b383acc046f668e9681efa4f0c2f
* Add @UsedForTesting and @ExternallyReferenced annotationsTadashi G. Takaoka2012-10-222-13/+3
| | | | | Bug: 7268357 Change-Id: I0b7e0c19f04af9ae30874d0a4c26ad81bc80be8c
* Reinstate the shortcut-only attributeJean Chalard2012-08-311-5/+5
| | | | | | | | Also add the blacklist attribute Bug: 7005742 Bug: 2704000 Change-Id: Icbe60bdf25bfb098d9e3f20870be30d6aef07c9d
* Move dicttool tests and make a script to run them (A4)Jean Chalard2012-08-042-0/+75
Change-Id: If582e81741c5edaf345dcb55517dcad0baa64c9e