aboutsummaryrefslogtreecommitdiffstats
path: root/tools/dicttool (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Add getDictDecoder.Yuichiro Hanada2013-09-123-5/+5
| | | | | Bug: 9618601 Change-Id: I173100ac704c03f7d5d0d53477e83cab5d1110d4
* Add a flag to readDictioanryBinary in DictDecoder.Yuichiro Hanada2013-09-113-3/+4
| | | | Change-Id: I356adb72047ebc43c924fbff1ff45e7460508a31
* Rename CharGroup to PtNode.Yuichiro Hanada2013-08-263-14/+14
| | | | | Bug: 10233675 Change-Id: I7b0eb07d195cd386cd0d9e97cd59bf48fcf24107
* Add DictDecoder.readDictionaryBinary.Yuichiro Hanada2013-08-233-13/+10
| | | | | Bug: 10434720 Change-Id: I14690a6e0f922ed1bab3a4b6c9a457ae84d4c1a4
* Add DictEncoder.Yuichiro Hanada2013-08-222-7/+9
| | | | Change-Id: I41049b9118b58838e5dedf8e5618d939ca70c5ef
* Rename BinaryDictEncoder to BinaryDictEncoderUtils.Yuichiro Hanada2013-08-213-6/+7
| | | | Change-Id: I4dabf17da7003b1d8204a83dbd10e5be6e8fd805
* Rename BinaryDictDecoder to Ver3DictDecoder.Yuichiro Hanada2013-08-204-10/+10
| | | | Change-Id: Ibf9b95b658df6e2c2218bdb62e2380f326a03832
* [Refactor] Rename BinaryDictReader and BinaryDictDecoder.Yuichiro Hanada2013-08-194-18/+20
| | | | | | | BinaryDictReader -> BinaryDictDecoder. BinaryDictDecoder -> BianryDictDecoderUtils. Change-Id: Iadf2153b379b760538ecda488dda4f17225e5f37
* Rename Node to PtNodeArrayJean Chalard2013-08-167-18/+21
| | | | | Bug: 10247660 Change-Id: I1a0ac19f58f96adb5efac5fd35c6404831618c99
* Remove unused imports.Yuichiro Hanada2013-08-163-9/+1
| | | | Change-Id: Ib46da6efeaa8f83a9cda24c947fc2e667a1468e8
* Fix build.Yuichiro Hanada2013-08-151-2/+2
| | | | Change-Id: I80d177f3c9bff1fb90029edeafa4a62d0b99e09e
* [Refactor] Divide BinaryDictInputOutput into BinaryDictEncoder and ↵Yuichiro Hanada2013-08-158-22/+24
| | | | | | BinaryDictDecoder. Change-Id: I7c3269d77e3e3b567e459dcaa1bc029903941744
* Add an initial JNI interface to dicttool.Jean Chalard2013-08-155-15/+102
| | | | | Bug: 10100269 Change-Id: I883992c2033e7d9e7c754c0bf653767728b221b6
* Revert "[Refactor] Divide BinaryDictInputOutput into BinaryDictInputUtils ↵Ken Wakasa2013-08-155-16/+14
| | | | | | | | and BinaryDictOutputUtils." This reverts commit 4c63d0614e7ed7aea4bcbab3a17090d841661d92. Change-Id: I1fa277d720bab4d895259df7d6d82eebfa5eb6c5
* [Refactor] Divide BinaryDictInputOutput into BinaryDictInputUtils and ↵Yuichiro Hanada2013-08-155-14/+16
| | | | | | BinaryDictOutputUtils. Change-Id: I0d476abe763c11ba9005152f928e8dccf15ac9de
* Add BinaryDictReader.Yuichiro Hanada2013-08-133-28/+14
| | | | | | Bug: 9618601 Change-Id: Ief07fa0c3c4f7f5999a3fafcef4e47b6b6fd8143
* Move a couple classes to the utils packageKen Wakasa2013-07-191-1/+1
| | | | Change-Id: Ia14a2011d79bad7cd02697b9254705f6e2099442
* Remove dependencies to android source in dicttoolKen Wakasa2013-07-172-4/+84
| | | | | bug: 9889653 Change-Id: I2630c56548f9146ade85b17f891932dae2082a85
* Fix build.Ying Wang2013-07-161-0/+1
| | | | Change-Id: I51c0b7ba5641c1e7c1d63a4e5a6307b08d6f4886
* Generalize constuctors & add testsJean Chalard2013-07-042-9/+26
| | | | | | | | | | If there is any two-args constructor with the right arg types in a test class, use it. Also, add a test suite to dicttool test. Also, have the return value of dicttool reflect success or failure. Change-Id: I51ab2a4abb93a0a483e8d6ef3c39d1ff1bce1dbd
* Add args to dicttool test.Jean Chalard2013-07-011-10/+57
| | | | Change-Id: I0667e0a5a6f6db3964cfcca5c8f083b9ceb41a2e
* Move util classes to the latin/utils directoryKen Wakasa2013-06-241-2/+2
| | | | Change-Id: I1c5b27c8edf231680edb8d96f63b9d04cfc6a6fa
* Add tests to dicttool test.Jean Chalard2013-06-207-8/+159
| | | | | Bug: 8526576 Change-Id: Idd6f9cd076d5915361c68f5c29afbba67dd54eba
* Add an initial test command to dicttool.Jean Chalard2013-06-196-8/+66
| | | | | | | | Also fix some warnings This is a preliminary change to help track b/8526576 Bug: 8526576 Change-Id: If2ed74bb92f9b5fb7bbaf9c4851d9d0b5514b405
* Fix two nasty bugs with surrogate pairs.Jean Chalard2013-04-011-0/+114
| | | | | | | | | | | | | | | | The important bug is in findWordInTree. The problem, which is not obvious, is that we were calling codePointAt() with the code point index in the string, instead of the char index. The other bug this change fixes was harmless in the practice, because it's in the iteration which is only used for debug and pretty printing purposes. It's very similar in that it would substract a length in code point to a length in chars and truncate a StringBuilder at that length, so it would fail in a quite similar manner. This changes the meaning of the "length" attribute in Position, but it's clearer this way anyway. Bug: 8450145 Change-Id: If396f883a9e6449de39351553ba83f5be5bd30f0
* Clean up dependency for dicttoolKen Wakasa2012-11-292-5/+20
| | | | | bug: 7635215 Change-Id: Ie50297ab592261390885c593341b6c46161b2e63
* Fix a bug in the diff toolJean Chalard2012-11-081-1/+6
| | | | | | | | Fix reporting of removed attributes multiple times instead of just one in some cases. Also, report the frequency of the removed bigram in the same cases. Change-Id: I1455fa7553fcebc3005c222bf5aa9afcf1678c31
* Add a missing report, and fix a wrong reportJean Chalard2012-11-011-7/+16
| | | | | | | Deleted words would be reported, but added words wouldn't Also, shortcuts would be reported as bigrams Change-Id: I017653f2afa65cf16924017a0be2ee2cbd6ca10d
* Add a "no changes" message in the diff commandJean Chalard2012-11-011-8/+30
| | | | | | | Also fix a bug where no locale would be interpreted as a different locale instead of the same. Change-Id: I296feef45e39a9e89509cb315e789676755141ab
* Fix an NPE in recent codeJean Chalard2012-11-011-1/+3
| | | | Change-Id: I5c76edff5c3c250167d425a737b09b10e25f9f84
* Merge "Use spaces instead of tabs in the combined format."Jean Chalard2012-10-311-3/+3
|\
| * Use spaces instead of tabs in the combined format.Jean Chalard2012-10-311-3/+3
| | | | | | | | Change-Id: Ie8a4cdc44f87839e29bfbffc03d4853b7b5cc5f6
* | Add a plumbing option to dicttool info.Jean Chalard2012-10-312-10/+22
|/ | | | | | | | Also align the `porcelain' option to the diff command that was used mistakenly. Bug: 7388665 Change-Id: Ic0e1b98c62ce37b2e909384a0370af4458563703
* Cleanup after dicttoolJean Chalard2012-10-303-7/+19
| | | | | | | Arrange for temporary files to be deleted. Also, add a security on stack overflows. Change-Id: I9da2ebefb06409a71b235243ea835ce10d6a9b81
* Implement the package commandJean Chalard2012-10-301-3/+17
| | | | | Bug: 7388852 Change-Id: Ib6a50e02894961b4c7d3f57bc0fc70c3b3bfe4e9
* Add the unpackage commandJean Chalard2012-10-304-0/+87
| | | | | Bug: 7388852 Change-Id: I7e5376f5d646e669884ef78e4e0dee62c99d4d6b
* Add an empty crypt command to aosp dicttoolJean Chalard2012-10-304-24/+33
| | | | | | | | This also makes the AdditionalCommandList useless, so let's remove it Bug: 7388852 Change-Id: I308f54ca6f778afe01c1233801a9cc22ebb3d1e9
* Accept comments in the combined file formatJean Chalard2012-10-291-2/+10
| | | | Change-Id: I17b745281b8b7b1922e1c2d3717986e9bb11aa0b
* Remove warningsJean Chalard2012-10-293-5/+3
| | | | | | Thanks Eclipse Change-Id: I88e3979ed22be5d8be5a5accdde417c6b1a8bf2d
* Add word arguments to the info command (A10)Jean Chalard2012-10-291-2/+46
| | | | | | | | With this, it's now possible to get all the information about a word from any dictionary. Bug: 7388857 Change-Id: Ifc9d539f52f87044a1974d95bf35d87465e84c47
* Implement the word-level diff (A9)Jean Chalard2012-10-291-11/+79
| | | | | Bug: 7388857 Change-Id: I4c4560d4f4b579936a44cdf409a4c27300b65610
* Add the dicttool diff command. (A8)Jean Chalard2012-10-292-0/+109
| | | | | | | | This is an initial implementation, it does not do everything just yet. Bug: 7388857 Change-Id: I11543973a4657e122ca3475225059b06b9a3f2b9
* Add a reporting option to the getDictionary method (A7)Jean Chalard2012-10-295-67/+69
| | | | | | This is refactoring to help future changes Change-Id: I8c4372383a2fff5805b96cc47df5012e4b231004
* Finish up the "info" command in dicttool. (A6)Jean Chalard2012-10-252-4/+39
| | | | | Bug: 7388857 Change-Id: I704f12a6be76ce1644ec5e8dd3b667f112e9c04a
* Implement a part of the "info" command (A5)Jean Chalard2012-10-252-3/+73
| | | | | Bug: 7388857 Change-Id: Id1bba7a33ab6195d5711bebb1df5c18c9c08925c
* Add symmetry and pre-emptively improve performance (A4)Jean Chalard2012-10-252-3/+39
| | | | | | | | | | The test for binary dictionary will soon entail decrypting and uncompressing files if necessary to test for their headers, and will become much slower than it is. It's better to be able to detect the XML format too, and leave the slower test for last. Bug: 7388852 Change-Id: I6b9a7944de80217e1571cab65dcd1cff347b3046
* Add automatic decryption capabilities. (A3)Jean Chalard2012-10-252-2/+59
| | | | | Bug: 7388852 Change-Id: Ie952b1ad6cfad2f83793bd968e159d3cfbf20a47
* Add auto detection and decoding of dictionary files. (A2)Jean Chalard2012-10-254-12/+191
| | | | | Bug: 7388852 Change-Id: I25e755fc15f5b383acc046f668e9681efa4f0c2f
* Some initial refactoring in dicttool. (A1)Jean Chalard2012-10-252-10/+43
| | | | | Bug: 7388852 Change-Id: I5ff70d12f3a8096ae6fb8cd4883a32ffe1683c9b
* Add reader and writer for the combined dict format.Jean Chalard2012-10-233-12/+318
| | | | | | | | | This introduces a new textual format for the dictionary that combines words, bigrams and shortcuts to avoid complexity. It is also extensible to n-grams to fool-prof for the future, and easier to read than XML. Bug: 7388540 Change-Id: I942bbad51bd0c905a5a54c278667563fd6dd66ec