Commit Graph

148 Commits

Author SHA1 Message Date
Alexandre Julliard 6346809302 unicode: Move the combining class table to ntdll.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-02-04 21:30:26 +01:00
Alexandre Julliard 0576fa43c4 unicode: Expand surrogates in decomposition tables.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-02-04 21:30:26 +01:00
Alexandre Julliard cd8eaef47e unicode: Avoid copying the decomposition data when not necessary.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-02-04 21:30:26 +01:00
Alexandre Julliard a646e4e6f2 unicode: Store recursive decompositions directly in the tables.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-02-04 21:30:26 +01:00
Alexandre Julliard dba4bd756a unicode: Store variable-length sequences also for the main decomposition table.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-02-04 21:30:26 +01:00
Alexandre Julliard f17a228d45 unicode: Try harder to reuse subsequences when compressing data arrays.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-01-28 19:26:13 +01:00
Alexandre Julliard bfeb0a97fe unicode: Use a standard two-level mapping table for the sortkeys map.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-01-28 19:25:07 +01:00
Alexandre Julliard fb87398b99 unicode: Use a standard two-level mapping table for the mirror map.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-01-28 18:58:50 +01:00
Alexandre Julliard 31360d4785 unicode: Use a standard two-level mapping table for the digit map.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-01-28 18:58:50 +01:00
Alexandre Julliard 9c3a25b855 unicode: Specify a bit width instead of a format when dumping arrays.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-01-23 21:11:29 +01:00
Alexandre Julliard a08821186a unicode: Use existing helpers to build the sortkeys table.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-01-23 21:11:29 +01:00
Alexandre Julliard 4b5c67ee0b unicode: Remove case mappings that don't round-trip.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-01-23 21:11:29 +01:00
Alexandre Julliard bd9d83b73a unicode: Use existing helpers to build the l_intl.nls file.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2020-01-23 16:45:02 +01:00
Alexandre Julliard 94a3add0ea kernel32: Move LCMapString functions to kernelbase.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-12-09 23:47:46 +01:00
Alexandre Julliard 1b46da5c05 kernel32: Move GetStringType functions to kernelbase.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-12-09 23:47:46 +01:00
Nikolay Sivov 624ed18b1f Update to Unicode 12.1.
Signed-off-by: Nikolay Sivov <nsivov@codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-12-09 23:47:45 +01:00
Alexandre Julliard 328ec3a768 kernelbase: Reimplement WideCharToMultiByte using Win32-format codepage tables.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-12-06 22:30:23 +01:00
Alexandre Julliard 7e8f1dac30 kernelbase: Reimplement MultiByteToWideChar() using Win32-format codepage tables.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-12-06 22:30:23 +01:00
Alexandre Julliard 7bb286ad9d kernel32: Move FoldStringW() function to kernelbase.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-11-28 09:05:13 +01:00
Alexandre Julliard 4f63971169 libport: Add codepage 28601 (Latin/Thai).
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-10-17 18:23:54 +02:00
Alexandre Julliard a9285c5131 make_unicode: Avoid duplicate lead bytes.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-10-06 13:39:53 +02:00
Nikolay Sivov cd7dd5e895 dwrite: Add recent script properties.
Signed-off-by: Nikolay Sivov <nsivov@codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-08-05 18:45:10 +02:00
Alexandre Julliard c52b2f1284 make_unicode: Remove duplicate DECLSPEC_HIDDEN.
Spotted by Matteo Bruni.

Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-05-24 11:25:38 +02:00
Alexandre Julliard ef07087f47 gdi32: Use the same BiDi direction table as usp10.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-05-22 19:16:05 +02:00
Alexandre Julliard 01ebf1ade4 dwrite: Use the same BiDi direction table as usp10.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-05-22 19:16:05 +02:00
Alexandre Julliard 333e6b3c69 make_unicode: Avoid including wine/unicode.h in generated files.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-05-22 19:16:05 +02:00
Alexandre Julliard d68f8d7b35 make_unicode: Store the full BiDi direction type in the table.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-05-22 19:16:05 +02:00
Alexandre Julliard 2f6918cbe2 make_unicode: Generate a separate table for BiDi direction type in usp10.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-05-22 19:16:05 +02:00
Alexandre Julliard bb6bd8a2f1 make_unicode: Use a two-level table for the kernel32 wctype table.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-05-22 19:16:05 +02:00
Alexandre Julliard 02a04ba05e make_unicode: Store the C2_* values directly in the kernel32 wctype table.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-05-22 19:16:05 +02:00
Alexandre Julliard f09dade9cb make_unicode: Add a wctype table in kernel32 for GetStringTypeW().
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-05-22 19:16:05 +02:00
Nikolay Sivov 13364151a4 tools: Update to Unicode 12.0.
Signed-off-by: Nikolay Sivov <nsivov@codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-04-29 18:46:25 +02:00
Alexandre Julliard a37c38191e libport: Don't hide the casemap and wctype tables.
For libwine backwards compatibility.

Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-04-02 19:20:21 +02:00
Alexandre Julliard 84cd904334 libwine: Move collation table to libwine_port.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-03-24 10:34:46 +01:00
Alexandre Julliard 9de388258f libwine: Move casemap tables to libwine_port.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-03-24 10:34:44 +01:00
Alexandre Julliard a67dca1bc8 libwine: Move wctype tables to libwine_port.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-03-23 13:45:52 +01:00
Alexandre Julliard 7fc9e45dd8 make_unicode: Don't output array sizes that could be over-estimated.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-03-22 19:45:39 +01:00
Huw Davies db3ae2ca9f libport: Add support for singleton decomposition.
Signed-off-by: Huw Davies <huw@codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-02-11 11:52:00 +01:00
Huw Davies eceb69e172 libport: Add support for compatibility decomposition.
Signed-off-by: Huw Davies <huw@codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-02-11 11:52:00 +01:00
Huw Davies dc919db2bf kernel32: Implement canonical reordering.
Signed-off-by: Huw Davies <huw@codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-02-11 11:52:00 +01:00
Huw Davies e4a9e2ff2e kernel32: Initial support for canonical decomposition in NormalizeString().
Signed-off-by: Huw Davies <huw@codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2019-02-11 11:52:00 +01:00
Nikolay Sivov d4eeb162bb tools: Update to Unicode 11.0.0.
Signed-off-by: Nikolay Sivov <nsivov@codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2018-07-03 12:01:40 +02:00
Jens Reyer ebbbe85038 make_unicode: Use VerticalOrientation.txt from UCD.
Signed-off-by: Jens Reyer <jre.winesim@gmail.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2017-07-13 11:45:18 +02:00
Jens Reyer b736dbe933 make_unicode: Update data tables to Unicode 10.0.0.
Signed-off-by: Jens Reyer <jre.winesim@gmail.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2017-07-13 11:44:41 +02:00
Nikolay Sivov 4c7e136013 dwrite: Update script list with latest additions.
Signed-off-by: Nikolay Sivov <nsivov@codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-11-06 17:40:05 +01:00
Nikolay Sivov c38be91061 dwrite: Improve script mapping generation.
Signed-off-by: Nikolay Sivov <nsivov@codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-07-04 17:41:00 +09:00
Nikolay Sivov 58e0972c5c Update data tables to Unicode 9.0.0.
Signed-off-by: Nikolay Sivov <nsivov@codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-06-22 22:09:28 +09:00
Francois Gouget 44468e8536 tools: Assorted comment spelling fixes.
Signed-off-by: Francois Gouget <fgouget@free.fr>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-04-19 14:57:30 +09:00
Alexandre Julliard 0bbeaae678 make_unicode: Mark most data tables as hidden.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-25 00:25:01 +09:00
Alexandre Julliard 34174e2ca8 libport: Mark internal functions and data tables as hidden.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-25 00:25:00 +09:00
Alexandre Julliard 1a16235de1 libport: Mark codepage tables as hidden.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-25 00:25:00 +09:00
Alexandre Julliard 52333e9c5d libwine: Move the wide char to multi-byte conversion functions to libwine_port.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-19 11:49:48 +09:00
Alexandre Julliard f7368aaa97 libwine: Move the multi-byte to wide char conversion functions to libwine_port.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-19 11:48:09 +09:00
Alexandre Julliard faf3871e77 libwine: Generate the composition tables access code along with the tables.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-19 11:38:14 +09:00
Alexandre Julliard a951d53394 libwine: Move the decomposition table to a separate file.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-19 11:34:02 +09:00
Nikolay Sivov 7dd90faaa3 dwrite: Fix Unknown/Common/Inherited script categories handling.
Signed-off-by: Nikolay Sivov <nsivov@codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-19 11:08:00 +09:00
Alexandre Julliard 2087f38e84 libwine: Move the codepage tables to libwine_port.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-19 00:49:10 +09:00
Alexandre Julliard d59d45e457 libwine: Move the digit folding tables to libwine_port.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-19 00:49:09 +09:00
Alexandre Julliard 232dc29ff8 make_unicode: Update vertical orientation table to the latest version.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-09 17:23:31 +09:00
Alexandre Julliard 575a979610 make_unicode: Support sparse arrays for character tables.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-09 17:23:31 +09:00
Alexandre Julliard cb65a3fbf9 make_unicode: Fix typo in Indic syllable table generation.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-09 17:23:27 +09:00
Alexandre Julliard 6203373496 libwine: Map partial DBCS characters to the default char.
Signed-off-by: Alexandre Julliard <julliard@winehq.org>
2016-02-09 13:46:48 +09:00
Nikolay Sivov e8c1cf4402 Update data tables to Unicode 8.0.0. 2015-10-02 15:37:05 +09:00
Nikolay Sivov 3704072911 dwrite: Mirror characters in case of RTL direction. 2014-10-06 17:36:26 +02:00
Nikolay Sivov fdd8454ef8 dwrite: Implement AnalyzeBidi(). 2014-10-01 12:01:05 +02:00
Nikolay Sivov 59bdda006b dwrite: Implement GetScriptProperties(). 2014-09-26 13:59:52 +02:00
Nikolay Sivov dae9096c2e dwrite: Allow underscores in script names. 2014-09-25 13:44:53 +02:00
Nikolay Sivov e36025a2a8 dwrite: Implement itemization by script id using Unicode.org data. 2014-09-24 11:10:39 +02:00
Nikolay Sivov f60350808d dwrite: Implement AnalyzeLineBreakpoints() using Unicode breaking algorithm. 2014-09-05 14:41:47 +02:00
Huw Davies 4ac5d66dfe tools: Only allow the absolute difference in bracket pairs to be less than 128, since we need the sign. 2014-07-09 16:18:22 +02:00
Aric Stewart 2a12c6a7d4 tools: Generate the Unicode Bidi Bracketing table. 2014-07-08 17:00:24 +02:00
Alexandre Julliard 18d410dec1 tools: Don't include wine/unicode.h if not necessary. 2014-07-08 17:00:22 +02:00
Alexandre Julliard 96ff3daaa3 usp10: Update the character data tables to Unicode 7.0.0. 2014-06-23 16:05:13 +02:00
Aric Stewart 742cde4fab tools: Build vertical orientation table.
Based on data related to UTR #50 Unicode Vertical Text Layout.
2013-12-04 16:34:04 +01:00
Alexandre Julliard 13479aa7b8 tools: Update the character data tables to Unicode 6.3.0. 2013-10-15 16:09:16 +02:00
Aric Stewart b5d9fc323d tools: Add new Explicit Formatting types for Unicode 6.3. 2013-10-15 16:02:38 +02:00
Alexandre Julliard 2292b06281 makefiles: Move l_intl.nls and wine.inf to loader so that they are installed even when tools are not built. 2013-10-07 13:32:03 +02:00
Alexandre Julliard 4be4ad8278 libwine: Add support for codepage 10005 (Mac Hebrew). 2013-08-19 19:02:01 +02:00
Alexandre Julliard 23ddde8850 libwine: Add support for codepage 10004 (Mac Arabic). 2013-08-19 19:00:55 +02:00
Alexandre Julliard 4f718ca07d libwine: Add support for defining round-trip mappings using the Unicode private range. 2013-08-19 18:59:40 +02:00
Alexandre Julliard 194c43ac30 libwine: Compress code page tables by merging identical sequences. 2013-07-22 17:16:02 +02:00
Alexandre Julliard 1f44de3f65 usp10: Update the character data tables to Unicode 6.2.0. 2013-07-22 17:16:01 +02:00
Alexandre Julliard 4be0f88e8d libwine: Use the best fit data for codepage 1361. 2013-07-22 17:16:00 +02:00
Alexandre Julliard 5fbb68769a libwine: Fix the default Unicode character for codepage 20932. 2013-07-22 17:16:00 +02:00
Alexandre Julliard 89a54082be libwine: Fix the default character for EBCDIC codepages. 2013-07-22 17:15:59 +02:00
Alexandre Julliard 2db2303bbc libwine: Add support for codepage 10082 (Mac Croatian). 2013-06-26 17:57:28 +02:00
Alexandre Julliard 085eda4e2d libwine: Add support for codepage 10021 (Mac Thai). 2013-06-26 17:56:26 +02:00
Alexandre Julliard 0928012251 libwine: Add support for codepage 10017 (Mac Ukrainian). 2013-06-26 17:55:31 +02:00
Alexandre Julliard ee34072cfb libwine: Add support for codepage 10010 (Mac Romanian). 2013-06-26 17:54:16 +02:00
Alexandre Julliard 1aebebaf72 libwine: Add support for codepage 10008 (Mac Simplified Chinese). 2013-06-26 17:52:31 +02:00
Alexandre Julliard 701d5efdef libwine: Add support for codepage 10003 (Mac Korean). 2013-06-26 17:50:04 +02:00
Alexandre Julliard c90c593288 libwine: Add support for codepage 10002 (Mac Traditional Chinese). 2013-06-26 17:47:17 +02:00
Alexandre Julliard aa23d6ecc6 libwine: Add support for codepage 10001 (Mac Japanese). 2013-06-26 17:42:33 +02:00
Alexandre Julliard f54c2f65b8 make_unicode: Move codepage file output code to a common routine and make default characters configurable. 2013-06-26 17:30:45 +02:00
Alexandre Julliard 2c4e5ad1a9 make_unicode: Cache files under their full path name to avoid conflicts. 2013-06-19 20:09:53 +02:00
Piotr Caban 047793e1aa make_unicode: Create tables with data needed by nameprep algorithm. 2012-04-26 19:41:28 +02:00
Alexandre Julliard b99b9565e8 usp10: Make the various lookup tables more compact. 2011-07-07 17:30:35 +02:00
Alexandre Julliard 704a330a8e tools: Move the cpmap.pl script to tools/make_unicode. 2011-07-07 15:10:01 +02:00