Unicode 11.0

[DFH]

Unicode 11.0 was released by the Unicode Consortium on 2018-06-05.
See https://www.unicode.org/versions/Unicode11.0.0/

Which is the latest version of Unicode that TextPipe supports ?

Best regards,

David

[DFH]

Still waiting for a response. Any news?

David

[DataMystic Support]

Latest Unicode version is 5.2.1.

I have asked the Component owner if this can be rectified.

Simon

[DFH]

I must say "I'm shocked!"

Unicode 5.2 was released in October 2009, so the library component is ten years behind.

Code: Select all

Version	Date	Scripts	Blocks	Total Code Points	Assigned Code Points	Unassigned Code Points	Named Characters	Graphic Characters	Format Characters	Control Characters	Private Use Characters	Noncharacters	Surrogate Code Points	Characters Added
1.0.0	October 1991	24	57	65,536	12,795	52,741	7,129	7,085	44	32	5,632	2	0	7,161
1.0.1	June 1992	25	59	65,536	34,505	31,031	28,327	28,283	44	32	6,144	2	0	21,204
1.1	June 1993	24	63	65,536	40,635	24,901	34,168	34,151	17	65	6,400	2	0	5,963
2.0	July 1996	25	67	1,114,112	178,500	935,612	38,885	38,867	18	65	137,468	34	2,048	11,373
2.1	May 1998	25	67	1,114,112	178,502	935,610	38,887	38,869	18	65	137,468	34	2,048	2
3.0	September 1999	38	86	1,114,112	188,809	925,303	49,194	49,168	26	65	137,468	34	2,048	10,307
3.1	March 2001	41	95	1,114,112	233,787	880,325	94,140	94,009	131	65	137,468	66	2,048	44,946
3.2	March 2002	45	107	1,114,112	234,803	879,309	95,156	95,023	133	65	137,468	66	2,048	1,016
4.0	April 2003	52	122	1,114,112	236,029	878,083	96,382	96,243	139	65	137,468	66	2,048	1,226
4.1	March 2005	59	142	1,114,112	237,302	876,810	97,655	97,515	140	65	137,468	66	2,048	1,273
5.0	July 2006	64	151	1,114,112	238,671	875,441	99,024	98,884	140	65	137,468	66	2,048	1,369
5.1	April 2008	75	168	1,114,112	240,295	873,817	100,648	100,507	141	65	137,468	66	2,048	1,624
5.2	October 2009	90	194	1,114,112	246,943	867,169	107,296	107,154	142	65	137,468	66	2,048	6,648
6.0	October 2010	93	206	1,114,112	249,031	865,081	109,384	109,242	142	65	137,468	66	2,048	2,088
6.1	January 2012	100	217	1,114,112	249,763	864,349	110,116	109,975	141	65	137,468	66	2,048	732
6.2	September 2012	100	217	1,114,112	249,764	864,348	110,117	109,976	141	65	137,468	66	2,048	1
6.3	September 2013	100	217	1,114,112	249,769	864,343	110,122	109,975	147	65	137,468	66	2,048	5
7.0	June 2014	123	249	1,114,112	252,603	861,509	112,956	112,804	152	65	137,468	66	2,048	2,834
8.0	June 2015	129	259	1,114,112	260,319	853,793	120,672	120,520	152	65	137,468	66	2,048	7,716
9.0	June 2016	135	270	1,114,112	267,819	846,293	128,172	128,019	153	65	137,468	66	2,048	7,500
10.0	June 2017	139	277	1,114,112	276,337	837,775	136,690	136,537	153	65	137,468	66	2,048	8,518
11.0	June 2018	146	288	1,114,112	277,021	837,091	137,374	137,220	154	65	137,468	66	2,048	684

[DataMystic Support]

There are two Unicode components in TextPipe - the pattern matching engine is quite current, but the individual transforms (NKF etc) are much older.

- Simon

[DFH]

How does this affect your development road-map?

David

[DataMystic Support]

We've made a request for the open source component to be updated
http://issuetracker.delphi-jedi.org/view.php?id=6679

In the meantime, we are switching the regex component to a more recent offering and seeing which other Unicode functions are available that we can leverage.

[DFH]

Am I right in thinking that this improvement didn't make it to TextPipe v10.8 ?

David

[DataMystic Support]

Correct - this is not ready for release yet.

[DFH]

You know that Unicode 12.1 was released in May 2019, Simon?

Code: Select all

Version	Date	Scripts	Blocks	Total Code Points	Assigned Code Points	Unassigned Code Points	Named Characters	Graphic Characters	Format Characters	Control Characters	Private Use Characters	Noncharacters	Surrogate Code Points	Characters Added
1.0.0	October 1991	24	57	65,536	12,795	52,741	7,129	7,085	44	32	5,632	2	0	7,161
1.0.1	June 1992	25	59	65,536	34,505	31,031	28,327	28,283	44	32	6,144	2	0	21,204
1.1	June 1993	24	63	65,536	40,635	24,901	34,168	34,151	17	65	6,400	2	0	5,963
2.0	July 1996	25	67	1,114,112	178,500	935,612	38,885	38,867	18	65	137,468	34	2,048	11,373
2.1	May 1998	25	67	1,114,112	178,502	935,610	38,887	38,869	18	65	137,468	34	2,048	2
3.0	September 1999	38	86	1,114,112	188,809	925,303	49,194	49,168	26	65	137,468	34	2,048	10,307
3.1	March 2001	41	95	1,114,112	233,787	880,325	94,140	94,009	131	65	137,468	66	2,048	44,946
3.2	March 2002	45	107	1,114,112	234,803	879,309	95,156	95,023	133	65	137,468	66	2,048	1,016
4.0	April 2003	52	122	1,114,112	236,029	878,083	96,382	96,243	139	65	137,468	66	2,048	1,226
4.1	March 2005	59	142	1,114,112	237,302	876,810	97,655	97,515	140	65	137,468	66	2,048	1,273
5.0	July 2006	64	151	1,114,112	238,671	875,441	99,024	98,884	140	65	137,468	66	2,048	1,369
5.1	April 2008	75	168	1,114,112	240,295	873,817	100,648	100,507	141	65	137,468	66	2,048	1,624
5.2	October 2009	90	194	1,114,112	246,943	867,169	107,296	107,154	142	65	137,468	66	2,048	6,648
6.0	October 2010	93	206	1,114,112	249,031	865,081	109,384	109,242	142	65	137,468	66	2,048	2,088
6.1	January 2012	100	217	1,114,112	249,763	864,349	110,116	109,975	141	65	137,468	66	2,048	732
6.2	September 2012	100	217	1,114,112	249,764	864,348	110,117	109,976	141	65	137,468	66	2,048	1
6.3	September 2013	100	217	1,114,112	249,769	864,343	110,122	109,975	147	65	137,468	66	2,048	5
7.0	June 2014	123	249	1,114,112	252,603	861,509	112,956	112,804	152	65	137,468	66	2,048	2,834
8.0	June 2015	129	259	1,114,112	260,319	853,793	120,672	120,520	152	65	137,468	66	2,048	7,716
9.0	June 2016	135	270	1,114,112	267,819	846,293	128,172	128,019	153	65	137,468	66	2,048	7,500
10.0	June 2017	139	277	1,114,112	276,337	837,775	136,690	136,537	153	65	137,468	66	2,048	8,518
11.0	June 2018	146	288	1,114,112	277,021	837,091	137,374	137,220	154	65	137,468	66	2,048	684
12.0	March 2019	150	297	1,114,112	277,575	836,537	137,928	137,765	163	65	137,468	66	2,048	554
12.1	May 2019	150	297	1,114,112	277,576	836,536	137,929	137,766	163	65	137,468	66	2,048	1

The above table was pasted from BabelPad Tools | Unicode Versions.
Some column misalignment due to the phpBB tab settings.

David

[DataMystic Support]

Yes, the next release has an upgrade to Unicode 11, but I think we can push it to Unicode 12.1 easily.

[DFH]

Good to read that.

David

[DFH]

The New features in this release for v11 includes:

• Upgraded Unicode support to Unicode 12.1.

PS. Please fix the format for the New features in this release help page.
It seems to have been generated using a Fixed Width Font - pre-formatted as if it were embedded code.
Nearby pages in the Help Contents are better examples of the expected format.

David