Search found 2196 matches

by DataMystic Support
Mon May 06, 2019 1:41 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Some external replace list files no longer work when the search type is Perl
Replies: 9
Views: 6963

Re: Some external replace list files no longer work when the search type is Perl

I suspect that the issue here is that the external files are now parsed for macros.

Given that the file is being loaded, there is an argument that it should not be parsed as this could be done by another process.
by DataMystic Support
Mon May 06, 2019 1:36 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Errors in log lines
Replies: 4
Views: 5903

Re: Errors in log lines

When included inside a restriction, the Add line number log line only reports on the details of the last invocation.

Similarly to the Add right margin filter when inside a restriction.

Possibly this could be changed so that each invocation of a restriction could log the activity of its subfilters.
by DataMystic Support
Mon May 06, 2019 1:28 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Software bug: Generate output files only if a change occurs
Replies: 8
Views: 5805

Re: Software bug: Generate output files only if a change occurs

Hi David,

We've found and fixed this error.

It was caused by the comments filter not correctly indicating that it did not cause a change. This error only appears when you have comment filters added to the log list under Filter Options.
by DataMystic Support
Mon May 06, 2019 1:02 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Help for this filter - some go to wrong page
Replies: 1
Views: 1964

Re: Help for this filter - some go to wrong page

Thanks, this review has been completed and about 7 changes made
by DataMystic Support
Mon May 06, 2019 10:51 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Subtle bug in Convert Numeric HTML/XML Entities to text
Replies: 7
Views: 4760

Re: Subtle bug in Convert Numeric HTML/XML Entities to text

Hi David - can you please send the original file and the TextPipe filter? The filter is a simple byte-by-byte state machine, expecting &#<decimal digits>; or &#x<hex digits>; or It handles 2-byte unicode characters properly. I don't understand why *any* changes are being made to your file as the non...
by DataMystic Support
Mon May 06, 2019 10:38 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Unicode 11.0
Replies: 12
Views: 9140

Re: Unicode 11.0

Latest Unicode version is 5.2.1.

I have asked the Component owner if this can be rectified.

Simon
by DataMystic Support
Wed Mar 20, 2019 8:08 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide filter Remove all diacritics
Replies: 21
Views: 9612

Re: Suggestion: Provide filter Remove all diacritics

What about this: https://en.wikipedia.org/wiki/Perl_Compatible_Regular_Expressions Unicode character properties Unicode defines several properties for each character. Patterns in PCRE can match these properties. e.g. \p{Ps}.*?\p{Pe} would match a string beginning with any "opening punctuation" and e...
by DataMystic Support
Wed Mar 20, 2019 8:05 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Maintaining and sharing TextPipe filters in the world of Git ?
Replies: 6
Views: 5516

Re: Maintaining and sharing TextPipe filters in the world of Git ?

Making it Windows-native, and work smoothly. The current Delphi control we use is very buggy and has required lots of kludgy workarounds
by DataMystic Support
Thu Mar 14, 2019 1:29 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Maintaining and sharing TextPipe filters in the world of Git ?
Replies: 6
Views: 5516

Re: Maintaining and sharing TextPipe filters in the world of Git ?

Thanks David,

I like the idea, and also the collaboration that this could bring to bear.

XML is still not on the table yet, but we are definitely making moves to uplift the TextPipe ribbon UI, various copybook extensions and a range of other features. XML is still on the list.

Regards,

Simon
by DataMystic Support
Thu Mar 14, 2019 1:27 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide filter Remove all diacritics
Replies: 21
Views: 9612

Re: Suggestion: Provide filter Remove all diacritics

Hi David,

If you're happy to provide the PCRE pattern to do so, we're happy to bundle this with TextPipe.

Regards,

Simon
by DataMystic Support
Thu Mar 14, 2019 1:17 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Validating large ~600GB CSV against schema?
Replies: 2
Views: 2013

Re: Validating large ~600GB CSV against schema?

Hi there, One approach you could use with REDSHIFT import is to REMOVE lines that do not have 850 fields in them, then treat these exceptions differently. The file size of 600GB is not an issue for TextPipe. Use Filter Library\Extract\Extract lines not matching (inverse grep) With an EasyPattern of:...