Search found 2290 matches

by DataMystic Support
Wed Mar 20, 2019 8:08 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide filter Remove all diacritics
Replies: 5
Views: 738

Re: Suggestion: Provide filter Remove all diacritics

What about this: https://en.wikipedia.org/wiki/Perl_Compatible_Regular_Expressions Unicode character properties Unicode defines several properties for each character. Patterns in PCRE can match these properties. e.g. \p{Ps}.*?\p{Pe} would match a string beginning with any "opening punctuation" and e...
by DataMystic Support
Wed Mar 20, 2019 8:05 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Maintaining and sharing TextPipe filters in the world of Git ?
Replies: 4
Views: 527

Re: Maintaining and sharing TextPipe filters in the world of Git ?

Making it Windows-native, and work smoothly. The current Delphi control we use is very buggy and has required lots of kludgy workarounds
by DataMystic Support
Thu Mar 14, 2019 1:29 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Maintaining and sharing TextPipe filters in the world of Git ?
Replies: 4
Views: 527

Re: Maintaining and sharing TextPipe filters in the world of Git ?

Thanks David,

I like the idea, and also the collaboration that this could bring to bear.

XML is still not on the table yet, but we are definitely making moves to uplift the TextPipe ribbon UI, various copybook extensions and a range of other features. XML is still on the list.

Regards,

Simon
by DataMystic Support
Thu Mar 14, 2019 1:27 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide filter Remove all diacritics
Replies: 5
Views: 738

Re: Suggestion: Provide filter Remove all diacritics

Hi David,

If you're happy to provide the PCRE pattern to do so, we're happy to bundle this with TextPipe.

Regards,

Simon
by DataMystic Support
Thu Mar 14, 2019 1:17 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Validating large ~600GB CSV against schema?
Replies: 2
Views: 232

Re: Validating large ~600GB CSV against schema?

Hi there, One approach you could use with REDSHIFT import is to REMOVE lines that do not have 850 fields in them, then treat these exceptions differently. The file size of 600GB is not an issue for TextPipe. Use Filter Library\Extract\Extract lines not matching (inverse grep) With an EasyPattern of:...
by DataMystic Support
Tue Mar 05, 2019 7:19 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Extract email addresses
Replies: 2
Views: 514

Re: Extract email addresses

Hi David,

Yes - this is updated ready for 10.8.

Note - every email service supports this, not just gmail.

Regards,

Simon
by DataMystic Support
Tue Feb 12, 2019 5:53 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Unicode normalize filters?
Replies: 20
Views: 6689

Re: Unicode normalize filters?

Hi David - this thread is closed as the issue appears to be resolved. If you have any issues please report them.
by DataMystic Support
Wed Jan 16, 2019 9:58 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Software bug: Convert HTML/XML Entities to Text
Replies: 6
Views: 905

Re: Software bug: Convert HTML/XML Entities to Text

Thanks David - the help and the filter are fixed for TextPipe 10.8 and the encodings have been updated for the latest unicode.
by DataMystic Support
Tue Jan 15, 2019 8:08 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Software bug: Generate output files only if a change occurs
Replies: 6
Views: 742

Re: Software bug: Generate output files only if a change occurs

Thanks David,

Can you please try and isolate the problem to one of the perl pattern matches, or the replace list? Alternatively, can you please send me a test data file? I will first turn on Prompt On Replace to see if anything triggers.
by DataMystic Support
Wed Jan 09, 2019 7:02 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Software bug: Generate output files only if a change occurs
Replies: 6
Views: 742

Re: Software bug: Generate output files only if a change occurs

Hi David - please send through your actual filter. If the process is not 1:1 input files to output files then this has no way to honor the request.
by DataMystic Support
Mon Dec 24, 2018 7:04 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Using a configured Diff Tool to apply a patch?
Replies: 2
Views: 635

Re: Using a configured Diff Tool to apply a patch?

Hi David - interesting - how do you think this would work?

Add the file to be patched to the file list, and supply the patching text to a new filter?

Which diff tools do you have in mind to support this?
by DataMystic Support
Mon Dec 24, 2018 7:01 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Strange bug in the Replace filter
Replies: 2
Views: 660

Re: Strange bug in the Replace filter

Hi David - I have tried this here with no issues (10.7.2). Can you please email me the filter and test file?
by DataMystic Support
Sat Sep 01, 2018 4:11 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Flush FIELD CONTENTS from one record to next
Replies: 4
Views: 5161

Re: Flush FIELD CONTENTS from one record to next

So you're capturing values to a variable. Are you using the Capture filter, which allows you to clear values at the end of file or end of section?