Search found 2235 matches

by DataMystic Support
Fri Jun 11, 2021 2:29 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Conditional Subpatterns
Replies: 1
Views: 56

Re: Conditional Subpatterns

Hi there,

How large is the XML content? You can use an EasyPattern like this:

Code: Select all

[ 0+ chars,
'value1' or 'value2' or 'value3',
longest 0+ chars ]
And set the replace with to

Code: Select all

$0
You can then add subfilters which trigger only when the match occurs.
by DataMystic Support
Wed Apr 21, 2021 8:55 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: TextPipe 11.8 released
Replies: 1
Views: 2415

TextPipe 11.8 released

TextPipe is a market leading self-service data preparation solution for data extraction. Extract, transform and load (ETL) data from anywhere - giving super powers to your data-wranglers such as ETL developers, programmers, data scientists and data analytics professionals. Connect to multiple data s...
by DataMystic Support
Thu Apr 01, 2021 7:35 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Scanning a line for a code - then using that code to update the related line.
Replies: 2
Views: 1432

Re: Scanning a line for a code - then using that code to update the related line.

Hi there, TextPipe isn't designed to solve the problem this way. In principle, consider that TextPipe processes your entire file with the first filter, before passing it into the next filter. So the cause-effect you're after here will only work for the last occurrence. Also, regex matches are built ...
by DataMystic Support
Thu Apr 01, 2021 7:29 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Support case conversion for all Unicode bicameral scripts
Replies: 2
Views: 1305

Re: Support case conversion for all Unicode bicameral scripts

Thanks David, I suspect we will have to redo these using UTF-8 as the input
by DataMystic Support
Wed Feb 17, 2021 9:29 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Adding a header to a single file output (join all input files together) ?
Replies: 2
Views: 1711

Re: Adding a header to a single file output (join all input files together) ?

Hi David,

This can be easily achieved by putting the Add file header filter AFTER a merge filter.
by DataMystic Support
Wed Jan 13, 2021 11:03 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide Unicode to Perl Escape Codes filter
Replies: 10
Views: 5776

Re: Suggestion: Provide Unicode to Perl Escape Codes filter

Does PCRE need to care if a character is two bytes or not? Can't it just match the sequence? Isn't it an "all or nothing" literal comparison?
by DataMystic Support
Sat Jan 09, 2021 7:32 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide Unicode to Perl Escape Codes filter
Replies: 10
Views: 5776

Re: Suggestion: Provide Unicode to Perl Escape Codes filter

I am not suggested everything gets squished to 2 bytes.

Please see sample filter attached.
convert each line to Perl Escape Codes.zip
(1.01 KiB) Downloaded 254 times
by DataMystic Support
Wed Jan 06, 2021 7:14 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide Unicode to Perl Escape Codes filter
Replies: 10
Views: 5776

Re: Suggestion: Provide Unicode to Perl Escape Codes filter

Let's take Unicode to UTF-8 Byte Codes. If we assume the Unicode is in UTF-8 form already (if not, just use a filter to convert it), then all you need to do is 1. Restrict to the text (a line or column) 2. Hex dump 3. Use a pattern match to match 2 hex characters at a time, and add \x{ } around it. ...
by DataMystic Support
Tue Jan 05, 2021 2:49 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide Unicode to Perl Escape Codes filter
Replies: 10
Views: 5776

Re: Suggestion: Provide Unicode to Perl Escape Codes filter

Hi David, Can't this already be done? Just use a restriction to match each line in turn, or the replace column: For the Unicode to Perl Escape Codes 1. Hex dump 2. Add left margin of \x{ 3. Add right margin of } For the Unicode to UTF-8 Byte Codes 1. Hex dump 2. Search for 2 hex bytes, and add a \x ...
by DataMystic Support
Tue Jan 05, 2021 2:45 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Software bug: Convert HTML/XML Entities to Text
Replies: 15
Views: 13315

Re: Software bug: Convert HTML/XML Entities to Text

You're welcome David - and Happy New Year too!
by DataMystic Support
Mon Dec 28, 2020 6:43 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide Unicode to Perl Escape Codes filter
Replies: 10
Views: 5776

Re: Suggestion: Provide Unicode to Perl Escape Codes filter

Hi David, this sounds like a filter list that could be prepared, rather than an internal filter.

If you design one we're happy to include it in the TextPipe distribution.