Search found 2234 matches

by DataMystic Support
Wed Apr 21, 2021 8:55 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: TextPipe 11.8 released
Replies: 1
Views: 1596

TextPipe 11.8 released

TextPipe is a market leading self-service data preparation solution for data extraction. Extract, transform and load (ETL) data from anywhere - giving super powers to your data-wranglers such as ETL developers, programmers, data scientists and data analytics professionals. Connect to multiple data s...
by DataMystic Support
Thu Apr 01, 2021 7:35 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Scanning a line for a code - then using that code to update the related line.
Replies: 2
Views: 1052

Re: Scanning a line for a code - then using that code to update the related line.

Hi there, TextPipe isn't designed to solve the problem this way. In principle, consider that TextPipe processes your entire file with the first filter, before passing it into the next filter. So the cause-effect you're after here will only work for the last occurrence. Also, regex matches are built ...
by DataMystic Support
Thu Apr 01, 2021 7:29 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Support case conversion for all Unicode bicameral scripts
Replies: 2
Views: 936

Re: Support case conversion for all Unicode bicameral scripts

Thanks David, I suspect we will have to redo these using UTF-8 as the input
by DataMystic Support
Wed Feb 17, 2021 9:29 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Adding a header to a single file output (join all input files together) ?
Replies: 2
Views: 1363

Re: Adding a header to a single file output (join all input files together) ?

Hi David,

This can be easily achieved by putting the Add file header filter AFTER a merge filter.
by DataMystic Support
Wed Jan 13, 2021 11:03 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide Unicode to Perl Escape Codes filter
Replies: 10
Views: 5214

Re: Suggestion: Provide Unicode to Perl Escape Codes filter

Does PCRE need to care if a character is two bytes or not? Can't it just match the sequence? Isn't it an "all or nothing" literal comparison?
by DataMystic Support
Sat Jan 09, 2021 7:32 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide Unicode to Perl Escape Codes filter
Replies: 10
Views: 5214

Re: Suggestion: Provide Unicode to Perl Escape Codes filter

I am not suggested everything gets squished to 2 bytes.

Please see sample filter attached.
convert each line to Perl Escape Codes.zip
(1.01 KiB) Downloaded 226 times
by DataMystic Support
Wed Jan 06, 2021 7:14 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide Unicode to Perl Escape Codes filter
Replies: 10
Views: 5214

Re: Suggestion: Provide Unicode to Perl Escape Codes filter

Let's take Unicode to UTF-8 Byte Codes. If we assume the Unicode is in UTF-8 form already (if not, just use a filter to convert it), then all you need to do is 1. Restrict to the text (a line or column) 2. Hex dump 3. Use a pattern match to match 2 hex characters at a time, and add \x{ } around it. ...
by DataMystic Support
Tue Jan 05, 2021 2:49 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide Unicode to Perl Escape Codes filter
Replies: 10
Views: 5214

Re: Suggestion: Provide Unicode to Perl Escape Codes filter

Hi David, Can't this already be done? Just use a restriction to match each line in turn, or the replace column: For the Unicode to Perl Escape Codes 1. Hex dump 2. Add left margin of \x{ 3. Add right margin of } For the Unicode to UTF-8 Byte Codes 1. Hex dump 2. Search for 2 hex bytes, and add a \x ...
by DataMystic Support
Tue Jan 05, 2021 2:45 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Software bug: Convert HTML/XML Entities to Text
Replies: 15
Views: 12474

Re: Software bug: Convert HTML/XML Entities to Text

You're welcome David - and Happy New Year too!
by DataMystic Support
Mon Dec 28, 2020 6:43 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Suggestion: Provide Unicode to Perl Escape Codes filter
Replies: 10
Views: 5214

Re: Suggestion: Provide Unicode to Perl Escape Codes filter

Hi David, this sounds like a filter list that could be prepared, rather than an internal filter.

If you design one we're happy to include it in the TextPipe distribution.
by DataMystic Support
Mon Dec 28, 2020 6:40 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Software bug: Convert HTML/XML Entities to Text
Replies: 15
Views: 12474

Re: Software bug: Convert HTML/XML Entities to Text

The help notes refer to:

- Updated "Convert HTML/XML Entities to Text" to fully support HTML5, with
~2200 entities now supported.