What's New in v7.7 ================== * Added new option 'Don't Reset at end of file' to Line Numbering filter. * Added new option 'Include counts of 1' to Count Duplicate Lines filter. * Improved mainframe copybook filter by - discarding line numbers from pasted copybooks - now handles null packed and zoned numeric fields - now outputs invalid digits in packed or zoned numerics as their hex equivalents - now adds filters to trim leading and trailing space from fields, and leading '+' signs from numerics - can now choose output format between Fixed, CSV, Tab- and Pipe-delimited - now can add leading zeroes to numeric fields where the implied position is greater than the field width - output format now includes a record header, which makes it far easier to validate the output file and import the file into a database - new filters for unpacking odd/even-length unsigned packed numerics, and for decoding overlapped unsigned packed numerics - delimiters are removed from the input file first to prevent extra fields being created. * Massively improved sort performance. * New filter to convert Excel spreadsheets to CSV format. * New preference to display the 'Scratch Pad' tab of the filter window. * New filter Restrict to Filenames Matching Perl Pattern. Use this to control which filters get applied to which files, based on the filename, folder, type etc, using the power of pattern matching. * New Output Filter option to open the output file on completion. * New Execute Program Filter option to not remove the output files -this allows them to easily be reviewed when debugging. * New function for Web-based Filter Wizard-Extract text between delimiters. * Changed the date and time macros for consistent results across different localities - @time - Inserts the time in the format HHMMSS @date - Inserts the date in the format YYYYMMDD @datetime - Inserts the date and time in the format YYYYMMDDHHMMSS * When the right-click menu 'Save' option is selected, TextPipe now saves the text exactly as is without interpreting special characters. * Search/replace filter now can accept pasted Unix text. * Unicode and code page conversions can now set the error character output when there is no appropriate character in the target encoding. * Added EasyPatterns for [dayname], [daynumber], and a function [ascii()] or [asc()] which can be used to insert arbitrary ASCII codes in either hex (eg $ff) or decimal (e.g. 255) format. EasyPatterns now can accept counts and quantities in either hex or decimal format. * Now shows the filenames in the Status Dialog with a clickable link. * TextPipe now prompts if you try and exit while a thread is running. * When a list of perl patterns is loaded or used, TextPipe now shows the line number of any error when a pattern parsing error occurs. * The grep form's context menu now displays EasyPatterns or perl patterns according to the pattern type selection. * New /Q=millisecond option to control how long TextPipe pauses before exiting. * The Options panel of the filter tree now scrolls to display buttons that are not visible. * Better handling of files that are missing or open in another process. * Fixed Range Check error with optimization of 1:1 maps. * Fixed merge sorting - duplicates were not being removed. * Fixed Single File Output - didn't force creation of folders for output file. * Fixed Windows Explorer shell extension - was starting the filter one row down from the correct one. * Fixed bug where Extract URLs filter would miss a URL on the very last line. * Fixed merge sorting bug (only for very large files) where processing never ended. What's New in v7.6.3 ==================== * New macro @fullOutputFilename. May be blank if the clipboard is being processed. * Fixed deadlock between threads that was slowing down the processing when the TextPipe.Application object was called from code. * Fixed Windows Explorer Content Menu not appearing. What's New in v7.6.2 ==================== * Fixed bug with grep filters where Match Case option was not recognised. * Standardized help text and labels for grep filters. * Fixed bug with conversions between ANSI and ASCII. * Fixed bug with delimited field parser when it encountered a ' or " in the middle of the field. * Fixed bug with clipboard button not being acted on correctly. What's New in v7.6.1 ==================== * New filters to Restrict to ANSI files, and Restrict to Unicode UTF16 files and Unicode UTF32 files. These are exceptionally handy for only converting ANSI files to Unicode, or only converting Unicode files to ANSI. * New filter to convert PDF documents to text format. * Menu re-organization: Email menu replaced by new Extract menu, encodings moved to Convert menu. 'Retain...' items renamed to 'Extract...'. * New macros @randomdigit and @randomletter - very useful for generating test data or for generating random sort keys. * New Explorer extension option to Analyse files - detect if they are Unicode, ANSI, etc. * Reverse File performance improvement. What's New in v7.6 ================== * New Unicode filters for Upper case, Lower case and Title case. * Speed improvements for handling very large files. * New Expand All/Collapse All menu on All Filters view. * New scripting function to build filters to convert a Mainframe Copybook. Copybook wizard now inserts a warning for each unidentified field, making incorrect fields easy to identify. * New warning message if no files were found to process. * Filters\Convert\Numeric HTML entities To Text filter now converts output characters to UTF-8. The resulting text can then be converted from UTF-8 to UTF-16 for display. * Menu items for common grep and conversion filters in the Wizard menu. Wizard menu now is always expanded. * Memo and text fields now use the fixed width font. * Unicode and code page conversions now do not load the entire file into memory, they convert the file progressively. * Updated Simplified Chinese translation. * Help text added to the Unicode/Code page conversion filter. * Moved Hex and HTTP encode/decode to the Convert menu. * Fixed pasting of text into a memo's Find window. What's New in v7.5.1 ==================== * Drag and drop now prevents nodes being dropped on filters that do not support subfilters. * Unicode replacement now reverses the order of Match Case to be correct. * Reverted help system to old style. What's New in v7.5 ================== * New Restrict to lines from list/lines NOT from list and Restrict to lines matching pattern list/lines NOT matching pattern list. New Match Case option for these filters too. * EasyPatterns for Month and MonthName now do not automatically capture. * Mainframe Copybook Wizard now copes with OCCURS where the number of repetitions is fixed. * New filter to convert numeric HTML entities to text e.g. · . New maps to convert text to decimal or hex HTML entities. * /CLEARFILTERS now removes all filters except the Log, Input and Output filters. This retains the default settings from normal.fll * /EXTENSION can now be set to blank to disable changing the extension. * Fixed Access Violation processing empty result sets. * Fixed load file list function. What's New in v7.4.3 ==================== * Now shows all available filters in a separate tree - these can be drag and dropped or double-clicked to move them into the filter tree. * Fix to Mainframe copybook filter to allow it to recognise field names that included digits followed by ' A'. What's New in v7.4.2 ==================== * Fixed bug with Unicode exact match and Unicode pattern match where extra characters were being output. What's New in v7.4.1 ==================== * Fixed bug with Unicode exact match and Unicode pattern match where search terms were not found. What's New in v7.4 ================== * Mainframe copybook wizard is now more flexible in the data it matches, and handles COMP-3 field types, and handles numeric fields with purely decimals (eg V999). * New filters for code page conversion. * New filters for Unicode Compose and Decompose: NFC - Canonical Decomposition, followed by Canonical Composition NFD - Canonical Decomposition NFKD - Compatibility Decomposition NFKC - Compatibility Decomposition followed by Canonical Composition And Canonical Compose. * Now supports Unicode command line parameters. * Now supports single quoted CSV data, quoted tab data, and backslashes in quoted CSV or Tab data. Existing text delimiters are now preserved on conversion between CSV and Tab formats. The EasyPattern [tabfield] can now match quoted tab data. * The Restrict to HTML filter can now set the maximum match size - to match very large sections of HTML or XML. * Clarified examples in perl pattern right-click menus. * Speed optimization for interactive search/replace when [Replace Job] chosen. * When files are dropped, TextPipe defaults files to 'no subfolders'. * Simplified the Trial Run button - now it only performs a trial run, and does not toggle back to the Filters to Apply tab. * XSLT filter now correctly flags modified text - so output files get created when the 'Only Output Modified Files' flag is set. XSLT filter now reports the error code and error reason to the log if an error occurs. * Run External Program filter now reports in the log if the external program has a non-zero exit code. The output file handle is now released on error. * The Unicode Map filter's 'Replace With Value' string now supports special characters. * Encode Hex filter now does not add line feeds. * Right-click option Show Hex Dump now checks if the underlying field is Unicode or not before displaying data. A toggle between UTF16-LE and UTF16-BE is also available. * Reduced memory requirements of Database filter when SELECTing data sets. * Fixed database filter's handling of VarBinary (BLOB) data. * Database filter now handles subfilters correctly for encoding VarBinary data. * Fixed bug when referencing a CSV or Tab search/replace list where the replacement text was missing. A new error message now provides the line number of any errors. * Fixed bug with inserting captured text as an HTML table row, and added the ability to insert as an XML record. * Fixed bug with HTML help crashing TextPipe on exit. * Fixed bug with Input Filter, Prompt On Binary files setting, if 'No To All' was chosen TextPipe skipped ALL remaining files, not just binary files. * Fixed Unicode display of extended information in the Prompt on Replace dialog. Note: Unicode patterns do not support capturing- only $0 works. * Fixed Map filter not detecting Reset and Clear changes. * Fixed help file opening twice when F1 pressed. * Fixed mismatch of 16 and 32-bit Unicode strings when converting from ANSI or ASCII/OEM to Unicode and between code pages. What's New in v7.3.1 ==================== * Restored registry settings required by Offline Explorer. * Changed default for re-loading previous filter to Off. * Better exception handling for XSLT filter. What's New in v7.3 ================== * New Mainframe Copybook wizard makes it incredibly easy to build a filter to process mainframe data. Handles packed, zoned, binary and display field types. * New filters to Expand Binary Number To ASCII and Expand Binary Number To EBCDIC. * Global dialogs now make use of popup menus to insert special characters etc. What's New in v7.2.1 ==================== * New filter to capture text to a global variable. This is much faster than using the Script filter to capture and then output text - which is the most common use of the Script filter. * New grid component for the Map filter - now supports far better range and mouse selection. * New option to automatically reopen the last filter. * The Replace Query dialog now has an extra tab to show a hex dump of the found text. This can be useful for debugging. What's New in v7.2 ================== * Right-click menu for Replace field now provides easy insertion of captured data as Tab or CSV-delimited fields or HTML. * The Prompt On Replace dialog now displays the length of each captured expression. * EasyPatterns 1.9.1 - added [PipeField] and [Pipe] keywords. * Fixed error when manually choosing the Skip option to not replace text in a DBCS file - more than one character was added. Only occurs under DBCS versions of Windows (eg Chinese). * New error message when there are too many capturing expressions in a pattern. * Fixed bug with 'First row is header row' not being recognised for processing delimited data with embedded carriage returns. What's New in v7.1.7 ==================== * Added short cut menu items for converting between Unicode/ANSI and Unicode/ASCII. * Added line number and offset properties to the TextPipe object available in the scripting filter. * Map filters now have a comment property to describe what they are doing. * EasyPatterns 1.9 - added keywords for [number, numbers, leftAngle, rightAngle, lessThan, greaterThan ] * Fixed restriction filters not supporting Secondary Output filters properly. * Fixed exact match filter not properly supporting Extract option, and not correctly handling text when 'Skip' was chosen. What's New in v7.1.6 ==================== * Search/replace lists now detect inserts, deletes and moves as changes. The order of moved rows is now retained. * Fixed restriction filters not supporting Secondary Output filters properly. * Fixed EP keywords for [CRLF], [DOSNewLine], [EmailAddress] and [Hyperlink] * Fixed width font for Trial Run Input/Output is now correctly loaded. What's New in v7.1.5 ==================== * EasyPatterns now allow repetition to be specified using the forms [2..3 ...] and [2-3 ...] in addition to [2 to 3 ...]. * Right-click menu item Escape Special Characters now works for EasyPattern fields. * Fixed format string error on filter export. * Fixed Search/Replace list -caused an error when it was opened. * Fixed Remove Byte Order Mark (BOM) filter when handling UTF-8 files. What's New in v7.1.4 ==================== * Added right-click menu to EasyPattern fields to make designing patterns easier. * Added Line, Column and Length indicators to Search/replace filter. * A warning is now shown for trailing whitespace in the search text, which often results in the text not being found. * Added 5 second countdown before TextPipe exits due to /Q command line parameter. * Greatly improved performance for massive numbers of files- TextPipe no longer checks for duplicate filenames. * Fixed EasyPattern for [month,monthnumber,day,hour] so that they match the long version of the pattern first, then try the shorter variations. * Fixed range check errors with Compress packed/zoned decimal filters. What's New in v7.1.3 ==================== * Fixed EasyPattern for [word] - previously matched non-word characters. * Fixed EasyPattern - '.' was not escaped - now fixed. * The Prompt On Replace dialog now shows the perl equivalent to an EasyPattern, for verification purposes. What's New in v7.1.2 ==================== * Fixed access violation with changes to the Restrict to Bytes filter. What's New in v7.1.1 ==================== * Improved Restrict to Bytes (Byte x to End-y) to handle unlimited amounts of data What's New in v7.1 ================== * You can now set the field delimiter for the Restrict To Fields, Copy Fields, Move Fields and Delete Fields filters. This opens the way for semi-colon- delimited, #-delimited, !-delimited, ^-delimited and other bizarre data formats. * Added two new filters for compressing mainframe EBCDIC data to Packed Decimal and Zoned Decimal formats. * The Split filter can now set the first filename number. * Added new Insert Bytes filter to complement the Insert Columns filter. This new filter disregards line feeds when it adds text, and is very useful for inserting commas into EBCDIC text as the text is converted. * New documentation links in the Filter Menus. * Synchronized scrolling is now properly restored when a filter is loaded. * EasyPattern fixes to align with the EasyPattern documentation - [symbol, symbols] - removed the '!' - [space, spaces] changed to just matched ASCII 32, not tabs, line feeds etc - [horizontalwhitespace, hspace] - now only match space and tab - [verticalwhitespace, vspace, worddelimiter, linedelimiter, paragraphdelimiter] - now match formfeed - [anybracket, anybrackets] - now match { and } * EasyPatterns now will NOT attempt to combine OR'd negated and non-negated character sets, such as [ not lineChar or 'a' ] * HTML filter now matches tags when the tag name is immediately followed by a tab or newline, not just a space. What's New in v7.0.8 ==================== * Fixed EasyPattern handling of vertical tab (\v), which affects the keywords verticaltab, verticalwhitespace, vspace, worddelimiter, wordchar, columndelimiter, columnchar, linedelimiter, linechar, whitespace, word, line, and column. This problem still exists in the perl pattern library, and can be worked around by using \x0b instead of \v. What's New in v7.0.7 ==================== * Expand Zoned Decimal and Expand Packed Decimal filters are no longer added inside a Restriction filter. * Changed EasyPatterns for EmailAddress, HyperLink, PageNumber and DayOfYear so that the constituent parts are captured into $variables for later substitution. * Fixed EasyPattern for FormFeed. * Fixed handling of EBCDIC negative zoned decimals. What's New in v7.0.6 ==================== * Fixed bug with parsing of text with \x{...} characters. What's New in v7.0.5 ==================== * Fixed shell context items - the last item did not work. Also fixed the path for the Split File filter. * Fixed bug with Rolling back .BAK files - if the Only Output Modified Files option was on, it would delete original files. What's New in v7.0.4 ==================== * Unicode conversion filter was only outputting the Byte Order Mark for the first file. What's New in v7.0.3 ==================== * Added swap button to Unicode conversion filter. * Fixed Unicode conversion filter bug. What's New in v7.0.2 ==================== * Fixed Backup Mode behaviour when the .bak file already existed (now it is deleted). What's New in v7.0.1 ==================== * Fixed Hex Dump option for Edit Fields and File Grid. What's New in v7.0 ================== * New Unicode (UTF-16LE) search and replace, with options for space compression and for ignoring non-spacing characters. * New Unicode (UTF-16LE) pattern matching. * Unicode conversion filter is now much simpler, as you just choose an input and output format in one step. * New XSLT filter for manipulating XML. * New file grid right-click menu items: - Analyze file - checks for various Unicode, XML, CSV and Tab delimited formats, Unix/PC/Mac end of line format and other file types - Hex dump - displays a hex dump of the first 200 characters of the file * Added \x{...} Unicode character matching for exact matches. This means that for a Unicode space you can type \x00000020 instead of \x00\x00\x00\x20. * Synchronized scrolling option for Trial Input and Output. * You can now control if the Trial Input and/or Output are treated as Unicode. * Optimized single byte maps for the special case of one output character for every input character. * Better help contexts for the 9 different search/replace types. What's New in v6.9 ================== * Removed restriction on pattern recursion depth - this was causing Stack Overflow errors for legitimate expressions. * Fixed file grid ordering - if you moved rows around, TextPipe did not remember the new row position. * Fixed menu items for Remove, Copy and Move tab fields. These did not add the required filters. * Fixed help hyperlinks on Trial Run and Files tabs. * Fixed bugs in Unicode Make Little/Big Endian filters. * Fixed bug in Convert From Unicode filter, for when it encountered a character that could not be converted. It now outputs a space. * The EasyPattern [year] keyword now checks for a 4 digit year before checking for a 2 digit year. * Convert Word Document To Text filter now only closes the Active Document, avoiding the MS Word error message 'This method or property is unavailable because a document window is not active'. * Fixed line wrapping problem with the clipboard export text of several restrict-type filters. * Increased maximum stack size to cope with increased size of Unicode filters (and avoid Stack Overflows). * Fixed database filter not quoting char or date/time data fields. What's New in v6.8.3 ==================== * New filters for handling pipe-delimited files: Remove pipe fields Restrict to pipe fields Copy pipe fields Move pipe fields * Added EasyPattern keywords for slash, colon, hash, pound, percent, star, asterisk and ampersand. EasyPatterns now generate much better perl regexps. * EasyPatterns can now set the maximum expected match size - this allows them to match text larger than the default of 4K. * Increased processing speed for Trial Runs and Clipboard output. * Restrict to fields filters now export the settings for Process Fields Individually, Exclude Delimiter, Exclude Quotes. * Fixed EasyPatterns [month] and [monthname] to attempt to match a long month name (January, February) first, then a short month name (Jan, Feb). * Fixed bug with Context Grep with lines after the match. Matching lines at the end of the file were being omitted. * Fixed code for handling CSV, Tab and Pipe delimited files with header lines. What's New in v6.8.2 ==================== * Added new EasyPatterns for [ CSVfield ] and [ TABfield ]. * New Restrict to Byte Range filter - useful for expanding mainframe packed and zoned decimal fields. * New Delete Byte Range filter. * XML filter now has better matching of double and single quoted attributes. These filters now handle embedded double single or double quotes, quotes escaped with backslash, and embedded new lines. * Optimized expand packed decimal and expand zoned decimal for speed. * Fixed bug with swap UTF-16 and swap UTF-32 word order. What's New in v6.8.1 ==================== * Added Expand packed decimal and Expand zoned decimal filters. * Fixed handling of Restrict to between tags filter - under some conditions the trailing > of the start tag would be put in the replace result. * Fixed Copy CSV/Tab fields bug. When copied fields were appended, the delimiter was not inserted if the copy position was the next available field. What's New in v6.8 ================== * Added Unicode functions - Remove BOM (Byte Order Mark) - Swap UTF-16 word order - Swap UTF-32 word order - Make Little Endian - Make Big Endian * Added 144 Unicode conversion functions to convert to and from: ARMSCII-8 ASCII BIG5 BIG5HKSCS C99 CES-BIG5 CES-GBK CNS-11643-1 CNS-11643-15 CNS-11643-2 CNS-11643-3 CNS-11643-4 CNS-11643-5 CNS-11643-6 CNS-11643-7 CNS-11643-INV CP1046 CP1124 CP1125 CP1129 CP1133 CP1161 CP1162 CP1163 CP1250 CP1251 CP1252 CP1253 CP1254 CP1255 CP1256 CP1257 CP1258 CP437 CP737 CP775 CP850 CP852 CP853 CP855 CP856 CP857 CP858 CP860 CP861 CP862 CP863 CP864 CP865 CP866 CP869 CP874 CP922 CP932 CP949 CP950 DEC-Hanyu DEC-Kanji EUC-CN EUC-jisx0213 EUC-JP EUC-KR EUC-TW GB18030 GB2312 GBK GEORGIAN-ACADEMY GEORGIAN-PS HP-ROMAN8 HZ ISO-2022-CN ISO-2022-CN-EXT ISO-2022-JP ISO-2022-JP1 ISO-2022-JP2 ISO-2022-JP3 ISO-2022-KR ISO646-CN ISO-646-JP ISO-8859-1 ISO-8859-10 ISO-8859-13 ISO-8859-14 ISO-8859-15 ISO-8859-16 ISO-8859-2 ISO-8859-3 ISO-8859-4 ISO-8859-5 ISO-8859-6 ISO-8859-7 ISO-8859-8 ISO-8859-9 ISO-IR-165 JAVA JIS_X0201 JIS_X0208 JIS_X0212 JOHAB Johab-Hangul KOI8-R KOI8-RU KOI8-T KOI8-U KSC-5601 MacArabic MacCentralEurope MacCroatian MacCyrillic MacGreek MacHebrew MacIceland MacRoman MacRomania MacThai MacTurkish MacUkraine MULELAO-1 NEXTSTEP RISCOS1 SHIFT-JISX0213 SJIS TCVN TDS565 TIS-620 UCS-2 UCS-2BE UCS-2-Internal UCS-2LE UCS-2-Swapped UCS-4 UCS-4BE UCS-4-Internal UCS-4LE UCS-4-Swapped UTF-16 UTF-16BE UTF-16LE UTF-32 UTF-32BE UTF-32LE UTF-7 UTF-8 VISCII * New context menu item to insert control characters like tabs and form feeds. * New context menu item to show a hex dump of the selected text. * Added logWarning to scripting model. * Added Cut/Copy/Paste to file grid context menu. * Added Tile function to Window menu. * The Convert Word Documents To Text filter now disables Word's screen display for faster processing. * The TextPipe Engine DLL now has a COM interface identical to TextPipe's, but removes most GUI operations for incredible speed. * Added alert() function to the internal TextPipe object of the scripting filter, so JScript functions can easily display debug dialogs. * EasyPatterns bug fixes and improved flexibility. In particular, the [char] keyword was fixed. * Several filters that should have allowed subfilters did not. Filters affected were: database filter, insert column filter, add left margin filter. * Fixed bug - the filename was being output even for non-matching lines, when context lines were included. * Fixed bug with partial trial run menu items including too many items. * Fixed bug with the filter tree allowing nodes to be pasted on the Input Filter, resulting in error-producing subfilters of the Input filter. What's New in v6.7 ================== * EasyPatterns - English-like text patterns for mere mortals e.g. to match phone numbers, use [3 digits, punctuation, 3 digits, punctuation, 4 digits] As easy as that! * Many fantastic new HTML and XML filters! * Restrict a search/replace or other filters to an XML element, attribute or to text between XML tag pairs * Remove an XML element, attribute or XML tag pair. * New Restrict To Filename filter. This allows you to search and replace inside filenames, number and rename files and much more! * Very powerful new debugging feature - selective trial runs. You can select which filters are being tested without having to clone a piece of the filter. You can perform a Trial Run on: * Entire Filter List (current behaviour, default) * Selected Filter Only * Selected Filter and Sub-Filters * Filter List up to and including Selected Filter To see these new options, right-click on a filter in the tree view. * New Backup Mode - renames original files to .BAK. Easily restore originals with a single click in the Results window. * New Convert Word documents to text files filter. * Fixed bug when the Result window Cancel button was clicked twice in a row. * Fixed bug with pasting filter tree items that were copied from level 2 or deeper. * Fixed bug with the Windows Explorer Extension that showed the TextPipe menu multiple times. * Fixed bug with multiple consecutive Script filters not passing header text. * Fixed bug with Search/Replace Enable UTF-8 option and Extract option being swapped when saved. * Fixed loading of Unicode maps from .TAB and .CSV formats - blank fields were erroneously skipped. What's New in v6.6.5 ==================== * Fixed bug with Remove Duplicates option of Sorting filter not being respected. What's New in v6.6.4 ==================== * New macros @time, @date and @datetime. * Fixed bug with handling of CSV fields with more than one line embedded in a column. What's New in v6.6.3 ==================== * Vastly improved sorting performance for files larger than 50 MB. * Simplified user interface by removing 1. Comments tab (old comments are now inserted into the filter list as the first item) 2. Forcing the MDI child window to initially appear maximized, making it look like a SDI application. The window size can still be changed as before 3. Removed the title that appeared above the properties 4. Removing the scratch pad tab unless a loaded filter has text in the scratch area. * Added UTF-32 Unicode Maps * When Prompt On Replace is on, it can now be disabled during the search. Note - this does not update the tree view immediately, and if the filter is currently selected it has no effect. * The evaluation version provides a warning if the user attempts to modify Excel or Word documents. * Unicode maps can now append multiple map files together into one map. * Unicode maps can now log overlapping regions as warnings or errors. * Improved Unicode map timings for populating with Default or blank values. * Added multi-maps for mapping input Unicode to multiple output Unicode forms depending on command line parameters. * /MINIMIZED now examined before any other parameter, eliminating flicker. * Fix error when the file grid was selected in the askSam version. * Fix for Run Time version that prevented filter additions after a filter had been loaded with /F=. What's New in v6.6.2 ==================== * New File Grid context menu option to copy 100 Kbytes to the Trial Run Area. * Upgraded to PCRE 4.3 pattern matching library to fix assertions not working correctly. * Added warning message that not all filter types can be exported to the command line. * Tips and Wizard dialogs now allow filters being double clicked on from Windows Explorer to be loaded. * Tips and Wizard are only shown if a filter hasn't been automatically loaded. * Run Time version now disables sound by default and does not show a tray icon. * Filter overlay images are now updated correctly when a disabled sub filter is deleted. What's New in v6.6.1 ==================== * Added Exit Codes depending on the highest level of error logged. * New /EXPORTFILTERTOLOG command line option. * Changes to support TextPipe Engine file processing. * Trial Input now preserves Unix EOLs when a file is pasted or loaded. * Changed menu structure to make it easier for new users. Removed some icons from the toolbar. * Fixed Access Violations with Remove Lines Matching Perl Pattern filter, and on some random occasions, with Perl pattern matches. * Fixed code generation of setPerl() statement. * Fixed an extra blank line being inserted at the start of the next file after a Unicode file was processed. What's New in v6.6 ================== * New filter supporting search/replace lists. The lists can either be specified in a grid, or they can be loaded dynamically from Excel, CSV or Tab-delimited file formats at run-time. * The file list now supports multiple file specifications separated by semi- colons eg c:\INetPub\* .html;* .txt;* .htm * The Split Files filter can now control how the output files are named. * Subtract entries in the file list are now shown in red, and Ignore entries (comments) shown in grey. * The Script filter now uses a Syntax highlighting editor to display VBScript, JScript, VBA, PerlScript and PythonScript code. It also allows separate default scripts to be saved for each language. * Unicode maps can now be loaded from and saved to Excel/CSV/Tab formats. Unicode filters are now far faster and can deal with undefined characters - such as removing them, replacing them with a custom string, sending them to a VBScript sub filter for specialized processing, or allowing them to pass through unchanged. * The filter tree view now supports Cut, Copy and Paste clipboard operations. There is also an undo action for the current filter. Filters can also be pasted into any application as a text export. * CSV and Tab-delimited files with CR/LFs embedded in fields are now handled correctly. New restriction filters can be used to remove the embedded CR/LFs. * CSV and Tab-delimited restricted filters can now remove the comma or tab field delimiters and the surrounding quotes to make it easier for sub filters to work with field data. Each field's data can now be processed individually rather than as a concatenation of field data. * Byte map lines where the output is different to the input are now shown in yellow. Byte maps can now scroll directly to the character you press on the keyboard - which makes finding mappings easier. * In the audit log, merge file filters now summarize the changes made by filters that follow them in the filter list. Split file filters also summarize the changes made. * GUI and internal changes to support the new French translation. * New command line options /CLEARCOMMENTS, /CLEARFILTERS, /SAVEFILTER, /LOGENABLE, /LOGMODE, /LOGTHRESHOLD, /PREPAREFILTERFORDISTRIBUTION, /SAVEFILTER, /PLAYSOUND. * When loading a list of commands from a command file with /Z=, comments can now be included in the file using a leading ';'. * Speed improvements for the GUI and for filter execution. * Audit logging now shows status for more filters including Scripts and Maps. The audit log text shown for search/replace filters now matches what is shown on the screen for ease of reference. * Various COM scripting changes to support new features, and to allow DataPipe to set the current directory. * Perl patterns now support UTF-8. * Convert end-of-lines filter now handles Mainframe CMS V- and F-format files (downloaded to PC in EBCDIC format). * Removed Rich Edit Memo controls - they caused RTF codes in plain text to be interpreted as fonts, and incorrectly added extra CR/LFs to Add Margins-type filters. * The file list had a bug where it added file entries more than once if they matched multiple file specifications in the same group. * Fixed bug with loading of single byte maps where the map was not actually loaded, from both the menu and from the map sub-form. Fixed Reverse function. * Unicode Maps - fixed problem where changes to the grid were not detected and saved. * Fixed bug with importing Excel and Tab-delimited search/replace lists. * Fixed bug with appending filters from the command line with multiple /F= appearing in reverse order. Fixed filters such as /Hx not being added. What's New in v6.5.1 ==================== * New filters - CSV to Tab-delimited, CSV to XML, Tab-delimited to CSV, Tab- delimited to XML. * Fixed error message when egrep pattern matcher encountered a \000 (null). Only perl patterns can handle nulls. What's New in v6.5 ================== * Search and replace lists can be loaded easily using the Load List from Excel/Tab/CSV formats in the Replace menu. * The Task Bar Menu and Map Menu now display sub folders of the TaskMenu and Maps folders, and sort all the filenames and folder names shown. This makes it very easy to categorize these maps and filters into folders. * If a filter has one or more of its sub filters disabled, a red slash is shown through its icon in the tree view. This makes it easy to find filters where disabled sub filters are hidden from view. A disabled filter still has a red cross through its icon in the tree view. * Custom patterns can now be defined in the file custom_patterns.txt in the TextPipe.exe folder. The patterns can be added through the right-click menus on every field. * Sorting can now handle files of unlimited size. Previously sorting was restricted to using physical and virtual memory. * New sorting options for date and time, date, and time. * New right-click option for filter tree view to turn a filter into a sub filter. * Matching/non-matching lines and other grep line based filters can now use Perl patterns, egrep patterns, MS Word patterns and Brief patterns. The addGrepFilter COM function has changed to support this. * Export to VBScript/JScript/web page now also exports the search replace options such as greedy matching, allow comments, buffer size etc. The edit distance threshold parameter has been removed from the addReplaceFilter COM function, and new functions added for setPerl, setEditDistance and setBufferSize. * Menus and tabs re-organisation, selection filters renamed to restriction filters. * A fixed width font is now used for most memo fields. * Improved handling of malformed CSV files. * Fixed export of Logging:Append to Log. The wrong value was being exported. * Fixed generation of random files of specified size. All files were being truncated at 8k. What's New in v6.4.1 ==================== * Added "Content Type" to system registry to help web downloads of .fll files. * COM object now registers itself in the Running Object Table (ROT), and frees itself at the correct times. * New COM properties Application.visible and Application.activeFilter * Fixed bug with moving nodes with sub filters. * The Task Bar menu now correctly runs filters for the second and subsequent runs - previously the status window stopped it from working. What's New in v6.4 ================== * New filter to Remove a line range (in addition to the Head/Tail filter). * New filter to Remove CSV fields. * New filter to Remove Tab fields. * New filter to Move CSV fields. * New filter to Move Tab fields. * New filter to Move Columns. * New filter to Copy CSV fields. * New filter to Copy Tab fields. * New filter to Copy Columns. * File/Open command can now open multiple filters at a time. * Drastically improved the speed of 'head' filters and Remove All - they now skip reading the remainder of the file no matter how large it is (a 'Head' filter is used to extract the first N lines of a file). * New option to display help in an embedded window that is synchronized with the current action. * Added filter export to VBScript and JScript - this can be used to very easily create code for ASP or web pages or simple scripts. * Added COM interface to create Head/Tail filter, Run External Program filter, Split filter, Show/Remove Duplicates filter, Secondary Output filter. Logging functions, Input filter and Output filter settings can now be controlled with precision. * COM functions are now error trapped to prevent dialog boxes appearing in server versions. Error messages are captured to the ErrorText property. * The Script Filter's default script can now be set. * Fixed display issue where memo field containing multi-line text (such as the search and replace fields) scrolled to the bottom rather than displaying text from the top. * The command line text of the External Program filter now does not have double quotes removed from it. * TextPipe now can paste more than 64K of text at a time into a memo control. Previously controls could hold more than 64K of text, you just couldn't paste that amount. * TextPipe now forces text paste operations to be plain text. * Speed improvements with string translation caching. * Wizard form now aligns correctly. What's New in v6.3.6 ==================== * A new option to only output modified files was added to the Output filter. * A new Search option on the File Menu allows filters to be easily located. * The status window now shows how many bytes of the input file have been processed. * A quick short cut is now to double click on any of the filename fields to simply open the file (e.g. Single file output). * The Remove and Remove All buttons now work for all tabs (previously they were not used for the Comments, Scratch Pad and Trial Run tabs). * When filters are being run from the command line, a new blank filter window is no longer created - this means that the status of the already running filter can be easily seen. * The Execute Program filter now deletes the Input and Output files when processing has completed. This filter is commonly used for sorting very large data files and other external processing. * The context grep filters Remove matching/non-matching lines and Retain matching/non-matching lines have been re-designed so that they work exactly the same as the Select matching/non-matching lines filters. * The /I command line option (recurse subfolders) now also applies to file lists loaded using /L=. * Added new command line option /CLEARFILES to clear the file list. Also added /S0-/S6 to handle different search/replace types. * Fixed bug with Remove/Retain Lines Matching Perl Pattern List, where all backslashes needed to be doubled twice. * Fixed bug with none of the /C... command line parameters working. What's New in v6.3.5 ==================== * Fixed problem with Extract Email Addresses filter removing one extra character from the start of the email address when it started with mailto: sendto:, email= etc. * Improved window behaviour when TextPipe is activated from COM - the main window is now not visible unless it is specifically shown. * Improved COM handling - TextPipe exits correctly now that there are no internal references to the Application object. What's New in v6.3.4 ==================== * Fixed problem with saving Count Duplicate Lines and Remove Duplicate Lines filters. What's New in v6.3.3 ==================== * Fixed problem with Remove Patterns From List filter - was crashing. What's New in v6.3.2 ==================== * Fixed problem with multiple output filters overwriting the same file. What's New in v6.3.1 ==================== * Fixed sub filters not working for filters Add Text Side by Side, Add Repeating Text Side by Side, Remove Lines Found In, Retain Lines Found In, Remove Matching Lines Found In, Retain Matching Lines Found In. * Added new options to the Export Command Line of the Output filter. * Fixed problem with memos not displaying text properly. What's New in v6.3 ================== * Added new Find in HTML helper window to help users Edit, Remove, Replace or Append to text inside HTML tags (such as the ALT tag of IMAGES), between HTML tags (such as between and ), and between two arbitrary pieces of text. * Added new 'Select each line in turn' filter. This is a short cut for creating a 'Select matching lines' filter with a pattern of '^'. * Window Menu now works properly - workaround found for Windows bug (being to turn off AutoHotKeys and AutoLineReduction). * New System menu item (on task bar) to force TextPipe to close, even if it has been activated via COM or from DataPipe etc. * Fixed double quotes appearing in filename fields after a filename has been chosen. * When special characters are pasted, the default mode has been changed from decimal to hex (so where \018 would previously have been pasted for special character 18, now \x12 would be pasted) * New Word Wrap toggle item in the popup menu of memo fields. * New Start Column and Length options for Sort filter, Remove Duplicates filter and Count Duplicates filter. * When a command line filter has been started with /G, TextPipe no longer clears the filter list so that you can now see the contents of the command line filter. * New command line parameter /OUTPUTKEEPSTRUCT to control whether the input file's folder structure is retained when a new output folder is set. * Fixed a bug with dragging and dropping filters, where you could get an Access Violation trying to edit the filter after moving it from inside its parent filter. * Fixed @inputFilename and @fullInputFilename incorrectly using the output filename. What's New in v6.2.9 ==================== * Expanded the Special\Find and Replace menu item into an entire menu to make it clearer. * Now uses Windows standard dialog boxes for easier translation. * Removed status window control resizing. * Removed validation on perl patterns that prevented back references from working. * Fixed error with perl ^ not matching the start of the first line in files less than 4K. * Fixed error with Extract Filter - some non-matching text was being passed to the output. * Fixed the maximum allowed value on various filters - Split At Lines, Detail lines allowed before writing to log file, size of random input file that can be generated, insert column position, line numbering, context grep lines before and after, delete columns values, duplicates filter, record length on EOL filter, head/tail filter, all number-type filters like spaces to tabs, centering etc, maximum buffer size for pattern matching etc. * Fixed handling of single and double quotes inside database queries. * Database filter 'insert script' option was not modifying file changed status. * Fixed TextPipe.getGlobalVar - now returns a blank string if the variable has not been defined, instead of the variable name preceded by '@'. GlobalVariables are now case-insensitive, and can hold multi-line values. * Fixed bug with 'Remove Prompting' not setting the modified flag if the filter changed. * Changed the text qualifier for database insert scripts from " to ' What's New in v6.2.8 ==================== * All fonts are now set to the system default font. This makes translation of Eastern languages far easier. * Tools\Put Sample In Trial Input now only includes files that have the 'Add' action enabled. It also handles the situation where no files have been specified. * Better DataPipe integration - now no longer hides the window when TextPipe is closed. The main form minimizes instead. What's New in v6.2.7 ==================== * Improved Command Line Wizard dialog. * New right click menu function for search/replace filters "Allow RTF tags" converts the pattern to one that allows embedded RTF font tags. * Better integration with DataPipe - COM functions have changed, now Application.hide minimizes TextPipe, and Application.show restores it. What's New in v6.2.6 ==================== * Improved speed of COM functions. * Added COM code to support DataPipe * Fixed bug (again) where null lines caused the pattern matcher to fail. What's New in v6.2.5 ==================== * Race condition fixed where a command line processing thread started with /G /Q doesn't get a chance to start before the application exits. * New command line parameters /MAXIMIZED and /HIDDEN (hidden acts the same as /MINIMIZED) * COM functions execute() and executeClipboard() now don't return until the processing thread has completed. * New COM function isRunning to determine if a processing thread is still running. * The COM function addReplaceFilter()'s ignoreCase parameter has been renamed to matchCase - now the sense of the value is correct, and is consistent with the user interface. * Fixed bug with perl-style patterns when used with look-behind assertions - 100 characters of text preceding the match is now retained in the search buffer. What's New in v6.2.4 ==================== * Secondary Output Filters can now be disabled and deleted. * Fixed errors occurring when a filter was modified after it had been moved up or down using the up or down buttons. * Added Application.Quit function to COM * When created from COM, the default is now for the main form to be invisible. What's New in v6.2.3 ==================== * Secondary Output Filters can now be added throughout the filter list to duplicate the output file, or write selected lines and columns out to a separate file, eg to place error lines or records in an error file, or to separate records of different type or length into new files. * A new Select Block filter allows undelimited blocks of data to be selected and processed as one. * Fixed VB/Jscript timeout - value is in milliseconds, not seconds. * Fixed obscure Perl replacement bug when run from command line. * Validation of ActiveX scripts now only occurs for VBScript - JScript validation didn't work because the MS JScript engine does not implement various functions. What's New in v6.2.2 ==================== * Updated perl library to PCRE 3.7 (from 3.5) * EOL filter now allows more than one character in the replacement string. * Enabled some command line operations to provide Windows Explorer support in TextPipe Web and Standard. * Fixed problem with the About dialog (in the evaluation version) interfering with filter loading when TextPipe was invoked by double-clicking or opening a .fll file. * Fixed bug with 'Escape Special Characters' not working properly. * Fixed bug with Split After XX Lines filter only outputting one line. * Fixed bug with 'Include Lines from End of File' when the number of lines was greater than 255. What's New in v6.2.1 ==================== * Tree view now displays more than just the first line of scripts and comments. * Fixed bug with perl-style grep and blank lines. * Input Filter export showed incorrect value for Delete Input Files After Processing. * Filters loaded from the command line now have their full path saved, so they get saved to the correct location even if the current directory is changed. * Added missing properties to Filter Export function. * Fixed bug handling command line filenames with embedded '..' paths. What's New in v6.2 ================== Note: v6.2 was released quickly to correct some serious bugs, but it was not announced until v6.2.1 was released with further bug fixes. * New filter to Remove lines matching any patterns in a list. * New filter to Retain lines matching any patterns in a list. * New filters to Retain matching lines, Remove matching lines, Retain non- matching lines and Remove non-matching lines - this is easier to understand than the Select lines filters. * New filter to add a file side-by-side with an existing file. * New filter to add a file side-by-side with an existing file and repeat the added file if the file being added to has more lines. * New filter to Split a File after a given number of lines. * New Input Filter to generate random a data file of a particular size. * New filter to repeat a file's contents a specified number of times. * Added Script Timeout option to VBScript/JScript filter * Show Command Line dialog now also shows the current path and all environment variables. * Added 'Escape special characters' menu item to right-click menus of all fields. This is very handy for adding backslashes in front of pattern matching meta characters, and doubling '@' and '$' characters where appropriate. * Added 'Allow Extra Spaces' menu item to right-click menu of all pattern fields, allowing you to easily search and replace in HTML files by ignoring any extra spaces or tabs that commonly occur. * Added 'Allow Extra Line Feeds or Spaces' menu item to right-click menu of all pattern fields, allowing you to easily search and replace in HTML files by ignoring any extra spaces, tabs or line feeds that commonly occur. * Updated help, fixed application links to help file, help file now displays when TextPipe is first run * Fixed bug with filter loading * Made splitter in Search/Replace filter visible, now resizes correctly. * Fixed 'Add folder' button - newer versions of Windows caused this dialog to appear behind the main window. * Unknown field codes (a name preceded by an '@' symbol) are now NOT replaced with a blank - they are left as is to prevent inadvertent use of a field code causing text to disappear. Known field codes (@clipboard, @inputFilename, @fullInputFilename) still work as normal. * Added new COM function to filter windows - closeWithoutSave. Added new options to COM interface, including default values. * Fixed bug with a filter validation function not being called when there were sub filters anywhere above them in the filter list. * Fixed a bug affecting the Select Matching Lines, Select Non-matching Lines, Select Lines From Length To END, Select Lines From Start To End, Select Lines From Start For Length filters when immediately followed by a line-based filter such as a Reverse Each Line, Pad To Width etc. Some text was not output at all. * Fixed a bug affecting the Remove Lines Found In List and Only Keep Lines Found In List filters - because the list was not internally sorted, the actual lines would only occasionally be processed correctly. A workaround was to ensure that the line list is first sorted in ascending alphabetical order. What's New in v6.1.1 ==================== * Improved the email address extraction filter to automatically remove leading 'mailto:', 'mime:', 'smtp:', 'email=', and remove trailing '?Subject' and trailing periods. * Fixed Perl Pattern Match not saving 'greedy' setting * Fixed hidden form problem with active field being invisible * Fixed Access Violations on editing filter list What's New in v6.1 ================== * PERL-STYLE pattern matching! - use both greedy and non-greedy matching options, as well as embedded comments, assertions, non-capturing sub- expressions and more! * Brief-style pattern matching * MS Word style pattern matching - use the * , ?, etc wildcards that you can use in MS Word. * New 'Extract' option for search and replaces, all non-matching text is discarded. * The Found Text can now be referred to in the Replacement Text as '$0' for Exact, Sounds-like and Edit-distance matches. Previously the Found Text could not be referred to, making some replacements harder. * You can now easily add a sub filter to the selected filter by holding [Alt] down while choosing it from the menu or selecting its speed button. * You can now easily add a filter at the parent level of a sub filter by holding [Shift] down while choosing it from the menu or selecting its speed button. * New Input Filter setting for text to come from the Trial Run Input area. * The filters Add Left Margin, Add Right Margin, Add Header and Add Footer now do not parse the included file for special functions or characters. This ensures that the file being included is included exactly as is. The parsing of text specified in the edit field continues as previously. * Fixed a recursion bug when [Alt+Down] is pressed to move a filter and its sub filters down, now the filters are moved down correctly. * Fixed bug with base panel of search and replace filter disappearing after returning from the Trial Run area. * Removed the Font Control context menu item for controls. * Better handling of Cancel button during a processing run. * Fixed handling of NULL values with database filter and Generate Insert Script mode. * Database Command Timeout setting for queries that run for more than 30 seconds. * Improved Tree handling is quicker and easier to use; the treeview changes immediately when a setting is changed, and there is a new Up and Down button to easily move filters up and down (in addition to Alt+Up and Alt+down). * All command line defaults now come from the Normal Template normal.fll, not the internal defaults which used to be: inputFromFiles, promptOnEach=false, skip binary files, binarySampleSize=100, outputToFiles, testMode=false, retainDateTime=false, changeExtension=false, changeBaseDir=false. * Fix for the error " The Decision Cube Capacity is Low. Please deactivate dimensions or change the data set" What's New in v5.6.3 ==================== * Uninstall now removes all registry entries * Installer now supports unattended installs * Fixed short cut conflict between Remove/Remove All buttons and menu items * Fixed bug with registry security in registered version What's New in v5.6.2 ==================== * Added 'Normal Template' functionality - a filter that is always loaded to set defaults. * Delete Input Files after Processing setting now displays a warning box when it is enabled. When a new filter is created this setting always defaults to disabled. * Added shortcuts to tabs on status form, query replace form and command line display form. * Fixed error in COM documentation for AddFile function - constants should be 1,2 and 3, not 0, 1 and 2. * Changed sizes of GUI controls to show foreign languages better. * Fixed bug with loading of foreign language, and enabled support for radio group type controls. * Fixed bug with Append Mode. What's New in v5.6.1 ==================== * Clicking on the filename column in the file list now sorts the filenames. * Improved COM interface - new methods for compiling the filter list which improves speed if the same filter is used repeatedly * New Append to existing file setting What's New in v5.6 ================== * Localisation complete - now everything in TextPipe can be translated to a foreign language by translating the file Languages\English.ini For more details on how to translate TextPipe, please visit: http://www.datamystic.com/textpipe/translate.html * COM interface now allows TextPipe to be fully controlled from languages such as VisualBasic, VBScript, C++, Delphi etc For more details on how to translate TextPipe, please visit: http://www.datamystic.com/textpipe/com_interface.html * Fixed bug with dragging and dropping filters onto a filter that doesn't support subfilters - now adds the dragged filter above it What's New in v5.5.2 ==================== * Added code for TextPipe Pro Run Time Engine * Marketing changes for evaluation edition * Began preparation for localisation * Fixed command line processing bug with modifying the Output filter settings after loading a filter with the /F= command * Fixed bug with debug windows What's New in v5.5.1 ==================== * Forms and menus can now be translated into other languages via a .ini file in the Languages folder * Improved the load time of massive filter lists loaded via the /Z= command line parameter * Trial Output now shows Column and Row in the same way that Trial Input does * File size for files larger than 2GB is now displayed correctly * Improved the way that form sizes and positions are saved * Improved the way that registered user data is saved under Win2K * Forced installation to require the Administrator account to prevent registry writing problems under Win2K What's New in v5.5 ================== * Lines of context surrounding a matching line can now be displayed, both before and after matching or non matching lines (grep filter) * Added short cuts to tabs (Alt+1 through Alt+5) * Added Filter Wizard to help new users * Added command line options for setting the output file extension, output folder, and merge output filename. * Sub filters can now be created by holding down Shift as they are drag and dropped to a location inside another filter * The database filter now directly supports creating a database insert script from extracted data * Improved tutorial lessons * TextPipe tutorial now listed in the start menu * Fixed bug with default folder not being TextPipe's folder (default was My Documents folder) * Fixed bug with access violation on exit after a filter is invoked from the command line * Fixed bug with Count Duplicates filter missing some lines * Fixed bug with Extract Emails filter missing the last email address if it ended at the end of the file * Fixed bug with errors not being reported during trial run - now if errors are reported the status dialog will not automatically close * Changed default extension to .fll for link filter dialog. Also added an open button so that the filter can be easily loaded and edited What's New in v5.4.1 ==================== * Can now CHANGE THE REPLACEMENT TEXT during a run. This is very useful for fixing up mistakes in the replacement text, and can also be used for pattern matches * New Paste Special command on context menus to allow pasting of special characters without TextPipe converting them to its internal code * Unknown '\' entries are now output with the leading '\' rather than without. This is to help new users * Trial Input and Output no longer attempt to validate special characters such as \t etc. * Fixed bug with '\' being incorrectly interpreted in the Prompt for replace window * Fixed bug with filters becoming modified when Search/Replace filter was selected (not edited) What's New in v5.4 ================== * VBScript/JScript code can now control TextPipe - LogError, LogInfo, inputFilename, fullInputFilename, terminate, setGlobalVar, getGlobalVar, subFilterEntireText, version * VBScript/JScript code can now have subfilters. Subfilters can be turned on or off by the script at any time using InitSubFilters, FlushSubFilters, subFilterChunk * Find/Find Again in all memo fields (multi-line edit) * Font control dialog on all edit fields (including memos) * Extended the number of filters than can be invoked via the command line * Facility to generate TextPipe command line parameters from an existing filter list * Trial Run can now be interrupted - runs in separate thread * Ctrl+A (Select All) now works in all fields * More options in the Window menu * Adhoc Transform tab renamed to Trial Run tab * Task bar menu now sends TextPipe to the back after a menu item is selected * Better handling of maximized windows when TextPipe restarts * Fixed bug with Select lines filter - if the input had (say) 2 lines and the setting was from line 3 to END What's New in v5.3.9 Beta ========================= * Added drag and drop between filter windows * Added drag and drop promotion/demotion and movement of filters in the filter tree display (and removed the Up/Down buttons) * Added Lesson 4 to tutorial What's New in v5.3.8 ==================== * "x2" function now duplicates sub filters at the same time * Fixed bug with Insert Column At filter where the column was set to zero (ie insert at end of line) and the actual line length = 1 (the text was inserted at the beginning of the line) * Fixed bug with replace filter and whole words option - output text can be duplicated * Fixed bug with merge filter and single file output filter * Fixed bug with Close All function not closing all windows * Fixed bug with Insert Filter File function changing the name of the currently loaded filter What's New in v5.3.7 ==================== * Updated Export To Clipboard and Print facility to cope with new filters and tree structured filters. This facility is an excellent way to maintain version information about your filters * Maps now moved to separate 'maps' folder * textpipe.log is now created in the same folder as textpipe.exe if no path has been specified * Recent Files menu now uses submenu of main menu * Filters opened will now load into the New Filter window if it is unchanged and does not hold a filter * Fixed problem with files and folders added via the command line not defaulting the subfolders setting correctly * Fixed problem with filter opening twice when opened from Explorer when TextPipe isn't currently opened * Fixed bug with merge filter not performing any filters following it in the filter list What's New in v5.3.6 ==================== * Added ability for Windows Explorer to detect TextPipe and open a filter in an existing TextPipe window * Recycle bin functionality temporarily removed while bugs fixed What's New in v5.3.5 ==================== * Fixed buttons and help for Files Tab * Delete file operations now use the Recycle Bin * Fixed bug with Remove Lines From File and Only Show Lines From file filters What's New in v5.3.4 ==================== * (Hopefully) fixed long-standing error on exit What's New in v5.3.3 ==================== * New subscribe facility on help menu * Fixed regexp bug with characters sets [] involving ranges of characters specified with a \ eg [\000-\255]. Also error message for character sets containing a \000. What's New in v5.3.2 ==================== * Better error handling when file delete/rename fails * Fixed bug with number of subfolders to process (1 Level was same as None) * File\Open now always opens a filter in a new window. New menu item to open in the current window * Fixed bug with Remove button, only removed first file from file list even if multiple files were selected * Now checks if log file exists before using Notepad to open it * Double quoting of filenames and folders containing spaces now handled correctly * Better handling of dropped files What's New in v5.3.1 ==================== * Added option to delete input files once they are processed - to support integration with GFI FAXmaker What's New in v5.3 ================== * New Sorting options * ASCII Sort (case-sensitive and case-insensitive). Previously only an ANSI sort was available (where lower case letters sort before upper case letters) * Numeric sort * Sort by length of line * New Unicode Map filter for translating Unicode files * Improved online help with Quick Start guide, improved tutorial and more cross-referencing * Status form now has indicator to show whether test mode or overwrite mode is active * All memo fields now can save to and load from a file * Trial output now has warning message if the output text contains null characters * Improved Command Line Assistant dialog * Fixed bug with Query Replace window not scrolling found text into view * Fixed bug with "First Match Only" option discarding text * Fixed move filter up/down bug with filter lists containing more than 256 filters * Fixed bug with database filter not extracting data correctly when fixed width format with no column titles was performed * Database filter now correctly handles non-SELECT queries that return a record set * Fixed bug with access violation on exit * Fixed bug with pattern match ignoring First Match Only setting under some circumstances What's New in v5.2 ================== * Added help toolbar for easier access to helpful features * Improved drag & drop behaviour for .fll files * Added automation check to disable debug filters * Added better error handling for MIME decode quoted printable filter * Advanced logging details in results window * Added error checking to ensure file can be deleted/moved to correct final filename, or error logged if not * Added output option for all files merged to a single file * New Clear All and Paste context menu item * Prompting dialog for Read Only files, Prompt Before Processing and Prompt on Binary Files now has option for No To All and Yes To All * New Search/Replace option to only replace the first occurrence * Trial Input/Output now have horizontal scroll bars * Grep filters (Keep matching lines, remove matching lines) now as select filters, where matching lines get subfilters applied to them * ActiveX scripting no longer requires dummy parameters for functions * Improved match information tab for Edit Distance and Sounds-like matches * Context menu on tree view for faster deletion/enable toggle * Database query now creates correct XML document. Handling of previously unrecognised data types. Original query output as comment. Headers always output even if 0 rows returned. Unique column names generated for all output types. Encoding="UTF-8" removed from XML header - not supported by some versions of IE * Status dialog now shows count of Non-binary Files Skipped * New Edit Distance option for search/replace filters - very handy for finding and locating misspelt words * New option to retain the existing file list when opening a new filter * New facility for search/replace to replace all or none within the current selection * Loading a .fll filter file now opens in the same window * Better detection of filter list changed * Better handling of loading very old filter lists * Added force lines to width filter * Added advanced logging facilities with detailed tracking of all changes made * Fixed exception with exact match filter * Fixed handling of non-select statements in Database filter, and improved error checking code * Fixed directory where preliminary output file created * Fixed split filter - was not performing "start file" processing for following filters * Fixed Remove Email Headers - was crashing * Fixed bug that affects all line-processing filters - when using Mac files the first character on each line may be repeated * Fixed bug with exact match filter that caused text to be output multiple times * Fixed Win NT bug with popup context menus on memo fields * Fixed delete columns filter * Fixed handling of grep/inverse grep filters * Comment filters now have vertical scroll bars for comment text * Fixed subfilter bugs where filter list was not built correctly, missing several filters * Fixed bug with Select Lines filter not outputting its results * Fixed bug with Select CSV Fields filter * Fixed errors with start and end word for Edit Distance and Sounds-like filters * Fixed split filter * Fixed handling of Select Columns with the 4th option * Fixed debug filter error * Fixed Select CSV/Tab field missing last field * Fixed handling of map menu and task bar menu What's New in v5.1 ================== * * * Sub filters - drag and drop a filter onto another in the tree view and the dropped filter will then process JUST the output from the parent node. Eg drop a "Title Case" filter onto a "Search/Replace" filter to change the search result to Title Case * * * New Database Connection filter. Attach to any ADO/ODBC database and execute any SQL command text against it. The result can be output as CSV, Tab-delimited or XML (with automatically generated DTD schema). All characters are appropriately escaped, including quotes within strings for CSV, and XML special characters. * Pattern matching now extended to handle up to 36 ($0-9,a-z) bracketed expressions. This is 26 more than any other product on the market. * New Select CSV Fields filter - select a group of consecutive CSV fields and apply sub filters to the result by dragging and dropping them onto this filter. Handles commas embedded in quotes etc * New Select Tab-delimited Fields filter - select a group of consecutive tab- delimited fields and apply sub filters to the result by dragging and dropping them onto this filter * New Select Line Range filter - select a group of consecutive lines and apply sub filters to the result by dragging and dropping them onto this filter * New Select Column Range filter - select a group of consecutive columns and apply sub filters to the result by dragging and dropping them onto this filter * New Remove All filter - useful for subfilters * Convert EOL filter can now specify any string as the new EOL character * New Truncate to Width filter * File output has new "Maintain folder structure" option when outputting to a new folder * Remove Columns filter now has more advanced options * New option Skip Prompt if Identical for Search/replace filters * ActiveX scripts can now easily output text at the start and end of each file * New tools added - option to verify a filter before it is run - performs syntax check etc. Also added Windows calculator * Explorer extension - right click on files, folders or drives brings up TextPipe options. New window on Tools menu to customise the Explorer extensions * Command Line Assistant window - provides examples of how to run TextPipe from the command line in a variety of modes * Show Command Line window - displays the command line parameters used to invoke TextPipe - useful for debugging command line scripts * Check for TextPipe Updates window - check if you have the most recent TextPipe by querying the DataMystic web site * TextPipe now interfaces to 2 external tools (see Help\Related Products menu)- JustData from www.justsoft.com.au Offline Explorer from www.metaproducts.com GUI enhancements * Tree view for filters which allows multi-level filters to be collapsed * Multiple-document interface (MDI) allows multiple filters to be open at once. New Window menu to support MDI interface * Dockable toolbars * Icons in menus * Right-click (context) menus on all edit/memo fields allow special characters, common patterns, replace expressions and macros to be inserted, as well as the normal clipboard operations * Can now set the font used in the Ad-hoc Input/Output area Bug fixes * ActiveX script now works in non-ad-hoc mode * Trial Run area now does not interpret \n, \t etc * Split files at Character - fixed bug What's New in v4.6 ================== * Example code for the TextPipe Engine - a text transformation .dll that can be downloaded from www.datamystic.com * New ActiveX scripting filter supports arbitrary user-written code in VBScript, Jscript or PerlScript, PythonScript, REXXscript etc * Output To New Folder can now recreate multi-level folder trees and output to a new drive * New Undo command to undo any changes to the current filter * New file grid button to Copy Row * New Extract filter to extract just the required text * Show Duplicates filter now called Count Duplicates, and outputs the number of times found to the left of each item * New Tools menu item to pull sample data from the file list or clipboard into the trial run area * New Tools menu item to move the Trial Run Output back to the Trial Run Input * Add Line Numbers filter now allows format of line numbers can be changed to custom user-defined settings, including numbering in hexadecimal etc * Sort filter now has Ignore Case option * Header, footer, left margin or right margin can now insert either a file or text. Cursor position now shown * Length of trial input and output area shown in both lines and characters. Cursor position now shown * Warning indicator on status bar now shows if Test Run mode is active or not * Debug filter - creates a debug window showing the text passing through the filter at that point * External filter files can now be linked to, providing true 'black box' style re-use, using File\Link To Filter * Can now duplicate the current filter - this makes adding a large number of similar filters very easy * Find and replace filters now use multi-line edit control - making it easier to edit large selections. The new edit control also provides the length and line count of the text * Maps now display a hex column in addition to the original Decimal and ASCII columns * Changed handling of changing the replacement text for a pattern-based search - now the default text is not modified for future replaces * Tips of the Day * Query replace window now supports resizing better * Changed registration URLs * The filter names shown in the filter list are now truncated, preventing Windows crashes with very long filter names * Fixed logging functions which were going wild when more than 1000 files were processed * Fixed pattern matching not handling \n \r \e \t \a * Fixed Randomize filter - was outputting blank text * Fixed pattern based search with patterns longer than 247 characters - was truncating and matching early What's New in v4.5 ================== * Soundex search method to search for words that sound like another word. Useful when you are replacing a typing error * New Preferences dialog - Play sound on completion - If no association, use user defined editor (need new options window) * Prepare filter for automation - removes all user prompting * Prepare filter for distribution - removes all test text * Can now insert a file with the Add Header, Add Footer, Add Left Margin and Add Right Margin filters - browse button * Add Line Numbers now has option to skip blank lines, (ie omit count but keep counting), as well as omit count and not count line) * Now can split files at a given character, after a specified number of occurrences (and split before, after or on top of character) * ANSI to Unicode and Unicode to ANSI filters (single byte to double byte) * Comment filters now shown in italics, disabled filters shown with strike through text, speed button to add comments * Better progress indicator - now much more accurate * Duration of filter job in seconds shown in status dialog * Increased size of edit fields for easier editing of multi-line text. Display of text length and number of lines of all memo fields (like Header, Footer, Left/Right Margin, Insert Column etc) * Performance improvement when handling very large files * Improved performance for Remove Blanks from Start of Line, Convert to Lower Case, Convert to Upper Case, OEM to ANSI, ANSI to OEM * Query replace dialog now shows file currently being processed * Query replace dialog now shows filter information for both normal and pattern based searches (so it is easy to see which text was matched by each expression) * Improved command line automation support. Now can have comments embedded - useful when converting Perl scripts to TextPipe scripts because code can be commented out rather than edited out * Form resizing now handled better * Fixed bug with Query Replace when replacement text was modified before replacing * Fixed bug with saving/loading of window positions * Fixed bug with detection of when the filter has been modified * Fixed bug with query replace 'Yes - file' button - did not change the first entry What's New in v4.4 ================== * Name change from DropConvert to TextPipe * Regular expression search and replace - allows pattern matching (also known as non-exact matches or regexps). Case-insensitive or case-sensitive matching * HTML Help integration * Prompt on replace. Can change the replacement text * Option to delete test files at end of test run * @inputFilename macro now allowed in filters for Add Text To Start Of Lines, Add Text At End Of Lines, Add Column Of Text * New @clipboard macro to insert the clipboard contents * Can disable filters by double-clicking or pressing Ctrl+T * When either the error display or the file display is full it is sent to the log file * /z command line parameter to read parameters from a file * Grep-based regular expression matching * In-place editing of file specifications * Inclusion and exclusion lists for file processing * File groups allow better handling of complex file groupings * Subfolder recursion can now be specified on a per-file basis. Improved performance of subfolder recursion * Improved detection for binary files - sample size can be adjusted, and binary characteristics are better identified * Case-sensitive replace - if found text is uppercase, replacement can be forced to all uppercase etc * New Export Filter to clipboard feature. Useful for documenting filters in Word * Enhanced detail when printing filters * File associations for .dCv test files * Status dialog now shows separate error tab, and shows files generated by each filter, with the old and new size of each with a comparison display for quick checks * Install/uninstall feature. Creates Start Menu items, desktop icon, Send To menu and file associations for .fll and .map files and for text files * Scratch pad area for test text * Trial run area for iterative testing * Improved error log for command line initiation * Pasted text is scanned for binary characters - and they are converted to readable text. Pasted text is now checked to see if it has already been converted * Heaps of useful sample filters * Window sizes now saved and restored. Minimum window sizes enforced * File list now supports including and excluding files, file groups, subfolder inclusion/exclusion on a per-line basis * Scratch Pad area for saving chunks of text * New Edit Menu with Cut, Copy, Paste and Disable/Enable Filter * Settings now saved on a per-user basis * Improved descriptions in filter window * Improved performance. Better use of memory (now uses far less) * Scrolling on drag of filters in filter list * More filters and options available from command line * Now handles filters from future versions better * Printer setup menu item now doesn't get lost :-) * Fixed bug with "Base map on filter list" function What's New in v4.3 ================== * Filter to insert a column of text * Filter to convert to ranDOm CasE * Filter to extract URLs. Very useful for retrieving mailto, http, https, ftp and gopher addresses * Task bar menu. Allows filters to be loaded and run without leaving external programs such as Word, enabling conversion to occur seamlessly without leaving the currently running program * All status windows from completed tasks are closed when starting a new task * Input filter new options: Input from file or clipboard * Output filter new options: Output to file or clipboard (independent of Input filter) change file extension change base directory on output * Filter to only show duplicate lines * Filter to reverse each line * Filter to centre justify lines * Filter to right justify lines * Filter to remove lines contained in an external file * Filter to only show lines contained in an external file * Filter to run external program. Very useful for user-written filters or for features not yet incorporated into DropConvert * Filter to add comments to the filter list * Character maths filter now shows hex and binary equivalents for operand * File history (up to 5 filters) shown in file menu * Tool bar buttons for commonly-used filters * Floating hints now used in preference to status bar * Explorer menus for .fll file type * Removed evaluation edition restriction of 5 filters * Now uses InstallShield install/uninstall