Textpipe Execution from Command line

Get help with installation and running here.

Moderators: DataMystic Support, Moderators

mohsinhsn
Posts: 2
Joined: Thu Dec 17, 2009 3:20 am

Textpipe Execution from Command line

Postby mohsinhsn » Thu Dec 17, 2009 3:39 am

Hi All,

I am executing textpipe using batch scripts to trigger binary to ascii converstion. All these batch jobs are scheduled via task scheduler jobs OR SSIS packages.

I am executing around 70 conversions using batch scripts.

The issue I am having is, when ever I schedule batch scripts to run at the same time (lets say 10 at a time) few off them will be able to convert into ascii files while the remaining will be running (I can see the related SPID in task manager) continuosly without any conversion. Eventually I had to stop the job or kill the associated SPID in task manager and start the batch script again to initiate the converion.

My questions:
1) Is it memory intensive application?
2) when I can see the thread in task manager why don't I see the conversion?
3) How can we make sure that the jobs run at the same time will execute successfully? Any memory settings within textpipe that I can adjust?

Our server has 32 GB of physical RAM out of which 25 GB is allocated to SQL Server. Remaining for OS and textpipe executions. We also analysed that when few of batch scripts fail, free available memory is near to zero.

The workaround we have now is to distribute the jobs to run at 1 minute interval. This case all will run fine expect when we receive files later than normal.

Appreciate your responses.

Thanks,
-Mohsin

User avatar
DataMystic Support
Site Admin
Posts: 2138
Joined: Mon Jun 30, 2003 12:32 pm
Location: Melbourne, Australia
Contact:

Re: Textpipe Execution from Command line

Postby DataMystic Support » Fri Dec 18, 2009 11:52 am

TextPipe is not memory intensive unless you are doing a Sort of a large file. This is not the issue.

What command line are you using to initiate TextPipe?

Have you disabled the Update check dialog, by setting the date years into the future (Help Menu)?
Regards,

Simon Carter, http://DataMystic.com/forums/index.php
http://PredictBGL.com - Insulin dose calculator for Type 1 diabetes
http://DownloadPipe.com - 250,000 free software downloads
http://DetachPipe.com - send huge email attachments

mohsinhsn
Posts: 2
Joined: Thu Dec 17, 2009 3:20 am

Re: Textpipe Execution from Command line

Postby mohsinhsn » Sat Dec 19, 2009 12:14 am

The sample batch script used in our SSIS package is as follows,

"C:\Program Files (x86)\DataMystic\TextPipe\textpipe.exe" "/f=C:\LSF6\Filters\FFSI102A.fll" "C:\LSF6\FiservBinaryFiles\Dev\I102A867*.*" /g /q

I will verify the option "Update Check Dialog'. What does this option is for?

We processing few (4-5) large files but not sure about sorting data in it.

Also, why don't textpipe start the conversion (when its thread is running in the back ground) even when memory is released from other textpipe processes if it is due to memory issues.

Thanks,
-Mohsin

User avatar
DataMystic Support
Site Admin
Posts: 2138
Joined: Mon Jun 30, 2003 12:32 pm
Location: Melbourne, Australia
Contact:

Re: Textpipe Execution from Command line

Postby DataMystic Support » Sat Dec 19, 2009 7:24 am

As I said, it is not due to memory issues.

I believe it is showing the Update Check dialog box, which is why filtering is not being launched.

Try /q=5 to allow a short delay before exiting - instead of /q
Regards,

Simon Carter, http://DataMystic.com/forums/index.php
http://PredictBGL.com - Insulin dose calculator for Type 1 diabetes
http://DownloadPipe.com - 250,000 free software downloads
http://DetachPipe.com - send huge email attachments

User avatar
DataMystic Support
Site Admin
Posts: 2138
Joined: Mon Jun 30, 2003 12:32 pm
Location: Melbourne, Australia
Contact:

Re: Textpipe Execution from Command line

Postby DataMystic Support » Mon Dec 21, 2009 9:26 am

In the registry, set
HKEY_CURRENT_USER\Software\DataMystic\TextPipe\updateDate
to 60000. Today is 40169 - this is measured in days.
Regards,

Simon Carter, http://DataMystic.com/forums/index.php
http://PredictBGL.com - Insulin dose calculator for Type 1 diabetes
http://DownloadPipe.com - 250,000 free software downloads
http://DetachPipe.com - send huge email attachments


Return to “TextPipe Tips and Tricks, Questions and Support”

Who is online

Users browsing this forum: No registered users and 3 guests