Data Mining General Question

Get help with installation and running here.

Moderators: DataMystic Support, Moderators

randersoniii
Posts: 4
Joined: Thu May 12, 2005 5:34 am

Data Mining General Question

Postby randersoniii » Thu May 12, 2005 10:12 am

Anyone have some general guidance on data mining of reports in which the data can have fields missing? For example, I need to mine a straight ASCII report of addresses laid out like

Person Name
Title
Company Name
Street1
Street2
City, State Zip

where the title, company name, and street2 fields are sometimes missing. The goal is to end up with a CSV with blanks in any missing fields.

User avatar
DataMystic Support
Site Admin
Posts: 2138
Joined: Mon Jun 30, 2003 12:32 pm
Location: Melbourne, Australia
Contact:

Postby DataMystic Support » Thu May 12, 2005 11:24 pm

See the data mining white paper at:

http://www.datamystic.com/docs
Regards,

Simon Carter, http://DataMystic.com/forums/index.php
http://PredictBGL.com - Insulin dose calculator for Type 1 diabetes
http://DownloadPipe.com - 250,000 free software downloads
http://DetachPipe.com - send huge email attachments

randersoniii
Posts: 4
Joined: Thu May 12, 2005 5:34 am

Postby randersoniii » Fri May 13, 2005 2:08 am

Actually, I have read both the data mining and report mining white papers. Neither, however, seems to talk about this issue of missing data fields in some records.

User avatar
DataMystic Support
Site Admin
Posts: 2138
Joined: Mon Jun 30, 2003 12:32 pm
Location: Melbourne, Australia
Contact:

Postby DataMystic Support » Fri May 13, 2005 5:40 pm

Ok.

Let's say you end up with lines like this:

##LINE1 ..data..
##LINE2 ..data..
##LINE3 ..data..

where ##LINE2 is optional.

Just use an EasyPattern like this

Code: Select all

[ '##LINE1', capture( 1+ linechar ), cr, lf,
  optional('##LINE2', capture( 1+ linechar ), cr, lf, )
  '##LINE3', capture( 1+ linechar ), cr, lf ]
Replace with:

Code: Select all

"$1","$2","$3"


Does that make sense?
Regards,

Simon Carter, http://DataMystic.com/forums/index.php
http://PredictBGL.com - Insulin dose calculator for Type 1 diabetes
http://DownloadPipe.com - 250,000 free software downloads
http://DetachPipe.com - send huge email attachments


Return to “TextPipe Tips and Tricks, Questions and Support”

Who is online

Users browsing this forum: Baidu [Spider] and 5 guests