IPA Data Iterator and TSV file input

Has anyone figured out how to use the Data Iterator mode to parse a TSV (Tab Separated Values) input file "by delimiter string"? In other words, is there a way to insert the <TAB> character in the "Delimiter String" parameter?

Find more posts tagged with

Comments

Legacy Contributor

www.lawsonguru.com/.../Default.aspx

russel-cornelson

The data iterator can not handle a tab character. I have an enhancement request for it, but in the meantime.

1. Create a string variable in the start node (DataIteratorString)

2. Setup the DataIterator to parse by line

3. Put an Assign Node in the Data Iterator Loop

4. Top of the Assign Node DataIteratorString = DataIterator_OutputData

5. After that line, use javascript var [var1,var2,var3,var4,var5] = DataIterator.split(' ');

Legacy Contributor

How would you sort a csv file? JS or otherwise using IPA.

Legacy Contributor

I use a couple of methods, depending on my needs:

1) Use the linux sort command in a syscmd node. It is very bare bones. If the records will not sort properly the way they are created, I prepare the file for sorting by adding my sort key to the beginning of each record. Then I strip it off after the file is sorted.

2) Use a sqltxn node to insert all the records into a table I create (we have a database on our Lawson database server for this purpose), and use bcp or sqlcmd in a syscmd node to sort the table and write it back out as a csv file.

russel-cornelson

There is many ways you can sort a csv ... the last time I did this I modified a powershell script to do it so I didn't have to write my own in javascript. I don't remember where I found the parts for this online but I had to modify it.

NOTE: This is using Import-CSV to load the csv; then instead of using Export-CSV I am using convertto-csv which allows the execution of a "replace function" before sending it to a file. NOTE: The replace function will remove all double quotes so if you are dealing with passwords or some field that could validly have a " character you will want to improve the regular expression on the replace.

$key1 = @{Expression={[int]$_.Incident}; Ascending=$true }

$key2 = @{Expression={[int]$_.Severity}; Ascending=$true }

$key3 = @{Expression='Escalated'; Descending=$true }

(Import-Csv "C:Users
cornelsonDesktopsortunsortedIncidentList.csv") |

Sort-Object $key1, $key2, $key3 |

convertto-csv -NoTypeInformation | % { $_ -replace '"', ""} | out-file "C:Users
cornelsonDesktopsortsortedIncidentList.csv" -fo -en ascii

Copyright © 2025 Infor. All rights reserved.