I'm using a Compass Sql in an IPA to extract data. Is there a quick way to change the delimiter

jocurrin

Thanks in advance!

Rebecca Derr

I've created an IPA that does this. Once I get the data in csv format I'm using the below js.
You would create and set the delim variable to |

var temp=GetResult_result.toString();

if (delim !== ",") {
var line = "'" + temp + "'";
var newLinesArray = [];
var regex = /"(.*?)"/g;
var matches = line.match(regex);

if (matches) {
for (var j = 0; j < matches.length; j++) {
line = line.replace(matches[j], matches[j].replace(/,/g, '<COMMA_PLACEHOLDER>'));
}
}

var lineArray = line.split(',');

for (var k = 0; k < lineArray.length; k++) {
lineArray[k] = lineArray[k].replace(/<COMMA_PLACEHOLDER>/g, ',');
}

var newLine = lineArray.join(delim);
newLinesArray.push(newLine);

// Convert the modified lines array back to a string
var newLines = newLinesArray.join('
');
temp = newLines.slice(1);
temp = temp.slice(0, -1);
}

data=temp;

this is followed by a write file node that uses the data var.

This code is more complicated that you might expect just because you could have a comma in your dataset (like in a description or something) and we wouldn't want to replace that with a special delimiter.

[edit] just realized the code above is wrapping the data in single quotes and then removing them at the end, that was from some earlier testing and I don't think its needed now