Best way to read a file and only return new/updated item information via IPD?

I am a newbie developer for IPA. In my process flow, I need to read a file with item information in it and then produce an output file that only has the items that changed and/or are newly added to locations. I believe I will need to create a javascript for this. Does anyone happen to have a sample javascript from doing this already that I can review? I feel like this is a common type of "interface".

Thank you!

Find more posts tagged with

Accepted answers

All comments

russel-cornelson

Questions
- what does a sample line of data look like from the file?
- how are you proposing to determine what changed? Verify against FSM Item and ItemLocation?

casyhorsley

3NELUM|11275|TAPE PAPER SURGICAL MICROPORE 1 X10YD BBIN|true|RL|1.0000000|false|false|3M|false
3NELUM|11276|TAPE PAPER SURGICAL MICROPORE 3 X10YD BBIN|true|BX|4.0000000|false|false|3M|false

I was thinking I would have the initial "master" file that I send the vendor to compare against. Output a file with the newly added items and then I would append to the master file

moellerg

So, if it's just item master changes you are looking for, why not investigate IC527 program? That does exactly that.

casyhorsley

Is the IC527 utilized for Cloudsuite FSM?

moellerg

That answer I do not have. We are on-prem.

russel-cornelson

Okay using two files ... I would likely use a file access node to read in the master file, load its data into a hash. then read in the new file and load it into a hash. Then compare the two....

PIECE ONE
FileAccessNode called FileMaster followed by assign node.

var lines = String(FileMaster_outputData).split(/
|
/).filter(Boolean)
FileMaster_outputData = "";
var header = lines.shift();
var MasterItems = Object.create(null);

lines.forEach(function(line) {
	var [vDepartment,vItem,vDesc,vBuom,vConv,vConsign,vImplant,vManuf,vActive] = line.split("|")
	var key = vDepartment + "|" + vItem
	MasterItems[key] = {
		Description: vDesc,
		BUOM: vBuom,
		Conv: vConv,
		Consign: vConsign,
		Implant: vImplant,
		Manuf: vManuf,
		Active: vActive
	}	
});

lines = [];
processlog.info("MasterItemsCount:" + Object.keys(MasterItems).length);

PIECE TWO - essentially same as the file above just calling it a new name
File Access node called FileCurrent followed by assign node

var lines = String(FileCurrent_outputData).split(/
|
/).filter(Boolean)
FileCurrent_outputData = "";
var header = lines.shift();
var CurrentItems = Object.create(null);

lines.forEach(function(line) {
	var [vDepartment,vItem,vDesc,vBuom,vConv,vConsign,vImplant,vManuf,vActive] = line.split("|")
	var key = vDepartment + "|" + vItem
	CurrentItems[key] = {
		Description: vDesc,
		BUOM: vBuom,
		Conv: vConv,
		Consign: vConsign,
		Implant: vImplant,
		Manuf: vManuf,
		Active: vActive
	}	
});

lines = [];
processlog.info("CurrentItemsCount:" + Object.keys(CurrentItems).length);;

Now we have our master file loaded into memory and our current file.
Then we just need a function that compares the two dictionaries to find what we are looking for ...

function compareItems(MasterItems, CurrentItems) {
    deletedItems = [];
    addedItems = [];
    changedItems = [];
    for (var key in MasterItems) {
        if (!CurrentItems[key]) {
            deletedItems.push(key);
        } else {
            var masterRecord = MasterItems[key];
            var currentRecord = CurrentItems[key];
            var isChanged = false;
            for (var field in masterRecord) {
                if (masterRecord[field] !== currentRecord[field]) {
                    isChanged = true;
                    break;
                }
            }
            if (isChanged) {
                changedItems.push(key);
            }
        }
    }
    for (var key in CurrentItems) {
        if (!MasterItems[key]) {
            addedItems.push(key);
        }
    }
    return {deletedItems:deletedItems, addedItems:addedItems, changedItems:changedItems};
}

Then in an assign node you simply call the function
compareItems(MasterItems,CurrentItems);
processlog.info("DeletedItemsCount:" + deletedItems.length);
processlog.info("AddedItemsCount:" + addedItems.length);
processlog.info("ChangedItemsCount:" + changedItems.length);
processlog.info("MasterItemsCount:" + Object.keys(MasterItems).length);
processlog.info("CurrentItemsCount:" + Object.keys(CurrentItems).length);

[View:/cfs-file/__key/communityserver-discussions-components-files/57/example.xml:320:240]

Rename example.xml to example.lpd

0911060553270289.pdf

JD Miller

Are you trying to read a file coming in from the Vendor, or Create a file to send to the vendor when there are Creates, Updates, Changes in Infor?
If the former, use a file channel and then query the Item BusinessClass to determine if it's an add or an update. If it's the latter, you have 2 options (Off the top of my head): you can trigger a Flow or check t o see if there's a bod that gets triggered already on the Business class. You can hitchhike or use that process to create a One line file to send. Your other option is to create a File on Integration Architect that will either send a full file or a Delta file on a scheduled basis.

Keeping a Master Item File as a Flat file for this seems like more work to maintain than it's worth. Reply with what you're trying to do, and I can send screenshots of how I would complete the task. With MT, any of the above shouldn't take too long to put something very basic together.

-JD

casyhorsley

Hi JD. It would be the latter option you described where we are sending a file to the vendor with only creates, updates and changes in Infor.

russel-cornelson

Replication sets are capable of Incremental Replications.

If the data exists in our FSM/HCM database, you could create a replication set that would generate a list of records that have changed since the last execution.

JD Miller

I created a quick "How To" on kicking off a Process Flow using LPL / Config Console, using Item as an example. Send an email to jd.miller@ci.stpaul.mn.us if you'd like a copy of the doc.

casyhorsley

After the final assign node, how would I output the changes/additions to a new file to send to the vendor?

Copyright © 2025 Infor. All rights reserved.