Data Flow: generating separate company records in Data Lake from a JSON Array of companies returned

luis-faisco

Hi,

sorry if this is an obvious question but I am very new to ION and have looked everywhere for a solution and couldn't find any.

I want to create a Data Flow where I call a REST api and get the response as a JSON array such as:

[
    {
        "id" : "1",
        "description" : "Company A"

    },
    {
        "id" : "1",
        "description" : "Company B"
    }
]

and create a Data Lake record for each company as:

    {
        "id" : "1",
        "description" : "Company A"

    }

and

    {
        "id" : "2",
        "description" : "Company B"

    }

I have tried many things including adding script nodes and splliter nodes, without success.

I can get data to enter Data Lake but only as records of the full API call result, not as separate entities, and therefore I cannot use Compass to query for individual companies.

(Ultimately this data will be passed on to d/EPM.)

I am sure this simple use case is supported by ION and the solution is quite straightforward.

Thanks in advance for any hints on how to accomplish this.