How to stream data from a cloud Single Tenant environment to Data Lake

Hi,

we'd like to know if it's possible to publish Ln data sets from a cloud ST environment to a Data Lake as JSON documents (so that we can query them with COMPASS or PAYLOAD).

we have a requirement to stream data from a cloud ST incrementally with a Change Data Capture logic similar to the MT one (based on timestamp e variation ID).

Many thanks in advance.

Alberto

Find more posts tagged with

Infor Data Fabric

Accepted answers

All comments

Kevin Heiman

Any on premise database can be loaded to data lake using AnySQL capability in ION.

Ln on premise can also publish the data to ION just like Cloud. This data can be sent to cloud using the Network Connection in ION which bridges an on prem ION to the cloud ION. We have used this at a couple of sites.

There was a June webinar Infor Data Lake (part 1 of 3) that focused on the getting your data to data lake (IMS and AnySQL) subject. That is now available in Campus, which has a link in the registration page.

Infor Data Lake webinar series Register Here July 14

Legacy Contributor

Hi and thanks,

i review the webinar and try to configure a Network Connection Point.

My requirement is to publish data from a Single-Tenant cloud to a Multi-Tenant Cloud, so accordingly, I do the following:

On Single-Tenant Side:

1. publish as test the Sync.PurchaseOrder BOD

2.Create a new Authorized Application

3.Download Credentials

On the Multi-Tenant side:

1. Create a Network Connection Point of type Receiver

2. Import the local authorization file exported from Single-Tenant and test it successfully

3. Register the Sync.PurchaseOrder document

4. Create a Data Lake Flow

Now, when I try to publish again the BOD no data is showed in Multi-Tenant ONEVIEW.

What's wrong with this setup?

Many thanks in advance.

Alberto

Rene Bottern

Have you looked at 'ION ETL Software', which allows you to setup Automated Transfer From/To the Datalake from different Data Sources?
This is just recently released, and I am using it to extract from Data Lake to a Local SQL instance, and the performance is very good.

Legacy Contributor

Hi Rene,

yes, this is the step two of our process but I think that we can't use the ETL directly against a Single Tenant because a Single-Tenant doesn't have a local DataLake (or at least we are not able to access it).

Alberto

Rene Bottern

Well, we don't have a "local DataLake" either. We are running M3 'On Prem' and DataLake in the Cloud, and we still extract M3 Data into the DataLake using this Tool.

Jaime Zepeda

Hello,

Where can we find more information about this 'ION ETL Software' ?

Thank you.

Jaime

Kevin Heiman

The ION ETL tool is not capable of sending data to Data Lake. It is used to pull data from Data Lake and persist it to on -premise database. Keeping on-prem database in sync with data lake and indirectly any producer such as M3.

Kevin Heiman

Assuming you have the on prem version at 2020-12 or higher and followed the online documentation steps.

It is noted that you don't see data in MT oneview. What is the onpremise active connection points showing? are there messages in pending state? ( I assume yes)

Are there messages in completed or sent column (I assume no) ?

did you check the API monitoring for failures?

Check the logs for errors?

Kevin Heiman

There is a user guide on docs.infor.com under Infor OS , as well as contact your Account Representative or Customer Service Manager.

Legacy Contributor

Hi Kevin,

yes, ST/OnPremise version is 2020-12 and MT is the latest one 2021-6.

I review the documentation that I found here

https://docs.infor.com/ion/2021-x/en-us/iondeskceug/default.html?helpcontent=uvj1542287222737.html

and it seems I make a basic mistake.

If I'm not wrong I have to create one Network Connection Point locally (ST-ONPremise) and a second one on a remote connection (MT) and also a local ION API Authorized App (that then I import/register on MT connection point) and a remote Authorized App that then I import/register on local ST connection point.

Finally, I create a local DataFlow with only the (local) Network Connection point and a remote Dataflow with the (remote) Network Connection point and a data lake ingest task.

Now when I try to test the local Network Connection Point I get the following error

API VERSION : V3] Get Accepted Documents failed: Error details: Call to Get Accepted Documents of external application was not 'ok'. code = 5004. Application connection point 'lid://infor.iondesk.iondesk/mt_ion_from_st_ion' is not in active state

But if I check the mt_ion_st_ion is active!

the remote Network Connection Point cannot be tested because buttons are disabled.

Alberto

Copyright © 2025 Infor. All rights reserved.