Hi,
We have had a successful POC of the Infor ETL Tool..
Question from our business architecture team ..
Can this be installed on a MS Server 2022?
Thanks
docs.infor states:
https://docs.infor.com/inforos/2023.x/en-us/useradminlib_cloud/default.html?helpcontent=etl_dl_ag/gac1608044295677.html
There are some other best practices for sizing and job building that should be followed when you build out for scale.
for example limit 8-10 transformations per job. Jobs should have a blend of transformation types so that not all the wide and deep loads are in the same Job.
try to schedule at a 15 min minimum interval, ideally larger. Data volumes can dictate.
Plenty of memory and fast DB insert update over network is important.
Keep your ETL software up to date. There a some fixes coming and transition to the newer Data Fabric APIs coming. watch for important updates.
Consider multiple server for a failover, run Jobs in parallel for different transformations, and should a server fail, you can put all job son the 2nd server temporarily.
These and more in docs and the training sessions.
Thanks Kevin!
Hi Chris,
Out of curiousity, why using the ETL tool? Do you use it to export the data from datalake into a local database for BI purposes? If that is the case, why not using streaming pipelines?
It is only available for postgres databases right now. I think Sql Server might be Q1 2024
Ah thought it was released last month, but apparently only for postgres. We used a datalake flow in ION to send updates as a json file to a file location where we import it into a sql database. In that case we didn't need the ETL tool, which makes it more easy to manage.
Currently, our repsets are being consumed by MSSQL Server (Dashboard Gear) .. We are interested in the pipelines, when it becomes available for MSSQL Server.
