AnySQL Incremental Load with Custom DataTypes

Hi,

I'm trying to load SunSystems data into the datalake using AnySQL. Many of the table fields have custom datatypes on the key fields - which makes it impossible to use as an incremental key for ION.

Has anyone found a workaround. Note that this is a Single Tenant SunSystems environment - so I don't have access to the SQL instance directly.

The current workaround is a full drop and reload of the datalake tables .. which works but isn't ideal.

Thanks in advance,

Les.

Find more posts tagged with

ION Connect

Accepted answers

All comments

Kevin Heiman

What are these data types that are not usable? There are a limited few data types that can be altered in the Select UI.

What is this particular column for incremental use?

Adding a view or joining to a second table are alternatives, however you may be limited in your situation.

antonio-caria

You want define a Unique Key for ION by table ?

Legacy Contributor

Thanks for contributing - I've raised an enhancement request for this.

The source system is outside of the client/partner control - so we don't have access to amend datatypes, create new fields or to create views.

The column would be (e.g.) a Lastupdate datetime field (casted as a custom datatype) but as the SQL type is non-standard - it cannot be used as a incremental key to track new records. (An ION error occurs when trying to do so)

Without setting an incremental key - the entire table is loaded each time I run the data load process, rather than having incremental rows loaded. This results in having an extra step of purging Datalake tables prior to each load to maintain data integrity.

Regards,

Les.

Kevin Heiman

Les, we are working a similar scenario for a client. Could you email me so that we can compare your needs?

We can then advise our outcome back here.

Copyright © 2025 Infor. All rights reserved.