Is posible to Purge a Object in Data lake before the next ingest load?

Mauricio Mendoza

Hi,

The purge option in data lake is only Ad Hoc? Someone knows if is possible?

Regards,

Mauricio

Find more posts tagged with

Infor Data Fabric

Accepted answers

All comments

unknown

Turn off the replication before purging

Mauricio Mendoza

Where can I turn off the replication before purging?. I am looking to have the object (Custom) purged before next load. Is possible?

Regards,

Mauricio

Prabakaran Nallayagounder

Re-population of the Data Lake

Should there be a requirement to re-populate the Data Lake, please adhere to the following established process.

Step 1: Syteline - Replication Rules:

Ensure that the selection for DATALAKE is configured to ‘Immediate’.
Verify that the ‘Disable Replication’ checkbox is activated (ON).

Step 2: Purge the Data Lake

Step 3: Syteline - Replication Rules :

Verify that the DATALAKE selection is set to ‘Immediate’.
Ensure that the ‘Disable Replication’ checkbox is deactivated (OFF).

Step 4: Syteline - Replication Management

Select the ‘Regenerate Replication Triggers’ checkbox.
Proceed to click the ‘Regenerate Replication Triggers’ button.

Step 5: Syteline - Manual Replication Utility:

Create and save a new record with the following details:

Site: DATALAKE
Category: DATALAKE

For multiple site configurations, ensure the ‘Local Data Only’ checkbox is unchecked.
Confirm that the ‘Run as Background Task’ checkbox is activated (ON).

Initiate the replication by clicking the ‘Replicate’ button.

Navigate to the ‘Background Task History’ and verify the job has been completed.

Please Note:
Should you have a DATALAKE_ADD Category, it is recommended to replicate the aforementioned steps for this category as well. Both categories can be initiated concurrently prior to reviewing the Background Task History form.
Important Consideration:
The duration required for data replication may vary significantly. This variance is contingent upon the volume of historical data retrieved and the duration for which the client has been conducting workshops or operating in a live production environment. Please be advised that extensive data sets may lead to longer replication times.

Mauricio Mendoza

Hi,

This is not for Syteline. This is for LX and Custom tables in the i5 database using the EC - Enterprise Connector.

Regards,

Mauricio

Danil Klemeshov

Hi Mauricio,

Have you considered using the Data Lake APIs to delete an object?

Kind regards,
Danil.

Kevin Heiman

Mauricio, There are APIs that could be used if you want to do something like purge a range or all data. This could be implemented in a Data or Work Flow using API call.

If you are pulling through AnySQL/ Data Loader, you would need to schedule this just before the load runs.

Or you can use the time filter on the API / UI to deleted them afterwards. i.e. Delete all with a file date before the first timestamp of the new data set.

If you are using compass, you would need to also run the clear function to remove the deleted data.

Mauricio Mendoza

Hi Danil / Kevin.

Understood. Thank you.

Regards,

Mauricio

Copyright © 2025 Infor. All rights reserved.