Can a view be created in the data lake that only filters on one code and can this be used in the Infor ETL tool?
I'm not suggesting a solution design here and if this is the best approach for dealing with your use case. Mainly answering if Data Lake Views can be used in ETL.
Technically yes, you can query a Data Lake View with the ETL Client by using the 'query' function in the Data Lake Input step. 'Query' function is using the Compass API service so you could run a SELECT that queries a view and returns the result set to ETL.
However, Infor has not documented practices on incrementally extracting data with the 'query' ETL function. There are documented best-practices on how to do incremental loads with the 'QueryAll' function, which is the recommended way of extracting data with the ETL Client.
So in this case, if you decide to use the 'query' function for incrementally loading data over time you would have come up with a ETL solution design or engage with the Infor Services team for help.
I recommend when using 'query' function to have good knowledge of Compass functionality as well Infor OS Service Limits that apply for running Compass queries.
Thank you for your reply. I was not sure if i did a view in the data lake if that would allow me to stay in the best practices by not having the query in the ETL code. It is our inventory transaction table that i need which will have MANY (Probably millions) of records and we only need one code type
