Ion Data Fabric (Customer Central Usage Report) Data Fabric Compute Time in minutes way too high. We have to find what is causing this. How can I find it ?
ION would be a part of the discovery for environments using data sources flowing through ION, however data can be put into Data Lake in other ways. Since what you are looking for is around from Data Fabric, regardless of how it got there, then Atlas is the way to explore Data Lake files.
Atlas is the UI front end and there are APIs for Data Lake as well. This will help you understand the volume of data changing / landing in Data Lake. You may have to look closer to see counts of Upserts / duplicate variations. There are some admin queries that could be run as well .
There are several ingredients to compute time as described in the Service Limits for Compute time. These are impacted by the amount of continually changing data, frequency of query, SQL clears of cache and a few other factors.
Can you clarify if you question is more about what is causing this to be high?
If needed, the Services teams can help you review what your processes could be doing to be more efficient.
If you want to reach out to your CSM, or directly to me, we can do a quick review of the numbers we see. We appreciate any feedback to improve the representation and documentation.
Kevin In ion one view: is there a way to find out what is causing the high?
tks Kevin. Wich admin query can we run to find out?
