I have a custom load method that retrieves all of the customer ship-to records that do not have corresponding customer document profiles. We have a large amount of ship-to records - almost 10,000. All of my load collections are set with a 0 so that all records are returned. What I have noticed, is that it will only iterate through the number of records set in the Process Default > User Preferences Max Record Cap which was set at 5000 so I end up not getting results for any ship-tos past this 5000 limit. To verify this, I changed the User Preferences Max Record Cap to 10,000 and now I get results past the 5000 limit.
The 5000 is not the limit of the records that are actually displayed in my data table (there are less than 2000) but it limits the records it will process to see if they should show in the data table to 5000. There is no indication this happens, you just have to know that the records returned are not what you expect! I can understand setting a record cap on users, but a CLM generated from a script should not have this limit. Has anyone found a way around this?