Hi,
Some thoughts about building and maintaining dimension-structures in V12:
I have lots of old V11-Importmaster-Jobs in which dimensions are updated. Usually they all work in the same way, e.g. for accounts:
- Run a query on a table with all accounts from the accounting-system
- Check, if account already exists
- If not: write a message in the protocol, add the new account and assign it to its node.
The challenge is: the main structure (nodes) of the PNL or Balance Sheet is available in the accounting system, but there is only one chart of accounts!
Now the requirement is that in controlling dept in addition to the standard chart of accounts they need various and flexible nodes to build sums over different sets of accounts which are from different nodes in the standard chart. So one base-account can be member of a lot of nodes. This can result in a number of parallel hierarchies.
This flexibility cannot be maintained in the accounting system, maybe one alternative chart of account would be possible but not unlimited.
In V11 this was an easy thing: Just adding some new elements and do the node-assignments in OLAP-Administration and done!
Now as we are in the migration to V12 and to become one day cloud-ready, I want to replace the Importmaster-Jobs more and more with native EPM-mappings and modelling tools.
I understand, that for this the whole structure of the dimension must be available in a relational structure, so not only new accounts or the standard chart, but the whole dimension including all individual nodes and elements, because when using a EPM mapping the dimension is always uploaded as whole.
What is the best way to easily maintain the individual structures in a dimension that cannot be queried from another source-system, as they are built in the head of the controllers?
Good thing would be, to maintain these individual structures in an Excel-Sheet, as everybody is familiar using Excel and it is very easy to copy 500 lines and search and replace things, make comments and formatting for easy reading. But how can the content of this Excel be uploaded into the staging database to link it to the other “standard” content of the dimension.
- Importmaster is one way, but as said, I want to get rid of this tool.
- SQL-Server Datatools or SSIS_Packages is another way – very technical.
- Exporting XLSX to CSV and upload this in repository and then using an APE-Script is technically possible, but this is inconvenient and several steps to execute.
- Giving users direct access to the staging database so that they can write their own INSERTS- and SQL-Statements – will end in chaos….
I assume, that other “legacy-V11/MIS-Customers” face this challenge as well.
I’m interested in how others are facing this challenge, what is your best practice to maintain individual dimension structures, what is your “replacement/successor” of OLAP-Administration-Tool?
I know that in V12 Relational- and OLAP modelling such functionality is available, but I’m talking of dimensions with hundreds or thousands of elements and I think the existing tools are good for smaller dimensions like versions etc, but not comfortable to handle big dimensions as accounts, customers, items etc.
Looking forward to your experience,
Ralf