Extracting Data from the Data Lake into sql server staging tables

tdouglass

Hi,

We have a need to extract information from the Data Lake and store it into sql server/azure staging tables for use outside of M3 or Birst.  Is this possible with the JDBC connection?  If so, is there instructions similar to an existing thread for installing on a tableau directory?  If not, Is there any other tool, other than the new ETL tool that will allow us to extract this information?

Tina

Legacy Contributor

Hey Tina,

The Compass JDBC driver and RESTful API services provide you with direct query access to data objects stored within the Data Lake. If you're looking to move copies of that data to a database or data warehouse, you're typically thinking something along the lines of ETL tooling which makes this much easier to manage. However, quite a few customers have written code to accomplish this as well including Microsoft SSRS, Powershell, PHP, and other languages.

The benefit of ETL tools or even relatively simple data pipeline software is that they help managed the connection and movement of that data along with statistics, resiliency, and so on. If your organization already has ETL tools - and many companies may already have one - then you could readily use the Compass JDBC driver there as well.