Active Datalake Data Flow not receiving documents from connection point

Legacy Contributor

My database connection point tests OK.
Next I defined a Datalake dataflow....I have a 2 node flow

Database node

The valid database connection point was added to Database
The database connection is able to read all database objects in the SqlServer schema. I have imported all columns, and generated the metadata.

Ingest node

Per requirement at least on ingest node is required.

While I can see the Table in Data Lake compass (presuming this was created by generating metadata) the catalog reamins empty. I dont' see any documents being sent to the connection point

NOTE. I have this set as every minute, and presume regions timeclock is GMT and 7 hours ahead of US CST. This dataflow should be running each minute.   

Legacy Contributor

After rummaging through logs, I suspected that SqlServer was prohibiting an IP/Port configuration sent by enterprise connector. I spent quite a bit of time in SqlServer Configuration Manager, specifically, SqlServer Network Configuration; Protocols, TCP/IP protocols enabling IP addresses and port 1433.

IP address, IP1 - 1P12 for example, are defined when you open the tab. Addresses are dedicated to IPV6 and IPV4. I was not able to define additional IP address. I located IP addresses that matched IP address in the logs, and confirmed that SqlServer Addresses and Port 1433 were enabled.

I also enabled TCP Dynamic Ports, but it appears I can only set one port: 1433.



I restarted the service and in the short run, this did solve location and database connection point failures, and I was able to use the database connection point in a Datalake Data flow, but I was never able to get records from SqlServer to Datalake. Then I started to experience grid failures, and my grid refused to connect e.g. AdminUI.cmd



So I decided to reinstall the connector on Postgres, which generated InforONEECGrid database. I configured the pg_hba.conf with broad IP address ranges, and left my SqlServer database in place. This configuration results in a reliable grid, and just like that I see documents in ION OneView, and confirmed records in DataLake Compass.



I strongly suspect the issue is SqlServer Network Configuration of TCP/IP protocols IP addresses and ports, but I could not seem to make the right ip address to port definittion. NOTE: postgres pg_hba.conf allow you to use CIDR ranges

If there are any SqlServer DBA gurus out there, I would like to hear from you.