Hello does anyone know what the timeline is for when we will be able to use infor streaming pipelines/snowpipe to stream realtime data straight from FSM to snowflake?
Isn't that already available as an option on your Replication Set? The Data Destination is "Streaming". If memory serves this was available with 2025.10.
It's possible if it's an indicator-based replication that it wouldn't show, only batch ingestion is used in that case. From doco:
Streaming - You can send records to other destinations using Infor OS Data Fabric streaming pipelines. You can use streaming to publish live data, but it is not intended for publishing initial load, archived data, or large-scale replication.
After replication occurs, records are ingested by the Infor OS Data Fabric and sent to the Data Lake in batches, which run at least every five minutes. In addition, the records are streamed to other destinations through pipelines. For replication sets configured for streaming, initial or full replications use the Data Lake Batch Ingestion method. Only incremental replications use the streaming ingestion service.
Streaming does not require prior configuration or setup. To confirm that streaming is ready, you can check the status of the Data Lake Stream Ingestion ION component in the Async Administrator and confirm if it has a Healthy status.
The delivery of the documents to Infor OS Data Fabric is processed by the StreamSweep action in the Async DataLakeStreamIngestion queue. When the documents are processed, they are removed from the DataLakeQueue holding table. To monitor the streaming activity, go to the Streaming Queue tab of the replication set and view the DataLakeQueue holding table.
Note: The streaming feature is not yet available in Infor Government Solutions (IGS).
Hi @Miles McLeod it looks like you got an answer here, should I close the other, similar, post?
No, this doesnt give clarity on the nuance of the destination being snowflake and the snowpipe feature which allows the bypassing of alot of manual pipeline building process to land the data in snowflake.
So once your FSM replication target destination is streaming I think the missing piece you are after is the setup and configuration of a pipeline in the Data Fabric streaming pipelines side in OS. This is where you'd specify or hook up to a snowpipe.
So I guess what I would like to confirm with you, is the set up and and amount of work in involved on both sides to stream fsm data from the data lake to snowflake through streaming pipelines is the same as doing it directly from FSM to Snowflake?
