How to compress a file to ZLIB deflate format to use in DataLake ingestion API?

Hi All,

Need small help.

We are trying to use the below API URL and passing the necessary input arguments.

URL :mingle-ionapi.se2.inforcloudsuite.com/.../dataobjects

Getting the below error: File compression type is not DEFLATE.

As per the documentation, Data objects must be sent compressed using ZLIB compressed data format with the DEFLATE compressionmethod. Requests containing uncompressed files or files compressed with a different method are rejected. Unable to find any ZLIB compressed applications.

Can anybody please suggest any other compression methods we can use or where and how to download the ZLIB compress setup file. Thanks.

Regards,

Kiran Kolluri

Find more posts tagged with

API Usage

Accepted answers

unknown

Kiran,

zlib is normally available by default for most linux distributions. to add it to windows you can find links here: https://zlib.net/

once installed (you may need to update your path statement), just use this syntax:

openssl zlib < sourcename > targetname

whre "sourcename" is the raw file and "targetname" is the deflated version.

...or you could install an emulator like CMDER (Cmder | Console Emulator) and run from there.

Good luck!

Kiran Kolluri

Hi @david-peters

I have tried with your recommended way an its working fine. Thanks.

NonStock.flv

All comments

unknown

What platform are you using? In Windows, you can use a program like 7-zip and deflate the file. If you are in Linux and just at a command line, you can use the gzip command. I have scripts running in Linux using PHP and for those I use the gzcompress() function. For python you would use the zlib library and the zlib.compress() function. It all depends on what platform/language you use. Also be sure to limit your file sizes when ingesting into data lake, there is a limit, so if you have a big file you might need to break it into smaller files first. Finally, make sure you are using nd-json and not regular json or the data won't be query-able.

unknown

Oh and a couple more things. First, make sure you get the uncompressed file size (in bytes) before compressing because that is required. And then if you have a lot of files, there is a 200 file per minute limit when sending data to the data lake with the API. It's a balancing act when ingesting large amounts of data to get the file sizes big enough to limit your files to under 200 per minute but small enough to stay under the size limit. It's not a big deal if you are doing this manually, but if you do it programmatically you have to make sure to account for these things in your code.

Kevin Heiman

This should be posted in the new Infor Developer community from https://developer.infor.com then select Community or https://community.developer.infor.com/
I can share some sample Python code there

Kiran Kolluri

Thanks @dkersten and @kevin-heiman .

We are going to propose this API to third party application to invoke and ingest data into datalake.

I am testing this in our ION API suite and during upload the file facing the compress error. Thanks.

Regards,

Kiran Kolluri

I am testing with the below option. Thanks.

ISCO Presentation.mp4

unknown

Download 7-zip for windows, Deflate your nd-json file. Then choose it and execute.

Kiran Kolluri

Hi @dkersten ,

Thanks for your quick response.

Tried the same way but getting the below error.

unknown

Sorry, looks like 7-zip does use deflate but isn't specifically using zlib. I'm not aware of a windows program that will do it, so either install python and write a python script, or do it in Linux. Perhaps someone else knows of a Windows program that supports zlib deflate natively. Frankly, chatGPT can write you a python script that would do it. If I had to do this in Windows, I would just go that route.

unknown

Kiran,

zlib is normally available by default for most linux distributions. to add it to windows you can find links here: https://zlib.net/

once installed (you may need to update your path statement), just use this syntax:

openssl zlib < sourcename > targetname

whre "sourcename" is the raw file and "targetname" is the deflated version.

...or you could install an emulator like CMDER (Cmder | Console Emulator) and run from there.

Good luck!

Kiran Kolluri

Hi @david-peters

I have tried with your recommended way an its working fine. Thanks.

NonStock.flv

Copyright © 2025 Infor. All rights reserved.