Birst - Add Query Based Object filter clause

QiaoLing Teoh

Hi all,

I'm trying to add the filter clause under "Add Query Based Object" in the "Connect" stage in Birst. However, it's not working and show me the error message " java.sql.SQLException: java.lang.IllegalArgumentException: Property predicate is not supported". It's working fine if only filter the query by "lastModified" field. Below are the example of my query:

1. SELECT * FROM OCUSMA WHERE "lastModified" >= '2018-01-01T00:00:00.000Z'  ==> working fine, able to return the results

2. SELECT * FROM OCUSMA WHERE "lastModified" >= '2018-01-01T00:00:00.000Z' and "CUNO" = 'Cust1' ==> not working, display error "Property predicate is not supported"

I had go through the documentation, and it stated that the error is due to the select statement cannot include that property.. but do we have any ways to add filter in query based object or any methods can only load certain records from data lake instead of load or republish whole table which need take hours to complete.

Thanks.

Legacy Contributor

Hey there,

Birst uses a special method of connecting to and querying contents from the Data Lake. Typically, the workflow is to pull the data objects (e.g. SELECT * FROM OCUSMA WHERE lastModified >= '...') into the Birst data warehouse and further process and transform data from there.

You can find a bit more information on the functionality and query behaviors with respect to Birst and Data Lake on the documentation portal under Data Lake JDBC Driver for Birst. Generally, this interface is slimmed down and limits the ability to do JOINs, multiple predicates and filtering, and complex transformations.

The Data Lake and Birst teams are currently working on introducing the Data Lake's Compass driver as a supported query engine for 2021 which will introduce much of the functionality you're trying to test today