parquet Files

[raadwiptec]

Any leads/suggestions how to read parquet Files from Qliksense? 

[Alexis_Touet · Accepted solution]

Hi @raadwiptec 

You could use apache drill / ODBC.
To preview the data and select columns you will need to use SQL query in your script or a paid  plugin by Cdata.

Hope this helps

[cookiejest]

Hi! Yes, we recently built a tool to do direct streaming of data to Qlik from Parquet files using the standard Qlik REST connector called Cloudslurp.

Just create an account and link your S3 bucket, Dropbox or upload your Parquet file. Then you can start doing SQL based queries to the file and then use the standard REST connector in Qlik to load data into your app. It has the added benefit of being able to filter down large Parquet files to smaller data sets so you can significantly reduce your app reload time.

The API call you use in the Qlik REST connector looks like this:

https://api.cloudslurp.com/data?token=YOURTOKENHERE&query=SELECT * FROM cldslp1."yellow_tripdata_2022-01.parquet";

You can copy and paste this for your exact data set by clicking on the 'Code' button:

[Lucke_Hallbergson]

Have a go at it!

https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/Introduction/saas-change...

[diagonjope]

Hi @raadwiptec ,

For what it might be worth, it seems tha QSe can now handle Parquet files:

https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/Scripting/work-with-parq...

Cheers,

++José

[TusharDev_Qlik]

Hi Alexis,

Could you please advise on using Apache Drill which is in built available with QS installation ?

Any external ODBC driver we need to install as an alternative solution to load .parquet files?

[marksouzacosta]

Qlik supports Parquet files since release August 2023:
https://help.qlik.com/en-US/sense/February2024/Subsystems/Hub/Content/Sense_Hub/Scripting/work-with-...