Skip to main content
Announcements
Qlik Connect 2024! Seize endless possibilities! LEARN MORE
cancel
Showing results for 
Search instead for 
Did you mean: 
dafnis14
Specialist
Specialist

Match function in QV12 slows reload

Hi,

I have a script similar syntax to the following. After upgrade, it takes 2:15 hours instead of 30 minutes..

LOAD X,

SUM(Y)    AS SUM_Y,

MAX(Z)   AS MAX_Z

FROM c:\XXX

WHERE MATCH(W, 'AAA','BBB','CCC')

GROUP BY X;

Looks like the combination of the aggregation with the Match causes this.

Any idea why?

Thanks!

Message was edited by: Dafnis X Fixed the Group By clause

1 Solution

Accepted Solutions
sasiparupudi1
Master III
Master III

Hi Dafnis

Are you loading the data from a qvd? if this is the case, your group by and match will loose the optimization.

I would suggest you load the table in memory and then do the aggregation

ex:

t1:

LOAD X,

Y

Z

FROM c:\XXX;

T2:

LOAD X,

SUM(Y)    AS SUM_Y,

MAX(Z)   AS MAX_Z

Resident T1

WHERE MATCH(W, 'AAA','BBB','CCC')

GROUP BY X;

This should improve the performance

View solution in original post

6 Replies
Chanty4u
MVP
MVP

you can try like

WHERE W  like  'AAA','BBB','CCC';

sasiparupudi1
Master III
Master III

LOAD X,D

SUM(Y)    AS SUM_Y,

MAX(Z)  AS MAX_Z

FROM c:\XXX

WHERE MATCH(W, 'AAA','BBB','CCC')

GROUP BY X,D;

dafnis14
Specialist
Specialist
Author

Hi Sasidhar,

The original script is correct.

Just fixed my example to the correct syntax.

Another words, there is probably some performance issue with the Group By and Match.

Thanks!

sasiparupudi1
Master III
Master III

Hi Dafnis

Are you loading the data from a qvd? if this is the case, your group by and match will loose the optimization.

I would suggest you load the table in memory and then do the aggregation

ex:

t1:

LOAD X,

Y

Z

FROM c:\XXX;

T2:

LOAD X,

SUM(Y)    AS SUM_Y,

MAX(Z)   AS MAX_Z

Resident T1

WHERE MATCH(W, 'AAA','BBB','CCC')

GROUP BY X;

This should improve the performance

dafnis14
Specialist
Specialist
Author

Amazing!

It took less then 5 minutes!

Thanks so much!

sasiparupudi1
Master III
Master III

Great, all the best