Skip to main content
Announcements
Qlik Connect 2024! Seize endless possibilities! LEARN MORE
cancel
Showing results for 
Search instead for 
Did you mean: 
sivavasam
Contributor II
Contributor II

Incremental Load with 3 columns as key

Hi 

I need to implement incremental data db table has 25,000,000 lines .... 50 plus fields but I has 3 coloumns  to combine a key for where not exists key .pls suggest me 

Example 

Table :

Load A,B,C,D,E

From QVD ;

Max:

Load Max (D) as MaxD

Resident to Table ;

Drop Table ;

Drop Max;

Let vMaxDate = peek ( 'MaxD',0);

Source :

Load * select From DB

Where D > '$(vMaxDate)';

Concatenate (source)

Load *, A &'|'&B&'|'&C as Key 

From Source QVD

Where doesn't not exists ( key);

Suggest if any ....

 

 

 

 

Labels (1)
1 Reply
BrunPierre
Partner - Master
Partner - Master

Hi, try this.

Let vMaxDate=Peek('MaxD', 0, 'Max');

Source:
LOAD * select From DB
Where D > '$(vMaxDate)';

Concatenate(source)
LOAD *
Where not Exists (Key);

LOAD *,
A &'|'&B&'|'&C as Key

FROM Source QVD;