Incremental Load with Replace - unexpected behavior

[exfosteve]

I have some behavior I'm not expecting.

I'm doing an incremental load, and the common field is timestamp which I have stored as a number (only 1 entry exists '43149'). 

If I don't use the where clause, the concatenation works fine.

Concatenate(INCDATA)

LOAD * from '$(outputFile)' (qvd) ;

This works.

Concatenate(INCDATA)

LOAD * from '$(outputFile)' (qvd)

where text(timestamp) <> '43159';

This does not.

Concatenate(INCDATA)

LOAD * from '$(outputFile)' (qvd)

where not Exists(timestamp);

Any Ideas?

[krishnacbe]

Check the format of the timestamp in both the tables.

[exfosteve]

I did floor(timestamp,1) prior to the incremental load.

[YoussefBelloum]

Hi,

can you show the script, especially when you first load your field timestamp ?

[exfosteve]

Here you go. I also included the 2 QVD Files

[exfosteve]

I ended up getting working based on the the following post:

Concatenate Load Where New ID (Not Exists)

by adding a temporary variable, this fixed it.

Let baseFile = 'skinnyBase.qvd';

Let updateFile = 'skinnyUpdate.qvd';

UDATA:

Load timestamp, Result,  timestamp as tsTMP

from '$(updateFile)' (qvd);

Concatenate(UDATA)

Load timestamp, Result from  '$(baseFile)' (qvd)

where not exists(tsTMP, timestamp);

DROP Field tsTMP;

[YoussefBelloum]

Hi Steve, it is working for me

with the where not exists, it is concatenating and removing correctly the value 43159 read from the first table.

[exfosteve]

what version are you using?  I'm running 11 SR17.