Skip to main content
Announcements
Qlik Connect 2024! Seize endless possibilities! LEARN MORE
cancel
Showing results for 
Search instead for 
Did you mean: 
raghujakkani
Contributor III
Contributor III

Tons of Warning Notifications with LOB lookup

Hello,

I have setup a Full Load with CDC replication between Oracle Database - Snowflake on Azure. Full load completed fine without errors/warning. but I am getting swamped with the below warning messages.  

LOB lookup: row was already deleted for the table "TABLE_NAME", PK values:

 

did anyone faced the same issue, looking for resolution. 

 

Thank you. 

Labels (3)
7 Replies
Dana_Baldwin
Support
Support

Hi @raghujakkani 

Full LOBs are not written to the Oracle redo log so Replicate has to run a separate query on the source to obtain the value. The message means that the source row was not found / was deleted when we ran the lookup query.

If LOBs are not actually needed, you can disable them in Task Settings > Metadata > Target Metadata. If they are needed but not the full LOB, you can use Limit LOB size on this same screen. If you need the full LOB the best option is to disable warning notifications if your email is getting flooded, or route them to the operating system log instead of email. Here is the relevant section of the user guide on notifications: Notifications settings #Notifications settings | Qlik Replicate Help

Hope this helps!

Dana

NakulanR
Partner - Contributor III
Partner - Contributor III

Hi @Dana_Baldwin ,

 

Is there any way of suppressing the warning emails that appear as a result of the missing LOBs, rather than switching off the "Any Warnings" notification?

 

We are seeing a scenario where for each "LOB lookup: row was already deleted ..." warning, there are 6 subsequent warning messages, one for each primary key in the table containing the LOB where the warning is: "Column '<col-name>': '<encrypted-value>' ". The "Any warnings" notification cannot be switched off as it reports other warnings that are of importance.

Would just like to know if the extra warning messages can be suppressed in any way?


Regards,

Nak

john_wang
Support
Support

Hello Nak, @NakulanR ,

Thanks for the detailed information. Unfortunately I do not think there is an option to suppress some given warning messages in current major versions. It means there is no filter function yet in notifications. I'm summarizing the relevant articles and Feature Request link, hope it helps a bit.

Regards,

John.

 

Identify Critical Qlik Replicate Notifications

FR: Task Notification Warning Codes

Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!
NakulanR
Partner - Contributor III
Partner - Contributor III

Hi @john_wang

 

Thanks for the prompt reply and confirming that the warnings can't be suppressed. I'll pass the feedback on to the customer facing the issue.

 

Regards,

Nak

john_wang
Support
Support

Thank you for your great support @NakulanR !

Help users find answers! Do not forget to mark a solution that worked for you! If already marked, give it a thumbs up!
Heinvandenheuvel
Specialist II
Specialist II

@NakulanR - you are replying to an older topic, which is just fine as the issue seems to be very much the same. Bu in case there are further developments specific to your customer situation you may want to consider your own follow up topic with clear subject and perhaps a back link.

If this source  "LOB lookup: row was already deleted" is indeed a regular occurrence, then you may wish to review the handling of that table in general. . Maybe it needs it's own task or placement in a dedicated task for trouble tables with lower levels of warning settings. Maybe it needs a different LOB setting - which is unfortunately a task-wide setting, not table specific.

Does that table have 'soft deletes thru using an 'operation_indicator' transformation? Maybe it needs transactional mode for more instant lob lookup or just a task with lower source latency in general. Is the task running with seconds of latency or hours of latency in general - in the later case the chances for a deleted source row are obviously higher. Or if those rows are indeed frequently deleted after soon after insert (seconds - or not much more than task latency, then maybe much higher batch apply tuning setting for timeout is in order. If the task were to apply changes only after collecting for minutes then maybe the delete is seen before the insert is processed and the whole row activity is optimized away? - one can dream right? Note- this would not 'solve' the issue, just potentially reduce the occurrence. The insert could easily happen at the end of one batch cycle and the delete in the next and there would be no cancelling.

Anyway, I hope it is clear that some analysis of what is typically happening to that table on the source is in order and it might just need special handling, different from most tables in the task.

Cheers,

Hein.

 

SushilKumar
Support
Support

Hello team,

 

If our response has been helpful, please consider clicking "Accept as Solution". This will assist other users in easily finding the answer.

 

Regards,

Sushil Kumar