Troubleshooting Stale Merged Loser Entities Remaining Active in Databricks Delta Share

Query/Question: 

Why do merged loser entities continue to show deleted=false and remain visible as active records in Databricks Delta Share tables?
 

Probable Cause: 

Downstream Delta Live Tables (DLT) update entity status based on ENTITY_LOST_MERGE (C5) pipeline events. If event streaming is interrupted, filtered, or fails to emit tombstone markers during the merge lifecycle, the loser record is not flagged as deleted in downstream tables.


Recommended fix: 

Run a targeted entity resync with reindexDeleted=true to republish deleted/merged state to the pipeline:

POST {tenantURL}/syncToDataPipeline?dataTypes=entities&reindexDeleted=true&entityType=<ENTITY_TYPE>

Documentation links: 

 

Reltio Data Pipeline Event Types] (https://docs.reltio.com/en/explore/reltio-data-pipeline/data-pipeline-events) | [Sync to Data Pipeline API] (https://docs.reltio.com/en/explore/reltio-data-pipeline/sync-data-pipeline-api)

Was this article helpful?
0 out of 0 found this helpful

Comments

0 comments

Please sign in to leave a comment.