Quantcast
Channel: Martin Dráb's Activities
Viewing all articles
Browse latest Browse all 17532

Export to Data Lake - Deleting Old entries from the Datalake

$
0
0

HI All, Wondering any one understand the process of changed data capture with main tables when we export data from F&O to datalake?

For example - this is the snapshot of LogisticsPostalAddress .csv file  from the Datalake, I noticed each and every time when I change the data in the F&O -Custtable there will be an entry in this table. So this table holds the previous address and as well as the current address. I can easily write an sql query and get the latest address but my worry is if these table grows Is there any settings in F&O to delete the old entries from the Datalake CSV files.  I'm mostly worried about the main Finance related tables as the volumes can grow rapidly on a daily basis. Any pointers will be highly appreciated.


Viewing all articles
Browse latest Browse all 17532

Trending Articles