Implement Dataset History Tracking and Data Lineage in Superset

[Ayoub-BOUCHACHIA]

Currently, Apache Superset is a powerful data exploration and visualization platform, but it lacks a built-in mechanism to track the history of datasets and their transformations. Adding a registry to track dataset lineage and history would be beneficial for data governance, auditing, debugging, and improving collaboration. This feature would enable users to trace where the data came from, how it was modified, and when those changes occurred.

Dataset History Tracking:

1. Versioning: Each dataset could be versioned, storing every transformation or update. For example, if a user applies a filter or aggregates data, these changes would be recorded along with the timestamp and user responsible.
2. Metadata Capture: This feature could track metadata such as schema changes, column modifications, data types, or even changes to the underlying database.
3. Audit Trail: Users would be able to see a clear, chronological view of changes made to the dataset, including who made those changes and why (e.g., an update request or bug fix).