Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MCOL-4889 Vacuum cleaning for on-disk data empty records #3237

Draft
wants to merge 13 commits into
base: develop
Choose a base branch
from

Conversation

Ziy1-Tan
Copy link
Contributor

@Ziy1-Tan Ziy1-Tan commented Jul 3, 2024

MCOL-4889 introduces new tools for managing AUX columns (introduced in #2046) to reduce disk usage.

Main Changes

1. Display Empty Value Rate

  • mcs_analyze_partition_bloat(['schema',] 'table', 'partition'): Analyze empty value rate at the partition level.
  • mcs_analyze_table_bloat(['schema',] 'table'): Analyze empty value rate at the table level.

2. Manual Cleanup

  • mcs_vacuum_partition_bloat(['schema',] 'table', 'partition'): Manually clean up empty values at the partition level.
  • mcs_vacuum_table_bloat(['schema',] 'table'): Manually clean up empty values at the table level.

3. Automatic Cleanup

  • VacuumCleaner: A background worker that automatically cleans up empty values.

@Ziy1-Tan Ziy1-Tan marked this pull request as draft July 3, 2024 16:38
@Ziy1-Tan Ziy1-Tan changed the title Vacuum cleaning for on-disk data empty records MCOL-4889 Vacuum cleaning for on-disk data empty records Jul 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant