Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: fix hang on bad datafile #53

Merged
merged 4 commits into from
Nov 10, 2023
Merged

fix: fix hang on bad datafile #53

merged 4 commits into from
Nov 10, 2023

Conversation

coanor
Copy link
Contributor

@coanor coanor commented Nov 9, 2023

If there was a bad datafile(0 byte size datafile or invalid data header), the cache Get() will always stand on the bad file.

On the fix, we just skip these bad file(switch to next read-pending file).

If there was a bad datafile(0 byte size datafile or invalid data
header), the cache Get() will always stand on the bad file.
@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

@guance-review-bot
Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: coanor

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@guance-review-bot
Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: coanor

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@guance-review-bot guance-review-bot bot added size/L and removed size/M labels Nov 9, 2023
diskcache/get.go Outdated
droppedBatchVec.WithLabelValues(c.path, reasonBadDataFile).Inc()
}()

if err := c.removeCurrentReadingFile(); err != nil {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这段代码要重构,它跟已有代码有很大重合。

@guance-review-bot
Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: coanor

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@guance-review-bot
Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: coanor

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@coanor coanor merged commit a50ea02 into main Nov 10, 2023
1 check failed
@coanor coanor deleted the fix-get-on-bad-data-file branch November 10, 2023 08:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants