refactor(cache): improve caching system and add expiring cache #408
+289
−17
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2 tasks
caarlos0
reviewed
Jan 6, 2025
cache.go
Outdated
|
|
||
| const ( | ||
| ConversationCache CacheType = "conversations" | ||
| TemporaryCache CacheType = "cache" |
There was a problem hiding this comment.
maybe name it "temp" instead of "cache"? or something more specific?
|
hey! thanks for the PR! can you merge with main? thanks! |
With this approach, I was able to shave off ~1.2s in each request
… cache
Using a standard error type (os.ErrNotExist) instead of a custom error
message ("cache expired") makes the error handling more consistent with
Go conventions and allows for better error checking using errors.Is().
- Add error handling for file removal operations - Properly handle file.Close() errors using defer functions
- Add package-level documentation for cache types and constants - Document public methods and types with descriptive comments - Reorganize constant and variable declarations
nathabonfim59
force-pushed
the
cache.copilot
branch
from
473e6a4 to
9cb7116
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
For my usage which primarily uses Copilot, this change made a huge difference in performance - reducing about ~2 seconds for each request by caching the access tokens.
Not sure if this is the direction you want to go, but I found it very helpful for my workflow.
Let me know if you'd like any changes - happy to update!
Changes
Convert existing cache to generic Cache[T] type
Add ExpiringCache implementation
Note: This PR builds on #406 and should be merged after it.