Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

InvokeModelInput has no explicitPromptCaching parameter #3030

Open
2 of 3 tasks
daqingllm opened this issue Mar 6, 2025 · 2 comments
Open
2 of 3 tasks

InvokeModelInput has no explicitPromptCaching parameter #3030

daqingllm opened this issue Mar 6, 2025 · 2 comments
Labels
service-api This issue is due to a problem in a service API, not the SDK implementation.

Comments

@daqingllm
Copy link

Acknowledgements

Describe the bug

Since InvokeModelInput has no ExplicitPromptCaching param, using go sdk can't enable prompt caching. It's a serious problem!

Regression Issue

  • Select this option if this issue appears to be a regression.

Expected Behavior

Support ExplicitPromptCaching

Current Behavior

No ExplicitPromptCaching param for InvokeModelInput

Reproduction Steps

none

Possible Solution

No response

Additional Information/Context

No response

AWS Go SDK V2 Module Versions Used

v1.8.3

Compiler and Version used

1.20

Operating System and version

mac

@daqingllm daqingllm added bug This issue is a bug. needs-triage This issue or PR still needs to be triaged. labels Mar 6, 2025
@Madrigal
Copy link
Contributor

Madrigal commented Mar 6, 2025

related to #2986

Need Bedrock Runtime to release updated models to the SDK

@lucix-aws lucix-aws added service-api This issue is due to a problem in a service API, not the SDK implementation. and removed bug This issue is a bug. needs-triage This issue or PR still needs to be triaged. labels Mar 6, 2025
@macnibblet
Copy link

@Madrigal when can we expect an update?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
service-api This issue is due to a problem in a service API, not the SDK implementation.
Projects
None yet
Development

No branches or pull requests

4 participants