Replies: 1 comment 6 replies
-
2024-08: ADOPT |
Beta Was this translation helpful? Give feedback.
-
|
@jacobwoffenden I heard that you might be running an evaluation on Bedrock comparing against the cost of self-hosting LLM training and execution? |
Beta Was this translation helpful? Give feedback.
-
|
👋 hey! my original firebreak (ministryofjustice/analytical-platform#4915) was comparing bedrock vs. cpu vs. gpu, but on reflection they aren't really serving the same purpose, so I removed it from the evaluation |
Beta Was this translation helpful? Give feedback.
-
|
Do you know if we should be adopting AWS bedrock or do you think this is still at the ASSESS stage? |
Beta Was this translation helpful? Give feedback.
-
|
I'm not sure as a platform team we can weigh in on that, our job is to make it available as demand arises. We've yet to gather any feedback on it either, do you know if its been useful? |
Beta Was this translation helpful? Give feedback.
-
|
@PriyaBasker23 I think you've got the most experience on Bedrock in the team - perhaps you can run an evaluation later in the year? |
Beta Was this translation helpful? Give feedback.
-
https://aws.amazon.com/bedrock/
Beta Was this translation helpful? Give feedback.
All reactions