HoneyHive is a model observability and evaluation platform that helps you continuously improve your models in production. We help you evaluate, deploy, monitor and fine-tune both closed and open-source large language models for production use-cases, allowing you to optimize model performance & align your models with your users’ preferences.
go get github.com/speakeasy-sdks/honeyhive-go-sdk
After signing up on the app, you can find your API key in the Settings page.
package main
import (
"context"
"log"
"github.com/speakeasy-sdks/honeyhive-go-sdk"
"github.com/speakeasy-sdks/honeyhive-go-sdk/pkg/models/shared"
"github.com/speakeasy-sdks/honeyhive-go-sdk/pkg/models/operations"
)
func main() {
s := honeyhive.New(honeyhive.WithSecurity(
shared.Security{
BearerAuth: shared.SchemeBearerAuth{
Authorization: "Bearer YOUR_BEARER_TOKEN_HERE",
},
},
))
req := operations.CreateDatasetRequest{
Request: shared.Dataset{
Description: "unde",
File: "deserunt",
Name: "porro",
Purpose: "nulla",
Task: "id",
},
}
ctx := context.Background()
res, err := s.Dataset.CreateDataset(ctx, req)
if err != nil {
log.Fatal(err)
}
if res.CreateDatasetResponse != nil {
// handle response
}
}
CreateDataset
- Create DatasetDeleteDataset
- Delete DatasetsFindDatasets
- Get Datasets
CreateFeedback
- Create Feedback
FindFineTunedModels
- This endpoint gets the fine-tuned models being managed by the user.
GetGeneration
- Get GenerationsIngestGenerations
- Create Generation for TaskModelPromptCreateGeneration
- Create Generation for Model and PromptTaskCreateGeneration
- Create Generation for Task
CreateMetric
- Create MetricFindMetrics
- Get Metrics
ChangePrompt
- Update PromptsCreatePrompt
- Create PromptDeletePrompt
- Delete PromptsFindPrompts
- Get Prompts
CreateTask
- Create a new taskFindAllTasks
- Find all TasksUpdateTask
- Update an existing task