Skip to content

Commit

Permalink
fix typo and add warning about replace lines
Browse files Browse the repository at this point in the history
  • Loading branch information
tinco committed Feb 6, 2025
1 parent b980407 commit 7ebdff2
Show file tree
Hide file tree
Showing 3 changed files with 4 additions and 2 deletions.
2 changes: 1 addition & 1 deletion EVALUATIONS.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,6 @@ An eval can be run as follows:
cargo run -- -c test-config.toml eval patch -i 5
```

The evals are analagous to unit tests, but statistical instead of deterministic. They should exercise a subset of
The evals are analogous to unit tests, but statistical instead of deterministic. They should exercise a subset of
the tools and/or agent behavior. By designing the evals this way, they are less expensive than running a full benchmark
such as SWE-bench, but still protect the agent from regressing on intended behavior.
2 changes: 2 additions & 0 deletions src/agent/tools/replace_lines.rs
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
/// Replace lines in a file. This tool is in beta and only has a ~80% success rate.
use swiftide::traits::CommandError;

use anyhow::Result;
Expand Down
2 changes: 1 addition & 1 deletion typos.toml
Original file line number Diff line number Diff line change
Expand Up @@ -3,4 +3,4 @@ extend-ignore-identifiers-re = ["ratatui.*"]

[files]
# Autogenerated
extend-exclude = ["CHANGELOG.md", "tests", "cliff.toml", "src/resources/*"]
extend-exclude = ["CHANGELOG.md", "tests", "cliff.toml", "src/resources/*", "src/evaluations/fixtures/*"]

0 comments on commit 7ebdff2

Please sign in to comment.