Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(models-http-api): add rate limit support for completion and chat #3468

Merged
merged 4 commits into from
Nov 26, 2024

chore: only expose impl for rate limited

eadfd66
Select commit
Loading
Failed to load commit list.
Merged

feat(models-http-api): add rate limit support for completion and chat #3468

chore: only expose impl for rate limited
eadfd66
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch failed Nov 26, 2024 in 0s

0.00% of diff hit (target 75.00%)

View this Pull Request on Codecov

0.00% of diff hit (target 75.00%)

Annotations

Check warning on line 20 in crates/http-api-bindings/src/chat/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/chat/mod.rs#L20

Added line #L20 was not covered by tests

Check warning on line 36 in crates/http-api-bindings/src/chat/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/chat/mod.rs#L36

Added line #L36 was not covered by tests

Check warning on line 44 in crates/http-api-bindings/src/chat/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/chat/mod.rs#L39-L44

Added lines #L39 - L44 were not covered by tests

Check warning on line 17 in crates/http-api-bindings/src/completion/llama.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/llama.rs#L17

Added line #L17 was not covered by tests

Check warning on line 20 in crates/http-api-bindings/src/completion/llama.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/llama.rs#L20

Added line #L20 was not covered by tests

Check warning on line 24 in crates/http-api-bindings/src/completion/llama.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/llama.rs#L24

Added line #L24 was not covered by tests

Check warning on line 24 in crates/http-api-bindings/src/completion/mistral.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/mistral.rs#L24

Added line #L24 was not covered by tests

Check warning on line 29 in crates/http-api-bindings/src/completion/mistral.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/mistral.rs#L29

Added line #L29 was not covered by tests

Check warning on line 37 in crates/http-api-bindings/src/completion/mistral.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/mistral.rs#L37

Added line #L37 was not covered by tests

Check warning on line 23 in crates/http-api-bindings/src/completion/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/mod.rs#L16-L23

Added lines #L16 - L23 were not covered by tests

Check warning on line 47 in crates/http-api-bindings/src/completion/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/mod.rs#L25-L47

Added lines #L25 - L47 were not covered by tests

Check warning on line 57 in crates/http-api-bindings/src/completion/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/mod.rs#L54-L57

Added lines #L54 - L57 were not covered by tests

Check warning on line 28 in crates/http-api-bindings/src/completion/openai.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/openai.rs#L28

Added line #L28 was not covered by tests

Check warning on line 32 in crates/http-api-bindings/src/completion/openai.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/openai.rs#L32

Added line #L32 was not covered by tests

Check warning on line 38 in crates/http-api-bindings/src/completion/openai.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/openai.rs#L38

Added line #L38 was not covered by tests

Check warning on line 51 in crates/http-api-bindings/src/embedding/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/embedding/mod.rs#L50-L51

Added lines #L50 - L51 were not covered by tests

Check warning on line 53 in crates/http-api-bindings/src/embedding/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/embedding/mod.rs#L53

Added line #L53 was not covered by tests

Check warning on line 25 in crates/http-api-bindings/src/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/rate_limit.rs#L14-L25

Added lines #L14 - L25 were not covered by tests

Check warning on line 37 in crates/http-api-bindings/src/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/rate_limit.rs#L32-L37

Added lines #L32 - L37 were not covered by tests

Check warning on line 48 in crates/http-api-bindings/src/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/rate_limit.rs#L41-L48

Added lines #L41 - L48 were not covered by tests

Check warning on line 52 in crates/http-api-bindings/src/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/rate_limit.rs#L51-L52

Added lines #L51 - L52 were not covered by tests

Check warning on line 65 in crates/http-api-bindings/src/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/rate_limit.rs#L60-L65

Added lines #L60 - L65 were not covered by tests

Check warning on line 76 in crates/http-api-bindings/src/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/rate_limit.rs#L69-L76

Added lines #L69 - L76 were not covered by tests

Check warning on line 81 in crates/http-api-bindings/src/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/rate_limit.rs#L80-L81

Added lines #L80 - L81 were not covered by tests

Check warning on line 94 in crates/http-api-bindings/src/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/rate_limit.rs#L89-L94

Added lines #L89 - L94 were not covered by tests