Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(models-http-api): add rate limit support for completion and chat #3468

Merged
merged 4 commits into from
Nov 26, 2024

feat(models-http-api): add rate limit support for chat

b6ec3a9
Select commit
Loading
Failed to load commit list.
Merged

feat(models-http-api): add rate limit support for completion and chat #3468

feat(models-http-api): add rate limit support for chat
b6ec3a9
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch failed Nov 26, 2024 in 0s

0.00% of diff hit (target 75.00%)

View this Pull Request on Codecov

0.00% of diff hit (target 75.00%)

Annotations

Check warning on line 37 in crates/http-api-bindings/src/chat/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/chat/mod.rs#L37

Added line #L37 was not covered by tests

Check warning on line 48 in crates/http-api-bindings/src/chat/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/chat/mod.rs#L40-L48

Added lines #L40 - L48 were not covered by tests

Check warning on line 22 in crates/http-api-bindings/src/chat/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/chat/rate_limit.rs#L17-L22

Added lines #L17 - L22 were not covered by tests

Check warning on line 37 in crates/http-api-bindings/src/chat/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/chat/rate_limit.rs#L30-L37

Added lines #L30 - L37 were not covered by tests

Check warning on line 46 in crates/http-api-bindings/src/chat/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/chat/rate_limit.rs#L40-L46

Added lines #L40 - L46 were not covered by tests

Check warning on line 58 in crates/http-api-bindings/src/chat/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/chat/rate_limit.rs#L51-L58

Added lines #L51 - L58 were not covered by tests

Check warning on line 63 in crates/http-api-bindings/src/chat/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/chat/rate_limit.rs#L62-L63

Added lines #L62 - L63 were not covered by tests

Check warning on line 17 in crates/http-api-bindings/src/completion/llama.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/llama.rs#L17

Added line #L17 was not covered by tests

Check warning on line 20 in crates/http-api-bindings/src/completion/llama.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/llama.rs#L20

Added line #L20 was not covered by tests

Check warning on line 24 in crates/http-api-bindings/src/completion/llama.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/llama.rs#L24

Added line #L24 was not covered by tests

Check warning on line 24 in crates/http-api-bindings/src/completion/mistral.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/mistral.rs#L24

Added line #L24 was not covered by tests

Check warning on line 29 in crates/http-api-bindings/src/completion/mistral.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/mistral.rs#L29

Added line #L29 was not covered by tests

Check warning on line 37 in crates/http-api-bindings/src/completion/mistral.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/mistral.rs#L37

Added line #L37 was not covered by tests

Check warning on line 23 in crates/http-api-bindings/src/completion/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/mod.rs#L16-L23

Added lines #L16 - L23 were not covered by tests

Check warning on line 47 in crates/http-api-bindings/src/completion/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/mod.rs#L25-L47

Added lines #L25 - L47 were not covered by tests

Check warning on line 60 in crates/http-api-bindings/src/completion/mod.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/mod.rs#L54-L60

Added lines #L54 - L60 were not covered by tests

Check warning on line 28 in crates/http-api-bindings/src/completion/openai.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/openai.rs#L28

Added line #L28 was not covered by tests

Check warning on line 32 in crates/http-api-bindings/src/completion/openai.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/openai.rs#L32

Added line #L32 was not covered by tests

Check warning on line 38 in crates/http-api-bindings/src/completion/openai.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/openai.rs#L38

Added line #L38 was not covered by tests

Check warning on line 17 in crates/http-api-bindings/src/completion/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/rate_limit.rs#L12-L17

Added lines #L12 - L17 were not covered by tests

Check warning on line 29 in crates/http-api-bindings/src/completion/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/rate_limit.rs#L22-L29

Added lines #L22 - L29 were not covered by tests

Check warning on line 34 in crates/http-api-bindings/src/completion/rate_limit.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/http-api-bindings/src/completion/rate_limit.rs#L33-L34

Added lines #L33 - L34 were not covered by tests

Check warning on line 59 in crates/ollama-api-bindings/src/completion.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/ollama-api-bindings/src/completion.rs#L59

Added line #L59 was not covered by tests

Check warning on line 65 in crates/ollama-api-bindings/src/completion.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

crates/ollama-api-bindings/src/completion.rs#L65

Added line #L65 was not covered by tests