From 3e05de65e98af47b517b6acde8e4c5d11e429af1 Mon Sep 17 00:00:00 2001 From: Antonio Sarosi Date: Thu, 28 Nov 2024 22:51:55 +0000 Subject: [PATCH] Test report --- integ-tests/typescript/test-report.html | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/integ-tests/typescript/test-report.html b/integ-tests/typescript/test-report.html index 249e518b0..93f836248 100644 --- a/integ-tests/typescript/test-report.html +++ b/integ-tests/typescript/test-report.html @@ -257,9 +257,9 @@ font-size: 1rem; padding: 0 0.5rem; } -

Test Report

Started: 2024-11-28 22:45:21
Suites (1)
0 passed
1 failed
0 pending
Tests (70)
68 passed
2 failed
0 pending
Integ tests > should work for all inputs
single bool
passed
0.428s
Integ tests > should work for all inputs
single string list
passed
0.385s
Integ tests > should work for all inputs
return literal union
passed
0.312s
Integ tests > should work for all inputs
single class
passed
0.405s
Integ tests > should work for all inputs
multiple classes
passed
0.717s
Integ tests > should work for all inputs
single enum list
passed
0.407s
Integ tests > should work for all inputs
single float
passed
0.304s
Integ tests > should work for all inputs
single int
passed
0.523s
Integ tests > should work for all inputs
single literal int
passed
0.39s
Integ tests > should work for all inputs
single literal bool
passed
0.281s
Integ tests > should work for all inputs
single literal string
passed
0.343s
Integ tests > should work for all inputs
single class with literal prop
passed
0.615s
Integ tests > should work for all inputs
single class with literal union prop
passed
0.616s
Integ tests > should work for all inputs
single optional string
passed
0.609s
Integ tests > should work for all inputs
single map string to string
passed
0.641s
Integ tests > should work for all inputs
single map string to class
passed
0.587s
Integ tests > should work for all inputs
single map string to map
passed
0.427s
Integ tests > should work for all inputs
enum key in map
passed
0.64s
Integ tests > should work for all inputs
literal string union key in map
passed
0.777s
Integ tests > should work for all inputs
single literal string key in map
passed
0.743s
Integ tests > should work for all inputs
primitive union alias
passed
0.46s
Integ tests > should work for all inputs
map alias
passed
0.845s
Integ tests > should work for all inputs
alias union
passed
1.529s
Integ tests
should work for all outputs
passed
4.278s
Integ tests
works with retries1
passed
1.074s
Integ tests
works with retries2
passed
2.274s
Integ tests
works with fallbacks
passed
2s
Integ tests
should work with image from url
passed
1.742s
Integ tests
should work with image from base 64
passed
1.229s
Integ tests
should work with audio base 64
passed
1.536s
Integ tests
should work with audio from url
passed
1.603s
Integ tests
should support streaming in OpenAI
passed
2.034s
Integ tests
should support streaming in Gemini
passed
10.13s
Integ tests
should support AWS
passed
1.694s
Integ tests
should support streaming in AWS
passed
1.526s
Integ tests
should allow overriding the region
passed
0.011s
Integ tests
should support OpenAI shorthand
passed
14.026s
Integ tests
should support OpenAI shorthand streaming
passed
9.005s
Integ tests
should support anthropic shorthand
passed
3.033s
Integ tests
should support anthropic shorthand streaming
passed
3.136s
Integ tests
should support streaming without iterating
passed
1.992s
Integ tests
should support streaming in Claude
passed
1.027s
Integ tests
should support vertex
failed
0.003s
Error: BamlError: Failed to read service account file: 
+
Test Report
Started: 2024-11-28 22:49:40
Suites (1)
0 passed
1 failed
0 pending
Tests (70)
68 passed
2 failed
0 pending
Integ tests > should work for all inputs
single bool
passed
0.336s
Integ tests > should work for all inputs
single string list
passed
0.476s
Integ tests > should work for all inputs
return literal union
passed
0.354s
Integ tests > should work for all inputs
single class
passed
0.363s
Integ tests > should work for all inputs
multiple classes
passed
0.437s
Integ tests > should work for all inputs
single enum list
passed
0.482s
Integ tests > should work for all inputs
single float
passed
0.388s
Integ tests > should work for all inputs
single int
passed
0.327s
Integ tests > should work for all inputs
single literal int
passed
0.842s
Integ tests > should work for all inputs
single literal bool
passed
0.385s
Integ tests > should work for all inputs
single literal string
passed
0.716s
Integ tests > should work for all inputs
single class with literal prop
passed
0.443s
Integ tests > should work for all inputs
single class with literal union prop
passed
0.522s
Integ tests > should work for all inputs
single optional string
passed
0.276s
Integ tests > should work for all inputs
single map string to string
passed
0.384s
Integ tests > should work for all inputs
single map string to class
passed
0.631s
Integ tests > should work for all inputs
single map string to map
passed
0.473s
Integ tests > should work for all inputs
enum key in map
passed
0.757s
Integ tests > should work for all inputs
literal string union key in map
passed
0.817s
Integ tests > should work for all inputs
single literal string key in map
passed
0.612s
Integ tests > should work for all inputs
primitive union alias
passed
0.355s
Integ tests > should work for all inputs
map alias
passed
1.07s
Integ tests > should work for all inputs
alias union
passed
1.468s
Integ tests
should work for all outputs
passed
4.689s
Integ tests
works with retries1
passed
1.159s
Integ tests
works with retries2
passed
2.216s
Integ tests
works with fallbacks
passed
1.637s
Integ tests
should work with image from url
passed
1.288s
Integ tests
should work with image from base 64
passed
1.227s
Integ tests
should work with audio base 64
passed
1.681s
Integ tests
should work with audio from url
passed
1.7s
Integ tests
should support streaming in OpenAI
passed
1.834s
Integ tests
should support streaming in Gemini
passed
9.248s
Integ tests
should support AWS
passed
1.666s
Integ tests
should support streaming in AWS
passed
1.624s
Integ tests
should allow overriding the region
passed
0.013s
Integ tests
should support OpenAI shorthand
passed
14.637s
Integ tests
should support OpenAI shorthand streaming
passed
13.789s
Integ tests
should support anthropic shorthand
passed
3.208s
Integ tests
should support anthropic shorthand streaming
passed
3.215s
Integ tests
should support streaming without iterating
passed
2.225s
Integ tests
should support streaming in Claude
passed
1.113s
Integ tests
should support vertex
failed
0.002s
 
Error: BamlError: Failed to read service account file: 
 
 Caused by:
-    No such file or directory (os error 2)
Integ tests
supports tracing sync
passed
0.014s
Integ tests
supports tracing async
passed
1.783s
Integ tests
should work with dynamic types single
passed
0.895s
Integ tests
should work with dynamic types enum
passed
0.748s
Integ tests
should work with dynamic literals
passed
0.785s
Integ tests
should work with dynamic types class
passed
6.247s
Integ tests
should work with dynamic inputs class
passed
0.508s
Integ tests
should work with dynamic inputs list
passed
0.551s
Integ tests
should work with dynamic output map
passed
0.685s
Integ tests
should work with dynamic output union
passed
1.529s
Integ tests
should work with nested classes
failed
0.106s
 
Error: BamlError: BamlClientError: Something went wrong with the LLM client: reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("localhost")), port: Some(11434), path: "/v1/chat/completions", query: None, fragment: None }, source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) }
+    No such file or directory (os error 2)
Integ tests
supports tracing sync
passed
0.011s
Integ tests
supports tracing async
passed
2.095s
Integ tests
should work with dynamic types single
passed
0.966s
Integ tests
should work with dynamic types enum
passed
1.019s
Integ tests
should work with dynamic literals
passed
1.638s
Integ tests
should work with dynamic types class
passed
0.822s
Integ tests
should work with dynamic inputs class
passed
0.427s
Integ tests
should work with dynamic inputs list
passed
0.45s
Integ tests
should work with dynamic output map
passed
0.641s
Integ tests
should work with dynamic output union
passed
1.652s
Integ tests
should work with nested classes
failed
0.113s
 
Error: BamlError: BamlClientError: Something went wrong with the LLM client: reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("localhost")), port: Some(11434), path: "/v1/chat/completions", query: None, fragment: None }, source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) }
     at BamlStream.parsed [as getFinalResponse] (/workspaces/baml/engine/language_client_typescript/stream.js:58:39)
-    at Object.<anonymous> (/workspaces/baml/integ-tests/typescript/tests/integ-tests.test.ts:620:19)
Integ tests
should work with dynamic client
passed
0.414s
Integ tests
should work with 'onLogEvent'
passed
1.518s
Integ tests
should work with a sync client
passed
0.621s
Integ tests
should raise an error when appropriate
passed
1.07s
Integ tests
should raise a BAMLValidationError
passed
0.369s
Integ tests
should reset environment variables correctly
passed
1.53s
Integ tests
should use aliases when serializing input objects - classes
passed
0.921s
Integ tests
should use aliases when serializing, but still have original keys in jinja
passed
0.919s
Integ tests
should use aliases when serializing input objects - enums
passed
0.808s
Integ tests
should use aliases when serializing input objects - lists
passed
0.289s
Integ tests
constraints: should handle checks in return types
passed
0.651s
Integ tests
constraints: should handle checks in returned unions
passed
0.573s
Integ tests
constraints: should handle block-level checks
passed
0.648s
Integ tests
constraints: should handle nested-block-level checks
passed
0.543s
Integ tests
simple recursive type
passed
2.737s
Integ tests
mutually recursive type
passed
1.637s

\ No newline at end of file
+    at Object.<anonymous> (/workspaces/baml/integ-tests/typescript/tests/integ-tests.test.ts:620:19)
Integ tests
should work with dynamic client
passed
0.602s
Integ tests
should work with 'onLogEvent'
passed
1.941s
Integ tests
should work with a sync client
passed
0.411s
Integ tests
should raise an error when appropriate
passed
0.882s
Integ tests
should raise a BAMLValidationError
passed
0.351s
Integ tests
should reset environment variables correctly
passed
1.532s
Integ tests
should use aliases when serializing input objects - classes
passed
0.92s
Integ tests
should use aliases when serializing, but still have original keys in jinja
passed
0.718s
Integ tests
should use aliases when serializing input objects - enums
passed
0.51s
Integ tests
should use aliases when serializing input objects - lists
passed
0.307s
Integ tests
constraints: should handle checks in return types
passed
0.587s
Integ tests
constraints: should handle checks in returned unions
passed
0.65s
Integ tests
constraints: should handle block-level checks
passed
0.417s
Integ tests
constraints: should handle nested-block-level checks
passed
0.6s
Integ tests
simple recursive type
passed
2.764s
Integ tests
mutually recursive type
passed
1.541s
\ No newline at end of file