-
Notifications
You must be signed in to change notification settings - Fork 4
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Updated docs to show examples for enums
- Loading branch information
Showing
4 changed files
with
299 additions
and
10 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,76 @@ | ||
# Response Model | ||
|
||
Defining LLM Output Schemas in Instructor is done via our `InstructMacro` macro which generates the underlying JSON Schema from your Rust Struct. We support a variety of different types out of the box like Enums, Vecs and Option types, read more about how to use them [here](/types). | ||
|
||
## What happens behind the scenes? | ||
|
||
At Runtime, Rust compiles your structs into blocks of memory with specific offsets for each field. | ||
|
||
Accessing fields involves using these offsets, similar to accessing array elements with indices. This approach ensures that structs are efficient and have no additional runtime overhead compared to manual memory management techniques. | ||
|
||
```rust | ||
struct Example { | ||
a: u32, | ||
b: u64, | ||
c: u8, | ||
} | ||
``` | ||
|
||
This means that we lose a significant amount of information about the types and fields that you use in your code. When we use the `InstructMacro`, we rewrite your struct under the hood to expose a `get_info()` method which contains information on your struct. | ||
|
||
```rust | ||
#[derive(InstructMacro, Debug)] | ||
#[allow(dead_code)] | ||
#[description("This is a struct")] | ||
struct TestStruct { | ||
#[description( | ||
"This is a sample example \ | ||
that spans across \ | ||
three lines" | ||
)] | ||
pub field1: String, | ||
#[description("This is a test field")] | ||
pub field2: str, | ||
} | ||
``` | ||
|
||
We add this code under the hood ( You can view all the expanded code using `cargo-expand` with the command `cargo expand <file name>`). | ||
|
||
```rust | ||
impl instruct_macros_types::InstructMacro for TestStruct { | ||
fn get_info() -> instruct_macros_types::InstructMacroResult { | ||
let mut parameters = Vec::new(); | ||
parameters | ||
.push( | ||
Parameter::Field(ParameterInfo { | ||
name: "field1".to_string(), | ||
r#type: "String".to_string(), | ||
comment: "This is a sample example that spans across three lines" | ||
.to_string(), | ||
is_optional: false, | ||
is_list: false, | ||
}), | ||
); | ||
parameters | ||
.push( | ||
Parameter::Field(ParameterInfo { | ||
name: "field2".to_string(), | ||
r#type: "str".to_string(), | ||
comment: "This is a test field".to_string(), | ||
is_optional: false, | ||
is_list: false, | ||
}), | ||
); | ||
instruct_macros_types::InstructMacroResult::Struct(StructInfo { | ||
name: "TestStruct".to_string(), | ||
description: "This is a struct".to_string(), | ||
parameters, | ||
is_optional: false, | ||
is_list: false, | ||
}) | ||
} | ||
fn validate(&self) -> Result<(), String> { | ||
Ok(()) | ||
} | ||
} | ||
``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,209 @@ | ||
# Support for Simple Types | ||
|
||
We support most basic types out of the box with our `InstructMacro` macro now. Here's a quick rundown of how to use our macro. | ||
|
||
## Importing the Macro | ||
|
||
You'll need to use the following imports to use the macro | ||
|
||
```rust | ||
use instruct_macros::{InstructMacro}; | ||
use instruct_macros_types::{ | ||
InstructMacro, InstructMacroResult, Parameter, ParameterInfo, StructInfo, | ||
}; | ||
|
||
#[derive(InstructMacro, Debug)] | ||
struct User { | ||
pub name: String, | ||
pub age: String | ||
} | ||
|
||
/* | ||
{ | ||
"type": "object", | ||
"properties": { | ||
"age": { | ||
"type": "string", | ||
"description": "" | ||
}, | ||
"name": { | ||
"type": "string", | ||
"description": "" | ||
} | ||
}, | ||
"required": [ | ||
"name", | ||
"age" | ||
] | ||
} | ||
*/ | ||
``` | ||
|
||
### Adding a Description | ||
|
||
We provide a `#[description( Description goes here )]` annoration that you can add to your struct. This will be included in the function call which we will send over to OpenAI/other inference providers. | ||
|
||
This is the same for individual fields or the entire struct with multi-line comments being relatively easy to implement. | ||
|
||
```rust | ||
#[derive(InstructMacro, Debug)] | ||
#[description("This is a user object")] | ||
struct User { | ||
#[description("This is the name of the user")] | ||
pub name: String, | ||
#[description( | ||
"This is\ | ||
a multi-line description\ | ||
which can be used" | ||
)] | ||
pub age: String, | ||
} | ||
|
||
/* | ||
{ | ||
"type": "object", | ||
"properties": { | ||
"name": { | ||
"type": "string", | ||
"description": "This is the name of the user" | ||
}, | ||
"age": { | ||
"type": "string", | ||
"description": "This isa multi-line descriptionwhich can be used" | ||
} | ||
}, | ||
"required": [ | ||
"name", | ||
"age" | ||
] | ||
} | ||
*/ | ||
``` | ||
|
||
## Advanced Types | ||
|
||
### Enums | ||
|
||
Enums are supported in the same way. Just declare it as if you would a normal `Serde` object and it'll work out of the box seamlessly. | ||
|
||
```rust | ||
#[derive(InstructMacro, Debug)] | ||
#[description("This is an enum representing the status of a person")] | ||
pub enum Status { | ||
Active, | ||
Inactive, | ||
Pending, | ||
} | ||
|
||
#[derive(InstructMacro, Debug)] | ||
pub struct User { | ||
name: String, | ||
status: Status, | ||
} | ||
|
||
/* | ||
{ | ||
"type": "object", | ||
"properties": { | ||
"name": { | ||
"type": "string", | ||
"description": "" | ||
}, | ||
"status": { | ||
"type": "string", | ||
"description": "This is an enum representing the status of a person", | ||
"enum_values": [ | ||
"Active", | ||
"Inactive", | ||
"Pending" | ||
] | ||
} | ||
}, | ||
"required": [ | ||
"name", | ||
"status" | ||
] | ||
} | ||
*/ | ||
``` | ||
|
||
If you'll like to provide a custom description for your enum field in your struct, just use the `description` annoration and we'll override the default description of the enum when we generate the function parameter. | ||
|
||
```rust | ||
#[derive(InstructMacro, Debug)] | ||
#[description("This is an enum representing the status of a person")] | ||
pub enum Status { | ||
Active, | ||
Inactive, | ||
Pending, | ||
} | ||
|
||
#[derive(InstructMacro, Debug)] | ||
pub struct User { | ||
name: String, | ||
#[description("This is the person's status")] | ||
status: Status, | ||
} | ||
|
||
/* | ||
{ | ||
"type": "object", | ||
"properties": { | ||
"status": { | ||
"type": "string", | ||
"description": "This is the person's status", | ||
"enum_values": [ | ||
"Active", | ||
"Inactive", | ||
"Pending" | ||
] | ||
}, | ||
"name": { | ||
"type": "string", | ||
"description": "" | ||
} | ||
}, | ||
"required": [ | ||
"name", | ||
"status" | ||
] | ||
} | ||
*/ | ||
``` | ||
|
||
### Vectors | ||
|
||
Sometimes you might want to extract a list of objects (Eg. Users). To do so, you can just use a simple `Vec` object. | ||
|
||
```rust | ||
#[derive(InstructMacro, Debug)] | ||
#[description("This is a struct with Option types")] | ||
struct Numbers { | ||
#[description("This is a list of numbers")] | ||
pub numbers: Vec<i32>, | ||
} | ||
|
||
/* | ||
{ | ||
"type": "object", | ||
"properties": { | ||
"users": { | ||
"type": "array", | ||
"description": "A list of users", | ||
"items": { | ||
"type": "object", | ||
"properties": { | ||
"name": { | ||
"type": "string", | ||
"description": "" | ||
} | ||
} | ||
} | ||
} | ||
}, | ||
"required": [ | ||
"users" | ||
] | ||
} | ||
*/ | ||
``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters