Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: embeddings overhaul #120

Merged
merged 106 commits into from
Nov 29, 2024
Merged

feat: embeddings overhaul #120

Show file tree
Hide file tree
Changes from 98 commits
Commits
Show all changes
106 commits
Select commit Hold shift + click to select a range
b7d146f
feat: setup derive macro
marieaurore123 Oct 2, 2024
5904734
test: test out writing embeddable macro
marieaurore123 Oct 3, 2024
ee9b5c3
test: continue testing custom macro implementation
marieaurore123 Oct 4, 2024
c8c1e9c
feat: macro generate trait bounds
marieaurore123 Oct 6, 2024
dff0aeb
refactor: split up macro into multiple files
marieaurore123 Oct 7, 2024
0d10011
refactor: move macro derive crate inside rig-core
marieaurore123 Oct 7, 2024
982a17b
Merge branch 'main' into feat(embeddings)/derive-macro
marieaurore123 Oct 8, 2024
79754aa
feat: replace embedding logic with new embeddable trait and macro
marieaurore123 Oct 8, 2024
3438fab
refactor: refactor rag examples, delete document embedding struct
marieaurore123 Oct 8, 2024
597e6c3
feat: remove document embedding from in memory store
marieaurore123 Oct 9, 2024
5407772
refactor: remove DocumentEmbeddings from in memory vector store
marieaurore123 Oct 9, 2024
c61685e
refactor(examples): combine vector store with vector store index
marieaurore123 Oct 9, 2024
a15d493
docs: add and update docstrings
marieaurore123 Oct 9, 2024
46b4680
fix (examples): fix bugs in examples
marieaurore123 Oct 9, 2024
fe75da1
style: cargo fmt
marieaurore123 Oct 9, 2024
6c7ab8d
revert: revert vector store to main
marieaurore123 Oct 9, 2024
d7d2c19
Merge branch 'refactor(vector-store)/in-memeory-vector-store' into fe…
marieaurore123 Oct 9, 2024
bb712e3
docs: update emebddings builder docstrings
marieaurore123 Oct 9, 2024
efa2b65
refactor: derive macro
marieaurore123 Oct 10, 2024
01dc233
Merge branch 'main' into refactor(vector-store)/in-memeory-vector-store
marieaurore123 Oct 10, 2024
5684c90
tests: add unit tests on in memory store
marieaurore123 Oct 10, 2024
82d9f0c
fic(ci): asterix on pull request sto accomodate for epic branches
marieaurore123 Oct 10, 2024
bf7316b
fix(ci): double asterix
marieaurore123 Oct 10, 2024
8325164
feat: add error type on embeddable trait
marieaurore123 Oct 11, 2024
de022c4
refactor: move embeddings to its own module and seperate embeddable
marieaurore123 Oct 11, 2024
220d9fc
refactor: split up macro into more files, fix all imports
marieaurore123 Oct 11, 2024
1dff738
Merge branch 'main' into refactor(vector-store)/in-memeory-vector-store
marieaurore123 Oct 15, 2024
8c993dd
fix: revert logging change
marieaurore123 Oct 15, 2024
ef00b38
Merge pull request #53 from 0xPlaygrounds/refactor(vector-store)/in-m…
marieaurore123 Oct 15, 2024
f5e60f5
Merge branch 'feat/embeddings-overhaul' into feat(embeddings)/derive-…
marieaurore123 Oct 15, 2024
5a8c361
feat: handle tools with embeddingsbuilder
marieaurore123 Oct 15, 2024
dc89e54
bug(macro): fix error when embed tags missing
marieaurore123 Oct 15, 2024
ae66d08
style: cargo fmt
marieaurore123 Oct 15, 2024
4305952
fix(tests): clippy
marieaurore123 Oct 15, 2024
24e3b98
docs&revert: revert embeddable trait error type, add docstrings
marieaurore123 Oct 15, 2024
a7dbf6c
style: cargo clippy
marieaurore123 Oct 15, 2024
886ebcb
clippy(lancedb): fix unused function error
marieaurore123 Oct 15, 2024
79dea45
fix(test): remove useless assert false statement
marieaurore123 Oct 15, 2024
6362344
cleanup: split up branch into 2 branches for readability
marieaurore123 Oct 16, 2024
b5e1bf3
cleanup: revert certain changes during branch split
marieaurore123 Oct 16, 2024
7caf134
docs: revert doc string
marieaurore123 Oct 16, 2024
8739692
fix: add embedding_docs to embeddable tool
marieaurore123 Oct 16, 2024
fb979ec
refactor: use OneOrMany in Embbedable trait, make derive macro crate …
marieaurore123 Oct 16, 2024
690027c
tests: add some more tests
marieaurore123 Oct 16, 2024
cca6059
clippy: cargo clippy
marieaurore123 Oct 17, 2024
f785b8c
docs: add docstring to oneormany
marieaurore123 Oct 17, 2024
0e2ade9
fix(macro): update error handling
marieaurore123 Oct 17, 2024
a98769c
refactor: reexport EmbeddingsBuilder in rig and update imports
marieaurore123 Oct 17, 2024
aca9134
Merge branch 'feat(embeddings)/derive-macro' into feat(embeddings)/ad…
marieaurore123 Oct 17, 2024
067894c
feat: implement IntoIterator and Iterator for OneOrMany
marieaurore123 Oct 17, 2024
32bcc61
refactor: rename from methods
marieaurore123 Oct 17, 2024
564bef4
tests: fix failing tests
marieaurore123 Oct 17, 2024
04f1f3e
refactor&fix: make PR review changes
marieaurore123 Oct 17, 2024
c8f6646
fix: fix tests failing
marieaurore123 Oct 17, 2024
40f3c18
test: add test on OneOrMany
marieaurore123 Oct 17, 2024
68d88b6
style: cargo fmt
marieaurore123 Oct 17, 2024
4bc7d07
docs&fix: fix doc strings, implement iter_mut for OneOrMany
marieaurore123 Oct 17, 2024
4d2ffdb
fix: update borrow and owning of macro
marieaurore123 Oct 18, 2024
6f04225
clippy: add back print statements
marieaurore123 Oct 18, 2024
bdd98e5
Merge branch 'main' into feat(embeddings)/derive-macro
marieaurore123 Oct 18, 2024
e218cf4
Merge branch 'feat(embeddings)/derive-macro' into feat(embeddings)/ad…
marieaurore123 Oct 18, 2024
5897e22
fix: fix issues caused by merge of derive macro branch
marieaurore123 Oct 18, 2024
2477af8
fix: fix cargo toml of lancedb and mongodb
marieaurore123 Oct 18, 2024
485ad3b
refactor: use thiserror for OneOtMany::EmptyListError
marieaurore123 Oct 18, 2024
4039cf6
Merge pull request #59 from 0xPlaygrounds/feat(embeddings)/derive-macro
marieaurore123 Oct 18, 2024
23336dc
Merge branch 'feat(embeddings)/derive-macro' into feat(embeddings)/ad…
marieaurore123 Oct 18, 2024
763c364
feat: add OneOrMany to in memory vector store
marieaurore123 Oct 18, 2024
3c5e59d
style: cargo fmt
marieaurore123 Oct 18, 2024
dc332c3
fix: update embeddingsbuilder import path
marieaurore123 Oct 18, 2024
db2ec98
tests: add tests for embeddingsbuilder
marieaurore123 Oct 18, 2024
3bb2231
clippy: add is empty method
marieaurore123 Oct 18, 2024
3688b78
fix: add feature flag to examples in mongodb and lancedb crates
marieaurore123 Oct 18, 2024
db8d188
fix: move lancedb fixtures into it's own file
marieaurore123 Oct 18, 2024
803b792
fix: add dummy main function in fextures.rs for compiler
marieaurore123 Oct 18, 2024
97775d6
fix: revert fixture file, remove fixtures from cargo toml examples
marieaurore123 Oct 18, 2024
05ef716
fix: update fixture import in lancedb examples
marieaurore123 Oct 18, 2024
d75e4bb
refactor: rename D to T in embeddingsbuilder generics
marieaurore123 Oct 18, 2024
2865134
refactor: remove clone
marieaurore123 Oct 21, 2024
55e2409
PR: update builder, docstrings, and std::markers tags
marieaurore123 Oct 21, 2024
0cbc5aa
style: replace add with push
marieaurore123 Oct 21, 2024
1176e2f
fix: fix mongodb example
marieaurore123 Oct 21, 2024
f34a5dd
fix: update lancedb and mongodb doc example
marieaurore123 Oct 21, 2024
f796e12
fix: typo
marieaurore123 Oct 21, 2024
38ca0db
Merge pull request #64 from 0xPlaygrounds/feat(embeddings)/add-embedd…
marieaurore123 Oct 21, 2024
223139e
docs: add and fix docstrings and examples
marieaurore123 Oct 22, 2024
ed9e038
docs: add more doc tests
marieaurore123 Oct 22, 2024
c502ea5
feat: rename Embeddable trait to ExtractEmbeddingFields
marieaurore123 Oct 23, 2024
ebc6b81
feat: rename macro files, cargo fmt
marieaurore123 Oct 23, 2024
5c2d451
PR; update docstrings, update `add_documents_with_id` function
marieaurore123 Oct 24, 2024
55b42d8
doc: fix doc linting
marieaurore123 Oct 24, 2024
5135451
Merge pull request #72 from 0xPlaygrounds/cleanup(embeddings)/finaliz…
cvauclair Oct 24, 2024
3627441
Merge branch 'main' into feat/embeddings-overhaul
cvauclair Oct 24, 2024
b5870ce
misc: fmt
cvauclair Oct 24, 2024
8c30b54
test: fix test
cvauclair Oct 24, 2024
474695b
refactor(embeddings): embed trait definition (#89)
marieaurore123 Nov 15, 2024
5eb0014
Merge branch 'main' into feat/embeddings-overhaul
marieaurore123 Nov 23, 2024
1336633
fix/docs: fix erros from merge, cleanup embeddings docstrings
marieaurore123 Nov 23, 2024
4363671
fix: cargo clippy in examples
marieaurore123 Nov 23, 2024
2d6d7c4
Feat: small improvements + fixes + tests (#128)
cvauclair Nov 29, 2024
a041699
style: Small renaming for consistency
cvauclair Nov 29, 2024
bfc3291
docs: Improve docstrings
cvauclair Nov 29, 2024
c21f549
style: fmt
cvauclair Nov 29, 2024
1637c8a
fix: `TextEmbedder::embed` visibility
cvauclair Nov 29, 2024
ca4d9dd
docs: Simplified the `EmbeddingsBuilder` docstring example to focus o…
cvauclair Nov 29, 2024
f760a5f
style: cargo fmt
cvauclair Nov 29, 2024
f21da45
docs: Small edit to lancedb examples
cvauclair Nov 29, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/ci.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ name: Lint & Test
on:
pull_request:
branches:
- main
- "**"
workflow_call:

env:
Expand Down
Loading
Loading