Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

deeplake.util.exceptions.TensorDoesNotExistError: "Tensor 'id' does not exist." #22

Open
plintner opened this issue Jun 20, 2023 · 1 comment

Comments

@plintner
Copy link

I'm getting an error during processing. Any suggestions?

Deep Lake Dataset in hub://adrenalineuser/repo-chat already exists, loading from the storage
Traceback (most recent call last):
File "src/main.py", line 110, in
main()
File "src/main.py", line 104, in main
process_repo(args)
File "src/main.py", line 33, in process_repo
process(
File "/home/username/DevelopmentWSL/Chat-with-Github-Repo/src/utils/process.py", line 105, in process
db.add_documents(texts)
File "/home/username/.local/lib/python3.8/site-packages/langchain/vectorstores/base.py", line 72, in add_documents
return self.add_texts(texts, metadatas, **kwargs)
File "/home/username/.local/lib/python3.8/site-packages/langchain/vectorstores/deeplake.py", line 184, in add_texts
return self.vectorstore.add(
File "/home/username/.local/lib/python3.8/site-packages/deeplake/core/vectorstore/deeplake_vectorstore.py", line 230, in add
processed_tensors, id = dataset_utils.preprocess_tensors(
File "/home/username/.local/lib/python3.8/site-packages/deeplake/core/vectorstore/vector_search/dataset/dataset.py", line 254, in preprocess_tensors
if dataset and dataset[tensor_name].htype == "image":
File "/home/username/.local/lib/python3.8/site-packages/deeplake/core/dataset/dataset.py", line 506, in getitem
raise TensorDoesNotExistError(item)
deeplake.util.exceptions.TensorDoesNotExistError: "Tensor 'id' does not exist."

@AsmaaMHadir
Copy link

I am getting the same error running the ConversationalRetrievalChain.from_llm object. I'm researching a potential workaround/solution

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants