New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve source-code indexing #30

Open

anbraten opened this issue Sep 3, 2023 · 2 comments

Contributor

anbraten commented Sep 3, 2023 •

edited

Loading

Goals

add quotes linking to actual code parts
improve understanding based on files (a file normally contains code that belongs to each other)
add more metadata to documents (maybe function names, class names, filenames)

Contributor Author

anbraten commented Sep 3, 2023 •

edited

Loading

Some links

https://python.langchain.com/docs/use_cases/code_understanding#loading
https://python.langchain.com/docs/integrations/document_loaders/source_code
https://api.python.langchain.com/en/latest/document_loaders/langchain.document_loaders.parsers.language.language_parser.LanguageParser.html
https://github.com/github/CodeSearchNet
metadata can be passed to documents like this: Document(page_content=f.read(), metadata={"source": filename, "lines"...})
https://github.com/JinghaoZhao/GPT-Code-Learner/

Contributor Author

anbraten commented Sep 4, 2023

https://github.com/tree-sitter/tree-sitter looks nice for understanding code parts

anbraten mentioned this issue

feat: enhance indexer #36

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment