🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library

A package for parsing PDFs and analyzing their content using LLMs.

A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.

🍱 semantic-chunking ⇢ semantically create chunks from large document for passing to LLM workflows

A recursive text chunker that attempts to break the text on meaningful boundaries.

This project is designed to extract text from documents and prepare it for processing by Large Language Models (LLM). Implemented a feature to store and utilize text style information, enabling the program to identify and segment content based on potential headers and titles.

This Text Summarization Tool uses advanced machine learning models to create concise, meaningful summaries of lengthy texts. Built with Hugging Face Transformers and Gradio, it efficiently handles various input lengths, ideal for summarizing articles, reports, and more

An exploration of text splitting and chunking in JavaScript

Presenting, Cubastion's HR chatbot - it can answer queries based on all the latest HR documents published by Cubastion's HR team. This conveniently saves time, allowing a Cubastion employee to resolve their query without having to comb through the actual documents. <<Developed with Python, sentence-transformers, Pinecone, llama3.2, and Streamlit>>

A lightweight TypeScript text splitter for RAG applications