Repositories list

• chonkie

  Public
  🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library

  aitext-processingchunking+ 2ragretrieval-augmented-generation

  Python

  •

  MIT License

  •77•1.9k•12•1•Updated Dec 13, 2024Dec 13, 2024

• autotiktokenizer

  Public
  🧰 The AutoTokenizer that TikToken always needed -- Load any tokenizer with TikToken now! ✨

  nlpmachine-learningtransformers+ 2tokenizerstiktoken

  Python

  •

  MIT License

  •2•16•1•1•Updated Dec 11, 2024Dec 11, 2024

• chonkie-docs

  Public
  A tiny handbook unlocking mighty power - 🦛 Documentation for Chonkie ✨

  airetrievalembeddings+ 5artificial-intelligencechunkingragllmschonkie

  MDX

  •0•1•0•0•Updated Dec 8, 2024Dec 8, 2024