chunks

⛏ Modded structure cleaner for Minecraft. Removes all references to non-existent structures to allow for clean error logs and chunk saving.

Efficient celery tasks chunkification

Python package that provides an easy-to-use interface to access data from the Mars Orbital Data Explorer

Helper scripts to split a large audio file into smaller chunks and annotate these chunks

exports an mp4 video file from an m3u8 chunklist file on the internet

Python app which generates subs and plays them along with video

The easiest and most effective way tool to retrain a RAG LLM/GEN AI/Agent on your data

MultiProcessing In Python Using MAP Function

AI-powered PDF Q&A system using FastAPI, ChromaDB, and OpenAI. Extracts, indexes, and retrieves relevant text chunks to answer questions.

A chunking system for game developement

Tool for lossless Minecraft world compression.

Causalito - Agente RAG orientado al campo de la inferencia bayesiana causal. Implementado usando Langchain, chromadb y modelos LLM avanzados.

This is a script to create BlueMap shape markers around chunks from a world.

A simple local CLI for merging split files like .pkg, .001, .bin, and other byte chunks.

The ChunkedSet stores its elements in Chunks of size k. It behaves as a set and contains only unique values in all chunks combined.

Text splitting example using Tiktoken

Weight samples by chunk behavior — leave-chunk-out influence over contiguous/interleaved/feature-cluster partitions; downweight regime-broken chunks. Held-out + null validated (honest about the overfit-the-tuned-split trap). numpy-only.

Show the token/chunk relevance of prompts for Forge/A1111

Pre-indexing QA auditor for RAG document ingestion pipelines. 11 deterministic checks for missing pages, OCR noise, duplicates, encoding corruption, and poor split boundaries.