Skip to content
#

quality-filtering

Star

Here are 5 public repositories matching this topic...

Language: All
Filter by language
All 5 Python 3 C++ 1 Jupyter Notebook 1

JochiRaider / sievio

Star 2

Sievio turns GitHub, local repos, and web PDFs into clean JSONL for LLM pretraining, fine-tuning, and RAG. It offers structure-aware chunking, reliable Unicode decoding, pluggable QC and safety checks, plus optional dataset cards and deduplication.

python data-deduplication dataset-creation data-pipelines repository-mining jsonl github-repos rag text-preprocessing quality-filtering code-mining llm llm-training llm-datasets
  • Updated Dec 27, 2025
  • Python

Improve this page

Add a description, image, and links to the quality-filtering topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the quality-filtering topic, visit your repo's landing page and select "manage topics."

Learn more