NeMo Curator Files

Scalable data pre processing and curation toolkit for LLMs

This is an exact mirror of the NeMo Curator project, hosted at https://github.com/NVIDIA/NeMo-Curator. SourceForge is not affiliated with NeMo Curator. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
NVIDIA NeMo Curator 0.6.0 source code.tar.gz	2025-01-07	2.4 MB	0
NVIDIA NeMo Curator 0.6.0 source code.zip	2025-01-07	2.6 MB	0
README.md	2025-01-07	343 Bytes	0
Totals: 3 Items		5.0 MB	0

What's changed

Synthetic Data Generation for Text Retrieval
LLM-based Filters
- Easiness
- Answerability
Q&A Retrieval Generation Pipeline
Parallel Dataset Curation for Machine Translation
Load/Write Bitext Files
Heuristic filtering (Histogram, Length Ratio)
Classifier filtering (Comet, Cometoid)

Source: README.md, updated 2025-01-07

Other Useful Business Software

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Gen AI apps are built with MongoDB Atlas

Build gen AI apps with an all-in-one modern database: MongoDB Atlas

MongoDB Atlas provides built-in vector search and a flexible document model so developers can build, scale, and run gen AI apps without stitching together multiple databases. From LLM integration to semantic search, Atlas simplifies your AI architecture—and it’s free to get started.

Start Free

Recommended Projects

AgentOps
Python SDK for agent monitoring, LLM cost tracking, benchmarking, etc.
DeSmuME: Nintendo DS emulator
DeSmuME is a Nintendo DS emulator
Apache OpenOffice
The free and Open Source productivity suite
Clonezilla
A partition and disk imaging/cloning program
KeePass
A lightweight and easy-to-use password manager

NeMo Curator Files

Scalable data pre processing and curation toolkit for LLMs

Get an email when there's a new version of NeMo Curator

What's changed