Data-Juicer

Data-Juicer is an open-source data processing and augmentation framework designed to enhance the quality and diversity of datasets for machine learning tasks. It includes a modular pipeline for scalable data transformation.

Features

Modular and extensible data processing pipeline
Supports data augmentation for improving model robustness
Predefined templates for various NLP and CV tasks
Scalable to large datasets and distributed computing
Compatible with popular deep learning frameworks
Open-source with community-driven contributions

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow Data-Juicer

Data-Juicer Web Site

Other Useful Business Software

Veeam Data Platform v13.1 - Get Your Free Trial

Secure by design, portable by default. Recover clean, fast, anywhere. Start a free trial.

Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.

Try it Free

Rate This Project

User Reviews

Be the first to post a review of Data-Juicer!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Natural Language Processing (NLP) Tool

Registered

2025-01-21

Similar Business Software

LM-Kit.NET

LM-Kit.NET is a complete local AI runtime for .NET that lets engineering teams ship AI-powered features without cloud dependencies, per-token costs, or data leaving the network. Most .NET AI integrations stop at inference. LM-Kit.NET covers the full range of capabilities production...

See Software
Google AI Studio

Google AI Studio is a unified development platform that helps teams explore, build, and deploy applications using Google’s most advanced AI models. It brings text, image, audio, and video models together in one interactive playground. With vibe coding, developers can use natural language to...

See Software
kama.ai

A Responsible AI Agent platform giving you Deterministic AI accuracy, transparency, and accountability. The Brand-Safe AI for your organization. As a Composite (hybrid) platform, it combines Knowledge Graph AI, governed Generative AI, and Intelligent Automation technologies. This...

See Software
Spark NLP

Experience the power of large language models like never before, unleashing the full potential of Natural Language Processing (NLP) with Spark NLP, the open source library that delivers scalable LLMs. The full code base is open under the Apache 2.0 license, including pre-trained models and...

See Software
Graphlogic GL Platform

Graphlogic Conversational AI Platform consists on: Robotic Process Automation (RPA) and Conversational AI for enterprises, leveraging state-of-the-art Natural Language Understanding (NLU) technology to create advanced chatbots, voicebots, Automatic Speech Recognition (ASR), Text-to-Speech (TTS)...

See Software
GPT-4

GPT-4 (Generative Pre-trained Transformer 4) is a large-scale unsupervised language model, yet to be released by OpenAI. GPT-4 is the successor to GPT-3 and part of the GPT-n series of natural language processing models, and was trained on a dataset of 45TB of text to produce human-like text...

See Software

Report inappropriate content

Data-Juicer

Data processing for and with foundation models

Features

Project Samples

Project Activity

Categories

License

Follow Data-Juicer

User Reviews

Additional Project Details

Operating Systems

Programming Language

Related Categories

Registered