Data-Juicer

Data-Juicer is an open-source data processing and augmentation framework designed to enhance the quality and diversity of datasets for machine learning tasks. It includes a modular pipeline for scalable data transformation.

Features

Modular and extensible data processing pipeline
Supports data augmentation for improving model robustness
Predefined templates for various NLP and CV tasks
Scalable to large datasets and distributed computing
Compatible with popular deep learning frameworks
Open-source with community-driven contributions

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow Data-Juicer

Data-Juicer Web Site

Other Useful Business Software

Build Securely on AWS with Proven Frameworks

Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.

Download Now

Rate This Project

User Reviews

Be the first to post a review of Data-Juicer!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Natural Language Processing (NLP) Tool

Registered

2025-01-21

Similar Business Software

LM-Kit.NET

LM-Kit.NET is a complete local AI runtime for .NET that lets engineering teams ship AI-powered features without cloud dependencies, per-token costs, or data leaving the network. Most .NET AI integrations stop at inference. LM-Kit.NET covers the full range of capabilities production...

See Software
Google AI Studio

Google AI Studio is a unified development platform that helps teams explore, build, and deploy applications using Google’s most advanced AI models, including Gemini 3.5. It brings text, image, audio, and video models together in one interactive playground. With vibe coding, developers can use...

See Software
kama.ai

A Responsible AI Agent platform providing accurate, accountable, and safe AI for your organization. As a Composite (hybrid) platform, it combines Knowledge Graph AI, governed Generative AI, and Intelligent Automation technologies. This combination gives you trusted answers that are accurate...

See Software
Spark NLP

Experience the power of large language models like never before, unleashing the full potential of Natural Language Processing (NLP) with Spark NLP, the open source library that delivers scalable LLMs. The full code base is open under the Apache 2.0 license, including pre-trained models and...

See Software
Graphlogic GL Platform

Graphlogic Conversational AI Platform consists on: Robotic Process Automation (RPA) and Conversational AI for enterprises, leveraging state-of-the-art Natural Language Understanding (NLU) technology to create advanced chatbots, voicebots, Automatic Speech Recognition (ASR), Text-to-Speech (TTS)...

See Software
GPT-4

GPT-4 (Generative Pre-trained Transformer 4) is a large-scale unsupervised language model, yet to be released by OpenAI. GPT-4 is the successor to GPT-3 and part of the GPT-n series of natural language processing models, and was trained on a dataset of 45TB of text to produce human-like text...

See Software

Report inappropriate content

Data-Juicer

Data processing for and with foundation models

Get an email when there's a new version of Data-Juicer

Features

Project Samples

Project Activity

Categories

License

Follow Data-Juicer

User Reviews

Additional Project Details

Operating Systems

Programming Language

Related Categories

Registered