Showing 643 open source projects for "dataset"

View related business solutions
  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New customers can spin up VMs, build with AI, and query data at no cost.

    Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
    Start Free
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Try It Free
  • 1
    CellTypist

    CellTypist

    A tool for semi-automatic cell type classification, harmonization

    CellTypist is an automated tool for cell type classification, harmonization, and integration. Classification, transfer cell type labels from the reference to query dataset. Harmonization, match and harmonize cell types defined by independent datasets. integration, integrate cell and cell types with supervision from harmonization. CellTypist recapitulates cell type structure and biology of independent datasets. Regularised linear models with Stochastic Gradient Descent provide a fast and accurate prediction. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    all AI news

    all AI news

    A list of online news & info sources in the AI/ML/Data Science space

    ...Overall, it provides a foundational dataset for tracking AI industry trends and updates.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    HDF5.jl

    HDF5.jl

    Save and load data in the HDF5 file format from Julia

    HDF5 stands for Hierarchical Data Format v5 and is closely modeled on file systems. In HDF5, a "group" is analogous to a directory, a "dataset" is like a file. HDF5 also uses "attributes" to associate metadata with a particular group or dataset. HDF5 uses ASCII names for these different objects, and objects can be accessed by Unix-like pathnames, e.g., "/sample1/tempsensor/firsttrial" for a top-level group "sample1", a subgroup "tempsensor", and a dataset "firsttrial". ...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 4
    Cactus Needle

    Cactus Needle

    26m function call model that runs on incredibly small devices

    ...It is based on a Simple Attention Network architecture and was distilled from a much larger model to focus on fast, compact tool-use behavior. The project provides open weights, training details, dataset generation resources, and a playground for testing the model with custom tools. Needle is optimized for single-shot function calling rather than broad conversational ability, so its core use case is selecting the right tool and producing structured arguments. It can be fine-tuned locally, including on consumer machines, which makes it useful for experimentation with small personalized agents. ...
    Downloads: 15 This Week
    Last Update:
    See Project
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 5
    gpt-llm-trainer

    gpt-llm-trainer

    Experimental notebook pipeline for creating language models

    gpt-llm-trainer is an experimental notebook pipeline for creating task-specific fine-tuned language models from a plain task description. It reduces the work normally required to collect examples, format a dataset, split training and validation data, and run fine-tuning code. The system can generate prompts and responses with larger models, then prepare that synthetic dataset for model training. It includes workflows for LLaMA 2 7B, GPT-3.5 fine-tuning, and a Claude-to-LLaMA training variant. The project is designed for fast experimentation rather than polished enterprise model operations. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    labelme Image Polygonal Annotation

    labelme Image Polygonal Annotation

    Image polygonal annotation with Python

    ...Image flag annotation for classification and cleaning. Video annotation. (video annotation). GUI customization (predefined labels / flags, auto-saving, label validation, etc). Exporting VOC-format dataset for semantic/instance segmentation. (semantic segmentation, instance segmentation). Exporting COCO-format dataset for instance segmentation. (instance segmentation). The first time you run labelme, it will create a config file in ~/.labelmerc. You can edit this file and the changes will be applied the next time that you launch labelme. ...
    Downloads: 8 This Week
    Last Update:
    See Project
  • 7
    Meilisearch

    Meilisearch

    An open-source, lightning-fast, and hyper-relevant search engine

    ...Smart presets let you start searching through your data with zero configuration. Send data to Meilisearch however you want, no need to match a schema or convert your dataset to a compatible format. Everyone makes mistakes! If typos break your search experience, many users will leave thinking what they were looking for just wasn't there. Start searching through your dataset in less than 5 minutes and quickly connect your codebase to Meilisearch with our official libraries. Meilisearch is designed to work out-of-the-box, no configuration needed.
    Downloads: 22 This Week
    Last Update:
    See Project
  • 8
    Bespoke Curator

    Bespoke Curator

    Synthetic data curation for post-training and data extraction

    ...It supports workflows where models are used to produce synthetic examples that can later be refined into reliable training datasets for reasoning, question answering, or structured information extraction tasks. Curator includes tools for monitoring data generation processes and managing dataset quality while large batches of examples are being created. The framework also integrates with multiple inference systems and APIs, allowing users to generate data using different model providers or open-source inference engines.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    NovaSR

    NovaSR

    A lightning fast audio upsampler

    ...At only about 50 KB in size, the model is orders of magnitude smaller than typical audio super-resolution networks, yet it achieves high quality and realtime performance thanks to its compact architecture and efficient convolutional design. NovaSR is especially valuable for post-processing tasks in speech enhancement, TTS pipelines, and dataset restoration where low sampling rates degrade perceived audio clarity; the minimal model size also makes it suitable for edge and embedded use cases where memory is at a premium. Its performance can reach thousands of times realtime on modern GPUs, allowing massive audio batches to be processed with negligible compute overhead.
    Downloads: 7 This Week
    Last Update:
    See Project
  • Demo Series - Small Business Backup By Veeam Icon
    Demo Series - Small Business Backup By Veeam

    Learn how to protect your Microsoft 365 data, with simple, actionable tips today.

    Watch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
    Watch Demo Series
  • 10
    CO3D (Common Objects in 3D)

    CO3D (Common Objects in 3D)

    Tooling for the Common Objects In 3D dataset

    CO3Dv2 (Common Objects in 3D, version 2) is a large-scale 3D computer vision dataset and toolkit from Facebook Research designed for training and evaluating category-level 3D reconstruction methods using real-world data. It builds upon the original CO3Dv1 dataset, expanding both scale and quality—featuring 2× more sequences and 4× more frames, with improved image fidelity, more accurate segmentation masks, and enhanced annotations for object-centric 3D reconstruction. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    DriveLM

    DriveLM

    Driving with Graph Visual Question Answering

    ...The system includes DriveLM-Data, a dataset built on driving environments such as nuScenes and CARLA, where human-written reasoning steps connect different layers of driving tasks. This design allows models to learn relationships between objects, behaviors, and navigation decisions through graph-structured logic.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    kepler.gl

    kepler.gl

    Kepler.gl is a powerful open source geospatial analysis tool for data

    ...For information on how to embed kepler.gl in your app take a look at this step-by-step tutorial on vis.academy. Built with Deck.gl, Kepler.gl utilizes WebGL to render large datasets quickly and efficiently. You can easily drag and drop a dataset, add filters, apply scales, and do aggregation on the fly. Built on React & Redux, Kepler.gl can be embedded inside your own mapping applications.
    Downloads: 8 This Week
    Last Update:
    See Project
  • 13
    Whisper

    Whisper

    Robust Speech Recognition via Large-Scale Weak Supervision

    OpenAI Whisper is a general-purpose speech recognition model. It is trained on a large dataset of diverse audio and is also a multitasking model that can perform multilingual speech recognition, speech translation, and language identification. A Transformer sequence-to-sequence model is trained on various speech processing tasks, including multilingual speech recognition, speech translation, spoken language identification, and voice activity detection.
    Downloads: 64 This Week
    Last Update:
    See Project
  • 14
    Cleanlab

    Cleanlab

    The standard data-centric AI package for data quality and ML

    cleanlab helps you clean data and labels by automatically detecting issues in a ML dataset. To facilitate machine learning with messy, real-world data, this data-centric AI package uses your existing models to estimate dataset problems that can be fixed to train even better models. cleanlab cleans your data's labels via state-of-the-art confident learning algorithms, published in this paper and blog. See some of the datasets cleaned with cleanlab at labelerrors.com.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    GluonTS

    GluonTS

    Probabilistic time series modeling in Python

    GluonTS is a Python package for probabilistic time series modeling, focusing on deep learning based models. GluonTS requires Python 3.6 or newer, and the easiest way to install it is via pip. We train a DeepAR-model and make predictions using the simple "airpassengers" dataset. The dataset consists of a single time-series, containing monthly international passengers between the years 1949 and 1960, a total of 144 values (12 years * 12 months). We split the dataset into train and test parts, by removing the last three years (36 months) from the train data. Thus, we will train a model on just the first nine years of data. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    VLMEvalKit

    VLMEvalKit

    Open-source evaluation toolkit of large multi-modality models (LMMs)

    ...Instead of requiring complex data preparation pipelines or multiple repositories for each benchmark, the system enables evaluation through simple commands that automatically handle dataset loading, model inference, and metric computation. VLMEvalKit supports generation-based evaluation methods, allowing models to produce textual responses to visual inputs while measuring performance through techniques such as exact matching or language-model-assisted answer extraction.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 17
    VR Neuroanatomy

    VR Neuroanatomy

    Explore and dissect a complete brain model in VR

    Understanding the anatomy of complex organs such as the human brain can be a challenge for students, so there is a definite advantage given to students who can experience the structures in a spatial way through real or virtual experiences. Since 2016, the Marquette Visualization Lab has been utilizing a dataset of 3 and 7 Tesla MRI scans from the Structural Informatics Group at University of Washington to visualize the structures of the brain in their Cave, utilizing the Unity game engine and 10 stereoscopic 3D projectors. Most MRI scans are presented as a volumetric rendering, but this dataset is unique because it was fully labelled and parcellated, allowing lab users to not only view the structures of the brain, but also virtually dissect it in a large scale, collaborative virtual reality environment. ...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 18
    NBA Sports Betting Machine Learning

    NBA Sports Betting Machine Learning

    NBA sports betting using machine learning

    ...The system gathers historical team statistics and game data spanning multiple seasons, beginning with the 2007–2008 NBA season and continuing through the present. Using this dataset, the project constructs matchup features that represent team performance trends and contextual information about each game. Machine learning models are then trained to estimate the probability that a team will win a game as well as whether the total score will fall above or below the sportsbook’s predicted total. In addition to predicting outcomes, the project evaluates expected value to determine whether a potential bet offers a statistical advantage compared with sportsbook odds.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 19
    HumanEval

    HumanEval

    Code for the paper "Evaluating Large Language Models Trained on Code"

    ...The benchmark has become a standard for evaluating code generation models, including those in the Codex and GPT families. Researchers can use the dataset to run reproducible comparisons across models and track improvements in functional code synthesis. By focusing on correctness through execution, human-eval provides a rigorous and practical way to evaluate programming capabilities in AI systems.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 20
    NeMo Curator

    NeMo Curator

    Scalable data pre processing and curation toolkit for LLMs

    ...At the core of the NeMo Curator is the DocumentDataset which serves as the the main dataset class. It acts as a straightforward wrapper around a Dask DataFrame. The Python library offers easy-to-use methods for expanding the functionality of your curation pipeline while eliminating scalability concerns.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 21
    ClosedXML

    ClosedXML

    A .NET library for reading, manipulating and writing Excel

    ClosedXML is a .NET library for creating and manipulating Excel files without requiring Microsoft Excel, designed for easy integration and performance.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 22
    FlagEmbedding

    FlagEmbedding

    Retrieval and Retrieval-augmented LLMs

    ...FlagEmbedding includes a family of models known as BGE (BAAI General Embedding), which are designed to achieve strong performance across multilingual and cross-lingual retrieval benchmarks. The toolkit provides infrastructure for inference, fine-tuning, evaluation, and dataset preparation, enabling developers to train custom embedding models for specific domains or applications. It also includes reranker models that refine search results by re-evaluating candidate documents using cross-encoder architectures, improving retrieval accuracy in complex queries.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 23
    Segment Anything

    Segment Anything

    Provides code for running inference with the SegmentAnything Model

    ...The architecture separates a powerful image encoder from a lightweight mask decoder, so the heavy vision work can be computed once and the interactive part stays fast. A bundled automatic mask generator can sweep an image and propose many object masks, which is useful for dataset bootstrapping or bulk annotation. The repository includes ready-to-use weights, Python APIs, and example notebooks demonstrating both interactive and automatic modes. Because SAM was trained with an extremely large and diverse mask dataset, it tends to generalize well to new domains, making it a practical starting point for research and production annotation tools.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 24
    Marble Skill Taxonomy

    Marble Skill Taxonomy

    Structured taxonomy of what children learn across the primary years

    Marble Skill Taxonomy is an open structured dataset that maps what children learn across primary and elementary education. It breaks curriculum content into fine-grained micro-topics instead of leaving learning goals as broad standards. Each topic includes subject, domain, age range, description, evidence criteria, assessment prompt, and stable identifiers. The dataset also defines prerequisite relationships, so developers can trace what a learner should master before a concept. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    Step1X-3D

    Step1X-3D

    High-Fidelity and Controllable Generation of Textured 3D Assets

    ...The result is fully 3D assets — meshes + textures — which can be rendered from any viewpoint, textured consistently, and used in 3D applications. To achieve this, the project includes a massive curated dataset: among more than 5 million candidate 3D assets, it filters and standardizes to produce a high-quality 2 million–asset subset suitable for training.
    Downloads: 0 This Week
    Last Update:
    See Project