Showing 642 open source projects for "dataset"

View related business solutions
  • 99.99% Uptime for MySQL and PostgreSQL Databases Icon
    99.99% Uptime for MySQL and PostgreSQL Databases

    Sub-second maintenance. 2x read/write performance. Built-in vector search for AI apps.

    Cloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
    Try Free
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 1
    PyTorch Forecasting

    PyTorch Forecasting

    Time series forecasting with PyTorch

    PyTorch Forecasting aims to ease state-of-the-art time series forecasting with neural networks for both real-world cases and research alike. The goal is to provide a high-level API with maximum flexibility for professionals and reasonable defaults for beginners. A time series dataset class that abstracts handling variable transformations, missing values, randomized subsampling, multiple history lengths, etc. A base model class that provides basic training of time series models along with logging in tensorboard and generic visualizations such actual vs predictions and dependency plots. Multiple neural network architectures for timeseries forecasting that have been enhanced for real-world deployment and come with in-built interpretation capabilities. ...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 2
    Charts.css

    Charts.css

    Open source CSS framework for data visualization

    Charts.css is a modern CSS framework. It uses CSS utility classes to style HTML elements as charts. No dependencies. 72kb file size. Less than 6kb gzipped file size! Visualization helps end-users understand data. Charts.css help frontend developers turn data into beautiful charts and graphs using simple CSS classes. The data is structured using semantic HTML tags and styled using CSS classes which change the visual representation displayed to the end-user. The framework offers developers...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 3
    Inventory

    Inventory

    Asset inventory dataset for public bug bounty program targets

    Trickest Inventory is an open source dataset and workflow collection designed to provide an extensive asset inventory for public bug bounty programs. The repository tracks and organizes security-relevant assets for more than 800 companies participating in public vulnerability disclosure and bug bounty initiatives. It collects information such as DNS records and web server data, helping security researchers better understand the attack surface of these programs.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 4
    Weights and Biases

    Weights and Biases

    Tool for visualizing and tracking your machine learning experiments

    ...Use W&B to visualize results in real time, all in a central dashboard. Focus on the interesting ML. Spend less time manually tracking results in spreadsheets and text files. Capture dataset versions with W&B Artifacts to identify how changing data affects your resulting models. Reproduce any model, with saved code, hyperparameters, launch commands, input data, and resulting model weights. Set wandb.config once at the beginning of your script to save your hyperparameters, input settings (like dataset name or model type), and any other independent variables for your experiments. ...
    Downloads: 3 This Week
    Last Update:
    See Project
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Get Started Free
  • 5
    Cloud Native Landscape

    Cloud Native Landscape

    The Cloud Native Interactive Landscape filters

    Cloud Native Landscape is an open-source project that serves as a comprehensive visual map and database of the cloud-native ecosystem, cataloging hundreds of tools, platforms, and services across categories such as orchestration, observability, networking, and storage. Rather than being a traditional software application, it is a curated dataset and visualization system that helps developers and organizations navigate the rapidly evolving cloud-native space. The project organizes technologies into structured categories, making it easier to understand relationships and identify tools relevant to specific use cases. It includes strict contribution guidelines to maintain consistency and ensure that listed projects meet certain criteria, such as community adoption and relevance. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    emojilib

    emojilib

    Emoji keyword library

    Emoji keyword library. Make emoji searchable with this keyword library. If you are looking for the unicode emoji dataset, including version, grouping, ordering, and skin tone support flag, check out unicode-emoji-json.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 7
    Materials Discovery: GNoME

    Materials Discovery: GNoME

    AI discovers 520000 stable inorganic crystal structures for research

    ...The project centers on Graph Networks for Materials Exploration (GNoME), a message-passing neural network architecture trained on density functional theory (DFT) data to predict material stability and energy formation. Using GNoME, DeepMind identified 381,000 new stable materials, later expanding the dataset to include over 520,000 materials within 1 meV/atom of the convex hull as of August 2024. The repository provides datasets, model definitions, and interactive Colabs for exploring these materials, computing decomposition energies, and visualizing chemical families. Additionally, it includes JAX-based implementations of GNoME and Nequip—the latter being used to train interatomic potentials for dynamic simulations.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 8
    Ultravox

    Ultravox

    Fast multimodal LLM for real-time voice interaction and AI apps

    ...It supports use cases such as conversational AI agents, speech-to-speech translation, and analysis of spoken audio content. Ultravox also includes tooling and configuration systems for training, evaluation, and dataset integration.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 9
    DBHub

    DBHub

    Universal database MCP server connecting to MySQL, PostgreSQL

    ...Operational flags include read-only mode, row limits, and even SSH tunneling options for secure access into private networks. A demo mode ships with an in-memory SQLite “employee” dataset so users can try the tools immediately without provisioning a database. The project lives in the Bytebase org alongside database DevSecOps tooling, underscoring a production focus on safe and auditable DB interaction.
    Downloads: 1 This Week
    Last Update:
    See Project
  • Train ML Models With SQL You Already Know Icon
    Train ML Models With SQL You Already Know

    BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

    Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
    Try Free
  • 10
    RetroPie BIOS

    RetroPie BIOS

    Full BIOS collection for RetroPie

    ...It also includes checksum validation mechanisms, allowing users to verify file integrity and ensure that BIOS files match expected standards. By maintaining a structured and verified dataset, the repository reduces common issues associated with missing or incorrect BIOS files.
    Downloads: 27 This Week
    Last Update:
    See Project
  • 11
    FramePack

    FramePack

    Lets make video diffusion practical

    FramePack explores compact representations for sequences of image frames, targeting tasks where many near-duplicate frames carry redundant information. The idea is to “pack” frames by detecting shared structure and storing differences efficiently, which can accelerate training or inference on video-like data. By reducing I/O and memory bandwidth, datasets become lighter to load while models still see the essential temporal variation. The repository demonstrates both packing and unpacking...
    Downloads: 39 This Week
    Last Update:
    See Project
  • 12
    Agent Apprenticeship

    Agent Apprenticeship

    The living ecosystem where AI agents complete tasks

    ...Apprentice agents can be paired with mentor agents, human reviewers, or domain experts depending on the selected mode. The project supports Codex, Cursor, Claude Code, OpenClaw, OpenCode, Hermes Agent, and custom agent commands. Its seed dataset includes curated tasks, reusable lessons, execution traces, work episodes, and structured experience records. It is designed for long-horizon agent work, workflow evaluation, runtime training, and shared improvement across an agent ecosystem.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    BigQuery Emulator

    BigQuery Emulator

    BigQuery emulator server implemented in Go

    ...Written in Go, it can run as a standalone binary, Docker container, or embedded library within test environments, making it highly flexible for different workflows. The emulator supports a large portion of the BigQuery API surface, including dataset management, query execution, and data ingestion, allowing applications to interact with it as if it were the real service. It uses SQLite as its underlying storage engine, with options for in-memory or persistent file-based databases depending on the use case. The system also implements many features of Google Standard SQL, including hundreds of functions and advanced query constructs, enabling realistic query testing.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    AI Deadlines

    AI Deadlines

    AI conference deadline countdowns

    ...The repository powers a website that displays countdown timers and structured information for top research conferences across subfields such as computer vision, natural language processing, machine learning, and robotics. The project maintains a curated dataset of conferences that includes metadata such as submission deadlines, abstract deadlines, event dates, conference locations, and related information. Researchers and students use the platform to plan their paper submissions and manage academic schedules without manually tracking multiple conference announcements. The repository includes configuration files and data sources that allow contributors to add or update conferences through pull requests, enabling community-driven maintenance.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    Hugging Face Skills

    Hugging Face Skills

    Definitions for AI/ML tasks like dataset creation

    Hugging Face Skills is a repository of standardized task definitions that package instructions, scripts, and resources so coding agents can reliably perform AI and machine learning workflows. Each skill is a self-contained folder with structured metadata and guidance that tells an agent how to execute tasks such as dataset creation, model training, evaluation, or Hub operations. The project is designed to be interoperable across major agent ecosystems, including Claude Code, OpenAI Codex, Gemini CLI, and Cursor, making it a cross-platform building block for agent automation. By formalizing best practices and workflows, Skills helps transform general-purpose coding agents into domain-aware assistants that can execute complex ML pipelines with less manual prompting. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    BIMserver

    BIMserver

    The open source BIMserver platform

    ...The main advantage of this approach is the ability to query, merge and filter the BIM model and generate IFC output (i.e. files) on the fly. Thanks to its multi-user support, multiple people can work on their own part of the dataset, while the complete dataset is updated on the fly. Other users can get notifications when the model (or a part of it) is updated.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    HyperTools

    HyperTools

    A Python toolbox for gaining geometric insights

    ...HyperTools is designed to facilitate dimensionality reduction-based visual explorations of high-dimensional data. The basic pipeline is to feed in a high-dimensional dataset (or a series of high-dimensional datasets) and, in a single function call, reduce the dimensionality of the dataset(s) and create a plot.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    React Chart.js

    React Chart.js

    React components for Chart.js, the most popular charting library

    ...In order to improve performance, offer new features, and improve maintainability, it was necessary to break backwards compatibility, but we aimed to do so only when worth the benefit. You will find that any event which causes the chart to re-render, such as hover tooltips, etc., will cause the first dataset to be copied over to other datasets, causing your lines and bars to merge together. This is because to track changes in the dataset series, the library needs a key to be specified. If none is found, it can't tell the difference between the datasets while updating. Specify a different property to be used as a key by passing a datasetIdKey prop to your chart component.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    AWS Data Wrangler

    AWS Data Wrangler

    Pandas on AWS, easy integration with Athena, Glue, Redshift, etc.

    An AWS Professional Service open-source python initiative that extends the power of Pandas library to AWS connecting DataFrames and AWS data-related services. Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON, and EXCEL). Built on top of other open-source projects like Pandas, Apache Arrow and Boto3, it offers abstracted functions to execute...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 20
    Letterboxd Recommendations

    Letterboxd Recommendations

    Scraping publicly-accessible Letterboxd data for movie recommendations

    ...Their ratings are then combined with a sample of ratings from the top 4000 most active users on the site to create a collaborative filtering recommender model using singular value decomposition (SVD). All movies in the full dataset that the user has not rated are run through the model for predicted scores and the items with the top predicted scores are returned. Due to constraints in time and computing power, the maximum sample size that a user is allowed to select is 500,000 samples, though there are over five million ratings in the full dataset from the top 4000 Letterboxd users alone.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 21
    WhatsApp Beacon

    WhatsApp Beacon

    OSINT tool for tracking WhatsApp online status via Web automation

    ...It uses Selenium automation to interact with the web interface and detect when a target account goes online or offline. By continuously monitoring these changes, WhatsApp Beacon records connectivity patterns and builds a historical dataset of activity sessions. The collected information is stored in logs and a local database, allowing users to review behavioral patterns over time. In addition, the project supports exporting collected data to spreadsheet formats for further analysis or reporting. WhatsApp Beacon is designed to run across multiple operating systems and can operate in the background using headless browser automation. ...
    Downloads: 28 This Week
    Last Update:
    See Project
  • 22
    CSV Lint

    CSV Lint

    CSV Lint plug-in for Notepad++ for syntax highlighting

    ...Use CSV Lint for metadata discovery, technical data validation, and reformatting on tabular data files. It is not meant to be a replacement for spreadsheet programs like Excel or SPSS, but rather it's a quality control tool to examine, verify or polish up a dataset before further processing.
    Downloads: 16 This Week
    Last Update:
    See Project
  • 23
    LongWriter

    LongWriter

    Unleashing 10,000+ Word Generation from Long Context LLMs

    ...Traditional large language models can process large inputs but often struggle to generate long outputs due to limitations in training data and alignment strategies. LongWriter addresses this challenge by introducing a specialized dataset and training approach that encourages models to produce longer responses. The system uses an agent-based pipeline called AgentWrite that decomposes large writing tasks into smaller subtasks, allowing the model to produce long documents section by section. Researchers also created the LongWriter-6k dataset containing thousands of examples with outputs ranging from a few thousand to tens of thousands of words.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    Magicoder

    Magicoder

    Empowering Code Generation with OSS-Instruct

    Magicoder is an open-source family of large language models designed specifically for code generation and software development tasks. The project focuses on improving the quality and diversity of code generation by training models with a novel dataset construction approach known as OSS-Instruct. This technique uses open-source code repositories as a foundation for generating more realistic and diverse instruction datasets for training language models. By grounding training data in real open-source examples, Magicoder aims to reduce bias and improve the reliability of code generation results compared to models trained solely on synthetic instructions. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    MaxKB

    MaxKB

    Open-source platform for building enterprise-grade agents

    ...It focuses on practical deployments such as customer support, internal knowledge bases, research assistants, and education, bundling tools for data ingestion, chunking, embedding, retrieval, and answer synthesis. The system exposes flexible tool-use (including MCP), supports multi-model backends, and provides dashboards for dataset management and evaluation. It’s backed by an active org that also builds adjacent ops tooling, and there’s a dedicated documentation repo for configuration and contribution. Community posts describe “self-host your ChatGPT-style assistant” positioning, with integrations and workflows to move from demo to production. Security advisories are tracked publicly, with upgrade guidance when issues arise.
    Downloads: 0 This Week
    Last Update:
    See Project