Showing 4436 open source projects for "data file"

View related business solutions
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New customers can spin up VMs, build with AI, and query data at no cost.

    Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
    Start Free
  • 1
    s3fs

    s3fs

    FUSE-based file system backed by Amazon S3

    s3fs allows Linux, macOS, and FreeBSD to mount an S3 bucket via FUSE. s3fs preserves the native object format for files, allowing use of other tools like AWS CLI. Large subset of POSIX including reading/writing files, directories, symlinks, mode, uid/gid, and extended attributes. Compatible with Amazon S3, and other S3-based object stores. Allows random writes and appends, large files via multi-part upload, and renames via server-side copy. User-specified regions, including Amazon GovCloud....
    Downloads: 2 This Week
    Last Update:
    See Project
  • 2
    Brotli

    Brotli

    Brotli compression format

    Version 1.0.9 contains a fix to "integer overflow" problem. This happens when "one-shot" decoding API is used (or input chunk for streaming API is not limited), input size (chunk size) is larger than 2GiB, and input contains uncompressed blocks. After the overflow happens, memcpy is invoked with a gigantic num value, that will likely cause the crash. Brotli is a generic-purpose lossless compression algorithm that compresses data using a combination of a modern variant of the LZ77 algorithm,...
    Downloads: 47 This Week
    Last Update:
    See Project
  • 3
    v2rayA

    v2rayA

    A web GUI client of Project V which supports V2Ray, Xray, SS, SSR

    A web GUI client of Project V which supports V2Ray, Xray, SS, SSR, Trojan and Pingtunnel. v2rayA is a V2Ray Linux client supporting global transparent proxy, compatible with SS, SSR, Trojan(trojan-go), PingTunnel protocols. We are committed to providing the simplest operation and meet most needs. Thanks to the advantages of Web GUI, you can not only use it on your local computer, but also easily deploy it on a router or NAS.
    Downloads: 47 This Week
    Last Update:
    See Project
  • 4
    DVC

    DVC

    Data Version Control | Git for Data & Models

    DVC is built to make ML models shareable and reproducible. It is designed to handle large files, data sets, machine learning models, and metrics as well as code. Version control machine learning models, data sets and intermediate files. DVC connects them with code and uses Amazon S3, Microsoft Azure Blob Storage, Google Drive, Google Cloud Storage, Aliyun OSS, SSH/SFTP, HDFS, HTTP, network-attached storage, or disc to store file contents.
    Downloads: 1 This Week
    Last Update:
    See Project
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Try It Free
  • 5
    Laravel PDF

    Laravel PDF

    Create PDF files in Laravel apps

    This package provides a simple way to create PDFs in Laravel apps. Under the hood it uses Chromium to generate PDFs from Blade views. You can use modern CSS features like grid and flexbox to create beautiful PDFs.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 6
    NCDatasets.jl

    NCDatasets.jl

    Load and create NetCDF files in Julia

    NCDatasets allows one to read and create netCDF files. NetCDF data set and attribute list behave like Julia dictionaries and variables like Julia arrays. This package implements the CommonDataModel.jl interface, which means that the datasets can be accessed in the same way as GRIB files opened with GRIBDatasets.jl.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    emuiibo

    emuiibo

    Virtual amiibo (amiibo emulation) system for Nintendo Switch

    Virtual amiibo (amiibo emulation) system for Nintendo Switch. A virtual amiibo is detected by emuiibo based on two aspects: a amiibo.json and a amiibo.flag file must exist inside the virtual amiibo's folder mentioned above. If (for whatever reason) you would like to disable a virtual amiibo from being recognised by emuiibo, just remove the flag file, and create it again to enable it. While old emuiibo formats are supported and converted to the current format (see above), it is strongly...
    Downloads: 54 This Week
    Last Update:
    See Project
  • 8
    Apache Avro

    Apache Avro

    Apache Avro is a data serialization system

    ...This permits each datum to be written with no per-value overheads, making serialization both fast and small. This also facilitates use with dynamic, scripting languages, since data, together with its schema, is fully self-describing. When Avro data is stored in a file, its schema is stored with it, so that files may be processed later by any program. If the program reading the data expects a different schema this can be easily resolved, since both schemas are present.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    ipfs-car

    ipfs-car

    Convert files to content-addressable archives and back

    Convert files to content-addressable archives and back. ipfs-car is a library and CLI tool to pack & unpack files from Content Addressable aRchives (CAR) file. A thin wrapper over @ipld/car and unix-fs. Content-addressable archives store data as blocks (a sequence of bytes) each prefixed with the Content ID (CID) derived from the hash of the data; typically in a file with a .car extension. Use ipfs-car to pack your files into a .car; a portable, verifiable, IPFS-compatible archive.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Try Free
  • 10
    Mage.ai

    Mage.ai

    Build, run, and manage data pipelines for integrating data

    ...That’s why we designed an easy developer experience that you’ll enjoy. Each step in your pipeline is a standalone file containing modular code that’s reusable and testable with data validations. No more DAGs with spaghetti code. Start developing locally with a single command or launch a dev environment in your cloud using Terraform. Write code in Python, SQL, or R in the same data pipeline for ultimate flexibility.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    AionUi

    AionUi

    Free, local, open-source Cowork for Gemini CLI, Claude Code, Codex

    ...Instead of forcing users to work in separate terminals for each tool, AionUi automatically detects installed CLI tools and provides a central visual workspace where sessions can run in parallel, contexts are preserved, and conversations are saved locally without sending data to external servers. It enhances productivity by offering smart file management features like batch renaming, automatic organization, and intelligent file classification, thereby reducing manual overhead when working with large datasets or complex document structures. AionUi also supports a remote WebUI mode, allowing users to access their local AI tools securely over a network from other devices while keeping all processing and data on their own hardware.
    Downloads: 16 This Week
    Last Update:
    See Project
  • 12
    tilemaker

    tilemaker

    Make OpenStreetMap vector tiles without the stack

    Create the vector tiles on your home machine or using a cloud CPU. Upload the file to your site or app. And that's it. No database to maintain; no contract to pay; and no restriction on commercial use. tilemaker is a single executable that takes OpenStreetMap data and makes it into vector tiles. It's supremely customizable, but if you just want off-the-shelf tiles in a standard style, tilemaker comes bundled with the files to do that too.
    Downloads: 25 This Week
    Last Update:
    See Project
  • 13
    FDUPES

    FDUPES

    FDUPES is a program for identifying or deleting duplicate files

    ...Because it operates directly on file content rather than just filenames, fdupes can accurately detect true copies and guide cleaning operations in data cleanup or migration tasks. It’s a simple, efficient, and widely used utility on Unix-like systems, appreciated by administrators, developers, and power users.
    Downloads: 17 This Week
    Last Update:
    See Project
  • 14
    Stirling-PDF

    Stirling-PDF

    Web application that allows you to perform operations on PDF files

    Stirling PDF is a powerful, locally hosted web-based PDF manipulation tool offering a wide range of editing, conversion, and utility features. It allows users to merge, split, compress, convert, OCR, and perform other operations on PDF files directly from a browser without uploading data to third-party servers. The tool is privacy-conscious, self-hostable via Docker, and built with modularity in mind to allow future expansion and integration.
    Downloads: 32 This Week
    Last Update:
    See Project
  • 15
    Matplotlib

    Matplotlib

    matplotlib: plotting with Python

    Matplotlib is a comprehensive library for creating static, animated, and interactive visualizations in Python. Matplotlib makes easy things easy and hard things possible. Matplotlib ships with several add-on toolkits, including 3D plotting with mplot3d, axes helpers in axes_grid1 and axis helpers in axisartist. A large number of third party packages extend and build on Matplotlib functionality, including several higher-level plotting interfaces (seaborn, HoloViews, ggplot, ...), and a...
    Downloads: 16 This Week
    Last Update:
    See Project
  • 16
    wavesurfer.js

    wavesurfer.js

    Navigable waveform built on Web Audio and Canvas

    ...You can also try wavesurfer.swf which is a Flash-based fallback. The audio will start playing as you press play. A thin line will be displayed until the whole audio file is downloaded and decoded to draw the waveform. Web Audio needs the whole file to decode it in the browser. You can however load pre-decoded waveform data to draw the waveform immediately. wavesurfer.js runs on modern browsers supporting Web Audio, including Firefox, Chrome, Safari (desktop and mobile) and Opera.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 17
    SleekDB

    SleekDB

    Pure PHP NoSQL database with no dependency

    SleekDB is a simple flat file NoSQL-like database implemented in PHP without any third-party dependencies that store data in plain JSON files. It is not designed to handle heavy-load IO operations, it is designed to have a simple solution where all we need a database for managing a few gigabytes of data. You can think of it as a database for low to medium operation loads.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    Luigi

    Luigi

    Python module that helps you build complex pipelines of batch jobs

    ...You want to chain many tasks, automate them, and failures will happen. These tasks can be anything, but are typically long running things like Hadoop jobs, dumping data to/from databases, running machine learning algorithms, or anything else. You can build pretty much any task you want, but Luigi also comes with a toolbox of several common task templates that you use. It includes support for running Python mapreduce jobs in Hadoop, as well as Hive, and Pig, jobs. It also comes with file system abstractions for HDFS, and local files that ensures all file system operations are atomic.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 19
    GeoIP

    GeoIP

    This project automatically generates GeoIP files in multiple formats

    ...The repo provides automated, periodic releases (e.g. weekly or on schedule) and also offers a CLI tool so users can regenerate or customize geo data in the format they need — for example, producing a .dat file for V2Ray / Xray-core, or a MaxMind-compatible .mmdb.
    Downloads: 10 This Week
    Last Update:
    See Project
  • 20
    INI

    INI

    Package ini provides INI file read and write functionality in Go

    The most powerful, convenient and popular Go package for INI manipulations existed on Earth. Not limited to reading from a file, parse from []byte type raw data, or streaming from io.ReadCloser works like a charm. Wide-range support of variant formats includes but is not limited to my.cnf, .gitconfig, or even unparseable sections. Automatically convert to native types of Go at no cost. Let you focus on the code logic and no more tedious conversions. Map your configuration to a user-defined struct{} to be more object-oriented. ...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 21
    Apache HBase

    Apache HBase

    Get random, realtime read/write access to your Big Data

    Use Apache HBase™ when you need random, realtime read/write access to your Big Data. This project's goal is the hosting of very large tables, billions of rows X millions of columns, atop clusters of commodity hardware. Apache HBase is an open-source, distributed, versioned, non-relational database modeled after Google's Bigtable. A Distributed Storage System for Structured Data by Chang et al. Just as Bigtable leverages the distributed data storage provided by the Google File System, Apache HBase provides Bigtable-like capabilities on top of Hadoop and HDFS. ...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 22
    Vue Json Pretty

    Vue Json Pretty

    A JSON tree view component that is easy to use

    A Vue component for rendering JSON data as a tree structure. The CSS file is included separately and needs to be imported manually. You can either import CSS globally in your app (if supported by your framework) or directly from the component.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 23
    Arrow Julia

    Arrow Julia

    Official Julia implementation of Apache Arrow

    This is a pure Julia implementation of the Apache Arrow data standard. This package provides Julia AbstractVector objects for referencing data that conforms to the Arrow standard. This allows users to seamlessly interface Arrow formatted data with a great deal of existing Julia code.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    Pandas Profiling

    Pandas Profiling

    Create HTML profiling reports from pandas DataFrame objects

    File sizes, creation dates, dimensions, indication of truncated images and existance of EXIF metadata. Mostly global details about the dataset (number of records, number of variables, overall missigness and duplicates, memory footprint). Comprehensive and automatic list of potential data quality issues (high correlation, skewness, uniformity, zeros, missing values, constant values, between others).
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    json_serializable

    json_serializable

    Generates utilities to aid in serializing to/from JSON.

    Provides Dart Build System builders for handling JSON.
    Downloads: 5 This Week
    Last Update:
    See Project