Showing 10 open source projects for "deduplication"

View related business solutions
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Try It Free
  • Host LLMs in Production With On-Demand GPUs Icon
    Host LLMs in Production With On-Demand GPUs

    NVIDIA L4 GPUs. 5-second cold starts. Scale to zero when idle.

    Deploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
    Try Free
  • 1
    wagmi

    wagmi

    React Hooks for Ethereum

    wagmi is a collection of React Hooks containing everything you need to start working with Ethereum. wagmi makes it easy to "Connect Wallet," display ENS and balance information, sign messages, interact with contracts, and much more, all with caching, request deduplication, and persistence. We create a wagmi Client and pass it to the WagmiConfig React Context. The client is set up to use the ethers Default Provider and automatically connect to previously connected wallets. Next, we use the useConnect hook to connect an injected wallet (e.g. MetaMask) to the app. Finally, we show the connected account's address with useAccount and allow them to disconnect with useDisconnect. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    Nuke

    Nuke

    Image loading system

    Nuke ILS provides an efficient way to download and display images in your app. It's easy to learn and use thanks to a clear and concise API. Its architecture enables many powerful features while offering virtually unlimited possibilities for customization. Despite the number of features, the framework is lean and compiles in just under 3 seconds¹. Nuke has an automated test suite 2x the size of the codebase itself, ensuring excellent reliability. Every feature is carefully designed and...
    Downloads: 16 This Week
    Last Update:
    See Project
  • 3
    Pachyderm

    Pachyderm

    Data-Centric Pipelines and Data Versioning

    ...Automatic immutable data lineage and data versioning of all data types. Autoscaling and parallel processing built on Kubernetes for resource orchestration. Uses standard object stores for data storage with automatic deduplication. Runs across all major cloud providers and on-premises installations. Automatic and intelligent versioning of even the largest data sets of unstructured and structured data. Git-like structure enables effective team collaboration. Full versioning for metadata including all analysis, parameters, artifacts, models, and intermediate results. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    SWR

    SWR

    React Hooks library for remote data fetching

    The name “SWR” is derived from stale-while-revalidate, a HTTP cache invalidation strategy popularized by HTTP RFC 5861. SWR is a strategy to first return the data from cache (stale), then send the fetch request (revalidate), and finally come with the up-to-date data. With SWR, components will get a stream of data updates constantly and automatically. And the UI will be always fast and reactive. With just one single line of code, you can simplify the logic of data fetching in your project,...
    Downloads: 0 This Week
    Last Update:
    See Project
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 5
    orogene

    orogene

    Makes `node_modules/` happen. Fast. No fuss

    Orogene is a next-generation package manager designed for Node.js environments, focusing on speed, efficiency, and seamless integration with tools that utilize node_modules/, such as bundlers and CLI applications. It employs a central store for dependencies, deduplicates packages, and leverages copy-on-write techniques on supported filesystems to minimize disk usage and accelerate loading times. Orogene aims to provide a robust and user-friendly experience, ensuring that developers can...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    graphql-react

    graphql-react

    A GraphQL client for React using modern context and hooks APIs

    graphql-react is a lightweight GraphQL client for React that emphasizes efficiency and simplicity. It provides built-in caching, request deduplication, and declarative data fetching without the complexity of larger GraphQL clients.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    XSIBackup-Classic

    XSIBackup-Classic

    Local and over IP backups for ©VMWare ©ESXi 5.1 to 6.7

    ...Consists in a cron programmable service running in the hypervisor. Hot backups, fully functional, standalone, ideal for dedicated servers. Full version supports quiescing, differential backup, deduplication and much more... Download link: https://33hops.com/xsibackup-vmware-esxi-backup.html Free VMWare backup solution for the ESXi hypervisor. Linux style command line tool. Crontab with configurable disk space autoprovision, set the room you want to reserve for your backups and rotate them. Full backups may be done with vmkfstools or by means of Rsync and its Delta algorithm (read: https://33hops.com/blog_xsibackup-rsync-considerations.html), to a local datastore or over TCP/IP tunneled through SSH, so any transfer over IP is secure.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 8
    GraphQL multipart request specification

    GraphQL multipart request specification

    A spec for GraphQL multipart form requests (file uploads).

    An interoperable multipart form field structure for GraphQL requests, used by various file upload client/server implementations. An “operations object” is an Apollo GraphQL POST request (or array of requests if batching). An “operations path” is an object-path string to locate a file within an operations object.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9

    lsdup

    List files with duplicate contents

    lsdup, short for "list duplicates", is a command line tool which can assist in finding and removing files with identical contents. Unlike many file deduplication tools, this has a "comparison mode" which lets you tell lsdup to "only read the files in this directory, do not consider any for duplicates... but, the files in that other directory may have duplicates, so delete (or move) any of those." lsdup also has normal deduplication, where, if given a single directory, it will sort the originals from the duplicates. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Try Free
  • 10
    The project will be looking at data (the intention is to begin looking at customer name/address data but this may widen over time) and ways to intelligently detect duplicates using fuzzy matching methods and algorithms.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next