Showing 261 open source projects for "retrieve data"

View related business solutions
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Get Started Free
  • AI Agents That Actually Do the Work Icon
    AI Agents That Actually Do the Work

    Assign real work to AI teammates that know your projects, priorities, and deadlines.

    ClickUp's Super Agents run 24/7 inside your workspace: triaging bugs, drafting content, updating statuses, and routing tasks without being told twice. Connect them to 500+ tools and let them execute, not just suggest. Build custom agents in minutes that understand your workflows and act on them autonomously.
    Try ClickUp Free
  • 1
    go-dork

    go-dork

    Fast Go-based CLI scanner for running automated search engine dorks

    ...Written in the Go programming language, it focuses on speed and efficiency when executing advanced search queries across multiple search engines. It allows users to run specialized queries, often referred to as “dorks,” to discover publicly exposed data, misconfigurations, or potentially vulnerable resources. It supports several major search engines and enables users to switch between them depending on the target or query requirements. go-dork can retrieve results from multiple pages of search results and process them sequentially for broader coverage during scans. go-dork also supports custom HTTP headers and proxy configuration, which can help users work around restrictions such as captchas or filtering mechanisms. ...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 2
    Arctic TimeSeries and Tick store

    Arctic TimeSeries and Tick store

    High performance datastore for time series and tick data

    ...Has different types of Stores, each with it's own benefits. Eg. Versionstore allows you to version and snapshot stuff, TickStore is for storage and highly efficient retrieval of streaming data, ChunkStore allows you to chunk and efficiently retrieve ranges of chunks.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 3
    S3cmd

    S3cmd

    Command line tool for managing Amazon S3 and CloudFront services

    S3cmd (s3cmd) is a free command line tool and client for uploading, retrieving and managing data in Amazon S3 and other cloud storage service providers that use the S3 protocol, such as Google Cloud Storage or DreamHost DreamObjects. It is best suited for power users who are familiar with command-line programs. It is also ideal for batch scripts and automated backup to S3, triggered from cron, etc. S3cmd is written in Python. It's an open-source project available under GNU Public License v2...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 4
    OpenAssistant

    OpenAssistant

    Chat-based assistant that understands tasks

    ...You do not need to run the project locally unless you are contributing to the development process. The website link above will take you to the public website where you can use the data collection app.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 5
    bilili

    bilili

    Command-line Bilibili video and danmaku downloader with batch support

    bilili is a command-line tool designed to download videos and related content from the Bilibili video platform. It focuses on enabling users to retrieve user-uploaded videos as well as serialized content such as bangumi episodes directly from the terminal environment. It provides automated downloading capabilities that handle video streams and associated data efficiently while minimizing manual interaction. bilili supports retrieving both the video files and danmaku comments, which are the scrolling overlay comments commonly associated with the platform’s videos. ...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 6
    Nativefier

    Nativefier

    Make any web page a desktop application

    Tired of having to search through numerous open tabs on your browser just to view a web page that you regularly view? Make things easier and more convenient for yourself with Nativefier! Nativefier is a command-line tool that easily creates a desktop app for any web site with minimal configuration. It creates an Electron (which uses Chromium under the hood) based native wrapper in an OS executable (.app, .exe, etc) for use on Windows, macOS and Linux. Using Nativefier is absurdly simple....
    Downloads: 41 This Week
    Last Update:
    See Project
  • 7
    SocialPwned

    SocialPwned

    OSINT tool to collect emails from social networks and find leaks

    ...Once emails are discovered, SocialPwned searches for leaked credentials using breach databases like PwnDB and Dehashed to determine whether those accounts have appeared in data leaks. SocialPwned also integrates with GHunt to retrieve additional public information related to Google accounts linked to the discovered emails. By combining social media intelligence with breach data analysis, SocialPwned helps investigators identify reused passwords and patterns that may indicate potential security weaknesses.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 8
    AI-powered enterprise search engine

    AI-powered enterprise search engine

    AI-powered enterprise search engine

    AI-powered enterprise search engine is an open-source, AI-powered enterprise search engine designed to help organizations quickly locate and retrieve information scattered across multiple internal tools, documents, and communication platforms. It enables users to search across sources such as Slack, Confluence, Jira, Google Drive, and other enterprise systems, consolidating fragmented knowledge into a single, unified search experience. By leveraging natural language processing, Gerev allows users to query information in plain English, making it easier to find answers without needing exact keywords or knowing where the data is stored. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    Cinemagoer

    Cinemagoer

    Python package useful to retrieve and manage the data of IMDb

    ...If you know the IMDb id of a movie, you can use the get_movie method to retrieve its data. It’s possible to retrieve the list of top 250 and bottom 100 movies. As on the IMDb site, each TV series and also each of a TV series’ episodes is treated as a regular title, just like a movie. The episodes of a series can be fetched using the “episodes” infoset.
    Downloads: 0 This Week
    Last Update:
    See Project
  • AI-powered service management for IT and enterprise teams Icon
    AI-powered service management for IT and enterprise teams

    Enterprise-grade ITSM, for every business

    Give your IT, operations, and business teams the ability to deliver exceptional services—without the complexity. Maximize operational efficiency with refreshingly simple, AI-powered Freshservice.
    Try it Free
  • 10
    EdgeUR

    EdgeUR

    Edge Gateway + Storage deal making using Delta

    Edge is currently under heavy development. Dedicated light node to upload and retrieve their CIDs. To do this, we decoupled the upload and retrieval aspect from the Estuary API node so we can create a node that can live on the "edge" closer to the customer. Dedicated node assignment for each customer. The customer or user can now launch an edge node and use it for both uploading to Estuary and retrieval using the same API keys issued from Estuary. Switches the upload protocol. The user still...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    Clarity AI

    Clarity AI

    A Perplexity clone

    Clarity AI is an AI-powered “search + chat” tool (similar in spirit to a simplified “AI-powered search engine / assistant”) created by Mckay Wrigley — intended to let users ask questions, get answers, and explore information via conversational interface rather than traditional search. The codebase (TypeScript) leverages LLMs / embeddings to process user queries, retrieve relevant data or context, and respond conversationally; this makes it useful as a personal knowledge assistant, research helper, or Q&A front end over arbitrary datasets or web-available info. Because Clarity AI is open-source, developers can adapt the backend or retrieval logic, integrate their own data sources (databases, documents, APIs), and build custom assistants or knowledge bots tailored to their needs. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    Cinemagoer

    Cinemagoer

    Python package to retrieve and manage data of the IMDb

    Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies. Platform-independent, it can retrieve data from both the IMDb's web server and a local copy of the whole db.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 13
    cep-promise

    cep-promise

    Search for ZIP code integrated into the services of Post Office

    cep-promise is a Brazilian postal code (CEP) lookup library that provides a simple and efficient way to retrieve address information from multiple services, ensuring high availability and reliability.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    Moriarty Project

    Moriarty Project

    Web-based OSINT tool for investigating phone number information

    ...It allows users to input a phone number and analyze various details related to that number through multiple investigation features. It performs information gathering by scraping data from online sources to retrieve insights such as owner information, spam risk, and related web references. Users can select specific investigation features to run individually or execute all available checks at once depending on their needs. Moriarty Project operates through a browser-based interface and includes multithreading improvements that help speed up the investigation process. ...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 15
    EliasDB

    EliasDB

    EliasDB a graph-based database

    ...EliasDB has a GraphQL interface which can be used to store and retrieve data. For more complex queries EliasDB has an own query language called EQL with an sql-like syntax. Includes a scripting interpreter to define alternative actions for database operations or writing backend logic. Written in Go from scratch. Only uses gorilla/websocket to support websockets for GraphQL subscriptions. The database can be embedded or used as a standalone application.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Pattern

    Pattern

    Web mining module for Python, with tools for scraping

    Pattern is an open-source Python library that provides tools for web mining, natural language processing, machine learning, and network analysis. The project integrates multiple capabilities into a single framework that allows developers to collect, process, and analyze textual data from the web. It includes modules for web scraping and crawling that can retrieve information from sources such as social media platforms, search engines, and online knowledge bases. In addition to data mining features, the library offers natural language processing functionality including part-of-speech tagging, sentiment analysis, and n-gram extraction. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    AirSim

    AirSim

    A simulator for drones, cars and more, built on Unreal Engine

    ...AirSim's development is oriented towards the goal of creating a platform for AI research to experiment with deep learning, computer vision and reinforcement learning algorithms for autonomous vehicles. For this purpose, AirSim also exposes APIs to retrieve data and control vehicles in a platform independent way. AirSim is fully enabled for multiple vehicles. This capability allows you to create multiple vehicles easily and use APIs to control them.
    Downloads: 34 This Week
    Last Update:
    See Project
  • 18
    ety

    ety

    A Python module to discover the etymology of words

    ety is a Python library and command-line tool designed to explore and retrieve the etymological origins of words by analyzing linguistic data and relationships between languages. It allows users to query a word and obtain its historical roots, including intermediate forms across different languages and time periods. The tool can generate recursive etymology chains as well as tree structures that visually represent how a word evolved over time.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    mlscraper

    mlscraper

    ML-based HTML scraper that learns extraction rules from examples

    mlscraper is a Python library designed to automatically extract structured data from HTML pages without requiring developers to manually write CSS selectors or XPath rules. Instead of defining extraction logic by hand, users provide a few examples of the data they want to retrieve from a webpage. It analyzes those examples within the HTML document and determines patterns or rules that can be used to extract the same type of information from similar pages.
    Downloads: 5 This Week
    Last Update:
    See Project
  • 20
    Node Binance Trader NBT

    Node Binance Trader NBT

    Cryptocurrency trading strategy & portfolio management development

    By default the trader tries to trade with margin, so you need to have at least 0.001 BTC in your spot as well as your margin account. Also, to cover trading fees, you'll need a small amount of BNB in both your spot and margin wallets. While the Bitcoin vs. Altcoins website itself is closed source, the automated trading bot called Node Binance Trader (NBT) is open source. It connects to your Binance account via the Binance API and executes the trades on your behalf. Choose any unique name you...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    Specter

    Specter

    Clojure(Script)'s missing piece

    Specter is a powerful Clojure (and ClojureScript) library that revolutionizes navigation and manipulation of deeply nested and recursive data structures through a flexible, high-performance API beyond what vanilla Clojure offers. Specter has an extremely simple core, just a single abstraction called "navigator". Queries and transforms are done by composing navigators into a "path" precisely targeting what you want to retrieve or change. Navigators can be composed with any other navigators, allowing sophisticated manipulations to be expressed very concisely. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Scylla

    Scylla

    Intelligent proxy pool for collecting and managing public proxies

    Scylla is an open source proxy pool system designed to collect, validate, and manage large numbers of public proxy servers for use in web scraping and data extraction workflows. It automatically crawls the internet to discover proxy IP addresses and evaluates their availability and reliability before adding them to a usable pool. It includes a JSON API that allows developers and applications to retrieve proxy information programmatically, making it easier to integrate proxy rotation into scraping tools or automation scripts. ...
    Downloads: 19 This Week
    Last Update:
    See Project
  • 23
    JJ

    JJ

    JSON Stream Editor (command line utility)

    JJ is a command line utility that provides a fast and simple way to retrieve or update values from JSON documents. It's powered by GJSON and SJSON under the hood. It's fast because it avoids parsing irrelevant sections of json, skipping over values that do not apply, and aborts as soon as the target value has been found or updated.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    SignalR

    SignalR

    Incredibly simple real-time web for .NET

    ...The simple programming model integrates seamlessly with other ASP.NET features like dependency injection, authentication, authorization, and scalability. While chat is often used as an example, you can do a whole lot more. Any time a user refreshes a web page to see new data, or the page implements Ajax long polling to retrieve new data, it's candidate for using SignalR. SignalR also enables completely new types of applications that require high-frequency updates from the server, such as real-time gaming.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    Myel pop

    Myel pop

    Run a point-of-presence within Myel

    Run a point-of-presence within Myel, the community-powered content delivery network. Our mission is to build a community powered content delivery network that is resilient, scalable, and peer-to-peer ↔️ to suit the long-term needs of Web3 applications. We're currently using Filecoin building blocks and are aspiring to make this library as interoperable as possible with existing Web3 backends such as IPFS. This library is still experimental so feel free to open an issue if you have any...
    Downloads: 0 This Week
    Last Update:
    See Project
Auth0 Logo