Showing 214 open source projects for "data capture framework"

View related business solutions
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Try Free
  • $300 Free Credits for Your Google Cloud Projects Icon
    $300 Free Credits for Your Google Cloud Projects

    Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

    Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
    Start Free Trial
  • 1
    LittleLink

    LittleLink

    A lightweight DIY alternative to services like Linktree

    The DIY self-hosted LinkTree alternative. LittleLink has more than 60 branded button styles you can easily use, with more being added by our community all the time. LittleLink has more than 60 branded button styles you can use (with even more being added by our community). You'll also find a light and dark theme ready to go. Not a fan of the default colors? Update skeleton-light.css or skeleton-dark.css to the HEX values of your choosing. You can also set your CSS to skeleton-auto.css, which...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    Serverless Express by Vendia

    Serverless Express by Vendia

    Run Node.js web applications and APIs using existing frameworks

    Run REST APIs and other web applications using your existing Node.js application framework (Express, Koa, Hapi, Sails, etc.), on top of AWS Lambda and Amazon API Gateway. Vendia is the real-time data cloud for rapidly building applications that securely share data across departments, companies, clouds, and regions. We’re excited to announce the latest release of Vendia Share! This release includes new features like smart contracts, user-level transactions, the beta release of Azure support, and more. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    Internet Pi

    Internet Pi

    Raspberry Pi config for all things Internet

    Internet Pi is an Ansible playbook and configuration framework for a Raspberry Pi (or similar single-board computer) that transforms it into a network-infrastructure monitoring and ad-blocking unit. The typical use case is: plug the Pi into your home network, install Pi-hole for DNS-level ad-blocking and privacy, and deploy Prometheus + Grafana to monitor internet connection quality, ping latency, speed tests, and uptime trends. The intention is both practical (reduce ads, manage DNS) and...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    Keystone

    Keystone

    The most powerful headless CMS for Node.js

    The most powerful headless CMS for Node.js, built with GraphQL and React. The superpowered CMS for developers. Keystone helps you build faster and scale further than any other CMS or App Framework. Just describe your schema, and get a powerful GraphQL API & beautiful Management UI for content and data. No boilerplate or bootstrapping – just elegant APIs to help you ship the code that matters without sacrificing the flexibility or power of a bespoke back-end. Ship a backend easily without surrendering control. Keystone has all you need to start fast and scale on your terms. ...
    Downloads: 1 This Week
    Last Update:
    See Project
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 5
    Netty-socketio

    Netty-socketio

    Socket.IO server implemented on Java

    This project is an open-source Java implementation of Socket.IO server. Based on Netty server framework. Supports 0.7...0.9.16 (netty-socketio 1.6.6) and 1.0+ (netty-socketio latest version) version of Socket.IO-client. Supports distributed broadcast across netty-socketio nodes (Redisson, Hazelcast). Supports OSGi, supports Spring, lock-free and thread-safe implementation, and declarative handler configuration via annotations. YourKit is kindly supporting this open source project with its...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 6
    LiteNetLib 1.0 indev

    LiteNetLib 1.0 indev

    Lite reliable UDP library for Mono and .NET

    Lite reliable UDP library for .NET Framework 3.5, Mono, .NET Core 2.0, .NET Standard 2.0. Small packet size overhead (1 byte for unreliable, 3 bytes for reliable packets). Helper classes for sending and reading messages. Always use library sources instead of precompiled DLL files (because there are platform-specific #ifdefs and workarounds for unity bugs). Fast packet serializer (Usage manual). Automatic small packets merging. Automatic fragmentation of reliable packets. Automatic MTU...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    Mezzanine

    Mezzanine

    CMS framework for Django

    Mezzanine is a powerful open source content management platform built using the Django framework. In many ways it is like many other content management tools, offering an intuitive interface for managing all of your content. But Mezzanine is different in that it provides most of its functionality by default. While other platforms rely heavily on modules or reusable applications, Mezzanine comes ready with all the functionality you need, making it the more efficient choice. Mezzanine has a...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    AWS Amplify

    AWS Amplify

    A declarative JavaScript library for application development

    The Amplify open-source client libraries provide use-case-centric, opinionated, declarative, and easy-to-use interfaces across different categories of cloud-powered operations enabling mobile and web developers to easily interact with their backends. These libraries are powered by the AWS cloud and offer a pluggable model which can be extended to use other providers. The libraries can be used with both new backends created using the Amplify CLI and existing backend resources. The Amplify...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    DotnetSpider

    DotnetSpider

    Lightweight .NET framework for fast web crawling and data scraping

    DotnetSpider is a web crawling and data extraction framework built on the .NET Standard platform. It is designed to help developers create efficient and scalable crawlers for collecting structured data from websites. It provides a high-level API that simplifies the process of defining spiders, managing requests, and extracting content from web pages. Developers can create custom spiders by extending base classes and configuring pipelines that handle downloading, parsing, and storing collected data. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Cut Data Warehouse Costs by 54% Icon
    Cut Data Warehouse Costs by 54%

    Easily migrate from Snowflake, Redshift, or Databricks with free tools.

    BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
    Try Free
  • 10
    Ascoos Framework 24'

    Ascoos Framework 24'

    This package is a very small part of the Ascoos Cms custom core

    ...Now, the new version 24 is now coming to create new data in its modular core.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    dude uncomplicated data extraction

    dude uncomplicated data extraction

    dude uncomplicated data extraction: A simple framework

    Dude is a very simple framework for writing web scrapers using Python decorators. The design, inspired by Flask, was to easily build a web scraper in just a few lines of code. Dude has an easy-to-learn syntax. Dude is currently in Pre-Alpha. Please expect breaking changes. You can run your scraper from terminal/shell/command-line by supplying URLs, the output filename of your choice and the paths to your python scripts to dude scrape command.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    spider_collection

    spider_collection

    Collection of Python web scraping scripts for data extraction tasks

    spider_collection is a collection of Python web crawler scripts created primarily for experimentation, learning, and practical scraping tasks. spider_collection gathers multiple independent spiders designed to collect data from different platforms and services, demonstrating a variety of scraping techniques and workflows. These crawlers make use of common Python scraping tools such as requests, parsel, BeautifulSoup, and the Scrapy framework to extract structured information from web pages. Several scripts also incorporate multi-threading and proxy usage to improve scraping efficiency and help avoid common anti-scraping limitations. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    Foswiki
    Foswiki is an Enterprise wiki, typically used to run a collaboration platform, knowledge base or document management system. Users can create wiki applications using the Topic Markup Language, and developers can extend its functionality with plugins. Foswiki stands for "Free and Open Source" wiki to emphasize its commitment to Open Source software.
    Downloads: 7 This Week
    Last Update:
    See Project
  • 14
    teemIP - CMDB & DDI solution

    teemIP - CMDB & DDI solution

    teemIP : Open source IPAM & DDI solution with CMDB integration.

    teemIP is an open source, web-based IP Address Management (IPAM) and DDI solution built on the iTop framework. It provides comprehensive IP management: IPv4/IPv6 plan management, subnet hierarchy, IP lifecycle, VLAN and DNS/DHCP integration. teemIP is now maintained by the teemIP SAS founding team: Christophe Naud (original creator), Martin de Laval and Quentin Ville. The company is being officially incorporated in July 2026. The project remains open source under AGPL...
    Leader badge
    Downloads: 113 This Week
    Last Update:
    See Project
  • 15
    WFDownloader App

    WFDownloader App

    Free batch downloader for image, wallpaper, video, audio, document,

    Use as an image gallery, wallpaper, audio/music, video, document, and other media bulk downloader from supported websites. Also use to download sequential website urls that have a certain pattern (e.g. image01.png to image100.png). Also use app's built-in site crawler for advanced link search or extraction. There is also special support for forum media downloading, forum thread offline archiving, rss feed downloading, and open directory downloading. It's a programmable downloader and also...
    Leader badge
    Downloads: 264 This Week
    Last Update:
    See Project
  • 16
    ZnetDK 4 Mobile

    ZnetDK 4 Mobile

    Responsive Web App development full-stack framework in PHP and JS

    Develop easily in PHP, MySQL and JavaScript your business web app for mobile and tablet devices from a ready-to-customize starter app, fully Responsive and Installable (PWA). No need to start up from scratch. You just have to add the views that fullfill your business requirements and connect them to the user navigation menu. All the features expected for a mobile business application are already developed! Authenticate your users through the built-in login form. Show them only the pages...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    LazyJ is a rapid development framework for Java-based WEB applications. It includes a very fast template engine, page and data caching, database wrapper with connection pooling, database-backed sessions, time-bounded execution and other nice features
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    Cerberus Content Management System 6

    Cerberus Content Management System 6

    Cerberus Content Management System

    Cerberus Content Management System is a dynamic, secure and infinitely expandable CMS designed after a Unix-Like model complete with a Unix-Like Kernel File named: Cerberus. It is a custom written Web Application Framework ( W.A.F. ) with a consistent and custom written Pre-Hyper-Text-Post-Processor Programming Code Framework ( P.C.F. ). This Web Application Software Project' aim is to be the fastest and most secure Web Application Framework, Web Application Programming Code Framework, Text, Voice and Video Communications Platform and Content Management System in the world. ...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 19
    JForum2

    JForum2

    Bug fixes and enhancements for JForum 2.x

    JForum is a powerful and robust discussion board system implemented in Java. It provides an attractive interface, an efficient forum engine, an easy to use administrative panel, an advanced permission control system and much more. Built from the ground up around an MVC framework , it can be deployed on any Servlet 3.1 container or application server running at least Java 8, such as Tomcat, Jetty and JBoss/WildFly. Its clean design and implementation make JForum easy to customize and...
    Downloads: 11 This Week
    Last Update:
    See Project
  • 20
    Magnolia CMS

    Magnolia CMS

    Java CMS that delivers smartphone simplicity on an enterprise scale

    Magnolia is an open Java CMS that delivers smartphone simplicity on an enterprise-scale. The mobile-inspired HTML5 user interface works through customisable, task-focused Apps, a notification stream called the Pulse, and a system of Favorites for quickly accessing the workspace. Magnolia CMS allows organizations to orchestrate online services, sales and marketing across all digital channels, maximizing the impact of every touchpoint. Magnolia’s open-source technology, support of open...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    CerberusCMS5

    CerberusCMS5

    Cerberus Content Management System

    Cerberus Content Management System is a dynamic, secure and infinitely expandable CMS designed after a Unix-Like model. It is a custom written Web Application Framework ( W.A.F. ) with a consistent and custom written Pre-Hyper-Text-Post-Processor Programming Code Framework ( P.C.F. ). This Web Application Software Project' aim is to be the fastest and most secure Web Application Framework, Web Application Programming Code Framework, Text, Voice and Video Communications Platform and Content Management System in the world. ...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 22
    Crawlab

    Crawlab

    Distributed web crawler admin platform for spiders management

    ...The frontend app interacts with the master node, which communicates with other components such as MongoDB, SeaweedFS and worker nodes. Master node and worker nodes communicate with each other via gRPC (a RPC framework). Tasks are scheduled by the task scheduler module in the master node, and received by the task handler module in worker nodes, which executes these tasks in task runners. Task runners are actually processes running spider or crawler programs, and can also send data through gRPC (integrated in SDK) to other data sources, e.g. MongoDB.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 23
    crawly

    crawly

    High-level web crawling and scraping framework for Elixir apps

    Crawly is a high-level application framework for crawling websites and extracting structured data using the Elixir programming language. It provides a complete environment for building web crawlers that systematically visit pages, collect information, and transform that data into structured formats for further processing. Crawly is designed for tasks such as data mining, information processing, and building historical archives of web content.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 24
    Matrix

    Matrix

    Plugin style, non-invasive APM system developed by WeChat

    ...The monitoring scope of the current tool includes: crash, lag, and out-of-memory, which includes the following two plugins, WCCrashBlockMonitorPlugin, which is based on KSCrash framework and features cutting-edge lag stack capture capabilities with crash capture, and WCMemoryStatPlugin, which is a performance-optimized out-of-memory monitoring tool that captures memory allocation and the callstack of an application's out-of-memory event. Determine whether the app is stuck by checking the running status of the Runloop, and support both the iOS and macOS platform. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    crawlergo

    crawlergo

    Headless Chrome crawler for collecting URLs for vulnerability scans

    crawlergo is a browser-based web crawler designed to collect URLs and request data that can be used by web vulnerability scanning tools. It uses a Chrome headless environment to render web pages and observe behavior during the DOM rendering stage in order to capture as many accessible endpoints as possible. By monitoring the page lifecycle and interacting with web elements, the crawler automatically triggers JavaScript events and navigational actions that would normally occur during real user interaction. ...
    Downloads: 0 This Week
    Last Update:
    See Project
Auth0 Logo