Showing 189 open source projects for "web crawler source code"

View related business solutions
  • AI-generated apps that pass security review Icon
    AI-generated apps that pass security review

    Stop waiting on engineering. Build production-ready internal tools with AI—on your company data, in your cloud.

    Retool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.
    Try Retool free
  • Earn up to 16% annual interest with Nexo. Icon
    Earn up to 16% annual interest with Nexo.

    More flexibility. More control.

    Generate interest, access liquidity without selling, and execute trades seamlessly. All in one platform. Geographic restrictions, eligibility, and terms apply.
    Get started with Nexo.
  • 1
    Casdoor

    Casdoor

    An open-source Identity and Access Management (IAM)

    A UI-first Identity Access Management (IAM) / Single-Sign-On (SSO) platform supporting OAuth 2.0, OIDC, SAML and CAS, integrated with Casbin RBAC and ABAC permission management. Within a few steps, we can setup a Casdoor app and realize our authorization management. Casdoor has a front-end back-end separation architecture, with maneuverable web UI and supporting high concurrency. Casdoor is supporting multi-languages, using i18n to support multi-languages UI. For more languages support,...
    Downloads: 9 This Week
    Last Update:
    See Project
  • 2
    kubenav

    kubenav

    kubenav is the navigator for your Kubernetes clusters

    kubenav is a mobile, desktop and web app to manage Kubernetes clusters. The app provides an overview of all resources in a Kubernetes clusters, including current status information for workloads. The details view for resources provides additional information. It is possible to view logs and events or to get a shell into a container. You can also edit and delete resources or scale your workloads within the app. The app is developed using Ionic Framework and Capacitor. The frontend part of the...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    CapRover

    CapRover

    Scalable PaaS (automated Docker+nginx), aka Heroku on Steroids

    CapRover is an extremely easy-to-use app/database deployment & web server manager for your NodeJS, Python, PHP, ASP.NET, Ruby, MySQL, MongoDB, Postgres, WordPress (and etc...) applications! It's blazingly fast and very robust as it uses Docker, Nginx, LetsEncrypt and NetData under the hood behind its simple-to-use interface. For a developer who does not like spending hours and days setting up a server, building tools, sending code to the server, building it, getting an SSL certificate,...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 4
    Gogs

    Gogs

    A painless self-hosted Git service

    Gogs is a simple, stable, self-hosted Git service that is easy to install and setup. All you have to do is run the binary on any platform that Go supports: Linux, macOS and Windows. You may also install from source, from packages, or ship with Docker or Vagrant. Gogs is very lightweight with minimal hardware requirements, running on Raspberry Pi and even on NAS devices. Gogs offers plenty of great features, including various access repositories, repository and organization webhooks,...
    Downloads: 5 This Week
    Last Update:
    See Project
  • $300 in Free Credit Towards Top Cloud Services Icon
    $300 in Free Credit Towards Top Cloud Services

    Build VMs, containers, AI, databases, storage—all in one place.

    Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
    Get Started
  • 5
    Nipe

    Nipe

    An engine to make Tor network your default gateway

    Nipe is a Perl-based engine whose primary aim is to make the Tor network act as the default gateway for outgoing traffic. In practice, it configures system firewall rules (iptables) and network routing so that almost all IPv4 traffic is redirected through Tor. The tool provides commands such as install, start, stop, restart, and status to manage its behavior. When “start” is issued, it sets up the necessary rules; when “stop” is used, it attempts to remove those rules. Nipe currently...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 6
    WireMock

    WireMock

    A tool for mocking HTTP services

    HTTP response stubbing, matchable on URL, header and body content patterns. Request verification, runs in unit tests, as a standalone process or as a WAR app. Configurable via a fluent Java API, JSON files and JSON over HTTP. Record/playback of stubs, fault injection, per-request conditional proxying, browser proxying for request inspection and replacement. Stateful behavior simulation and configurable response delays. Mock your APIs for fast, robust and comprehensive testing. WireMock is a...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 7
    Artillery

    Artillery

    Cloud-scale load testing. Fully serverless, test any stack

    Artillery is cloud-native, open source, and integrates with your favorite monitoring and CI/CD stack. Load test anything, at any scale. The most advanced load-testing platform in the world. Get started and run a test in minutes from your local machine. Then scale it out effortlessly. Free & open-source. Artillery scales like no other. Run your tests from your own AWS account with no infra to set up or manage. Use Playwright to load test with real browsers. Test HTTP, WebSocket, Socket.io,...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 8
    HttpKernel Component

    HttpKernel Component

    A structured process for converting a Request into a Response

    The HttpKernel component provides a structured process for converting a Request into a Response by making use of the EventDispatcher component. It's flexible enough to create full-stack frameworks, micro-frameworks or advanced CMS systems like Drupal. Every HTTP web interaction begins with a request and ends with a response. Your job as a developer is to create PHP code that reads the request information (e.g. the URL) and creates and returns a response (e.g. an HTML page or JSON string)....
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    TeemIp - IPAM and DDI solution

    TeemIp - IPAM and DDI solution

    IP Address Management - CMDB - Ticketing - DNS and Zone Management

    ...Project source code is located on https://github.com/TeemIP
    Leader badge
    Downloads: 220 This Week
    Last Update:
    See Project
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 10
    Snal Linux

    Snal Linux

    Arch based live Linux distribution

    Live distro with i3 and firefox. Lots of network and filesystem utilities. Snal Linux is Simple, Networked, and Live Linux. Snal Linux code repository has been moved to https://codeberg.org/snallinux/snallinux
    Leader badge
    Downloads: 60 This Week
    Last Update:
    See Project
  • 11
    GeoNetwork opensource - Metadata Catalog
    ...You can also connect directly with the companies supporting the development. Source code available on github https://github.com/geonetwork/
    Leader badge
    Downloads: 150 This Week
    Last Update:
    See Project
  • 12
    Text Line Duplicate Remover

    Text Line Duplicate Remover

    Remove duplicate lines from your text

    This standalone offline web browser tool helps you remove duplicate lines from your text, with additional text processing options. Simply open it in your browser by double-clicking the html file. It also includes the source code too. I made this when I was working with long lists of entries and needed something to automatically clean them up. As a bonus you can also change the Sentence Case of the text, make it lowercase, UPPERCASE or Sentence case.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 13
    Image to ico Easymode

    Image to ico Easymode

    Image to software icon or favicon made simple

    ...I have support for these: - Windows PC Exe Programs - 16×16, 32×32, 48×48, 256×256 .ico bundled - Website Favicon - 32x32 .ico - Android Phone Apps - 192x192 .png - Progressive Web Apps (PWA) - 512x512 .png I recommend uploading images atleast 512x512px tall/wide, unless you're doing pixel perfect icons and just want an easier 'convert to .ico format' tool. (Source code is included as it is a standalone offline html file that works in any modern web browser.)
    Downloads: 3 This Week
    Last Update:
    See Project
  • 14
    BJH OS

    BJH OS

    An Operating System Created In Html CSS And JS By Muhammad Haris.

    💻 BJH OS Assalam O Alaikum! 👋 I’m Muhammad Haris, Developer of BJH OS 🌐💡 — a web-based OS built with pure HTML, CSS & JS. Enjoy draggable windows, built-in apps, a web terminal, Flash Browser, AI assistant, and persistent data via localStorage. 🚀 Highlights Custom desktop environment & smoother UI Modular architecture Built-in apps & BJH OS Apps Market Remote alerts & updates Secure login & developer tools 🛒 BJH OS Apps Market Features Browse apps/games App details: icon,...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    Gopi OS

    Gopi OS

    Install it once, forget about maintenance, and keep working.

    GopiOS - General Ordinary Purpose Intuitive Operating System Source Code: https://github.com/gopios/gopios Overview GopiOS is created for stability, performance, ease of use and maximum application support. It is designed to serve education, office, and enterprise environments while remaining flexible for developers and servers. GopiOS uses the CachyOS kernel, pacman and Nix as package managers, and supports modern application formats such as AppImage and Flathub. ...
    Leader badge
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Zoekt

    Zoekt

    Fast trigram based code search

    zoekt is a fast, scalable code search engine written in Go that builds compressed indexes (shards) for source repositories and serves low-latency regex and substring queries. It optimizes for developer workflows: refresh indexes from Git, search across many repos instantly, and jump into hits with surrounding context and file navigation. The indexer uses efficient n-gram dictionaries and posting lists to keep query latency low, while storing metadata (branch, language, repo) for precise filtering. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    DocWire SDK

    DocWire SDK

    Award-winning modern data processing SDK in C++20

    DocWire SDK, a standout C++20AI driven data processing tool, has received award from SourceForge and strong backing from Microsoft. It handles nearly 100 file types, empowering efficient text extraction, web data extraction, and document analysis. For businesses, the shift to DocWire SDK signifies a leap forward. It promises comprehensive document format support and the ability to extract valuable insights from email boxes, databases, and websites using cutting-edge AI. DocWire SDK aims to...
    Downloads: 6 This Week
    Last Update:
    See Project
  • 18
    ZestISO

    ZestISO

    An easy to use Arch Linux based OS

    UPDATE: New distro name coming soon. Daily builds are temporarily suspended while I fix network issues. Is your Windows PC or Mac slow or unsupported? Don't throw it away, try ZestISO today! ZestISO is an easy to use, highly customisable Arch Linux based OS. It's fast, secure, and supports all your favourite software and games*. No ads, bloat or telemetry here! Editions: KDE Plasma Gaming (for beginners and gamers), XFCE (for low-end PCs) and IceWM (for servers and ultra low-end...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Open Crypto Tracker

    Open Crypto Tracker

    Bitcoin Alts portfolio tracker, email / text / alexa / telegram alerts

    100% FREE / open source / PRIVATE cryptocurrency portfolio tracker. Email / text / alexa / telegram price alerts, price charts, mining calcs, leverage / gain / loss / balance stats, news feeds +more. Privately track Bitcoin / Ethereum / unlimited cryptocurrencies. Customize as many assets / markets / alerts / charts as you want. Over 50 Exchanges / 40 Trading Pairs Supported (exchanges / pairings list at bottom of README.txt): https://tinyurl.com/ct-readme Nearly Unlimited Assets...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 20
    MailSlurper

    MailSlurper

    Local, web-based mail server application. Slurp mails into oblivion!

    MailSlurper is a small SMTP mail server that slurps mail into oblivion! MailSlurper is perfect for individual developers or small teams writing mail-enabled applications that wish to test email functionality without the risk or hassle of installing and configuring a full-blown email server. It's simple to use! Simply set up MailSlurper, configure your code and/or application server to send mail through the address where MailSlurper is running, and start sending emails! MailSlurper will...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    RPA for Python

    RPA for Python

    Python package for doing RPA

    Python package for doing RPA. RPA for Python's simple and powerful API makes robotic process automation fun! You can use it to quickly automate away repetitive time-consuming tasks on websites, desktop applications, or the command line. See sample Python script, the RPA Challenge solution, and RedMart groceries example. To send a Telegram app notification, simply look up @rpapybot to allow receiving messages. To automate Chrome browser invisibly, use headless mode. To run 10X faster instead...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 22
    Configuration Backup (ConfiBack)

    Configuration Backup (ConfiBack)

    Project for backing up network device configuration

    Using this project you can make backup and track changes of configuration of network devices like switches, routers, etc.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 23
    AfterLogic WebMail Lite

    AfterLogic WebMail Lite

    Fast and easy-to-use webmail front-end for your existing mail server.

    Fast and easy-to-use webmail front-end for your existing IMAP mail server, Plesk or cPanel. Install it on your web servers for personal or commercial use, redistribute, integrate with other software, or alter the source code (provided that you contribute your changes back to the community). For free.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 24
    Gideros Mobile

    Gideros Mobile

    Cross platform SDK

    Develop your app in Lua language and export it to most popular platforms, from desktop PC and Mac to mobile (Android, iOS, Windows Phone) and even Web. While Gideros is mainly dedicated to game development, it is also a good fit for professional apps. Code once, run everywhere! Intro documentation: http://docs.giderosmobile.com/ Reference documentation: http://docs.giderosmobile.com/reference/ Forum: http://giderosmobile.com/forum Full source code: https://github.com/gideros/gideros
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    TagUI

    TagUI

    Free RPA tool by AI Singapore

    Write flows in simple TagUI language and automate away repetitive time-consuming tasks on your computer. Tasks include those on websites (native support for Chrome and Edge), desktop apps, or the command line. The TagUI project is open-source and free forever. It's easy to setup and use, and works on Windows, macOS and Linux. Besides English, flows can be written in 22 other languages, so you can do RPA using your native language. Check out this demo video automating data collection in 4...
    Downloads: 8 This Week
    Last Update:
    See Project
MongoDB Logo MongoDB