Showing 1069 open source projects for "web crawler source code"

View related business solutions
  • Fully Managed MySQL, PostgreSQL, and SQL Server Icon
    Fully Managed MySQL, PostgreSQL, and SQL Server

    Automatic backups, patching, replication, and failover. Focus on your app, not your database.

    Cloud SQL handles your database ops end to end, so you can focus on your app.
    Try Free
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 1
    pH7 Social Dating CMS (pH7Builder)❤️

    pH7 Social Dating CMS (pH7Builder)❤️

    🚀 Professional Social Dating Web App Builder (formerly pH7CMS)

    pH7Builder is a Professional, Free & Open Source PHP Social Dating Builder Software (primarily designed for developers ...). This Social Dating Web App is fully coded in object-oriented PHP (OOP) with the MVC pattern (Model-View-Controller). It is low resource-intensive, extremely powerful and highly secure. pH7Builder is included with over 42 native modules and is based on its homemade pH7 Framework which includes more than 52 packages To summarize, pH7Builder Social Dating Script gives you the perfect ingredients to create the best dating web app or social networking site on the World Wide Web! ...
    Downloads: 26 This Week
    Last Update:
    See Project
  • 2
    Simple Infopanel

    Simple Infopanel

    Simple Infopanel is a free digital signage software in PHP and React

    Simple Infopanel is a free digital signage software that works like a slider and shows title, image or video, description and QR-Code for URL on every slide. It provides its own GUI for the editing based on PHP-Framework Symfony. The GUI has an integrated simple role concept. This tool can be used for digital signage, Information panels (infopanels), News aggregators, events or similar. You only need to have docker installed to start this application. The source code is available on GitHub:...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 3
    RhinOS

    RhinOS

    RhinOS, CMS, Content Management System, Josep Sanz Campderrós

    RhinOS is a framework to develop web sites using the latest features to provide a fastest access and administration to the web portal. The main features are: - Parametrized CMS and simple and efficient pseudo-code parser.
    Leader badge
    Downloads: 4 This Week
    Last Update:
    See Project
  • 4
    Cerberus Content Management System 6

    Cerberus Content Management System 6

    Cerberus Content Management System

    Cerberus Content Management System is a dynamic, secure and infinitely expandable CMS designed after a Unix-Like model complete with a Unix-Like Kernel File named: Cerberus. It is a custom written Web Application Framework ( W.A.F. ) with a consistent and custom written Pre-Hyper-Text-Post-Processor Programming Code Framework ( P.C.F. ). This Web Application Software Project' aim is to be the fastest and most secure Web Application Framework, Web Application Programming Code Framework, Text,...
    Downloads: 7 This Week
    Last Update:
    See Project
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Try Free
  • 5
    CerberusCMS5

    CerberusCMS5

    Cerberus Content Management System

    Cerberus Content Management System is a dynamic, secure and infinitely expandable CMS designed after a Unix-Like model. It is a custom written Web Application Framework ( W.A.F. ) with a consistent and custom written Pre-Hyper-Text-Post-Processor Programming Code Framework ( P.C.F. ). This Web Application Software Project' aim is to be the fastest and most secure Web Application Framework, Web Application Programming Code Framework, Text, Voice and Video Communications Platform and Content...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 6
    GeoNetwork opensource - Metadata Catalog
    ...You can also connect directly with the companies supporting the development. Source code available on github https://github.com/geonetwork/
    Leader badge
    Downloads: 150 This Week
    Last Update:
    See Project
  • 7
    ToolSparkr

    ToolSparkr

    Free online developer tools JSON formatter, Base64 encoder, and more

    ToolSparkr - 35+ free browser-based developer tools. No signup required, no data uploaded to servers. Everything runs in your browser. Tools: JSON Formatter & Validator, Base64 Encoder/Decoder, Password Generator, QR Code Creator, MD5/SHA Hash Generator, Color Converter, URL Encoder/Decoder, UUID Generator, DNS Lookup, WHOIS Lookup, IP Lookup, HTTP Status Checker, HTML Entity Encoder, Morse Code Converter, CSS Minifier, Bcrypt Generator & more. Built for developers, designers,...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 8
    wappskafander_t2

    wappskafander_t2

    Wraps a HTTP server that might optionally run PHP by using FastCGI.

    wappskafander_t2 wraps an old version of a Hiawatha web server (hiawatha-webserver.org). If FastCGI and PHP are available, then the web server probably can execute PHP. As of 2022_11 this "branch" of the wappskafander_t2 will not be incrementally updated, because it, the wrapping code, NOT the wrapped web server, is an old mess that needs a total rewrite. The current version of the wrapping code is usable as a functional "blob" that serves HTTP and optionally PHP generated content from...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    JForum2

    JForum2

    Bug fixes and enhancements for JForum 2.x

    JForum is a powerful and robust discussion board system implemented in Java. It provides an attractive interface, an efficient forum engine, an easy to use administrative panel, an advanced permission control system and much more. Built from the ground up around an MVC framework , it can be deployed on any Servlet 3.1 container or application server running at least Java 8, such as Tomcat, Jetty and JBoss/WildFly. Its clean design and implementation make JForum easy to customize and...
    Leader badge
    Downloads: 128 This Week
    Last Update:
    See Project
  • AI-generated apps that pass security review Icon
    AI-generated apps that pass security review

    Stop waiting on engineering. Build production-ready internal tools with AI—on your company data, in your cloud.

    Retool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.
    Try Retool free
  • 10

    twitch-batch-downloader

    Automate the download of entire Twitch.tv channels

    Automate the download of entire Twitch.tv channels with its metadata. Save each Twitch video into its own folder, with date and time values, video ID, stream metadata, frame screenshot, .ts parts list and sha256 hash. Keep the original ts files and generate mp4 files from them. It requires a shell and some command line utilities. See README.md for details in the Code/git section.
    Downloads: 6 This Week
    Last Update:
    See Project
  • 11
    Catbird Linux

    Catbird Linux

    Linux for content creation, web scraping, coding, and data analysis.

    Catbird Linux is a USB pluggable Live Linux operating system built for media creation, web scraping, and software coding. It is the daily driver you want for retrieving data, making videos or podcasts, and making software tools to automate the repetitive tasks. It is ready for work in Python, Lua, and Go languages, with numerous packages for web scraping or downloading data via API calls. Using Catbird Linux, it is possible to accomplish in depth stock market analysis, track weather...
    Downloads: 9 This Week
    Last Update:
    See Project
  • 12
    Automated Bluesky Poster

    Automated Bluesky Poster

    Free, easy, infinite Bluesky posting automation.

    ...All programs are Free and Open Source, but please donate. Source Code and installation here, directly on Github: https://github.com/ReactorcoreGames/BlueskyAutoPoster (Note: It uses Github Actions to run the program)
    Downloads: 2 This Week
    Last Update:
    See Project
  • 13
    Whakerexa

    Whakerexa

    A minimalist and lightweight web kit for accessible contents

    `Whakerexa` provides a lightweight, modular set of CSS and JavaScript tools for building accessible, consistent, and customizable web interfaces. It is intended to be as simple as possible to make **accessible web content**, and to minimize the use of CSS classes for enhancing the readability of HTML code. It was designed to be easily customizable, allowing users to adjust properties such as fonts, colors, borders, etc., effortlessly. Most of the properties are stored into variables which makes possible to re-define them, then to obtain a custom different style, enabling users to achieve a unique style easily. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    MobiDevTools

    MobiDevTools

    A mobile devtools for debugging web sites and web apps

    This add-on provides an intuitive and visually appealing panel interface embedded directly inside your Firefox browser. Whether you develop for mobile or desktop web, gain instant access to critical page data and performance metrics — all without leaving the browser or resorting to external tools. »`Click the WebExtension's icon in the toolbar or menu to open the overlay.`
    Downloads: 1 This Week
    Last Update:
    See Project
  • 15
    Seditio

    Seditio

    Seditio CMS

    Seditio is a modular content management system and content management framework powered by PHP and MySQL. The engine distinguishes itself from other content management systems by keeping the HTML code completely separate from the PHP. This allows graphic designers to create skins without having to know much PHP. Seditio can be skinned by editing pre-made skins supplied by the community, or easily making one's own by creating a template, and simply substituting for the TPL tags. To...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    JVx - Enterprise Application Framework

    JVx - Enterprise Application Framework

    Java Application Framework

    Develop professional database applications, highly performant with little source code. JVx is a full-stack application framework to create multi tier applications with Single Sourcing for different technologies (Swing, vaadin, react, ...). Nightly builds are available: https://dev.sibvisions.com/jvx.nightly/ Maven snapshots are available: https://oss.sonatype.org/content/repositories/snapshots Eclipse plugin is available: http://marketplace.eclipse.org/search/site/eplug
    Downloads: 7 This Week
    Last Update:
    See Project
  • 17
    webEdition CMS
    webEdition is a WCMS (Web Content Management System) written in PHP and using MySQL. It is the perfect CMS for website creators and administrators, who wish to manage their websites comfortably with an extemely flexible and extensible CMS.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    Automated Twitter Poster

    Automated Twitter Poster

    Free, easy, infinite Twitter posting automation.

    ...All programs are Free and Open Source, but please donate. Source Code and installation here, directly on Github: https://github.com/ReactorcoreGames/TwitterAutoPoster (Note: It uses Github Actions to run the program)
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    ZnetDK 4 Mobile

    ZnetDK 4 Mobile

    Responsive Web App development full-stack framework in PHP and JS

    Develop easily in PHP, MySQL and JavaScript your business web app for mobile and tablet devices from a ready-to-customize starter app, fully Responsive and Installable (PWA). No need to start up from scratch. You just have to add the views that fullfill your business requirements and connect them to the user navigation menu. All the features expected for a mobile business application are already developed! Authenticate your users through the built-in login form. Show them only the pages...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 20
    Blog4u

    Blog4u

    A simple but beautiful blogging system that doesn't require a database

    Do you find WordPress with all its features and detailed user management quite nice, but it’s actually „overkill“ for you and too maintenance-intensive in the long run with its constant updates? Does HTML stand for more than just „How To Make Love“ to you, but also and above all for „HperText Markup Language“? Then download my little blog software and install it on your own web space! This blog system does not require a database and consists of just a „handful“ of PHP files. It is easy to...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    MGB OpenSource Guestbook
    MGB is a free OpenSource Guestbook completely written in PHP, using JavaScript and a MySQL Database. Easy to use, flexible and customizable with templates to make it fit 100% to your homepage.
    Downloads: 22 This Week
    Last Update:
    See Project
  • 22
    Commentics is an advanced PHP comment script with many features. Its main aims are to be integrable, customizable and secure. It is designed to be integrated into your existing pages.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 23

    Fetch

    A window.fetch JavaScript polyfill

    Fetch is a window.fetch polyfill, a Promise-based mechanism for programmatically making web requests in the browser. It is a viable replacement for most uses of XMLHttpRequest in traditional web applications, since it implements a subset of the standard Fetch specification. It is compatible with most popular browsers, however modern versions of browsers like Chrome, Firefox, Microsoft Edge, and Safari already have native implementations of window.fetch, hence the code from this polyfill will...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    Gerapy

    Gerapy

    Distributed Crawler Management Framework Based on Scrapy

    Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js. Someone who has worked as a crawler with Python may use Scrapy. Scrapy is indeed a very powerful crawler framework. It has high crawling efficiency and good scalability. It is basically a necessary tool for developing crawlers using Python. If you use Scrapy as a crawler, then of course we can use our own host to crawl when crawling, but when the crawl is very large, we can’t...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    Crawlab

    Crawlab

    Distributed web crawler admin platform for spiders management

    Golang-based distributed web crawler management platform, supporting various languages including Python, NodeJS, Go, Java, PHP and various web crawler frameworks including Scrapy, Puppeteer, Selenium. Please use docker-compose to one-click to start up. By doing so, you don't even have to configure MongoDB database. The frontend app interacts with the master node, which communicates with other components such as MongoDB, SeaweedFS and worker nodes. Master node and worker nodes communicate...
    Downloads: 3 This Week
    Last Update:
    See Project
MongoDB Logo MongoDB