Search Results for "web crawler source code"
Sort By:
Showing 70 open source projects for "web crawler source code"
View related business solutions-
$300 in Free Credit Towards Top Cloud ServicesStart your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
-
Full-stack observability with actually useful AI | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
1
PostgREST
REST API for any Postgres database
...Object-relational mapping is a leaky abstraction leading to slow imperative code. The PostgREST philosophy establishes a single declarative source of truth: the data itself. It’s easier to ask PostgreSQL to join data for you and let its query planner figure out the details than to loop through rows yourself. It’s easier to assign permissions to db objects than to add guards in controllers. (This is especially true for cascading permissions in data dependencies.) -
2
Sanic
Async Python 3.6+ web server/framework
Build fast, run fast with Sanic! Sanic is a Python 3.6+ web server and web framework designed to go fast. It provides a way to get a highly performant HTTP server up and running fast, while also making it easy to build, expand, and eventually scale. Sanic aspires to be as simple as possible while delivering the performance that you require. It allows the usage of the async/await syntax added in Python 3.5, so your code is guaranteed to be non-blocking and speedy. It's also ASGI compliant,... -
3
Takes
True object-oriented Java web framework without NULLs
Takes is a true object-oriented and immutable Java8 web development framework. Pay attention that UTF-8 encoding is set on the command line. The entire framework relies on your default Java encoding, which is not necessarily UTF-8 by default. To be sure, always set it on the command line with file.encoding Java argument. We decided not to hard-code "UTF-8" in our code mostly because this would be against the entire idea of Java localization, according to which a user always should have a... -
4
LinkChecker
Check links in web documents or full websites
LinkChecker is a free, GPL licensed website validator. LinkChecker checks links in web documents or full websites. It runs on Python 3 systems, requiring Python 3.8 or later. The version in the pip repository may be old, to find out how to get the latest code, plus platform-specific information and other advice see doc/install.txt in the source code archive. If you do not want to install any additional libraries/dependencies you can use the Docker image which is published on GitHub Packages. -
Gemini 3 and 200+ AI Models on One PlatformBuild generative AI apps with Vertex AI. Switch between models without switching platforms.
-
5
ciao
HTTP checks & tests (private & public) monitoring
HTTP checks & tests (private & public) monitoring - check the status of your URL. ciao checks HTTP(S) URL endpoints for a HTTP status code (or errors on the lower TCP stack) and sends a notification on status change via E-Mail or Webhooks. It uses Cron syntax to schedule the checks and comes along with a Web UI and a RESTful JSON API. Create an open-source web application for checking URL statuses with a UI and a REST API which is easy to install and maintain (no external dependencies like Databases, Caches, etc.) in public and private environments. -
6
HTTP Kit
Clojure HTTP server/client library with WebSocket support
http-kit is a minimalist, event-driven, high-performance Clojure HTTP server/client library with WebSocket and asynchronous support. A simple, high-performance event-driven HTTP client+server for Clojure. HTTP Kit is an (almost) drop-in replacement for the standard Ring Jetty adapter. So you can use it with all your current libraries (e.g. Compojure) and middleware. Using an event-driven architecture like Nginx, HTTP-kit is very, very fast. It comfortably handles tens of thousands of... -
7
Akka HTTP
The Streaming-first HTTP server/module of Akka
The Akka HTTP modules implement a full server- and client-side HTTP stack on top of akka-actor and akka-stream. It’s not a web framework but rather a more general toolkit for providing and consuming HTTP-based services. While interaction with a browser is of course also in scope it is not the primary focus of Akka HTTP. Akka HTTP follows a rather open design and many times offers several different API levels for “doing the same thing”. You get to pick the API level of abstraction that is... -
8
NaviServer
NaviServer, a high performance web server written in C and Tcl
NaviServer is an extensible web server suited to create scalable websites and services. Originally based on AOLserver (http://www.aolserver.com), the ongoing development is done independently under Mozilla Public License by a core group of people that use it for their businesses and by other supporters. Features: High performance multi-threaded architecture, massively scalable and extensible, many modules, dynamic scripted pages (ADP), caching functions (static files, Tcl byte code, chunks), pooled database connections, thread shared arrays, introspection commands, mass virtual hosting (no server restart), watchdog, control port and command mode, efficient handling of down-/uploads with async I/O, IPv4/IPv6 Core developers: Vlad Seryakov, Stephen Deasey, Zoran Vasiljevic, Gustaf Neumann Source: https://github.com/naviserver-project/naviserver Info: https://wiki.tcl-lang.org/page/NaviServer Documentation: https://naviserver.sourceforge.io/n/toc.html -
9
xxm
A non-IDE, compile-on-refresh, web platform for Delphi.
xxm is a web platform for Delphi. Combine Delphi and HTML into a compiled library loadable by an ISAPI extension, a stand-alone HTTP service, an Internet Explorer snap-in, a FireFox module, an Apache module, oldskool CGI... -
AI-powered service management for IT and enterprise teamsGive your IT, operations, and business teams the ability to deliver exceptional services—without the complexity. Maximize operational efficiency with refreshingly simple, AI-powered Freshservice.
-
10
Whakerexa
A minimalist and lightweight web kit for accessible contents
`Whakerexa` provides a lightweight, modular set of CSS and JavaScript tools for building accessible, consistent, and customizable web interfaces. It is intended to be as simple as possible to make **accessible web content**, and to minimize the use of CSS classes for enhancing the readability of HTML code. It was designed to be easily customizable, allowing users to adjust properties such as fonts, colors, borders, etc., effortlessly. Most of the properties are stored into variables which makes possible to re-define them, then to obtain a custom different style, enabling users to achieve a unique style easily. ... -
11
wappskafander_t2
Wraps a HTTP server that might optionally run PHP by using FastCGI.
wappskafander_t2 wraps an old version of a Hiawatha web server (hiawatha-webserver.org). If FastCGI and PHP are available, then the web server probably can execute PHP. As of 2022_11 this "branch" of the wappskafander_t2 will not be incrementally updated, because it, the wrapping code, NOT the wrapped web server, is an old mess that needs a total rewrite. The current version of the wrapping code is usable as a functional "blob" that serves HTTP and optionally PHP generated content from... -
12
Bubbles
Bubbles the simple, easy to use HTTP web server, browser controlled
Bubbles the simple, easy to use HTTP web server that is browser controlled, and capable of serving static files over the internet, either streamed from disk, or direct from RAM without lag. A GUI administration panel is accessed through your web browser (e.g. "http://localhost:1080/admin/" + default password of "admin"), which controls all her settings and vital functions, all in real time. Apart from serving files, she is capable of tracking site visits (site counters), receiving... -
13
NodeJS Simple Web Server
Web server code in nodejs, for test html sites
Simple server in Nodejs to display static html web page where you only need to show an index.html required: Node.js 0.12.18 or latest -
14
Rouille
Web framework in Rust
Rouille is a micro-web-framework library. It creates a listening socket and parses incoming HTTP requests from clients, then gives you the hand to process the request. Rouille was designed to be intuitive to use if you know Rust. Contrary to express-like frameworks, it doesn't employ middlewares. Instead, everything is handled in a linear way. Concepts closely related to websites (like cookies, CGI, form input, etc.) are directly supported by rouille. More general concepts (like database... -
15
civetweb
Embedded C/C++ Web Server
Civetweb is a small footprint HTTP Server with optional Lua and SQLite support written in C. It can be embedded into C/C++ applications or used as stand alone web server for Windows, Linux, BSD or Mac-OS. This project is based on the Mongoose web server, but maintains the MIT license and is free from GPL licenses. Installation Guide https://github.com/civetweb/civetweb/blob/master/docs/Installing.md Contributions are welcome and encouraged. The official source code is at https://github.com/civetweb/civetweb Problems may be reported at https://github.com/civetweb/civetweb/issues Use the "Civetweb" Google groups for questions and discussion https://groups.google.com/d/forum/civetweb -
16
EmbedIO
A tiny, cross-platform, module based web server for .NET
A tiny, cross-platform, module based, MIT-licensed web server for .NET Framework and .NET Core. Written entirely in C#, using our helpful library SWAN. Network operations use the async/await pattern: Responses are handled asynchronously. Multiple implementations support: EmbedIO can use Microsoft HttpListener or internal Http Listener based on Mono/websocket-sharp projects. Cross-platform: tested on multiple OS and runtimes. From Windows .NET Framework to Linux MONO. Extensible: Write your... -
17
binserve
A fast production-ready static web server with TLS (HTTPS)
A fast static web server with TLS (HTTPS), routing, hot reloading, caching, templating, and security in a single binary you can set up with zero code. Binserve is designed to be performant, this is thanks to Actix-Web - one of the fastest web frameworks out there and DashMap for handling routes and cache storage. Binserve is cross-platform and portable to any major operating system, like it can run on your Android phone! Routing is simply matching a URI path to a file or a directory in a... -
18
sushii-image-server
Web server made with Koa and puppeteer to convert HTML to images
Simple local web server made with Express and Puppeteer to generate images for sushi-bot. The static directory can be used to serve static files used for HTML screenshots (e.g., JavaScript, CSS, image files). This is intended for requests from trusted services and is not designed for direct public access. Any JavaScript code can be run on the system and local files can be accessed. -
19
vue-resource
The HTTP client for Vue.js
vue-resource is a plugin for Vue.js which provides services for making web requests and handle responses using a XMLHttpRequest or JSONP. You can install it via yarn or NPM. Available on jsdelivr, unpkg or cdnjs. Typescript for vue-resource should work out of the box since the type definition files are included within the npm package. The http service can be used globally Vue.http or in a Vue instance this.$http. A Vue instance provides the this.$http service which can send HTTP requests. A... -
20
PHP mini vulnerability suite
Multiple server/webapp vulnerability scanner
github: https://github.com/samedog/phpmvs -
21
GCDWebServer
The #1 HTTP server for iOS, macOS & tvOS
...Well designed API with fully documented headers for easy integration and customization. Entirely built with an event-driven design using Grand Central Dispatch for best performance and concurrency. No dependencies on third-party source code. Parser for web forms submitted using "application/x-www-form-urlencoded" or "multipart/form-data" encodings (including file uploads). Allow implementation of fully asynchronous handlers of incoming HTTP requests. Minimize memory usage with disk streaming of large HTTP request or response bodies. Automatically handle transitions between foreground, background and suspended modes in iOS apps. ... -
22
Cicada
Fast lightweight HTTP service framework
Fast, lightweight Web framework based on Netty; without too much dependency, and the core jar package is only 30KB. Configuration files can also be read in multiple environments, just add VM parameters, also ensure that the parameter name and file name are consistent. -
23
Velosurf is a database access layer for the Apache Velocity template engine. It provides an automatic database mapping of tables and relationships without any code generation, and provides authentication, localization and form validation tools.
-
24
NTK RTMP SERVER
Naam Tamilar Web TV Live Streamer
Naam Tamilar RTMP Server This project updated as open source for future use of Naam Tamilar Political Party. To contribute to the party and in some case if there is any possibilities if i cannot support them for long term. I thought of sharing this source code so in future it may be helpful for the community and party in which other software developers can help them to upgrade. This source is forked from - https://github.com/arut/nginx-rtmp-module and modified with multiple broadcast... -
25
jReflectServer
A lightweight Java HTTP server and webservice-framework
jReflectServer is a very small, lightweight and super easy-to-use java web-server and -framework for creating (distributed) pure java web-applications, webservices and small websites. jReflectServer is able to randomly forward requests to a cluster of remote server nodes. For this distributed code execution no special code is needed. A distributed session can be used to share data between the server instances. Due to its small footprint, it's also perfect for embedded hardware like the...
