Showing 459 open source projects for "web crawler source code"

View related business solutions
  • Build Securely on AWS with Proven Frameworks Icon
    Build Securely on AWS with Proven Frameworks

    Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

    Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
    Download Now
  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New customers can spin up VMs, build with AI, and query data at no cost.

    Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
    Start Free
  • 1
    bootstrap_form

    bootstrap_form

    Repository of the bootstrap_form gem

    Official repository of the bootstrap_form gem, a Rails form builder that makes it super easy to create beautiful-looking forms using Bootstrap 5. bootstrap_form is a Rails form builder that makes it super easy to integrate Bootstrap v5-style forms into your Rails application. It provides form helpers that augment the Rails form helpers. bootstrap_forms's form helpers generate the form field and its label and all the Bootstrap mark-up required for proper Bootstrap display. bootstrap_form. You...
    Downloads: 8 This Week
    Last Update:
    See Project
  • 2
    Serverless Java container

    Serverless Java container

    A Java wrapper to run Spring, Spring Boot, Jersey, and other apps

    The AWS Serverless Java Container library is a framework that allows developers to run existing or new Java web applications—built with frameworks such as Spring, Jersey, Spark, Struts—inside AWS Lambda with minimal modifications. It bridges the gap between traditional servlet or web-framework models and serverless functions by mapping HTTP events from API Gateway into requests your framework understands and routing responses back appropriately. This means you can keep much of your familiar...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 3
    Networked-Aframe

    Networked-Aframe

    Web framework for building multi-user virtual reality experiences

    Multi-user VR on the Web. A framework for writing multi-user VR apps in HTML and JS. Built on top of A-Frame. Follow the NAF Getting Started tutorial to build your own example from scratch, including setting up a local server. Networked-Aframe works by syncing entities and their components to connected users. To connect to a room you need to add the networked-scene component to the a-scene element. For an entity to be synced, add the networked component to it. By default the position and...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 4
    CodeBehind Framework

    CodeBehind Framework

    CodeBehind is a modern back-end framework under ASP.NET Core.

    CodeBehind is a modern back-end framework under ASP.NET Core. CodeBehind was developed by Elanat in 2023 and competes with Microsoft's default web frameworks (ASP.NET Core MVC and Razor Pages and Blazor). CodeBehind is an engineering masterpiece that simultaneously provides the possibility of development based on MVC, Model-View, Controller-View, only View, and Web-Forms. The type of structure and naming in CodeBehind is nostalgia and reminds me of former Microsoft Web-Forms. The aspx...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 99.99% Uptime for MySQL and PostgreSQL Databases Icon
    99.99% Uptime for MySQL and PostgreSQL Databases

    Sub-second maintenance. 2x read/write performance. Built-in vector search for AI apps.

    Cloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
    Start Free
  • 5
    panicparse

    panicparse

    Crash your app in style (Golang)

    ...Helps debugging crashes and deadlocks in heavily parallelized processes. Race detector support, e.g. it can parse output produced by go test -race. HTML export. Easy to use as an HTTP Handler middleware. High-performance parsing. HTTP web server that serves a very tight and swell snapshot of your goroutines, much more readable than net/http/pprof. >50% more compact output than original stack dump yet more readable. Deduplicates redundant goroutine stacks. Useful for large server crashes. Arguments as pointer IDs instead of raw pointer values. Pushes stdlib-only stacks at the bottom to help focus on important code. ...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 6
    Slack Machine

    Slack Machine

    A simple, yet powerful and extendable Slack bot

    Slack Machine is a simple, yet powerful and extendable Slack bot framework. More than just a bot, Slack Machine is a framework that helps you develop your Slack workspace into a ChatOps powerhouse. Slack Machine is built with an intuitive plugin system that lets you build bots quickly but also allows for easy code organization. A plugin can look as simple as this:
    Downloads: 10 This Week
    Last Update:
    See Project
  • 7
    Confluent's .NET Client for Apache Kafka

    Confluent's .NET Client for Apache Kafka

    Confluent's Apache Kafka .NET client

    confluent-kafka-dotnet is Confluent's .NET client for Apache Kafka and the Confluent Platform. Confluent-kafka-dotnet is a lightweight wrapper around librdkafka, a finely tuned C client. There are a lot of details to get right when writing an Apache Kafka client. We get them right in one place (librdkafka) and leverage this work across all of our clients (also confluent-kafka-python and confluent-kafka-go). Confluent, founded by the creators of Kafka, is building a streaming platform with...
    Downloads: 10 This Week
    Last Update:
    See Project
  • 8
    express-openapi-validator

    express-openapi-validator

    Auto-validates api requests, responses, and securities using ExpressJS

    Auto-validates api requests, responses, and securities using ExpressJS and an OpenAPI 3.x specification. Express-openapi-validator is an unopinionated library that integrates with new and existing API applications. express-openapi-validator lets you write code the way you want; it does not impose any coding convention or project layout. Simply, install the validator onto your express app, point it to your OpenAPI 3 specification, then define and implement routes the way you prefer. An...
    Downloads: 9 This Week
    Last Update:
    See Project
  • 9
    Hexagon

    Hexagon

    Hexagon is a microservices toolkit written in Kotlin

    Hexagon is a microservices toolkit written in Kotlin. Its purpose is to ease the building of server applications (Web applications or APIs) that run inside a cloud platform. The Hexagon Toolkit provides several libraries to build server applications. These libraries provide single standalone features and are referred to as "Ports".
    Downloads: 5 This Week
    Last Update:
    See Project
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Start Free
  • 10
    go-zero

    go-zero

    A cloud-native Go microservices framework with cli tool

    go-zero is a web and rpc framework with lots of built-in engineering practices. It’s born to ensure the stability of busy services with resilience design and has been serving sites with tens of millions of users for years. go-zero (listed in CNCF Landscape: https://landscape.cncf.io/?selected=go-zero) is a web and rpc framework with lots of builtin engineering practices. It’s born to ensure the stability of busy services with resilience design and has been serving sites with tens of millions...
    Downloads: 5 This Week
    Last Update:
    See Project
  • 11
    dynaconf

    dynaconf

    Configuration Management for Python

    Inspired by the 12-factor application guide. Settings management (default values, validation, parsing, templating). Protection of sensitive information (passwords/tokens). Multiple file formats toml|yaml|json|ini|py and also customizable loaders. Full support for environment variables to override existing settings (dotenv support included). Optional layered system for multi environments [default, development, testing, production] (also called multi profiles). Built-in support for Hashicorp...
    Downloads: 5 This Week
    Last Update:
    See Project
  • 12
    Phalcon

    Phalcon

    High performance, full-stack PHP framework delivered as a C extension

    Its innovative architecture makes Phalcon the fastest PHP framework ever built! Developers do not need to know C to use Phalcon. Its functionality is exposed as PHP classes and interfaces under the Phalcon namespace, ready to be used. Zephir/C extensions are loaded together with PHP one time on the web server's daemon start process. Classes and functions provided by the extension are ready to use for any application. The code is compiled and isn't interpreted because it's already compiled to...
    Downloads: 24 This Week
    Last Update:
    See Project
  • 13
    DotWeb

    DotWeb

    Simple and easy go web micro framework

    Simple and easy go web micro framework. Important: Now need go1.9+ version support, and Support go mod. support go mod. Support static routing, parameter routing, group routing. Routing supports file/directory services, and supports setting whether to allow directory browsing. HttpModule support, support for custom code capabilities at the global level before routing. Middleware support, support App, Group, Router level settings. Feature support, which can be enabled globally by binding...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 14
    StimulusReflex

    StimulusReflex

    Build reactive applications with the Rails tooling you already know

    StimulusReflex is a Ruby on Rails framework for building reactive, real-time web interfaces without moving most application logic into a heavy frontend framework. It connects Stimulus controllers, Rails server-side actions, Action Cable, and CableReady to respond to user interactions over WebSockets. When a user clicks, types, submits, or triggers another event, the server processes the action and sends DOM updates back to the browser. This lets developers keep validation, persistence,...
    Downloads: 8 This Week
    Last Update:
    See Project
  • 15
    Rinf

    Rinf

    Rust for native business logic, Flutter for flexible and beautiful GUI

    Rust for native business logic, Flutter for flexible and beautiful GUI. Rinf is a production-ready framework for creating beautiful and performant cross-platform apps using Flutter and Rust with batteries fully included. Simply add this framework to your app project, and you're all set to write Flutter and Rust together. There are no webviews, web servers, hidden threads, or unnecessary memory copying that might cause performance overhead. This setup acts as a very thin wrapper around Dart...
    Downloads: 9 This Week
    Last Update:
    See Project
  • 16
    Production-ready Docker PHP

    Production-ready Docker PHP

    Production-ready Docker images for PHP. Optimized for Laravel

    serversideup/php is an optimized set of Docker Images for running PHP applications in production. Everything is designed around improving the developer experience with PHP and Docker. Gone are the days of configuring each environment differently, and gone are the days of trying to figure out why your code works in one environment and not the other. These images are highly optimized to run modern PHP applications, no matter where you want your application to run. Ditch FPM for a modern way of...
    Downloads: 12 This Week
    Last Update:
    See Project
  • 17
    RuoYi

    RuoYi

    The warehouse's SpringBoot-based rights management system

    The warehouse's SpringBoot-based rights management system is easy to read and understand, and the interface is simple and beautiful. The core technology uses Spring, MyBatis, and Shiro without any other heavy dependencies. I have always wanted to make a background management system, and I have seen many excellent open source projects but found no suitable ones. So I started to write a background system in my spare time. So there is Zoe. She can be used for all web applications, such as...
    Downloads: 10 This Week
    Last Update:
    See Project
  • 18
    re-frame

    re-frame

    A ClojureScript framework for building user interfaces

    re-frame is a ClojureScript framework for building user interfaces. It has a data-oriented, functional design. Its primary focus is on high programmer productivity and scaling up to larger Single-Page applications. Developed in late 2014, and released in 2015, it is mature and stable. It is used by both small startups and companies with over 500 developers, and it has delivered into production applications which are 40K lines of code and beyond. ClojureScript is a Lisp. Alan Kay once...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Neiki's Code Editor

    Neiki's Code Editor

    Lightweight embeddable code editor Web Component with syntax highlight

    Neiki's Code Editor is a lightweight embeddable code editor built as a native Web Component using vanilla JavaScript. It runs without dependencies or build tools and can be dropped into any website via a single script tag. The editor provides a modern development experience with syntax highlighting, themes, line numbers, search, auto-indentation, and fullscreen support. Designed for flexibility and performance, it uses Shadow DOM for style isolation and supports multiple languages...
    Downloads: 5 This Week
    Last Update:
    See Project
  • 20
    Preact

    Preact

    Fast 3kB React alternative with the same modern API

    Preact is a lightweight alternative to React that implements the same core component and hooks model in a tiny footprint. It provides a virtual DOM, diffing, and a familiar Component/JSX API, enabling developers to reuse much of their React knowledge. With preact/compat, many React libraries can be used directly, making migration or code sharing practical in performance-sensitive apps. Its focus on size and speed makes it attractive for embedded widgets, mobile web, and scenarios where...
    Downloads: 11 This Week
    Last Update:
    See Project
  • 21
    TurboGears

    TurboGears

    Python web framework with full-stack layer

    TurboGears is a hybrid web framework able to act both as a Full Stack framework or as a Microframework. TurboGears helps you get going fast and gets out of your way when you want it! TurboGears can be used both as a full stack framework or as a microframework in single-file mode. TurboGears 2 is built on top of the experience of several next-generation web frameworks including TurboGears 1 (of course), Django, and Rails. All of these frameworks had limitations that frustrated us, and TG2 was...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Phoenix LiveView

    Phoenix LiveView

    Rich, real-time user experiences with server-rendered HTML

    Phoenix LiveView is an Elixir library that enables rich, real-time user experiences by using server-rendered HTML over WebSockets, providing seamless dynamic interactivity without needing front-end JavaScript frameworks. It integrates deeply with Phoenix and ships by default in new Phoenix applications. LiveView brings a unified experience to building web applications. You no longer have to split work between client and server, across different toolings, layers, and abstractions. Instead, LiveView enriches the server with a declarative and powerful model while keeping your code closer to your data (and ultimately your source of truth).
    Downloads: 8 This Week
    Last Update:
    See Project
  • 23
    Middy

    Middy

    The stylish Node.js middleware engine for AWS Lambda

    Middy is a very simple middleware engine that allows you to simplify your AWS Lambda code when using Node.js. If you have used web frameworks like Express, then you will be familiar with the concepts adopted in Middy and you will be able to get started very quickly. A middleware engine allows you to focus on the strict business logic of your Lambda and then attach additional common elements like authentication, authorization, validation, serialization, etc. in a modular and reusable way by...
    Downloads: 7 This Week
    Last Update:
    See Project
  • 24
    Solid

    Solid

    A declarative JavaScript library for building user interfaces

    Solid is a declarative JavaScript library for creating user interfaces. Instead of using a Virtual DOM, it compiles its templates to real DOM nodes and updates them with fine-grained reactions. Declare your state and use it throughout your app, and when a piece of state changes, only the code that depends on it will rerun. Check out our intro video or read on! Fine-grained updates to the real DOM. Declarative data: model your state as a system with reactive primitives. Render-once mental...
    Downloads: 9 This Week
    Last Update:
    See Project
  • 25
    gmailctl

    gmailctl

    Declarative configuration for Gmail filters

    This utility helps you generate and maintain Gmail filters in a declarative way. It has a Jsonnet configuration file that aims to be simpler to write and maintain than using the Gmail web interface, to categorize, label, archive and manage your inbox automatically. If you use Gmail and have to maintain (like me) a lot of filters (to apply labels, get rid of spam or categorize your emails), then you probably have (like me) a very long list of messy filters. At a certain point one of your...
    Downloads: 8 This Week
    Last Update:
    See Project