Showing 459 open source projects for "web crawler source code"

View related business solutions
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Start Free
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 1
    ML.NET

    ML.NET

    Open source and cross-platform machine learning framework for .NET

    With ML.NET, you can create custom ML models using C# or F# without having to leave the .NET ecosystem. ML.NET lets you re-use all the knowledge, skills, code, and libraries you already have as a .NET developer so that you can easily integrate machine learning into your web, mobile, desktop, games, and IoT apps. ML.NET offers Model Builder (a simple UI tool) and ML.NET CLI to make it super easy to build custom ML Models. These tools use Automated ML (AutoML), a cutting edge technology that...
    Downloads: 6 This Week
    Last Update:
    See Project
  • 2
    Deepkit Framework

    Deepkit Framework

    A new full-featured and high-performance TypeScript framework

    A new full-featured and high-performance TypeScript framework for enterprise applications. High-quality TypeScript libraries and next-gen backend framework. Leverage TypeScript types to the fullest, in completely new ways. A runtime type system for JavaScript, powered by TypeScript types. Deepkit's type compiler makes it possible to use the whole TypeScript type system in any JavaScript runtime for the first time enabling completely new ways of writing data-driven applications. A framework...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 3
    CacheManager

    CacheManager

    CacheManager is an open source caching abstraction layer for .NET

    CacheManager is an open source caching framework for .NET written in C# and is available via NuGet. It supports various cache providers and implements many advanced features. A simple but very efficient implementation. This handle is faster than any other in most scenarios and works cross-platform. Two implementations are available, based on System.Runtime.Caching and based on the new Microsoft.Extensions.Caching.Memory package. Redis can be used as an extremely fast and reliable...
    Downloads: 5 This Week
    Last Update:
    See Project
  • 4
    uni-app

    uni-app

    A cross-platform framework using Vue.js

    uni-app is a cross-platform framework that lets developers build applications with Vue syntax and deploy them to multiple targets: iOS, Android, web (H5), and a range of mini-program ecosystems. It abstracts platform differences through a unified component and API layer, so most business logic and UI code can be shared across outputs. The tooling includes a CLI, IDE support, and a plugin market that provides native integrations, UI kits, and deployment helpers. Developers can choose between...
    Downloads: 2 This Week
    Last Update:
    See Project
  • Host LLMs in Production With On-Demand GPUs Icon
    Host LLMs in Production With On-Demand GPUs

    NVIDIA L4 GPUs. 5-second cold starts. Scale to zero when idle.

    Deploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
    Start Free
  • 5
    PowerHub

    PowerHub

    A post exploitation tool based on a web application

    PowerHub is a PowerShell-based automation framework designed to centralize and orchestrate common administrative tasks across Windows environments. It exposes a modular command set for inventorying systems, managing services, deploying packages, and executing remote commands with consistent logging and error handling. The project places emphasis on discoverability and reuse: scripts are organized into reusable modules and functions with clear parameter contracts so teams can compose...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    Aimeos core

    Aimeos core

    Aimeos PHP ecommerce framework for ultra fast online shops

    Aimeos-Core is the core library and framework for the Aimeos ecommerce ecosystem, providing the essential building blocks for flexible, scalable online shops, marketplaces, and enterprise commerce applications. Unlike a monolithic shop application, Aimeos-Core is designed as a modular framework that you can embed into your own web app, enabling you to define custom front-ends and workflows while relying on its robust commerce services for catalog, cart, checkout, orders, and customer...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    OWL

    OWL

    Optimized Workforce Learning for General Multi-Agent Assistance

    OWL (Optimized Workforce Learning) is a sophisticated open-source framework built on the CAMEL-AI ecosystem for orchestrating teams of AI agents to collaboratively solve complex, real-world tasks with dynamic planning and automation capabilities. Unlike single-agent systems, it treats task completion as a collaborative workforce where agents take on specialized roles (planning, execution, analysis) and coordinate via a modular multi-agent architecture that supports flexible teamwork across...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    Elgg

    Elgg

    A social networking engine in PHP/MySQL

    Introducing a powerful open-source social networking engine. Providing you with the core components needed to build a socially aware web application. Elgg is an award-winning open source social networking engine that provides a robust framework on which to build all kinds of social environments, from a campus-wide social network for your university, school or college or an internal collaborative platform for your organization to a brand-building communications tool for your company and its...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 9
    ExpressJS.com

    ExpressJS.com

    The Express.js Website

    This repository contains the source for the Express web site and documentation, the canonical reference for developers using the Express framework. It organizes material into API reference, getting-started guides, best practices, and topic-focused explanations such as routing, middleware, error handling, templating, and performance. Versioned docs help readers match API behavior to the framework version they’re running, reducing confusion during upgrades.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 99.99% Uptime for MySQL and PostgreSQL Databases Icon
    99.99% Uptime for MySQL and PostgreSQL Databases

    Sub-second maintenance. 2x read/write performance. Built-in vector search for AI apps.

    Cloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
    Start Free
  • 10
    Visual Blocks

    Visual Blocks

    Visual Blocks for ML is a Google visual programming framework

    Visual Blocks is a node-based, in-browser environment for building AI and data-processing workflows with drag-and-drop components. It lets you connect sources, transforms, models, and visualizers into a live graph, so changes propagate instantly and results are observable without writing glue code. Under the hood it leans on web-friendly runtimes (e.g., WebGPU/WebGL/WebNN or TensorFlow.js backends) to execute pipelines locally, which is great for demos, teaching, and privacy-sensitive...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    Textual

    Textual

    Textual is a TUI (Text User Interface) framework for Python

    Textual is a Python framework for creating interactive applications that run in your terminal. Textual adds interactivity to Rich with a Python API inspired by modern web development. On modern terminal software (installed by default on most systems), Textual apps can use 16.7 million colors with mouse support and smooth flicker-free animation. A powerful layout engine and re-usable components makes it possible to build apps that rival the desktop and web experience. Textual runs on Linux,...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    nodejs-integration-tests-best-practices

    nodejs-integration-tests-best-practices

    Beyond the basics of Node.js testing

    Component/integration test is a hybrid between E2E and unit tets. It's gaining a lot of popularity and going by the testing diamond model it is considered as the default technique for the modern backend. Its main idea is testing an entire component (e.g., Microservice) as-is, through the API, with all the layers including the database but fake anything extraneous. This brings both high confidence and great developer experience. However, doing it right, fast, exhaustive and maximizing the...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    TodoMVC

    TodoMVC

    Helping you select an MV* framework

    TodoMVC is a project that helps developers choose an MV* framework by providing a structured way of comparing JS libraries and frameworks. These days there are so many MV* frameworks developers can choose from to structure and organize JavaScript web apps. TodoMVC helps developers navigate through this sea of choices on the basis of actual project code, so they can choose which one matches them and their needs best. TodoMVC has been called the 'Speed-dating' and 'Rosetta Stone' of MV*...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    SkiaSharp

    SkiaSharp

    SkiaSharp is a cross-platform 2D graphics API for .NET platforms

    SkiaSharp is a cross-platform 2D graphics API for .NET platforms based on Google's Skia Graphics Library. It provides a comprehensive 2D API that can be used across mobile, server and desktop models to render images. Building SkiaSharp is mostly straight forward. The main issue is the multiple dependencies for each platform. However, these are easy to install as they are found on the various websites. If you are just working on managed code, it is even easier as there mays to skip all the...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 15
    Sakura Boot

    Sakura Boot

    Framework on top of spring-boot that helps create back-ends

    This framework, built on top of Spring Boot, is designed to speed up the development of robust backends. It ensures adherence to best practices while allowing a high degree of customization. The framework is structured using a modular architecture, making it easy to add or remove features based on the project’s specific needs. While Spring Boot speeds up the development process, developers still require extensive knowledge, must ensure adherence to best practices, and often write repetitive...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    neo.mjs

    neo.mjs

    The application worker driven frontend framework

    neo.mjs is the next-generation UI framework for creating desktop & mobile Web Apps. It has a very strong focus on performance and creating scalable & modular architectures. A clean & consistent API, as well as the ability to run without any build processes, will increase the productivity of your team while creating better solutions at the same time. While current libraries/frameworks like Angular, React or Vue provide reasonable performance for small or mostly static Apps, they lack when it...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    django-helpdesk

    django-helpdesk

    A Django application to manage tickets for an internal helpdesk

    A Django application to manage tickets for an internal helpdesk. Formerly known as Jutda Helpdesk. django-helpdesk was formerly known as Jutda Helpdesk, named after the company which originally created it. As of January 2011 the name has been changed to reflect what it really is: a Django-powered ticket tracker with contributors reaching far beyond Jutda. django-helpdesk includes a basic demo Django project so that you may easily get started with testing or developing django-helpdesk. The...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    Artillery

    Artillery

    Cloud-scale load testing. Fully serverless, test any stack

    Artillery is cloud-native, open source, and integrates with your favorite monitoring and CI/CD stack. Load test anything, at any scale. The most advanced load-testing platform in the world. Get started and run a test in minutes from your local machine. Then scale it out effortlessly. Free & open-source. Artillery scales like no other. Run your tests from your own AWS account with no infra to set up or manage. Use Playwright to load test with real browsers. Test HTTP, WebSocket, Socket.io,...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Cogent Core

    Cogent Core

    A free and open source framework for building powerful 2D and 3D apps

    Cogent Core is a free and open source framework for building powerful, fast, elegant 2D and 3D apps that run on macOS, Windows, Linux, iOS, Android, and the web with a single Go codebase, allowing you to Code Once, Run Everywhere (Core). See the Cogent Core Website for more information, including extensive documentation and editable interactive running examples. The website itself is a Cogent Core app running on the web using wasm.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20

    bloxtor

    professional and intelligent web-development framework designed for No

    Bloxtor is a **professional and intelligent web-development framework designed for No-Coders, Low-Coders, and Coders alike**. It functions as a versatile code reader and converter, seamlessly transforming code into visual environments and visual components back into code. The concept is to provide a centralized AI-powered web development platform with multiple levels of Citizen Development, empowering both technical and non-technical developers to easily create any type of web application,...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 21

    OpenXava

    Automatic frontend engine for Java

    Automatic frontend engine for Java. Write just the domain classes in plain Java. Get a web application ready for production.
    Leader badge
    Downloads: 34 This Week
    Last Update:
    See Project
  • 22
    Polyglot Formatter

    Polyglot Formatter

    Multi-language code formatter with automatic language detection

    Polyglot Formatter is a lightweight browser-based code beautifier that automatically detects and formats HTML, CSS, JavaScript, PHP, and JSON. Designed for developers, it provides instant code cleanup and readability improvements without requiring a server, build process, or account. Everything runs locally in the browser for maximum privacy and convenience. The formatter supports mixed-language files, nested code blocks, configurable indentation, line wrapping, syntax highlighting, and...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 23
    PHP Jet Framework

    PHP Jet Framework

    Powerful PHP8 framework for real developers

    🧰 Everything you need Completely unique MVC that will make your work much easier, flexible and powerful ORM, perfect forms, all ready for international environment, support for authentication and authorization including roles and rights, REST, AJAX, server-side UI generation and many more Last but not least, the whole system is modular and built on the principle of micro-applications - application modules. This will quite fundamentally improve your productivity, testing and...
    Downloads: 95 This Week
    Last Update:
    See Project
  • 24
    Brill Software

    Brill Software

    A faster way to develop React Web Applications

    The Brill Framework allows React web applications to be built quickly using a "Low Code" approach. A Content Management System (CMS) supports editing of pages containing React components. The React components communicate with each other and the Server using a middleware that's based on WebSockets. With a "No Code" solution, there's always something you require that's not support. You spend ages bending the product to your requirements or pay the supplier to provide the components...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    Neiki's Page Editor

    Neiki's Page Editor

    Visual HTML page editor that renders real HTML and CSS

    ...It transforms any container into a complete editing environment with accurate HTML and CSS rendering inside an isolated iframe, ensuring pages look exactly as they will in a real browser. The editor includes a modern toolbar, source code view, image and table editing, drag-and-drop tools, autosave, fullscreen mode, localization, and five built-in themes. It supports full HTML documents, external stylesheets, custom CSS, database integration through async load/save handlers, editable regions, plugins, and built-in sanitization with an optional PHP helper for server-side security. ...
    Downloads: 8 This Week
    Last Update:
    See Project