Showing 172 open source projects for "web crawler source code"

View related business solutions
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Get Started Free
  • $300 Free Credits for Your Google Cloud Projects Icon
    $300 Free Credits for Your Google Cloud Projects

    Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

    Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
    Start Free Trial
  • 1
    Go Tools

    Go Tools

    Various packages and tools that support the Go programming language

    This subrepository holds the source for various packages and tools that support the Go programming language. Some of the tools, godoc and vet for example, are included in binary Go distributions. Others, including the Go guru and the test coverage tool, can be fetched with go get. Packages include a type-checker for Go and an implementation of the Static Single Assignment form (SSA) representation for Go programs. This repository uses prettier to format JS and CSS files. The version of...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 2
    AtlantaFX

    AtlantaFX

    Modern JavaFX CSS theme collection with additional controls

    Modern JavaFX CSS theme collection with additional controls.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 3
    100 proyectos de JavaScript

    100 proyectos de JavaScript

    100 JavaScript projects with code and videos for free

    100 proyectos de JavaScript is a large collection of 100 JavaScript projects, each with source code and an accompanying video tutorial, offered entirely for free. The repository is tied to the website javascript100.dev, which presents the projects as a structured learning path so learners can progressively build their skills through practice.Each project lives in its own numbered folder (for example, 01-tinder-swipe), and the README explains how to run them via the VS Code Live Preview...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 4
    plotly

    plotly

    An interactive graphing library for R

    This part of the book teaches you how to leverage the plotly R package to create a variety of interactive graphics. There are two main ways to creating a plotly object: either by transforming a ggplot2 object (via ggplotly()) into a plotly object or by directly initializing a plotly object with plot_ly()/plot_geo()/plot_mapbox(). Both approaches have somewhat complementary strengths and weaknesses, so it can pay off to learn both approaches. Moreover, both approaches are an implementation of...
    Downloads: 2 This Week
    Last Update:
    See Project
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Try Free
  • 5
    Werkzeug

    Werkzeug

    The comprehensive WSGI web application library

    Werkzeug is a comprehensive WSGI web application library. It began as a simple collection of various utilities for WSGI applications and has become one of the most advanced WSGI utility libraries. Werkzeug doesn’t enforce any dependencies. It is up to the developer to choose a template engine, database adapter, and even how to handle requests. Includes an interactive debugger that allows inspecting stack traces and source code in the browser with an interactive interpreter for any frame in the stack. ...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 6
    Lyricist

    Lyricist

    Missing I18N/L10N (internationalization/localization) multiplatform

    Jetpack Compose greatly improved the way we build UIs on Android, but not how we interact with strings. stringResource() works well, but doesn't benefit from the idiomatic Kotlin like Compose. Lyricist tries to make working with strings as powerful as building UIs with Compose, i.e., working with parameterized string is now typesafe, use of when expression to work with plurals with more flexibility, and even load/update the strings dynamically via an API.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 7
    Hello ImGui

    Hello ImGui

    Hello, Dear ImGui: unleash your creativity in app development

    hello_imgui is a cross-platform framework that simplifies the development of graphical applications using Dear ImGui. It abstracts away boilerplate code for window creation, input handling, and platform integration, allowing developers to focus on building user interfaces and interactive content quickly. Targeted at prototyping, tools, and GUI apps, hello_imgui works on Windows, macOS, Linux, iOS, and WebAssembly with minimal setup. Its plug-and-play nature makes it ideal for teaching,...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    Helium

    Helium

    Lighter web automation with Python

    Helium is a Python library built on top of Selenium to make browser automation more intuitive and human-friendly. It replaces verbose boilerplate code with natural language-like API calls such as click("Login") or write("hello", into="Name"). Helium manages browser setup, waits, and teardown, enabling quick development of scripts for testing, scraping, or task automation without requiring deep Selenium knowledge.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 9
    Gaufrette

    Gaufrette

    PHP library that provides a filesystem abstraction layer

    Gaufrette is a PHP library designed to abstract filesystem operations, providing a consistent interface to interact with various storage backends. It allows developers to work with files stored locally, on cloud platforms, or via network protocols, without changing the code. Gaufrette supports plugins for caching, metadata management, and file transformation, making it a flexible choice for file management in web applications.
    Downloads: 1 This Week
    Last Update:
    See Project
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 10
    ScottPlot

    ScottPlot

    Interactive Plotting Library for .NET

    ScottPlot is a free and open-source plotting library for .NET that makes it easy to interactively display large datasets. Line plots, bar charts, pie graphs, scatter plots, and more can be created with just a few lines of code. The ScottPlot Cookbook demonstrates how to create line plots, bar charts, pie graphs, scatter plots, and more with just a few lines of code. The ScottPlot Demo is a click-to-run application that demonstrates mouse-interactive versions of every cookbook recipe....
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    SurveyJS

    SurveyJS

    JavaScript Survey and Form Library

    SurveyJS Form Library is distributed as npm packages and as scripts and style sheets that you can reference on your page. You can use it in any React, Angular, Vue, Knockout, or jQuery application. React, Angular, Knockout, and Vue3 are supported natively. To communicate with the server, the libraries use JSON objects that represent form schemas (content and layout of a form) and form results (answers). You have the option to build dynamic JSON-driven forms using our free full-featured...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 12
    next-starter

    next-starter

    A Next.js starter template, packed with features

    next-starter is a comprehensive Next.js starter template designed to accelerate project initialization. It integrates essential tools and technologies, including TypeScript, Tailwind CSS, NextAuth.js, ESLint, Stripe, and various testing utilities, providing a robust foundation for building scalable and maintainable web applications.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    Testcontainers Java

    Testcontainers Java

    Testcontainers is a Java library that supports JUnit tests

    Testcontainers for Java is a Java library that supports JUnit tests, providing lightweight, throwaway instances of common databases, Selenium web browsers, or anything else that can run in a Docker container. Use a containerized instance of a MySQL, PostgreSQL or Oracle database to test your data access layer code for complete compatibility, but without requiring complex setup on developers' machines and safe in the knowledge that your tests will always start with a known DB state. Any other...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    Practical ASP.NET Core

    Practical ASP.NET Core

    Practical samples of ASP.NET Core 10 RC

    practical-aspnetcore is a repository containing hundreds of sample projects, micro-applications, and code snippets across multiple versions of .NET Core (including 2.1, 3.1, 5.0, 6.0, 7.0, 8.0, 9.0, 10 RC) to illustrate real-world patterns, advanced topics, and features in .NET Core development. It is intended as a hands-on learning resource for building web APIs, middleware, authentication, real-time, microservices, etc.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    templUI

    templUI

    A growing collection of beautifully designed UI components for Go

    templUI is a modern UI component library built specifically for Go applications using the templ templating language, offering a developer-first approach to building interfaces with strong type safety and performance. It provides a growing collection of beautifully designed, production-ready components styled with Tailwind CSS, allowing developers to construct modern web interfaces without relying on heavy frontend frameworks. One of its defining principles is code ownership, meaning...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Formik

    Formik

    Build forms in React

    Formik is the world's most popular open-source form library for React and React Native. Formik takes care of the repetitive and annoying stuff, keeping track of values/errors/visited fields, orchestrating validation, and handling submission, so you don't have to. This means you spend less time wiring up state and change handlers and more time focusing on your business logic. No fancy subscriptions or observables under the hood, just plain React state and props. By staying within the core...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    Russh

    Russh

    Rust SSH client & server library

    Russh provides a Rust library for implementing SSH clients and servers with a modern, async-friendly design. It exposes building blocks for authentication, channel management, port forwarding, and key handling, allowing you to embed SSH functionality directly into Rust applications. The API is designed to be explicit and composable, making it possible to implement custom behaviors like reverse tunnels, interactive shells, and service multiplexing. Because performance and safety are central,...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 18
    Google CTF

    Google CTF

    Google CTF

    Google CTF is the public repository that houses most of the challenges from Google’s Capture-the-Flag competitions since 2017 and the infrastructure used to run them. It’s a learning and practice archive: competitors and educators can replay tasks across categories like pwn, reversing, crypto, web, sandboxing, and forensics. The code and binaries intentionally contain vulnerabilities—by design—so users can explore exploit chains and patching in realistic settings. The repo also includes...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Laravel Echo

    Laravel Echo

    Laravel Echo library for beautiful Pusher and Ably integration

    In many modern web applications, WebSockets are used to implement realtime, live-updating user interfaces. When some data is updated on the server, a message is typically sent over a WebSocket connection to be handled by the client. This provides a more robust, efficient alternative to continually polling your application for changes. To assist you in building these types of applications, Laravel makes it easy to "broadcast" your events over a WebSocket connection. Broadcasting your Laravel...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Jimp

    Jimp

    An image processing library written entirely in JavaScript for Node

    An image processing library for Node written entirely in JavaScript, with zero native dependencies. If you're using this library with TypeScript the method of importing slightly differs from JavaScript. Instead of using require, you must import it with ES6 default import scheme. If you're using a web bundles (webpack, rollup, parcel) you can benefit from using the module build of jimp. Using the module build will allow your bundler to understand your code better and exclude things you aren't...
    Downloads: 6 This Week
    Last Update:
    See Project
  • 21
    hello.js

    hello.js

    API library for connecting with OAuth2 services

    A client-side JavaScript SDK for authenticating with OAuth2 (and OAuth1 with an OAuth proxy) web services and querying their REST APIs. HelloJS standardizes paths and responses to common APIs like Google Data Services, Facebook Graph and Windows Live Connect. It’s modular, so that list is growing. No more spaghetti code! Compiled source, which combines all of the modules, can be obtained from GitHub, and source files can be found in Source. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    My Python Eggs

    My Python Eggs

    Python Examples

    My Python Eggs, commonly associated with the geekcomputers Python repository, is a large collection of practical Python scripts and small programs created primarily for experimentation, automation, and educational purposes. Rather than being a single cohesive application, it functions as a repository of utilities that demonstrate how Python can be used to solve everyday problems and automate repetitive tasks. The scripts cover a wide range of topics, including file management, networking,...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 23
    Lexbor

    Lexbor

    Lexbor is development of an open source HTML Renderer library

    Lexbor is the development of a web browser engine available as a software library; it ships with a free license and has no extra dependencies. For us, speed is an absolute must-have. In our development process, we focus on fastest parsing techniques for HTML, CSS, and fonts, fastest data processing methods, and fastest ways to serve content to end users. Whether you are building a backend that handles millions of HTML documents or a UI-heavy user app, your software’s response rate always...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 24
    barba.js

    barba.js

    Create badass, fluid and smooth transitions between website’s pages

    Barba.js — aka Barba — is a small (7kb minified and compressed) and easy-to-use library that helps you create fluid and smooth transitions between your website's pages. It makes your website run like a SPA (Single Page Application) and help reduce the delay between your pages, minimize browser HTTP requests and enhance your user's web experience.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    GraphQL Juniper

    GraphQL Juniper

    GraphQL server library for Rust

    GraphQL is a data query language developed by Facebook intended to serve mobile and web application frontends. Juniper makes it possible to write GraphQL servers in Rust that are type-safe and blazingly fast. We also try to make declaring and resolving GraphQL schemas as convenient as Rust will allow. Juniper does not include a web server - instead it provides building blocks to make integration with existing servers straightforward. It optionally provides a pre-built integration for the...
    Downloads: 0 This Week
    Last Update:
    See Project