Search Results for "concurrent"
Sort By:
27 projects for "concurrent" with 2 filters applied:
-
Error to trace to log to deploy. One click. No SSH.AppSignal links every error to the trace, the trace to the log, the log to the deploy that shipped it.
-
Stop Cyber Threats with VM-Series Next-Gen Firewall on AzureGain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
-
1
Scrapling
An adaptive Web Scraping framework
Scrapling is an adaptive web scraping framework designed to handle everything from a single HTTP request to large-scale, concurrent crawls. Built for modern websites, it intelligently adapts to structural changes by automatically relocating elements when page layouts update. The framework includes advanced fetchers capable of bypassing anti-bot protections such as Cloudflare Turnstile using stealth and browser automation techniques. Its powerful spider system supports multi-session crawling, pause and resume functionality, and real-time streaming of scraped data. ... -
2
Pydoll
Async Python library in automating Chromium browsers without WebDriver
...It provides a high-level API that simplifies common browser automation tasks while still offering access to low-level protocol features for advanced control. Its architecture is built around asynchronous programming using Python’s asyncio framework, enabling concurrent automation of multiple tabs and browser contexts. Pydoll also includes tools for monitoring and intercepting network traffic, allowing developers to analyze or modify requests and responses during automation workflows. It emphasizes realistic interactions and fingerprint management to reduce the likelihood of automated actions. -
3
Mink
PHP web browser emulator abstraction
Mink is an open-source PHP library that provides a browser abstraction layer for web application testing, allowing developers to simulate user interactions with websites in a consistent and flexible way. Instead of tying test logic to a specific browser driver, Mink introduces a unified API that can work with multiple drivers such as Goutte, Selenium, ChromeDriver, or BrowserKit. This abstraction enables developers to write tests once and run them across different environments without... -
4
Cowboy
Small, fast, modern HTTP server for Erlang/OTP
...The project is well suited for real-time systems, APIs, messaging infrastructure, telecom-style applications, and fault-tolerant services that benefit from the Erlang runtime. Cowboy is a strong choice when developers need an efficient HTTP layer that fits naturally into actor-based, concurrent Erlang architectures. -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
5
gain
Asyncio-based Python framework for building fast web crawling spiders
Gain is a Python web crawling framework designed to simplify the process of building efficient and scalable web scrapers. It is built on top of asynchronous technologies such as asyncio, aiohttp, and uvloop to support high-performance crawling with concurrent network requests. It provides a structured framework for creating spiders that can navigate websites, extract structured data, and process the collected results. Developers define crawlers using components such as spiders, parsers, and items, allowing them to organize crawling logic and data extraction rules clearly. Gain supports CSS selectors and XPath expressions for parsing page content and extracting specific elements. ... -
6
CoW is a "Controllable Wiki" and basic CMS that supports collaborative document creation with asynchonous off-line editing. CoW makes it easy to add interaction to static websites, and to support concurrent editing and off-line working using Subversion
-
7
KCP C#
KCP C# version. Thread safe, no alloc at runtime, no pressure on gc
...It supports Span<byte>, external buffer rental, and a generic KcpCore<Segment> architecture for performance-focused implementations. The library is partly thread-safe, allowing concurrent Send and Input calls while restricting concurrent Recv and Update calls for correctness. It is useful for game networking, real-time communication, and other latency-sensitive C# applications that need reliable delivery over UDP. -
8
crawly
High-level web crawling and scraping framework for Elixir apps
...Crawly is designed for tasks such as data mining, information processing, and building historical archives of web content. Crawly follows the Elixir and OTP architecture model, enabling concurrent and fault-tolerant crawling processes that can handle many requests efficiently. Developers define specialized components called spiders to control how pages are visited and how information is extracted from them. It also supports extensibility through middlewares, pipelines, and fetchers that allow customization of request handling, data processing, and crawling behavior. -
9
pspider
Simple Python framework for building multithreaded web crawlers
PSpider is a lightweight web crawling framework written in Python designed to simplify the development of custom web spiders. It focuses on providing an easy-to-understand architecture while still supporting concurrent crawling for improved performance. It uses a multithreaded model that separates the crawling workflow into several components responsible for fetching, parsing, and saving data. Tasks are managed through queues, allowing different parts of the crawler to process work asynchronously and efficiently. PSpider defines a set of modules and utility classes that help developers manage crawling tasks, filter URLs, and process scraped content. ... -
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
10
gocrawl
Polite concurrent web crawler library for Go with flexible hooks
gocrawl is a lightweight web crawling library written in the Go programming language that enables developers to build custom web crawlers and data extraction tools. gocrawl focuses on providing a minimal yet powerful crawling engine that can be easily extended and adapted for different web scraping or indexing tasks. It is designed to be polite when accessing websites by respecting crawling rules such as robots.txt policies and applying crawl delays for each host. It executes requests... -
11
ruia
Async Python framework for fast and flexible web scraping spiders
Ruia is an asynchronous web scraping micro-framework built for Python that focuses on simplicity, speed, and flexibility when creating web crawlers. Ruia is powered by Python’s asyncio library along with aiohttp, enabling developers to perform concurrent network requests efficiently and scrape data from websites with minimal overhead. Ruia follows a “write less, run faster” philosophy, emphasizing concise code and streamlined spider development. It provides a structured approach to building scraping projects through components such as data items, spiders, middleware, and plugins. ... -
12
lightcrawler
Website crawler that audits site pages automatically with Lighthouse
...Lightcrawler supports configuration through a JSON configuration file, enabling users to customize how the crawler operates and which Lighthouse audits should be executed. Settings such as crawl depth and the number of concurrent browser instances can be configured to control how aggressively the crawler scans a site. It was created as a developer utility to help identify issues across an entire website more efficiently. -
13
Jolie
A service-oriented programming language.
...Please refer to our main website: www.jolie-lang.org Jolie is the first full-fledged programming language based upon the service-oriented paradigm, suitable to create new services from scratch or to compose existing ones in powerful orchestrators in order to obtain new functionalities. You can use Jolie for building any kind of distributed applications. Examples are cloud middleware, web portals, and standalone concurrent applications. -
14
A simple packet crafting tool that turns text commands into pcaps. Optionally build a DAQ and Snort can directly read commands or raw payload data - no pcap required. Packets can exhibit any flaw or anomaly desired. Syntax is flexible and powerful.
-
15
yoDownet
The previous generation graphical download manager
yoDownet is an open-source && free graphical download manager project that tries to be simple and minimal, also for sake of humor it's described as "The Previous Generation Graphical Download Manager". -
16
SportWire is a website toolkit for high-speed high-volume collection, transformation and redistribution of documents. Sportwire is currently employed by xmlteam.com to translate multiple concurrent vendor news feeds into standard SportsML at over 20 documents per second.
-
17
HTTP Replicator is a general purpose caching proxy server written in python. It reduces bandwidth by merging concurrent downloads and building a local 'replicated' file hierarchy, similar to wget -r. The cache is also accessible through a web interface
-
18
Nucular Archiving System for creating full text indices for fielded data. Python API, web, and command line interfaces. Fast. Very light weight. Concurrent read/writes with no possible locking issues. No server process. Proximity. Facets. Funny name.
-
19
HTTP::DownloadLimit - module to set restrictions for files downloading from your webserver. This module allows you to log all downloads, restrict downloadable files extensions and concurrent downloads of the same file.
-
20
A collection of Objective Caml libraries to support the development of concurrent, single-threaded Internet application servers.
-
21
Simple web server I've been writing in my spare time, written in very well documented and set out C, uses a pre-forking system to handle concurrent user requests and is quite fast. Check the wiki for current info.
-
22
Surety is a Chancery replacement. It is an attendance and grading system, but it can be adapted to fit many other Web-App projects. It is designed to handle thousands of concurrent requests, and be extremely efficient.
-
23
Download Catalyst is a multi-platform download manager that accelerates and resumes downloads resursively using concurrent threads, with an extensible API & multiple planned UIs (both console and GUI). Besides HTTP/FTP, it also supports proxy connections
-
24
UTL_FTP is a FTP client for PL/SQL. It is simple, clean and light. It allows multiple concurrent sessions. Uses stored Java for the library backend.
-
25
Java program to extract postings and comments from http://www.livejournal.com (blog) into DB and view/classify/process it. LJ loader. Components to reuse: perl-like, but efficient Web pages scraper, trees analyzer, concurrent scheduler.
