Search Results for "multi threaded"
Sort By:
Showing 79 open source projects for "multi threaded"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
Stop Cyber Threats with VM-Series Next-Gen Firewall on AzureGain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
-
1
Spider
High-performance Rust web crawler and scraper for large-scale data
Spider is a high-performance web crawler and web scraping library written in Rust that enables developers to crawl and index websites efficiently. It focuses on speed, concurrency, and reliability by using asynchronous and multi-threaded processing to handle large volumes of web pages. It can rapidly crawl websites to collect links, retrieve page content, and extract structured information from HTML documents. Spider can operate concurrently across many pages, allowing it to gather large datasets in a short period of time. Spider also provides mechanisms for subscribing to crawl events so developers can process page data such as URLs, status codes, or HTML content as it is discovered. ... -
2
Bili23 Downloader
Cross platform GUI tool for downloading videos from Bilibili sites
Bili23-Downloader is an open source desktop application designed for downloading video content from the Bilibili platform. It provides a graphical interface that allows users to download various types of media including user-uploaded videos, series episodes, movies, and other hosted content. It focuses on ease of use with a zero-configuration setup, making it accessible to both beginners and experienced users. It supports high performance downloads through multi-threading and includes resume... -
3
Mummy
An HTTP and WebSocket server for Nim
Mummy is a multi-threaded HTTP 1.1 and WebSocket server written entirely in Nim, designed to maximize server hardware performance without compromising on developer experience. -
4
Rclone
Rsync for cloud storage
Rclone is a command line program for syncing files and directories to and from various cloud storage providers, including Google Drive, Amazon Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Cloudfiles, Google Cloud Storage, Yandex Files and many more. -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
5
YASIO
A multi-platform support c++11 library with focus on asio
...It is used in game and multimedia projects and provides integrations or demos for Unity, Unreal Engine, xlua, axmol, and related development stacks. yasio can be used for TCP, UDP, SSL, IPv6, KCP, and multi-threaded networking scenarios. It is useful for developers who need a portable socket layer that works consistently across games, apps, tools, and custom client software. -
6
Python API for JMComic
Python crawler and API for downloading JMComic albums and images
JMComic-Crawler-Python is a Python library and crawler framework designed to programmatically access and download comic content from the JMComic platform. It provides a structured API that allows developers to retrieve albums, chapters, and images using simple Python code while handling the necessary network requests and data processing behind the scenes. It supports both web-based and mobile API interfaces, enabling flexible interaction with the platform depending on the available... -
7
tumblr-crawler
Python crawler to download photos and videos from Tumblr blogs
tumblr-crawler is an open source Python-based utility designed to download media content from Tumblr blogs. It provides a script that automatically retrieves photos and videos from specified Tumblr sites and saves them locally for offline access. Users can specify one or multiple blogs to crawl by editing a configuration file or by passing parameters through the command line. Once executed, the script fetches media from the Tumblr API and stores the downloaded files in folders named after... -
8
bilibili-manga-downloader
Download and manage Bilibili Manga chapters with GUI downloader
...It provides a graphical user interface that allows users to search for manga titles using keywords, view detailed information about available series, and select chapters to download. BiliBili-Manga-Downloader supports multi-threaded downloading to improve performance and includes progress tracking with estimated time remaining for active downloads. It also offers multiple output formats, allowing chapters to be saved as image folders or compressed comic archive formats suitable for local manga readers. -
9
JennyNet2
Java transport layer on the TCP/IP network
Java Network Transport Layer resting on TCP/IP for client/server or peer-to-peer communication with high efficiency on multi-processor systems. Based on a multi-threaded architecture, enables parallel sending and receiving of Java objects and file transfers on multiple priority channels. Uses Java default and optional Kryo for object serialisation. -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
10
pj-ftp-server
Pure Java FTP server. Free portable cross-platform multi-threaded.
Pure Java FTP server. Free portable cross-platform. Run as root/admin ! 1) Fully multi-threaded. 2) Multi platform support. 3) Can run in GUI-mode: # java -jar pj-ftp-server.jar 4) Can run in CMD-mode (used cmd-mode-config.properties): # java -jar pj-ftp-server.jar cmd 5) IP-filter (access list) support. 6) Writable=true/false support 7) Support listening on different local interfaces 8) Speed limit support 9) Anonymous-mode support 10) Different TCP-ports support 11) Logging support 12) Support limit max concurrent logins 13) Support limit max concurrent logins per IP 14) Need JRE-1.8: https://www.oracle.com/java/technologies/javase/javase8-archive-downloads.html Source = https://github.com/harp077/pj-ftp-server If you like this - put a star on https://github.com/harp077/pj-ftp-server/ for support project please. -
11
pj-tftp-server
Pure Java TFTP server.
Pure Java TFTP server. Free, portable, cross-platform. Fully multi-threaded. Implements RFC 1350. Run as root/admin in cmd-mode with cmd argument = path to folder, for example: java -jar pj-tftp-server.jar /tmp .Need JRE-1.8. Source - https://github.com/harp077/pj-tftp-server If you like this - put a star on https://github.com/harp077/pj-tftp-server/ for support project please. -
12
Lux
Fast Go CLI tool for downloading videos from many streaming sites
Lux is an open source command-line tool designed for downloading videos from a wide variety of online media platforms. Written in the Go programming language, the project focuses on providing a fast and lightweight downloader that can retrieve media content directly from supported websites. Lux works by extracting video information from a given page and downloading the available streams to the user’s system. Lux supports downloading individual videos as well as playlists and can display... -
13
PingAlert
Multi-thread Ping Hosts Monitor Tool. Email/ Teams/ Telegram alerts
PingAlert check multiple hosts in parallel using multi-threaded workers instead of checking one by one. This is especially useful for small and medium businesses monitoring many servers, routers, switches, firewalls, Internet connections, cloud services, VPN endpoints, and branch office devices When a monitored host fails continuously and reaches threshold, a DOWN alert is sent. -
14
spider_collection
Collection of Python web scraping scripts for data extraction tasks
spider_collection is a collection of Python web crawler scripts created primarily for experimentation, learning, and practical scraping tasks. spider_collection gathers multiple independent spiders designed to collect data from different platforms and services, demonstrating a variety of scraping techniques and workflows. These crawlers make use of common Python scraping tools such as requests, parsel, BeautifulSoup, and the Scrapy framework to extract structured information from web pages.... -
15
OmniPull
Just pull anything
OmniPull is a powerful, cross-platform download manager built with Python and PySide6. It provides a modern, intuitive interface for managing downloads with advanced features like multi-threading, queue management, and media extraction. -
16
HPN-SSH is a series of performance patches for OpenSSH. By addressing network limitations and CPU limitations significant throughput performance can be realized. Gains of close to two orders of magnitude are possible on long fat network paths. The official git repo is now available at http://github.com/rapier1/openssh-portable. The Sourceforge repository should not be seen as the canonical repository for HPN-SSH. We will update it as we can but users should look to github to generate...
-
17
bilili
Command-line Bilibili video and danmaku downloader with batch support
...It provides automated downloading capabilities that handle video streams and associated data efficiently while minimizing manual interaction. bilili supports retrieving both the video files and danmaku comments, which are the scrolling overlay comments commonly associated with the platform’s videos. These danmaku comments can be automatically converted into ASS subtitle format for playback compatibility with media players. bilili also implements multi-threaded and segmented downloading techniques to improve download performance and reliability. Additionally, it supports resuming interrupted downloads so partially downloaded content can continue without restarting from the beginning. -
18
Brynet
A Header-Only cross-platform C++ TCP network library
Header Only Cross-platform high-performance TCP network library using C++ 11. The server uses two network threads and one logic thread, the client uses one network (also process logic) thread. Every packet size is 46 bytes. Every packet contains the client's id. Server broadcast packets to all clients when recv one packet from any client. The client sends one packet when recv packet from the server and the packet's id is equal self. -
19
FACIL.IO
Your high performance web application C framework
facil.io is an evented Network library written in C. facil.io provides high performance TCP/IP network services by using an evented design that was tested to provide an easy solution to the C10K problem. facil.io includes a mini-framework for Web Applications, with a fast HTTP / WebSocket server, integrated Pub/Sub, optional Redis connectivity, easy JSON handling, Mustache template rendering and more nifty tidbits. facil.io powers the HTTP/Websockets Ruby Iodine server and it can easily... -
20
Mowglee
Mowglee - The Geo Crawler!
Mowglee is a distributed, multi-threaded, asynchronous task execution based web crawler in Java.It is designed for geographic affinity and is highly modular. -
21
GoogleScraper
Python tool for scraping search engine results from many providers
GoogleScraper is a Python-based tool designed to automatically collect and process search engine results from multiple providers. It enables developers and researchers to programmatically query search engines and extract useful information such as links, titles, and result descriptions. GoogleScraper supports several major search engines and can be used to gather structured datasets from search result pages for further analysis. It provides two different scraping approaches: sending direct... -
22
FileSearch is a multi-threaded documents searcher. No indexes need to be updated ; no background service is required. The more you have drives the more search speed is increased thanks to its multi-threading technic.
-
23
ECommerceCrawlers
Collection of Python ecommerce and website crawler examples projects
ECommerceCrawlers is a collection of practical Python web crawler projects designed to gather data from a variety of ecommerce platforms, websites, and online services. It aggregates many independent crawler examples created by contributors and organized into separate subprojects that target specific sites or data sources. These examples demonstrate how to build and operate web scrapers capable of collecting structured information such as product listings, news content, job postings, social... -
24
Embedded HTTP Server (EHS) is a C++ class library which can be inherited from to add HTTP(S) server functionality to any class or application. It is easily extendable (samples included) and supports SSL, form data via POST or GET, uploads via multi-part form attachments and WebSockets. Operation modes include single- and multi-threaded operation.
-
25
crawler4j
Open source web crawler for Java
crawler4j is an open source web crawler for Java which provides a simple interface for crawling the Web. Using it, you can setup a multi-threaded web crawler in few minutes. You need to create a crawler class that extends WebCrawler. This class decides which URLs should be crawled and handles the downloaded page. shouldVisit function decides whether the given URL should be crawled or not. In the above example, this example is not allowing .css, .js and media files and only allows pages within ics domain. visit function is called after the content of a URL is downloaded successfully. ...
