Search Results for "throughput"

Scweet is a Python-based Twitter/X scraping library and CLI designed to collect tweets, profile timelines, followers, following lists, and user profile data without requiring the official Twitter/X API or a developer account. Instead of depending on deprecated unauthenticated scraping methods, it works by using X’s web GraphQL API together with authenticated browser cookies, which gives it a more current and practical approach for data extraction. The project supports a broad set of...

Gain is a Python web crawling framework designed to simplify the process of building efficient and scalable web scrapers. It is built on top of asynchronous technologies such as asyncio, aiohttp, and uvloop to support high-performance crawling with concurrent network requests. It provides a structured framework for creating spiders that can navigate websites, extract structured data, and process the collected results. Developers define crawlers using components such as spiders, parsers, and...

...See here: https://github.com/ziplet/ziplet A J2EE servlet filter which compresses data written to the response. It supports several algorithms (gzip, deflate, etc.) and emphasizes minimal memory usage and high throughput. Also provides detailed performance stats. Feel free to fork pjl-comp-filter on Github: https://github.com/ziplet/ziplet

...A single package that makes the most of each platform by tapping into their unique capabilities, combining this power with an intuitive interface, beautiful design and Haskell's excellent support for unprecedented levels of concurrency and parallelism. It strives for the smallest source code size (< 500 lines) while delivering maximum throughput with near zero overhead.

ciperf is used to calculate the -b and -l values for iperf in order to produce a chosen udp packet throughput (overhead = 51 bytes) in respect to some variables which may change the calculation of the parameters (e.g. computers, links, ...).

ArrayPipeLine is a web-based Laboratory Information Management system, using MySQL, Perl CGI and R. It enables high-throughput analysis of microarray data, providing automation of data handling, and rapid creation and implementation of analysis pipelines