Search Results for "data processing"

Harper is an offline, privacy-first English grammar checker written primarily in Rust. It analyzes writing locally, avoiding the latency and data exposure associated with cloud-only services. The engine is designed to lint documents in milliseconds while using a small memory footprint. It can run through WebAssembly in browsers and applications or through native command-line and language-server components. Official integrations support editors and tools including Visual Studio Code, Neovim,...

Spider is a high-performance web crawler and web scraping library written in Rust that enables developers to crawl and index websites efficiently. It focuses on speed, concurrency, and reliability by using asynchronous and multi-threaded processing to handle large volumes of web pages. It can rapidly crawl websites to collect links, retrieve page content, and extract structured information from HTML documents. Spider can operate concurrently across many pages, allowing it to gather large datasets in a short period of time. Spider also provides mechanisms for subscribing to crawl events so developers can process page data such as URLs, status codes, or HTML content as it is discovered. ...