Search Results for "cli tools"

...Its powerful spider system supports multi-session crawling, pause and resume functionality, and real-time streaming of scraped data. Scrapling combines high performance, memory efficiency, and extensive async support to deliver blazing-fast scraping workflows. With a developer-friendly API, CLI tools, MCP server integration for AI-assisted extraction, and Docker support, it offers a complete solution for modern web scrapers.

Goose AEO is an AI agent orchestration framework focused on automating engineering operations and workflows through autonomous agents. It builds on the concept of local AI agents that can execute complex tasks such as writing code, debugging, managing pipelines, and interacting with APIs without continuous human supervision. The system is designed to be extensible and adaptable, allowing developers to integrate different language models and configure multi-agent workflows tailored to...

Katana is an open source command-line web crawling and spidering framework developed by ProjectDiscovery. It is designed to efficiently crawl websites and web applications in order to discover endpoints, resources, and other useful information that may not be easily visible through manual browsing. Katana focuses on speed and automation, making it suitable for use in security reconnaissance workflows and automated pipelines. Katana supports both standard HTTP crawling and headless browser...

Browserless is an open-source headless browser automation library and service built on top of Puppeteer that simplifies the process of running and scaling Chromium-based browser tasks in production environments. It provides a high-level API for interacting with headless Chrome, allowing developers to perform operations such as generating PDFs, capturing screenshots, extracting text or HTML, and automating web navigation. The project is designed to act as a production-ready abstraction layer...

...It surfaces details such as your IP address, protocol versions, cipher suites, SNI, and other attributes that are otherwise tedious to confirm across layers. The tool emphasizes clarity and minimalism, helping engineers quickly verify configuration changes in browsers, proxies, VPNs, or CLI tools. It is especially helpful when validating modern TLS features like ALPN, HTTP versions, and certificate behavior under different client stacks. Because the output is human-friendly, it doubles as an educational resource for understanding how transport and application-layer negotiations actually manifest. Teams use it to troubleshoot misconfigurations and confirm policy enforcement without setting up their own inspection endpoints.

go-dork is an open source command-line tool designed to automate search engine dorking and reconnaissance tasks. Written in the Go programming language, it focuses on speed and efficiency when executing advanced search queries across multiple search engines. It allows users to run specialized queries, often referred to as “dorks,” to discover publicly exposed data, misconfigurations, or potentially vulnerable resources. It supports several major search engines and enables users to switch...

This Amazon Mechanical Turk (MTurk) SDK is no longer under active development as of 12/31/2017. The latest MTurk SDKs, with support for most common programming languages, are now a part of the Amazon Web Service (AWS) SDKs at https://aws.amazon.com/tools/. With the AWS SDKs, you can also connect to MTurk using the AWS Command Line Interface (https://aws.amazon.com/cli/), allowing you to perform operations from your Windows, Mac, or Linux command line without having to write code.

Since the governments of some countries are using the blocking the internet access to several websites and web service providers which includes some world famous sites like Google, YouTube, twitter, Facebook, and Wikipedia etc., we designed this tiny utility in order to help people getting through the Internet blockade. Hosts Setup Utility provides basic tools to manage the hosts file on current operating systems. It also provides both support for Graphical Desktop environment with Graphical User Interface (GUI) and CLI environment with Text-based User Interface (TUI). Users could use these tool to modify the hosts to visit specified websites or services blocked by ISP/government. Functions which help users to backup/restore hosts files are also provided. ...

This Amazon Mechanical Turk (MTurk) SDK is no longer under active development as of TK. The latest MTurk SDKs, with support for most common programming languages, are now a part of the Amazon Web Service (AWS) SDKs at https://aws.amazon.com/tools/. With the AWS SDKs, you can also connect to MTurk using the AWS Command Line Interface (https://aws.amazon.com/cli/), allowing you to perform operations from your Windows, Mac, or Linux command line without having to write code.

This Amazon Mechanical Turk (MTurk) SDK is no longer under active development as of 1/1/2018. The latest MTurk SDKs, with support for most common programming languages, are now a part of the Amazon Web Service (AWS) SDKs at https://aws.amazon.com/tools/. With the AWS SDKs, you can also connect to MTurk using the AWS Command Line Interface (https://aws.amazon.com/cli/), allowing you to perform operations from your Windows, Mac, or Linux command line without having to write code. If you need to access an archive of this code, you may find it here https://github.com/awslabs/mturk-legacy-sdks/tree/master/perl-sdk.