Search Results for "linux proxy scraper" - Page 4
Sort By:
Showing 192 open source projects for "linux proxy scraper"
View related business solutions-
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
Proxy_Pool
Python crawler proxy IP pool (proxy pool)
The main function of the crawler agent IP pool project is to regularly collect free agents published on the Internet for verification and storage, and to regularly verify and store agents to ensure the availability of agents, and to provide API and CLI. At the same time, you can also expand the proxy source to increase the quality and quantity of the proxy pool IP. -
2
SirTunnel
Minimal, self-hosted, 0-config alternative to ngrok
SirTunnel is a minimal, self-hosted tunneling tool for exposing a local web server through a public HTTPS URL. It combines standard SSH remote tunnels with Caddy instead of requiring a dedicated client. A small Python script tells Caddy which public hostname should proxy to the temporary server-side tunnel port. Caddy handles reverse proxying and automatic HTTPS certificate management. Tunnel mappings are ephemeral and controlled by clients, keeping server-side state and configuration to a... -
3
Oblivion-Inverse
Open source e-mail tracker made with Flask, setup & run in 10 minutes
Oblivion-Inverse is a simple, free & open source e-mail tracking solution which based on the usage of web beacons or tracking pixels. Build with Flask and setup under 10 minutes on your own production environment. Designed to provide information about the email read status, time, IP address of the recipient's device or proxy, as well as request headers such as the user-agent, which can reveal details about the recipient's browser, operating system, and device. Generate tracking links for... -
4
TensorFlow Addons
Useful extra functionality for TensorFlow 2.x maintained by SIG-addons
TensorFlow Addons is a repository of contributions that conform to well-established API patterns but implement new functionality not available in core TensorFlow. TensorFlow natively supports a large number of operators, layers, metrics, losses, and optimizers. However, in a fast-moving field like ML, there are many interesting new developments that cannot be integrated into core TensorFlow (because their broad applicability is not yet clear, or it is mostly used by a smaller subset of the... -
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
5
NExfil
Fast OSINT tool for discovering web profiles by username
NExfil is an open source OSINT (Open Source Intelligence) tool designed to locate user profiles across the web based on a given username. Developed in Python, the tool automates the process of checking hundreds of websites to determine whether a specific username exists on those platforms. By performing automated queries across numerous services, NExfil helps investigators, researchers, and security professionals quickly identify potential accounts associated with a particular username. The... -
6
ddgr
DuckDuckGo from the terminal
ddgr is a cmdline utility to search DuckDuckGo from the terminal. While googler is highly popular among cmdline users, in many forums the need of a similar utility for privacy-aware DuckDuckGo came up. DuckDuckGo Bangs are super-cool too! So here's ddgr for you! Unlike the web interface, you can specify the number of search results you would like to see per page. It's more convenient than skimming through 30-odd search results per page. The default interface is carefully designed to use... -
7
paramspider
Mine parameterized URLs from web archives for security testing
ParamSpider is an open source command-line tool designed to discover URLs that contain parameters by mining historical data from web archives such as the Wayback Machine. It helps security researchers, penetration testers, and bug bounty hunters collect potential attack surfaces by automatically gathering archived URLs related to a specific domain. Instead of returning every discovered URL, the tool intelligently filters results to highlight parameterized endpoints that are more useful for... -
8
Originally a reimplementation of OpenGroupware's ZideStore. While compatible with legacy ZideStore Coils provides a sophisticated workflow system with ETL and integration capabilities and superior WebDAV/CalDAV features and compatibility. The workflow engine suppports processes described in BPML and provides integration with a variety of services include SSH, LPD, LDAP, and relation databases.
-
9
URS (Universal Reddit Scraper)
A comprehensive Reddit scraping command-line tool written in Python
Universal Reddit Scraper, a comprehensive Reddit scraping command-line tool written in Python. Whether you are using URS for enterprise or personal use, I am very interested in hearing about your use case and how it has helped you achieve a goal. This is a comprehensive Reddit scraping tool that integrates multiple features. All files except for those generated by the wordcloud tool are exported to JSON by default. Wordcloud files are exported to PNG by default. All exported files are saved... -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
10
AI Explainability 360
Interpretability and explainability of data and machine learning model
The AI Explainability 360 toolkit is an open-source library that supports the interpretability and explainability of datasets and machine learning models. The AI Explainability 360 Python package includes a comprehensive set of algorithms that cover different dimensions of explanations along with proxy explainability metrics. The AI Explainability 360 interactive experience provides a gentle introduction to the concepts and capabilities by walking through an example use case for different... -
11
CrossLinked
LinkedIn employee enumeration tool using search engine scraping
CrossLinked is an open source LinkedIn enumeration tool designed to collect employee names associated with a target organization. Instead of accessing LinkedIn directly or relying on its API, it performs search engine scraping using services such as Google and Bing to discover public LinkedIn profile results. By analyzing these search results, CrossLinked extracts employee names and processes them into usable formats for security assessments or reconnaissance activities. This approach allows... -
12
AWS Jupyter Proxy
Jupyter server extension to proxy requests with AWS SigV4 authentican
A Jupyter server extension to proxy requests with AWS SigV4 authentication. This server extension enables the usage of the AWS JavaScript/TypeScript SDK to write Jupyter frontend extensions without having to export AWS credentials to the browser. A single /awsproxy endpoint is added on the Jupyter server which receives incoming requests from the browser, uses the credentials on the server to add SigV4 authentication to the request, and then proxies the request to the actual AWS service... -
13
SCFProxy
A proxy tool based on cloud function
SCFProxy is a tool to implement HTTP proxy, SOCKS proxy, and reverse proxy based on cloud function and API gateway provided by several cloud service providers. -
14
scanless
Online port scan scraper
scanless is a Python command-line utility and library for running port scans through third-party online scanning services. It is built for users who want quick visibility into exposed ports without running a local scanner directly from their own machine. The tool can scan an IP address or domain, choose a specific supported scanner, select a random scanner, or run all available scanners. It supports services such as ipfingerprints, spiderip, standingtech, viewdns, and yougetsignal. scanless... -
15
ProxyPool
An Efficient ProxyPool with Getter, Tester and Server
Simple and efficient proxy pool, providing the following functions. Regularly crawl free proxy websites, easy and scalable. Use Redis to store brokers and sort broker availability. Regular testing and screening to eliminate unavailable proxies and leave available proxies. Provides a proxy API to randomly select available proxies that pass the test. The principle analysis of the proxy pool can be seen in " How to Build an Efficient Proxy Pool ". It is recommended to read it before using it.... -
16
Image Downloader
Download images from Google, Bing, Baidu
Crawl and download images using Selenium Using python3 and PyQt5. Supported Search Engine: Google, Bing, Baidu. Keywords input from the keyboard or input from line separated keywords list file for batch process. Download image using a customizable number of threads. Fully supported conditional search (eg. filetype:, site:). Switch for Google safe mode. Proxy configuration (socks, HTTP). CMD and GUI ways of using are provided. -
17
Mr.Holmes
A Complete Osint Tool
Mr.Holmes is a project focused on information gathering by public sources about social networks,phone-numbers, domains and ip and with the help of Google-Dorks it generated some useful links for information gathering. It can geolocate any ip or domain and geolocate approximately every location of almost all the companies. Including Who-is Lookup, Phone-Carriers and Proxied Requests. -
18
Instagram Scraper
Scrapes an instagram user's photos and videos
instagram-scraper is a command-line application written in Python that scrapes and downloads an instagram user's photos and videos. Use responsibly. To scrape a private user's media you must be an approved follower. Providing username and password is optional, if not supplied the scraper runs as a guest. In this case all private user's media will be unavailable. All user's stories and high-resolution profile pictures will also be unavailable. By default, downloaded media will be placed in... -
19
AutoScraper
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
This project is made for automatic web scraping to make scraping easy. It gets a URL or the HTML content of a web page and a list of sample data that we want to scrape from that page. This data can be text, URL or any HTML tag value of that page. It learns the scraping rules and returns similar elements. Then you can use this learned object with new URLs to get similar content or the exact same element of those new pages. -
20
SMSBoom
SMS bombing / SMS pressure measurement, a robust and free python
SMS bombing / SMS pressure measurement / | A robust and free python SMS bombing program, specializing in blowing up bad guys, with millions of interfaces, multi-threaded automatic addition of effective interfaces, support for millions of concurrent asynchronous coroutines, a completely free SMS bombing too! Hongkonger develops the whole network for the first time! api.jsonDefine the interface in a custom way. Support keyword replacement. Timestamp [timestamp] phone number [phone]... -
21
mlscraper
ML-based HTML scraper that learns extraction rules from examples
mlscraper is a Python library designed to automatically extract structured data from HTML pages without requiring developers to manually write CSS selectors or XPath rules. Instead of defining extraction logic by hand, users provide a few examples of the data they want to retrieve from a webpage. It analyzes those examples within the HTML document and determines patterns or rules that can be used to extract the same type of information from similar pages. Once trained, the generated scraper... -
22
GT7Proxy
Gran Turismo 7 Telemetry for Simracing
Gran Turismo 7 Telemetry proxy. Can be used to feed SimTools or any other app. -
23
pspider
Simple Python framework for building multithreaded web crawlers
PSpider is a lightweight web crawling framework written in Python designed to simplify the development of custom web spiders. It focuses on providing an easy-to-understand architecture while still supporting concurrent crawling for improved performance. It uses a multithreaded model that separates the crawling workflow into several components responsible for fetching, parsing, and saving data. Tasks are managed through queues, allowing different parts of the crawler to process work... -
24
Scylla
Intelligent proxy pool for collecting and managing public proxies
Scylla is an open source proxy pool system designed to collect, validate, and manage large numbers of public proxy servers for use in web scraping and data extraction workflows. It automatically crawls the internet to discover proxy IP addresses and evaluates their availability and reliability before adding them to a usable pool. It includes a JSON API that allows developers and applications to retrieve proxy information programmatically, making it easier to integrate proxy rotation into... -
25
V2RayCloudSpider
V2RayCloudSpider
V2RSS is an "ecological mining machine" that can perform vertical mining on global providers based on the SSPanel-Uim framework; it can generate bottom-up "aggregation collection" tasks for mainstream protocol headers; it can self-digest and Compared with proxypool , the output is purer and more reliable proxy nodes; it has powerful production features such as self-discovery and service self-healing.
