Search Results for "linux proxy scraper"
Sort By:
Showing 43 open source projects for "linux proxy scraper"
View related business solutions-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
Stop Cyber Threats with VM-Series Next-Gen Firewall on AzureGain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
-
1
Linkedin Scraper
A library that scrapes Linkedin for user data
Linkedin Scraper is a library that scrapes Linkedin for user data. Version 2.0.0 and before is called linkedin_user_scraper and can be installed via pip3 install --user linkedin_user_scraper. The reason is that LinkedIn has recently blocked people from viewing certain profiles without having previously signed in. So by setting scrape=False, it doesn't automatically scrape the profile, but Chrome will open the linkedin page anyways. You can login and logout, and the cookie will stay in the... -
2
http-proxy-middleware
Http-proxy middleware for connect, express and browser-sync
Node.js proxying made simple. Configure proxy middleware with ease for connect, express, browser-sync and many more. All http-proxy options can be used, along with some extra http-proxy-middleware options. Determine which requests should be proxied to the target host. Target host to proxy to. (protocol + host). Providing an alternative way to decide which requests should be proxied; In case you are not able to use the server's path parameter to mount the proxy or when you need more... -
3
FlareSolverr
Proxy server to bypass Cloudflare protection
FlareSolverr is a proxy server to bypass Cloudflare and DDoS-GUARD protection. FlareSolverr starts a proxy server, and it waits for user requests in an idle state using few resources. When some request arrives, it uses puppeteer with the stealth plugin to create a headless browser (Firefox). It opens the URL with user parameters and waits until the Cloudflare challenge is solved (or timeout). The HTML code and the cookies are sent back to the user, and those cookies can be used to bypass... -
4
geckodriver
WebDriver for Firefox
geckodriver is an implementation of WebDriver, and WebDriver can be used for widely different purposes. How you invoke geckodriver largely depends on your use case. If you are using geckodriver through Selenium, you must ensure that you have version 3.11 or greater. Because geckodriver implements the W3C WebDriver standard and not the same Selenium wire protocol older drivers are using, you may experience incompatibilities and migration problems when making the switch from FirefoxDriver to... -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
5
POI POI POI
Scalable KanColle browser and tool
poi is a scalable browser and tool set for Kantai Collection(KanColle). Key features include proxy,HTTP, Socks5 and PAC (Experimental). Cache, including custom cache. Data synthesis and analysis. Notification and plugin support for extensive functionalities. -
6
camofox-browser
Headless browser automation server for AI agents to visit sites
camofox-browser is a headless browser automation server built specifically for AI agents that need to interact with websites that often block standard automation stacks. It wraps Camoufox, a Firefox fork that performs fingerprint spoofing at the C++ level, which means many browser characteristics are altered before page scripts can inspect them, rather than relying on JavaScript-layer stealth patches. The project is designed around a REST API, making it easier for agents and external tools... -
7
Ulixee Hero
The web browser built for scraping
It's the first modern headless browsers designed specifically for scraping instead of just automated testing. Hero provides access to the W3C DOM specification without the need for Puppeteer's complicated evaluate callbacks and multi-context switching. We've recreated a fully compliant DOM directly in NodeJS allowing you bypass the headaches of previous scraper tools. The powerful Chrome engine sits under the hood, allowing for lightning fast rendering. Emulators make it easy to disguise... -
8
crawlee
A web scraping and browser automation library for Node.js
Crawlee is a web scraping and browser automation library. It helps you build reliable crawlers. Fast. Crawlee won't fix broken selectors for you (yet), but it helps you build and maintain your crawlers faster. When a website adds JavaScript rendering, you don't have to rewrite everything, only switch to one of the browser crawlers. When you later find a great API to speed up your crawls, flip the switch back. It keeps your proxies healthy by rotating them smartly with good fingerprints that... -
9
bee-host
Firefox/Chrome proxy app for an external editor
A native messaging host application for Browser's Exernal Editor extension (https://github.com/rosmanov/chrome-bee) -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
Goutte
Goutte, a simple PHP Web Scraper
Goutte is a screen scraping and web crawling library for PHP. Goutte provides a nice API to crawl websites and extract data from the HTML/XML responses. Goutte depends on PHP 7.1+. Add fabpot/goutte as a require dependency in your composer.json file. Create a Goutte Client instance (which extends Symfony\Component\BrowserKit\HttpBrowser). Make requests with the request() method. The method returns a Crawler object (Symfony\Component\DomCrawler\Crawler). To use your own HTTP settings, you may... -
11
generator-ngx-rocket
Extensible Angular 13+ enterprise-grade project generator
Extensible Angular 5+ enterprise-grade project generator based on angular-cli with best practices from the community. Bootstrap, Angular Material or even Ionic are available, just pick one and start to code. Save time and maintenance effort by creating Progressive Web App and mobile app with the same code base. The app template is based on HTML5, TypeScript and Sass. Optimized build and bundling process with Webpack. Development server with backend proxy and live reload. Cross-browser CSS... -
12
Browser Pool
A Node.js library to easily manage and rotate a pool of web browsers
Browser Pool is a small, but powerful and extensible library, that allows you to seamlessly control multiple headless browsers at the same time with only a little configuration, and a single function call. Currently it supports Puppeteer, Playwright and it can be easily extended with plugins. We created Browser Pool because we regularly needed to execute tasks concurrently in many headless browsers and their pages, but we did not want to worry about launching browsers, closing browsers,... -
13
SecretAgent
The web scraper that's nearly impossible to block
SecretAgent is a headless browser that’s nearly impossible to detect. It achieves this by emulating real users. And it has powerful auto-replay functionality that lets you create and debug scripts in record setting time. -
14
Tamper Dev
Extension that allows you to intercept and edit HTTP/HTTPS requests
If you are a developer, you can use Tamper Dev to debug your websites, or if you are a pentester, you can use it to search for security vulnerabilities by inspecting the HTTP traffic from your browser. Unlike most other extensions, Tamper Dev allows you to intercept, inspect and modify the requests before they are sent to the server. This extension provides functionality similar to Burp Proxy, MITM Proxy, OWASP ZAP, Tamper Data, and Postman Proxy, but without the need of additional software,... -
15
googler
Google Search, Google Site Search, Google News from the terminal
googler is a power tool to Google (Web & News) and Google Site Search from the command-line. It shows the title, URL and abstract for each result, which can be directly opened in a browser from the terminal. Results are fetched in pages (with page navigation). Supports sequential searches in a single googler instance. googler was initially written to cater to headless servers without X. You can integrate it with a text-based browser. However, it has grown into a very handy and flexible... -
16
ASProxyWing is a handy, easy to use client / server desktop distributed proxy, which works as a HTTP-tunnel for clients. Provides high secure, easy to integrate proxy servers.
-
17
CyberDragon Browser
CyberDragon Browser - privacy enhanced, portable browser
CyberDragon has: - Tracker blocker. It will block over 6000 various trackers from following your daily surfing habits. Also optional tracker blocker file that list over 30 000 trackers is provided. - Very strict, zero-tolerance cookie control. By default, only session cookies that have Secure and HttpOnly cookie attributes set are allowed. Also, all 3rd party cookies are blocked by default. These settings can be overrided by site, either blocking or allowing specific cookies, allowing... -
18
In many times we want to help our friends and family, they are under some kind of censorship or blocked by firewall, they just want to get some true news.
-
19
webStraktor is a programmable World Wide Web data extraction client. Its purpose is to scrape HTML based content via the HTTP protocol and extract relevant information. webStraktor features a scripting language to facilitate the collection, the extraction and the storage of information available on the web, including images. The scripting language uses elements of the Regular Expression and xPath syntax. The webStraktor scripting language has a small instruction set and its syntax is easy...
-
20
Zeromus Browser
Zeromus Browser is free, simple and lightweight.
Zeromus Browser is a simple browser whose feature list includes things like "History", "Bookmarks" and "zLink", that is a page to see the most visited hosts. It is small, less then 10,000 lines of code and very fast. The SpringSun 2.0.0 update includes a new homepage, a new zLink page, new keyboard shortcuts, a new button to the download manager, a streamlined interface, and a major modification of the search engines. The SpringSun 2.1.0 update use Qt 4.8.3 for more stability. The... -
21
BlueLightCat
A web browser free, simple and clear.
BlueLightCat is a simple browser whose feature list includes things like "History", "Bookmarks" and "QuickView", that is a page to see the most visited hosts. It is small, less then 10,000 lines of code and very fast. Note: BlueLightCat is a fork of Zeromus Browser. -
22
WebX
A internet browser using a unique interface.
A browser that is more compliant than IE 10, with a sophisticated docking tool that increases productivity (Or procrastination). -
23
MM3-ProxySwitch - Firefox WebExtension
MM3-ProxySwitch - Firefox & Chrome - Extension (Add-ons)
In Browser Chrome by Google or Firefox and Thunderbird by Mozilla you can per default configure only the setting for one internet connection. With the MM3- Proxy Switch you can manage different configurations and simply switch over between these. -
24
Atomschlag
A lightweight Webkit browser written entirely in Python
Atomschlag is a project of writing a Webkit-based browser using PyGTK and PyWebkitGTK, completely in Python, to create a useable, secure and lightweight replacement of existing browsers in custom appliances. The primary project goals are: - small size; - minimal abilities to track you down based on the client info; - maximal compatibility with proxy-based anonymity layers such as I2P; - URL filtering for blocking ads and user tracking services; - simple and non-overloaded user interface. -
25
zBrowser NightSky
zBrowser-NightSky is a fast browser imagined to you
Zeromus Web Browser (called zBrowser) is a simple browser whose feature list includes things like "History", "Bookmarks" and "zLink", that is a page to see the most visited hosts. It is small, less then 10,000 lines of code and very fast. The 1.0.0 update of NightSky includes a new homepage, a new zLink page, new keyboard shortcuts, a streamlined interface, and a major modification of the search engines. The 1.1.0 update included the removal of the editor page and activation of...
