Search Results for "scrape" - Page 2
Sort By:
Showing 57 open source projects for "scrape"
View related business solutions-
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
PRTG Catches Network Issues Before They Cause DowntimeReactive troubleshooting usually means hearing about a problem from frustrated users, not your monitoring tool. PRTG sets threshold-based alerts across devices, servers and applications, notifying your team by email, SMS or push the moment a metric crosses a set limit. That means catching a failing disk or overloaded server before it becomes an outage and getting time back from firefighting. Start a free trial and set your first alerts today.
-
1
Rod
A Devtools driver for web automation and scraping
Rod is a high-level driver for DevTools Protocol. It's widely used for web automation and scraping. Rod can automate most things in the browser that can be done manually. Chained context design, intuitive to timeout or cancel the long-running task. Auto-wait elements to be ready. Debugging friendly, auto input tracing, remote monitoring headless browser. Thread-safe for all operations. Automatically find or download browser. High-level helpers like WaitStable, WaitRequestIdle,... -
2
MBR Bulk WP Detector
A free WP plugin that lets you check unlimited URLs
MBR Bulk WP Detector is a free WordPress plugin that lets you check unlimited URLs right from your own dashboard. No subscriptions, no URL limits, and your data stays completely private on your server. What Can You Do With It? The basics are simple: Paste a list of URLs (or upload a CSV file), click a button, and boom—you’ve got a clear breakdown of which sites are running WordPress and which aren’t. But it gets better… Turn on Deep Scan mode, and you’ll also discover what... -
3
Soketi
Just another simple, fast, and resilient open-source WebSockets server
Ever dreamed about Serverless WebSockets? Soketi can be deployed to Cloudflare Workers. All around the world, closer to your users. Same Pusher protocol. Powered by Cloudflare's Durable Objects and KV, you can achieve great speeds at edge for your users. -
4
dude uncomplicated data extraction
dude uncomplicated data extraction: A simple framework
...Please expect breaking changes. You can run your scraper from terminal/shell/command-line by supplying URLs, the output filename of your choice and the paths to your python scripts to dude scrape command. -
Earn up to 16% annual interest with Nexo.Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.
-
5
-
6
Artisan View
Manage your views in Laravel projects through artisan
This package adds a handful of view-related commands to Artisan in your Laravel project. Generate blade files that extend other views, scaffold out sections to add to those templates, and more. All from the command line we know and love. -
7
AutoScraper
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
This project is made for automatic web scraping to make scraping easy. It gets a URL or the HTML content of a web page and a list of sample data that we want to scrape from that page. This data can be text, URL or any HTML tag value of that page. It learns the scraping rules and returns similar elements. Then you can use this learned object with new URLs to get similar content or the exact same element of those new pages. -
8
Ansible Role: prometheus
Deploy Prometheus monitoring system
Ansible-Prometheus is an Ansible role for automating the deployment and configuration of Prometheus monitoring systems. -
9
ruia
Async Python framework for fast and flexible web scraping spiders
Ruia is an asynchronous web scraping micro-framework built for Python that focuses on simplicity, speed, and flexibility when creating web crawlers. Ruia is powered by Python’s asyncio library along with aiohttp, enabling developers to perform concurrent network requests efficiently and scrape data from websites with minimal overhead. Ruia follows a “write less, run faster” philosophy, emphasizing concise code and streamlined spider development. It provides a structured approach to building scraping projects through components such as data items, spiders, middleware, and plugins. Developers can define structured fields to extract information from HTML content and process responses asynchronously to improve crawling performance. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
SCVZ menza
App za prikaz jelovnika u studentskoj menzi u Varaždinu
Aplikacija napravljena u Flutter framework-u. Projekt koji sam radio u slobodno vrijeme i želim predstaviti prilikom prijave za studentsku praksu. Aplikacija komunicira s Flask serverom koji scrape-a podatke sa službene stranice menze. Server aplikaciji vraća json u kojoj se nalazi današnji jelovnik. Trenutno je server hostan na Heroku platformi. https://scvzmenza-app.herokuapp.com/danas -
11
Marathon
Deploy and manage containers (including Docker) on top of Apache Mesos
...Supply an HTTP endpoint to receive notifications, for example to integrate with an external load balancer. Query them at /metrics in JSON format, push them to systems like Graphite, StatsD and DataDog, or scrape them using Prometheus. -
12
X-RAY
The next web scraper, see through the <html> noise
...X-ray has support for concurrency, throttles, delays, timeouts and limits to help you scrape any page responsibly. Swap in different scrapers depending on your needs. Currently supports HTTP and PhantomJS driver drivers. In the future, I'd like to see a Tor driver for requesting pages through the Tor network. -
13
lazynlp
Library to scrape and clean web pages to create massive datasets
LazyNLP is a lightweight tool for collecting and curating large-scale text datasets for machine learning and NLP applications with minimal manual effort. -
14
SEO MACROSCOPE
SEO Macroscope is a website scanning tool, to check your website
...Generate and export text and XML sitemaps from the crawled pages. Analyze redirect chains. Use custom filters to verify the presence/absence of tracking tags. Use CSS Selectors, XPath Queries, and Regular Expressions to scrape website data. -
15
Prometheus Kubernetes Setup
Kubernetes Setup for Prometheus and Grafana
This repository provides a pre-configured Prometheus stack optimized for monitoring Kubernetes clusters and cloud-native applications. -
16
django-dynamic-scraper
Creating Scrapy scrapers via the Django admin interface
...Since it simplifies things DDS is not usable for all kinds of scrapers, but it is well suited for the relatively common case of regularly scraping a website with a list of updated items (e.g. news, events, etc.) and then dig into the detail page to scrape some more infos for each item. Django Dynamic Scraper tries to keep its data structure in the database as separated as possible from the models in your app, so it comes with its own Django model classes for defining scrapers, runtime information related to your scraper runs and classes. -
17
google-play-scraper
Node.js scraper to get data from Google Play
Node.js module to scrape application data from the Google Play store. Retrieves the full detail of an application. Retrieves a list of applications from one of the collections at Google Play. Retrieves a list of apps that results of searching by the given term. Returns the list of applications by the given developer name. Given a string returns up to five suggestions to complete a search query term. -
18
Simple-Scrape is a simple web-scraping library that allows for programmatic access to HTML code. No further techniques are needed and the library is very compact and thus easy to use.
-
19
Gene Name Errors Screen
Scrape and screen gene name errors in Excel files
Here we provide a suite of bash scripts that were used to identify, download and screen for gene name errors in Excel files that are published as supplementary files in academic journals as well as the NCBI GEO database. These were run on Ubuntu 14.04 LTS. -
20
chrome-extensions-examples
All Chrome Extension examples collected into one repository
...The Chrome Extensions examples did not exist as a Git repository, and browsing both the samples page and the VCViewer did not seem particularly handy. So, I decided to scrape the content into this repository for easier browsing and (possible) editing. -
21
Amazon ASIN Check
Get Price and Rating of list of ASIN numbers.
This program uses a list of Amazon Standard Identification Number to scrape the price, rating and sold by data of the product. Input is a text file and data is outputted as a CSV file. Written in C# and developed by B.J Erasmus. This project was given by HNS2014 on freelancer.com -
22
Scra.php
Scrape anything!
The ultimate customiseable YAML-ised Web Scraper for PHP -
23
Scripts (written in Java) that scrape the entire inventory of products available "in store" on walgreens.com and make it available as a spreadsheet.
-
24
Scripts (written in Java) that scrape the entire inventory of a specific walmart store (from walmart.com) and make it available as a spreadsheet.
-
25
.NET 3.5 classes that scrape the HTML from http://gatherer.wizards.com and provides a means for saving the data in different formats for offline use.
