Search Results for "scraper" - Page 3
Sort By:
Showing 74 open source projects for "scraper"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
BanalProbe
OKCupid message scraper/Tumblr republisher
Automatically scrapes incoming messages from OKCupid and republishes as Tumblr photo posts. Extensible framework to support additional message sources and destinations. -
2
YarrrRSS, pronounced yar-es-es, is a scraper for The Pirate Bay which generates RSS feeds for a given category, user, or search query. It supports caching, trust filters (VIP, Trusted) and aggregates multiple pages of results into 1 feed.
-
3
Scripts (written in Java) that scrape the entire inventory of products available "in store" on walgreens.com and make it available as a spreadsheet.
-
4
Scripts (written in Java) that scrape the entire inventory of a specific walmart store (from walmart.com) and make it available as a spreadsheet.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
Windows Command Line Utility. Loops through all sub directories of specified directory, feeding each file and the size of that file into the specified CSV file.
-
6
This is an advanced web scraper with user friendly GUI which let the user define rules and web addresses to extract data from one time or periodically and a target database filed that the data should be saved in.
-
7
A .Net Library Implementation of an XML screen-scraper currently found in XBMC The intention of the library is to make integratation of XML scrapers easy, essentially converting a text file into working program logic.
-
8
This tool will fetch information from Google's Keyword Tool for a user with PHP's cURL library. Unlike most scrapers, this one integrates the captcha verification so as to thwart SPAM requests. This tool would allow analysis of the data when complete
-
9
An Excel macro to scrap citation statistics from certain websites and populate results back into the spreadsheet. Please check Release Notes.
-
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
10
A simple to set up web scraper written in Java. It uses modified regEx to quickly write complex patterns to parse data out of a website. It contains a GUI tool for testing your configuration scripts and is fully automated through the command line
-
11
-
12
Data One Broadband Statistics is a screen-scraper written using Perl to download usage statistics of BSNL's Data One (www.bsnl.co.in/service/dataone.htm) broadband service and total it. BSNL (www.bsnl.co.in) allows only IE and has no monthly total.
-
13
JSP tag library, Java Class Library, and Dot Netand Mono(C#, VB.Net, any Dot Net Language) DLL to display stock quotes, stock charts and other stock data. (Examples for VB.Net, C#, Java, JSP Tags are included)
-
14
Java program to extract postings and comments from http://www.livejournal.com (blog) into DB and view/classify/process it. LJ loader. Components to reuse: perl-like, but efficient Web pages scraper, trees analyzer, concurrent scheduler.
-
15
-
16
UltraScrape is a new automated screen scraper for DOS text-based programs. It can be used to extract information from DOS-based programs, especially databases, and dump the records to a file (without reverse-engineering the file format).
-
17
Hirudo is a Java Swing application for downloading web content. It functions as a screen-scraper, filename generator and download manager. All this and much more in an intuitive cross-platform user interface. Hirudo requires Java 1.4.
-
18
-
19
Wadsworth is a java based web scripting engine. It uses user-defined XML scripts to define its actions. It can be used as a web testing tool, or as a web scraper, or to automate any web actions you wish. It can also be invoked and controlled by another
-
20
Scrapeforge is a screen scraper daemon to gather current project information from Sourceforge hosted projects.
-
21
This project aims at developing a free open-source Scraper and Macro Interface for Web programmers, that needs no installation and will work in most of the operating systems.
-
22
-
23
dataflowkit
Golang framework for scraping data from web pages
Golang Web Scraper library for extracting data from web pages. Save results as CSV, JSON, XML -
24
Blackfire Player
Web Crawling, Web Testing, and Web Scraping application
Blackfire Player is a powerful Web Crawling, Web Testing, and Web Scraper application. It provides a nice DSL to crawl HTTP services, assert responses, and extract data from HTML/XML/JSON responses. Some Blackfire Player use cases: Crawl a website/API and check expectations -- aka Acceptance Tests; Scrape a website/API and extract values; Monitor a website; Test code with unit test integration (PHPUnit, Behat, Codeception, ...); Test code behavior from the outside thanks to the native Blackfire Profiler integration -- aka Unit Tests from the HTTP layer (tm). ...
