Search Results for "scraping"
Sort By:
Showing 21 open source projects for "scraping"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Stop Cyber Threats with VM-Series Next-Gen Firewall on AzureGain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
-
1
newpipeextractor
Library for extracting streaming site data without official APIs
...It handles many low-level tasks involved in web data extraction, including parsing responses, managing platform-specific logic, and handling errors, allowing developers to focus on implementing application features rather than scraping mechanics. Each supported service is implemented through its own extractor components that conform to a common interface, enabling consistent access to data across different platforms. -
2
Web data extraction (web data mining, web scraping) tool. It leverages well proved XML and text processing techologies in order to easely extract useful data from arbitrary web pages.
-
3
Quoter
Quoter - The Console Based Stock Quote Tool
Quoter is a small command line tool to fetch stock quotes. In order to minimize HTML scraping, it retrieves quotes from IEXCloud. You can signup for free and get 500k stock quotes per month. Please check their usage agreements prior to signing up and ensure you are allowed to user their service. After getting an account, log into the dashboard and you can see your API tokens. You'll need the secret token to use this program. -
4
MyBookshelf
Read online content from customized sources
MyBookshelf is an open-source Android reading app (known in Chinese as “阅读”) that lets users configure custom content sources to read web novels and other online text, offering a flexible alternative to fixed, vendor-controlled ebook stores. Instead of depending on a single provider, it uses “source rules” that define how to search, parse, and fetch chapters from multiple third-party sites, giving users control over where and how they obtain content. The app focuses on delivering a... -
Earn up to 16% annual interest with Nexo.Put idle assets to work with competitive interest rates, borrow without selling, and trade with precision. All in one platform. Geographic restrictions, eligibility, and terms apply.
-
5
lxspider
Educational Python web scraping case collection for many sites
lxSpider is a collection of web scraping examples designed primarily for learning and experimentation with data extraction techniques. It gathers numerous crawler implementations that demonstrate how to collect data from a wide range of websites and online services. It focuses heavily on practical cases that illustrate how different platforms handle requests, authentication parameters, and anti-scraping protections. lxSpider includes examples targeting areas such as e-commerce platforms, social media services, content sites, research databases, and information portals. ... -
6
Shuttle Music Player
Shuttle Music Player
Shuttle is an open source, local music player for Android. The codebase in this repository is very old and unwieldy. The foundations were written when I was first learning java, around 10 years ago. It has become too much of a maintenance burden to try to keep up-to-date, so I've decided to archive the repository. Without open source, Shuttle wouldn't exist, and I probably wouldn't be an Android developer. One of my motivations for open sourcing this project is to 'give back'. Maybe Shuttle... -
7
jBrowserDriver
A programmable, embeddable web browser driver
jBrowserDriver is a programmable, embeddable web browser driver compatible with the Selenium WebDriver specification, implemented in pure Java and based on WebKit. -
8
This toolkit allows developpers to assemble several web applications into a single one. Pages are build using contents, resources and page templates coming from the original applications. The applications may use different technologies (Java, PHP...)
-
9
GitGet
Ever wanted to download only a part of a Git repository.
Ever wanted to download only a part of a Git repository. Just paste the URL of the repo you want to download and sit back and enjoy. This simple java application makes use of Web Scraping and downloads only those files you need, thus helping you save your precious bandwidth and space. -
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
10
Gecco
Lightweight Java web crawler framework with jQuery-style extraction
Gecco is a lightweight web crawler framework written in Java that simplifies the process of building web scraping applications. It is designed to make crawler development straightforward by allowing developers to extract page elements using jQuery-style selectors rather than complex parsing logic. It integrates several well-known Java libraries and frameworks, including tools for HTTP requests, HTML parsing, JSON processing, and application development. -
11
DSTK - DataScience ToolKit
DSTK - DataScience ToolKit for All of Us
DSTK - DataScience ToolKit is an opensource free software for statistical analysis, data visualization, text analysis, and predictive analytics. Newer version and smaller file size can be found at: https://sourceforge.net/projects/dstk3/ It is designed to be straight forward and easy to use, and familar to SPSS user. While JASP offers more statistical features, DSTK tends to be a broad solution workbench, including text analysis and predictive analytics features. Of course you may specify... -
12
Simple-Scrape is a simple web-scraping library that allows for programmatic access to HTML code. No further techniques are needed and the library is very compact and thus easy to use.
-
13
A Microsoft(tm) RDP session recorder and/or child safe browsing enforcer. Has a screen saver,keyboard logger and screen scraping ability. RautorViewer replays sessions and can do textual searches on scraped content.
-
14
ScraperEdit for XBMC
XML bindings and a GUI for creating and editing XBMC Scrapers
This program is an editor for creating XBMC Scrapers. It is similar to ScraperEditor, an other editor using ScraperXML, that runs under .Net environment. This program runs under Sun/Oracle's Java Runtime. HELP WANTED! I am looking for someone, who would help me writing documentation, like user's manual and on-line help. Also if someone want to help, translated language files are always welcome... -
15
...It adheres to the Robots Exclusion Protocol and it can be configured to operate in an anonymous way by connecting to the predominant types of web proxy servers. webStraktor extends the functionality of web crawlers, spiders or bots by integrating scraping and crawling capabilities.
-
16
Mangaligator
Download manga or extract links from popular online manga readers
Mangaligator is an OpenSource Manga Downloader. It supports the sites mangafox.com, mangareader.net, mangashare.com, mangavolume.com, goodmanga.net, manga.animea.net and mangahere.com. The URLs of the pages also are saved seperately and can be used for other purposes. -
17
A Java library that makes accessing webpages and internet content simple, including submitting forms, "clicking" links, screen scraping, and navigating structure in a Javascript-like fashion. Integrated with the Chrome javascript engine Rhino.
-
18
Aracnis is a Java based framework for building distributed web spiders. These spiders can be used to accomplish a variety of tasks, for example, screen-scraping and link integrity checking.
-
19
Switchboard is a conceptual-level interface to many web and network related functions (SOAP, REST, XML parsing, screen-scraping, FTP, network sniffing), designed for the Processing environment.
-
20
...With support for 2D,3D and nD mathematical calculations, also including Matrix, functions support and shapes. It includes a few none mathematical code, like filesearch and screen scraping.
-
21
Jice is a Java-based screen scraping and parsing utility used by developers to extract specific content from any document publicly accessible via the HTTP protocol.
- Previous
- You're on page 1
- Next
