Search Results for "java crawler"
Sort By:
Showing 2 open source projects for "java crawler"
View related business solutions-
Secure Your Containers with ChainguardChainguard Secure Containers — Spend less time patching vulnerabilities and more time building software that innovates. Secure, CVE-free OSS that empowers teams to build the future instead of patch the past.
-
Binary Options and Forex Trading SoftwareCapitalCore is an online broker offering Forex (CFD) and binary options trading with the highest payouts in the industry. Our platform gives you access to global currency pairs for CFD trading and fast, straightforward binary options. Enjoy quick withdrawals, competitive spreads, and advanced trading tools, all designed to help you succeed. With flexible account options and dedicated support, we’re here to help traders of all levels reach their financial goals.
-
1
crawler4j
Open source web crawler for Java
crawler4j is an open source web crawler for Java which provides a simple interface for crawling the Web. Using it, you can setup a multi-threaded web crawler in few minutes. You need to create a crawler class that extends WebCrawler. This class decides which URLs should be crawled and handles the downloaded page. shouldVisit function decides whether the given URL should be crawled or not. -
2
The Java Sitemap Parser can parse a website's Sitemap (http://www.sitemaps.org/). This is useful for web crawlers that want to discover URLs from a website that is using the Sitemap Protocol. This project has been incorporated into crawler-commons (https://github.com/crawler-commons/crawler-commons) and is no longer being maintained.
- Previous
- You're on page 1
- Next
