Showing 60 open source projects for "java crawler"

View related business solutions
  • Total Network Visibility for Network Engineers and IT Managers Icon
    Total Network Visibility for Network Engineers and IT Managers

    Network monitoring and troubleshooting is hard. TotalView makes it easy.

    This means every device on your network, and every interface on every device is automatically analyzed for performance, errors, QoS, and configuration.
    Learn More
  • RealEstateAPI Icon
    RealEstateAPI

    Most Expressive API for building Disruptive Prop-Tech.

    Smart API’s with future unicorns in mind. Unlimited property data and machine-learning out of the box. Designed for teams that want to shake up their industry.
    Learn More
  • 1
    A new Web Crawler including sophisticated searching process especialized by language !
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    a crawler to index and search the XML web
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    WebSPHINX is a web crawler (robot, spider) Java class library, originally developed by Robert Miller of Carnegie Mellon University. Multithreaded, tollerant HTML parsing, URL filtering and page classification, pattern matching, mirroring, and more.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    Content Engineering Tools including an XSLT based site rendering system, XSLT Documentation Generator, and Swing based Site Crawler. The tools may be downloaded and used seperately since there are no dependancies between them.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Signalmash: Omni-channel communications platform Icon
    Signalmash: Omni-channel communications platform

    Signalmash fuels innovation by mashing programmatic voice, messaging (SMS/MMS), elastic SIP trunking and hosted PBX into one communications platform.

    Discover Signalmash, the ultimate Communication Platform as a Service (CPaaS) solution, offering a versatile suite of communication APIs designed to cater to the evolving needs of businesses.
    Learn More
  • 5
    An application to crawl public profiles of www.myspace.com
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    This project aims to be a base for specialized image crawlers. It can download images from a specific website and can be extended to crawler any website. All the the processes are multithread. Accept filters.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7

    RedditCrawler

    Crawls reddit website to pull statistical info.

    Reddit Crawler is made to crawl a list of subreddits and get the number of online users. The project will be updated to get more statistical info
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8

    Luanium

    A Lua-based crawling scripting language and leveraging selenium

    ...I would put commands in a file or DB to use selenium to interpret the HTML and Javascript. The best would be to have a complete language with conditionals and looping. I'm a java developper and I needed that the crawler to run in a Spring-Boot application. So I decided to use a Lua interpreter in Java to build a crawling tool based on Selenium. The trick here is to add the crawling commands into the Lua interpreter.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    Spider is web crawler written in the Java.Based on an Regular expression string the spider parses the internet for web pages matching this string and stores it in an MYSQL database.
    Downloads: 0 This Week
    Last Update:
    See Project
  • User-friendly DAM and PIM in one marketing platform | Kontainer Icon
    User-friendly DAM and PIM in one marketing platform | Kontainer

    Improve ROI, save time and professionalize with Kontainer Digital Asset Management that enables brands to organize, tag, convert and distribute photos

    Improve ROI, save time and professionalize with Kontainer Digital Asset Management that enables brands to organize, tag, convert and distribute photos, videos, graphics, PDFs and templates that are easy to search and ready to share and integrate.
    Learn More
  • 10
    studiMaps is a web based application for visualization and analysis of social networks. It consists of two software components: a web-crawler for getting data and the web based application for visualization.
    Downloads: 0 This Week
    Last Update:
    See Project