Showing 214 open source projects for "web crawler source code"

View related business solutions
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Get Started Free
  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New to Google Cloud? Get $300 in credits to explore Compute Engine, BigQuery, Cloud Run, Gemini Enterprise Agent Platform, and more.

    Start your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
    Claim $300 Free
  • 1
    JTella is the Java API for the GNUTella network. Using JTella, Java based GNUTella tools and servants can be created, with JTella providing the network interface code.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 2
    Web-as-corpus tools in Java. * Simple Crawler (and also integration with Nutch and Heritrix) * HTML cleaner to remove boiler plate code * Language recognition * Corpus builder
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    Doing online research has never been easier. You can write surveys online, run a clustering survey, and infinitely customize by adding JSP code. It can generate agile reports from JIRA and Bugzilla hours, and online diagrams.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 4
    Global Consciousness Project uses hardware "random" number generators and finds patterns between that and major world events. This Java applet will run on their webpage and translate that data to music-like audio. Or for general audio synthesizing.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Try Free
  • 5
    Java IO Extension is a open source project which extends java IO package by providing a java class library to access IO system in a local area network Developers can easily use IO Extension just like using java IO API to access a remote IO system
    Downloads: 1 This Week
    Last Update:
    See Project
  • 6
    nxs crawler is a program to crawl the internet. The program generates random ip numbers and attempts to connect to the hosts. If the host will answer, the result will be saved in a xml file. After than the crawler will disconnect... Additionally you can
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    Design-Side Includes (DSI) is a command-line utility for inserting common sections of HTML code into multiple web pages at design-time. Use DSI to reuse web content while still realizing the operational benefits of deploying static web pages.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    Translates XHTML pages for a Java Web Application. Uses Google Translate API. The code to interface with Google is a seperate module which can be used for other Java applications. An example Web Application WAR file is included to see how it works.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    The WhereIsNow Web Service Client Library project is a java library used to query the WhereIsNow webservices. You can freely embed it in your code to easily develop new clients and integrate the WhereIsNow features in your own applications.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 10
    MiniTemplator is a compact template engine for HTML files. It's available in Java, PHP and Visual Basic (VB/VBA). It uses a simple syntax for template variables and blocks, supports nested blocks and is implemented as a single code module.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    Retriever is a simple crawler packed as a Java library that allows developers to collect and manipulate documents reachable by a variety of protocols (e.g. http, smb). You'll easily crawl documents shared in a LAN, on the Web, and many other sources.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 12
    Dunbar is a location-based chat tool for mobile devices and phones as well as desktop computers. The architecture is built on web services so that clients on any operating system can be created. The service will be free to users, and the source code will
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    Expand is an Open Source tool for easily developing professional Web applications. Is based on JEE5 standard technologies, annotations and pojos. Includes rapid prototyping features and a set of frameworks and wizards to ultra-fast creation of Web apps.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    A very light web framework with a component support. No templates, XML and HTML texts are necessary. Components are assembled to a hierarchy structure similarly like a HTML code, each component can be inherited as well as be composed to a new component.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    Jolene is a toolkit which provides a DOM (Document Object Model) of HTML documents to Java. This gives developers a pure view unlike JSP, ASP, Velocity. Use plain HTML documents to generate your website and swap them out without changing server side code
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    A Java web framework, which provides an easy and effective way to separate the HTML pages and the associated Java code without using any custom document tags, source code outside class files, or custom XML metadata files. Unlimitedly extensible.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    The DeDuplicator is an add-on module (plug-in) for the web crawler Heritrix. It offers a means to reduce the amount of duplicate data collected in a series of snapshot crawls.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 18
    A self-hosted Code Generator (CG) implementing in Java, which can be served as a template generator for legacy systems, a new module generator for existing systems and a business software generator on RiaBiz architecture.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    A collection of discreet, mostly Web-related libraries, utility classes, and some AWT code (good for applets). Package xentity implements a JDBC-based administrative system for building an O/R persistence layer.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Liweb is a suite of software components and tools for web application development. It allows compiled Java code to be run in a web browser using a JVM bytecode executor implemented in Javascript. It also supports comfortable native Java debuggers.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    Simple Java AJAX Message Listener that I would classify as a template rather than a framework. Used for simple messaging between the browser and the server. All the files, including source code, are included and ready to be deployed on a J2EE App Server.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    This is a taglib for memcached, almost full compatible to oscache's taglib. If you use oscache taglibs as your cache engine, you can mostly no need modify any jsp code to change to the best cache system, memcached.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    Peruser is a open-source lightweight knowledge application framework. Peruser speaks XML and RDF and is implemented in Java. Peruser code runs within Cocoon, as a standalone webapp, as console programs invoked through ant, or as embeddable java code.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    This project is now hosted on Google Code: http://code.google.com/p/wicket-web-beans
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    wickettools-extjs is a library that integrates ExtJS, a client-side javascript library with wicket, a J2EE web framework.
    Downloads: 1 This Week
    Last Update:
    See Project
Auth0 Logo