Showing 214 open source projects for "web crawler source code"

View related business solutions
  • $300 Free Credits for Your Google Cloud Projects Icon
    $300 Free Credits for Your Google Cloud Projects

    Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

    Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
    Start Free Trial
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Try It Free
  • 1
    DCTemplate is a templating system for (X)HTML and JavaScript. It allows web developers to maintain dynamic chunks of XHTML as well-formed XML templates that are "compiled" at build time to high-performance JavaScript methods. Now includes Maven sup
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    FM-Classic provides an easy way to get data from Java servlets into Web pages, and helps you keep graphic design separate from application logic. FM-Classic is a continuation of the FreeMarker 1.x code base.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    The Open Web Application Security Project (OWASP) software and documentation repository.
    Downloads: 23 This Week
    Last Update:
    See Project
  • 4

    CzeroCase

    Framework for Case Management

    CZero is an Open Source Platform for Adaptive Case Management, developed to ease the creation of advanced solutions to support relations between documents, records, people, and processes, ensuring compliance with government regulations, industry standards, and internal company procedures, according to the European Digital Agenda guidelines. Czero framework, based on Java environment, integrate the most modern solutions like OSGI, CMIS, WSS, LDAP, enabling designer and developers to build,...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 5
    Aejaks combines the server-side Ajax windowing system Echo2 with the powerful simplicity of the Tcl langauge. The result is a rich development environment in which to develop Ajax-based web applications, often with much less code to write.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    Framework (scripts, configuration, code) to build free and public services around travel and leisure data. That project makes an extensive use of already existing data sources such as Geonames and dbPedia, and adds some glue around those (eg, links).
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    Constellio Enterprise Search engine

    Constellio Enterprise Search engine

    Open source Search Engine and Enterprise Search

    Constellio is an enterprise search engine that allows companies to search all their organization's information through a single interface (Web, CRM, ERP, ECM, Mail etc.). Constellio is Based on Apache Solr and Google Search Appliance's connector. Constellio has a powerful web crawler.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8

    Concretis

    Flexible platform for rapid Web site creation, without any limitations

    Concretis is flexible and powerful platform for rapid Web site creation without any limitations to preset Web site templates. Concretis comes with comprehensive administration application that allows to manage Web site content easily. Source code and documentation can be found on https://github.com/evgeniy-khist/concretis
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    JClaim
    Java Instant Message (IM) Library, Client and Tools. Flexible framework to design your own. AIM, ICQ, Yahoo, MSN, Jabber, SMS, Nate, GoogleTalk. GUI, spell checking and more. Includes a web interface for remote/cell access. Mac, Win, Linux friendly
    Downloads: 0 This Week
    Last Update:
    See Project
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Try Free
  • 10

    GWT Uploader

    GWT library that encapsulates the browser's file upload capabilities.

    GWT Uploader is a freely available open source GWT library that encapsulates the file upload capabilities provided by the File and XMLHttpRequest Level 2 APIs as well as the SWFUpload library. Using GWT Uploader allows for enhanced file upload dialogs (multiple uploads, drag and drop, queues, parallel streams, etc.) and interactive interfaces (upload progress indicators, real-time throughput display, etc.) within GWT applications using pure Java code that provides a consistent experience...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 11
    Yet another web crawler? Yes, but this ones uses the full power of regular expressions to accept or reject, examine or ignore, save or refuse pages. You also use MIME types to do all this. Powerful and flexible.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    SeerSuite
    SeerSuite is an application toolkit for digital libraries and search engines; i.e., CiteSeerX. CiteSeerX has moved to GitHub, please get the latest code from: https://github.com/SeerLabs/CiteSeerX
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    This Amazon Mechanical Turk (MTurk) SDK is no longer under active development as of TK. The latest MTurk SDKs, with support for most common programming languages, are now a part of the Amazon Web Service (AWS) SDKs at https://aws.amazon.com/tools/. With the AWS SDKs, you can also connect to MTurk using the AWS Command Line Interface (https://aws.amazon.com/cli/), allowing you to perform operations from your Windows, Mac, or Linux command line without having to write code.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    The archive-crawler project is building Heritrix: a flexible, extensible, robust, and scalable web crawler capable of fetching, archiving, and analyzing the full diversity and breadth of internet-accesible content.
    Downloads: 22 This Week
    Last Update:
    See Project
  • 15

    skysail osgimonitor

    Simple web view on OSGi runtime

    skysail osgimonitor is a set of bundles which will show you the installed bundles with their status using freemarker. Main purpose of this project right now is to serve as code for a tutorial.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    gnuPaste: a small Eclipse plugin which allows you to post your code from Eclpise to web pages like rafb.net
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    maDDR
    Code library for browser/device repository. Standard interface adhering to W3C specification. Will be available in multiple source languages for multiple platforms. Main use is context-based adaptation of content/services on mobile aware Web servers.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    A java-based JSON service for zip code location lookup and distance calculation. Implemented as a web application and related support classes. Includes a zip code dataset that should be loaded into a database.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    CheckSite is a lightweight application to test the availability of a web site. The application can check the sites through test methods like http return code, md5 of a page,.. CheckSite has a plugin system, possibility to easily develop your own test
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Mapper is a presentation framework for XML, WEB & GUI applications based on the Model-View-Controller pattern. Its event driven components & models provide an easy & consistent way to bind fields to ValueObjects or Collections for all presentation types.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    Ex-Crawler
    Ex-Crawler is divided into 3 subprojects (Crawler Daemon, distributed gui Client, (web) search engine) which together provide a flexible and powerful search engine supporting distributed computing. More informations: http://ex-crawler.sourceforge.net
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    The Ars Machina Project is a collection of packages with two general goals: to reduce the amount of code needed to implement an application and to suggest some standards to the software architecture and naming of classes and interfaces.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    A school project consisting of a crawler, a server and a searchpage.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    ItSucks
    This project is a java web spider (web crawler) with the ability to download (and resume) files. It is also highly customizable with regular expressions and download templates. All backend functionalities are also available in a separate library.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 25
    sjws
    (Yet another) Small Java Web-Server: A (Very) Small Java-Based Webserver. It allows you to publish ressources and Self-Generated Java-Pages in Object-Style (new Table("Title");).
    Downloads: 0 This Week
    Last Update:
    See Project
Auth0 Logo