Showing 137 open source projects for "web crawler source code"

View related business solutions
  • Keep company data safe with Chrome Enterprise Icon
    Keep company data safe with Chrome Enterprise

    Protect your business with AI policies and data loss prevention in the browser

    Make AI work your way with Chrome Enterprise. Block unapproved sites and set custom data controls that align with your company's policies.
    Download Chrome
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 1
    WebMagic

    WebMagic

    A scalable web crawler framework for Java

    WebMagic is a scalable crawler framework. It covers the whole lifecycle of crawler, downloading, url management, content extraction and persistent. It can simplify the development of a specific crawler. WebMagic is a simple but scalable crawler framework. You can develop a crawler easily based on it. WebMagic has a simple core with high flexibility, a simple API for html extracting. It also provides annotation with POJO to customize a crawler, and no configuration is needed. Some other...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    The Apache Struts web framework

    The Apache Struts web framework

    Mirror of Apache Struts

    The Apache Struts web framework is a free open-source solution for creating Java web applications. Web applications differ from conventional websites in that web applications can create a dynamic response. Many websites deliver only static pages. A web application can interact with databases and business logic engines to customize a response. Web applications based on JavaServer Pages sometimes commingle database code, page design code, and control flow code. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    Odigos

    Odigos

    Distributed tracing without code changes

    ...Manage and configure collectors via a convenient web UI. Installing Odigos takes less than 5 minutes, and requires no code changes.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 4
    Takes

    Takes

    True object-oriented Java web framework without NULLs

    Takes is a true object-oriented and immutable Java8 web development framework. Pay attention that UTF-8 encoding is set on the command line. The entire framework relies on your default Java encoding, which is not necessarily UTF-8 by default. To be sure, always set it on the command line with file.encoding Java argument. We decided not to hard-code "UTF-8" in our code mostly because this would be against the entire idea of Java localization, according to which a user always should have a...
    Downloads: 2 This Week
    Last Update:
    See Project
  • DAT Freight and Analytics - DAT Icon
    DAT Freight and Analytics - DAT

    DAT Freight and Analytics operates DAT One truckload freight marketplace

    DAT Freight & Analytics operates DAT One, North America’s largest truckload freight marketplace; DAT iQ, the industry’s leading freight data analytics service; and Trucker Tools, the leader in load visibility. Shippers, transportation brokers, carriers, news organizations, and industry analysts rely on DAT for market trends and data insights, informed by nearly 700,000 daily load posts and a database exceeding $1 trillion in freight market transactions. Founded in 1978, DAT is a business unit of Roper Technologies (Nasdaq: ROP), a constituent of the Nasdaq 100, S&P 500, and Fortune 1000. Headquartered in Beaverton, Ore., DAT continues to set the standard for innovation in the trucking and logistics industry.
    Learn More
  • 5
    Codename One

    Codename One

    Cross-platform framework for building truly native mobile apps

    An open-source mobile-first toolkit for building high-quality, cross-platform native apps for Android, iOS, Desktop & Web. Rapid cross-platform app development using Java or Kotlin with 100% code reuse. Apps are compiled down to native code for maximum performance and a smooth user experience. Write, debug, and test apps all inside your IDE (IntelliJ, Eclipse, VSCode or NetBeans) using the Codename One simulator.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 6
    Serverless Java container

    Serverless Java container

    A Java wrapper to run Spring, Spring Boot, Jersey, and other apps

    The AWS Serverless Java Container library is a framework that allows developers to run existing or new Java web applications—built with frameworks such as Spring, Jersey, Spark, Struts—inside AWS Lambda with minimal modifications. It bridges the gap between traditional servlet or web-framework models and serverless functions by mapping HTTP events from API Gateway into requests your framework understands and routing responses back appropriately. This means you can keep much of your familiar...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    Sakura Boot

    Sakura Boot

    Framework on top of spring-boot that helps create back-ends

    This framework, built on top of Spring Boot, is designed to speed up the development of robust backends. It ensures adherence to best practices while allowing a high degree of customization. The framework is structured using a modular architecture, making it easy to add or remove features based on the project’s specific needs. While Spring Boot speeds up the development process, developers still require extensive knowledge, must ensure adherence to best practices, and often write repetitive...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8

    OpenXava

    Automatic frontend engine for Java

    Automatic frontend engine for Java. Write just the domain classes in plain Java. Get a web application ready for production.
    Leader badge
    Downloads: 27 This Week
    Last Update:
    See Project
  • 9
    NanoH5 (tsl2nano)

    NanoH5 (tsl2nano)

    java bean / database driven zero code application framework

    NanoH5 (or FullRelation) is a fullstack UI implementation framework providing a model driven design (MDA). Build a complete html5 application through a given class- or database-model without coding (coding APIs are available).
    Leader badge
    Downloads: 252 This Week
    Last Update:
    See Project
  • Free and Open Source HR Software Icon
    Free and Open Source HR Software

    OrangeHRM provides a world-class HRIS experience and offers everything you and your team need to be that HR hero you know that you are.

    Give your HR team the tools they need to streamline administrative tasks, support employees, and make informed decisions with the OrangeHRM free and open source HR software.
    Learn More
  • 10
    Brill Software

    Brill Software

    A faster way to develop React Web Applications

    The Brill Framework allows React web applications to be built quickly using a "Low Code" approach. A Content Management System (CMS) supports editing of pages containing React components. The React components communicate with each other and the Server using a middleware that's based on WebSockets. With a "No Code" solution, there's always something you require that's not support. You spend ages bending the product to your requirements or pay the supplier to provide the components...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    Stripes
    Stripes is a Java web framework with the goal of making Servlet/JSP based web development in Java as easy, intuitive and straight-forward as possible. Stripes has always been guided by the following principles: * Convention over configuration (CoC) * Extremely lightweight with very few external dependencies. * Quick, iterative code/deploy/test experience for developers. * Application stack agnostic. Developers can integrate Stripes into their existing application stacks. * Do a few...
    Leader badge
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12

    flavour

    A Pure Java Single-Page App Framework

    Make fast, lightweight, native, single-page web apps that run in modern browsers while coding entirely in Java. * Website: https://flavour.sourceforge.io * Mastodon: https://mastodon.social/@FlavourJava * Podcast: https://castini.frequal.com/cast/show/Flavourcast/f7e171e8-22de-4f3b-adbb-5462991343c5 * Source Code: https://sourceforge.net/p/flavour/trunk/HEAD/tree/ * Introductory article in java Magazine: https://blogs.oracle.com/content/published/api/v1.1/assets/CONT8F9404EB36BE4DBFB2A9E220E42ACCD7/native?...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    JVx - Enterprise Application Framework

    JVx - Enterprise Application Framework

    Java Application Framework

    Develop professional database applications, highly performant with little source code. JVx is a full-stack application framework to create multi tier applications with Single Sourcing for different technologies (Swing, vaadin, react, ...). Nightly builds are available: https://dev.sibvisions.com/jvx.nightly/ Maven snapshots are available: https://oss.sonatype.org/content/repositories/snapshots Eclipse plugin is available: http://marketplace.eclipse.org/search/site/eplug
    Leader badge
    Downloads: 9 This Week
    Last Update:
    See Project
  • 14
    Spring Boot Examples

    Spring Boot Examples

    Spring Boot tutorials, technology stack example code

    spring-boot-examples is a collection of small, runnable projects that teach Spring Boot “by example,” emphasizing minimal dependencies and practical, copy-pasteable patterns. The repository provides multiple standalone demos (e.g., web, scheduling, persistence, messaging, caching, Docker) to help beginners quickly grasp common components and idioms. The author notes that all examples have been updated to Spring Boot 3.0, with earlier 1.x and 2.x code paths kept accessible for reference. Each...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 15
    SpringBoot Labs

    SpringBoot Labs

    A repository covering six columns

    SpringBoot-Labs is a comprehensive learning and reference repository created by yudaocode that explores advanced concepts, features, and best practices in Spring Boot development. The project provides an extensive collection of example modules, each demonstrating a specific framework integration or architectural pattern within the Spring ecosystem. Topics include web development, microservices, security, messaging, distributed systems, DevOps deployment, and cloud-native application design....
    Downloads: 5 This Week
    Last Update:
    See Project
  • 16
    Carina Framework

    Carina Framework

    Java-based test automation framework (Maven + TestNG)

    Carina is a Java-based test automation framework that unites all testing layers: Mobile applications (web, native, hybrid), WEB applications, REST Services, Databases. The Carina framework is built on top of the most popular open-source solutions like Selenium, Appium, TestNG allowing to reduce dependence on the specific technology stack. Carina is fully integrated into Zebrunner (https://zebrunner.com/) which is now responsible for all the development and release cycles, as well as...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    SpringAll

    SpringAll

    Step by step, learn Spring Boot, Spring Boot & Shiro, Spring Batch

    SpringAll is a comprehensive learning project that gathers a wide range of Spring, Spring Boot, and Spring Cloud demos in one repository. It is designed for developers who want to deepen their understanding of the Spring ecosystem by exploring concrete, runnable code samples. Each module focuses on a specific technology or integration—covering web applications, ORM frameworks, microservices, caching, messaging, security, distributed systems, and monitoring. The repository emphasizes both...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 18
    CloudTest-Cloud java unit test framework

    CloudTest-Cloud java unit test framework

    A redefined framework with new approach and methodology for unit test

    CloudTest is a redefined unit testing approach and methodology, which can make your testing jobs become much more easy and efficient. It is a pure java lightweight framework integrated test cases management, test data management, assert management, automation regression, performance monitor and test report in one.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Roth

    Roth

    Roth is a full-stack enterprise application development framework.

    Roth is a full-stack framework for enterprise web application development in Java. Though it can be characterized as an M.V.C. framework, a more accurate description would be a M.U.S.I.C. framework (Model Utility Servlet Interface Client). The Model and Utility components provide a simple persistence-like interface to database back-ends, without the complexity or overhead of JPA or Hibernate. The servlet component provides a simple and easy way to generate concise controller code with...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Asterion for JSF
    Rapid JSF web development with single backing bean per page and straightforward clean navigation. March 20, 2015: Version 2.0.2 released tested on Tomcat, JBoss, and Weblogic. Simple Tomcat example code included to be built with Ant. Asterion for JSF is a library for JSF web applications that provides the execution of managed-bean's methods when each page is being entered, displayed and left. The methods navigateIn(), preRender() and navigateOut() are automatically executed.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 21
    Cicada

    Cicada

    Fast lightweight HTTP service framework

    Fast, lightweight Web framework based on Netty; without too much dependency, and the core jar package is only 30KB. Configuration files can also be read in multiple environments, just add VM parameters, also ensure that the parameter name and file name are consistent.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Moqui Ecosystem
    The Moqui Ecosystem is a series of open source components for enterprise applications all built on a common framework (Moqui Framework) written in Java and Groovy. The components include tools that plug in to the framework, business artifacts, and applications. Some of the popular tool plug ins include ElasticSearch, Apache FOP, Apache Camel, OrientDB, and Hazelcast. The business artifacts later includes a universal data model (mantle-udm), service library (mantle-usl), reusable...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    Qwicap is a Java web application development API that discards the traditional hit-run-exit CGI model, provides rich state, and a powerful XML "templating" engine to avoid mixing code and content. It builds on Servlet, XHTML and CSS technologies.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    A thin layer of Java code over Sun's Java code to make life easier for developers. Most of the classes are utility classes for example to support checking of method parameters, String methods, Mathematical methods et cetera.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    JPPF

    JPPF

    The open source grid computing solution

    JPPF makes it easy to parallelize computationally intensive tasks and execute them on a Grid.
    Downloads: 23 This Week
    Last Update:
    See Project