Showing 31 open source projects for "python web crawler"

View related business solutions
  • Go from Code to Production URL in Seconds Icon
    Go from Code to Production URL in Seconds

    Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

    Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
    Start Free
  • Train ML Models With SQL You Already Know Icon
    Train ML Models With SQL You Already Know

    BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

    Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
    Start Free
  • 1
    WebMagic

    WebMagic

    A scalable web crawler framework for Java

    WebMagic is a scalable crawler framework. It covers the whole lifecycle of crawler, downloading, url management, content extraction and persistent. It can simplify the development of a specific crawler. WebMagic is a simple but scalable crawler framework. You can develop a crawler easily based on it. WebMagic has a simple core with high flexibility, a simple API for html extracting. It also provides annotation with POJO to customize a crawler, and no configuration is needed. Some other...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 2
    Odigos

    Odigos

    Distributed tracing without code changes

    ...Odigos automatically scales OpenTelemetry collectors based on observability data volume. Manage and configure collectors via a convenient web UI. Installing Odigos takes less than 5 minutes, and requires no code changes.
    Downloads: 20 This Week
    Last Update:
    See Project
  • 3
    zfoo

    zfoo

    Extremely fast enterprise server framework, can be used in RPC

    zfoo is an extremely fast enterprise server framework designed for RPC systems, game servers, web servers, and distributed application backends. It combines asynchronous execution, actor-style design, lock-free architecture, and native GraalVM support to deliver high scalability. The framework supports single-server, microservice, cluster, and gateway deployment modes, making it adaptable to different production architectures.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 4
    Framework Benchmarks

    Framework Benchmarks

    Source for the TechEmpower Framework Benchmarks project

    ...Please feel free to ask questions here. We encourage new frameworks and contributors to ask questions. We're here to help! This project provides representative performance measures across a wide field of web application frameworks. With much help from the community, coverage is quite broad and we are happy to broaden it further with contributions. The project presently includes frameworks on many languages including Go, Python, Java, Ruby, PHP, C#, F#,Clojure, Groovy, Dart, JavaScript, Erlang, Haskell, Scala, Perl, Lua, C, and others. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Fully Managed MySQL, PostgreSQL, and SQL Server Icon
    Fully Managed MySQL, PostgreSQL, and SQL Server

    Automatic backups, patching, replication, and failover. Focus on your app, not your database.

    Cloud SQL handles your database ops end to end, so you can focus on your app.
    Start Free
  • 5
    ZK - Simply Ajax and Mobile
    ZK is an open-source Java framework for building modern web and mobile applications. It enables developers to create rich, interactive UIs using only Java — no JavaScript required. With 200+ Ajax-powered components, event-driven architecture, and support for popular technologies like Spring, Java EE, and JSP/JSF, ZK makes it simple to deliver powerful and user-friendly web applications.
    Downloads: 40 This Week
    Last Update:
    See Project
  • 6
    NanoH5 (tsl2nano)

    NanoH5 (tsl2nano)

    java bean / database driven zero code application framework

    NanoH5 (or FullRelation) is a fullstack UI implementation framework providing a model driven design (MDA). Build a complete html5 application through a given class- or database-model without coding (coding APIs are available).
    Downloads: 19 This Week
    Last Update:
    See Project
  • 7
    GUIDOLib
    The GUIDOLib provides a powerful engine for the graphic rendering of music scores, based on the Guido Music Notation format. It supports Linux, Mac OS X, Windows, Android and iOS operating systems. A Java JNI interface is available as well as a Javascript version of the library. A Web API has also been designed, allowing to deploy the engine as a Web service.
    Downloads: 12 This Week
    Last Update:
    See Project
  • 8
    SIGAR (System Information Gatherer and Reporter) is a cross-platform, cross-language library and command-line tool for accessing operating system and hardware level information in Java, Perl and .NET.
    Leader badge
    Downloads: 560 This Week
    Last Update:
    See Project
  • 9

    pgApex

    http://95.85.49.98:8081/apex/q

    Web RAD for PostgreSQL tool.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Start Free
  • 10
    dynamide
    dynamide is a dynamic web application framework for handling the presentation and business layers in a traditional web app. See http://dynamide.com
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    GEPETTO - Gene Prioritization in Java

    GEPETTO - Gene Prioritization in Java

    GEPETTO (GEne Prioritization ExTended TOol)

    GEPETTO (GEne PrioriTization ExTended TOol) is an original open-source framework, distributed under the LGPL license, for gene selection and prioritization on a desktop computer that ensures confidentiality of personal data. It takes advantage of the data integration capabilities in the SM2PH-Central Framework(KD4v,MSV3d,BIRD,..), combined with in-house developed gene prioritization methods. It currently incorporates six prioritization modules, based on gene sequence, protein-protein...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 12
    yafra

    yafra

    Apache Cayenne, Wicket, CXF, GWT, EJB examples as a framework

    Yet another (different) framework. Examples around Apache Cayenne. Using different technologies like Apache CXF Google Web Toolkit EJB Apache Wicket Eclipse RCP Java ANSI C Perl Python Bash WE MOVED TO GITHUB.COM !! All sources are now in git on github.com - search for yafra project. Thanks sf.net for the very good service in the past - but now it was time to move on!
    Downloads: 1 This Week
    Last Update:
    See Project
  • 13
    Lioness (Languages Interop Framework)
    Framework for making Windows applications that are one .exe file in AutoHotKey_L,C++,C#, VB.NET,Java,Groovy,Common Lisp,Nemerle,Ruby,Python,PHP,Lua,Tcl,Perl,Jint,S#,WSH VBScript,HTML/JavaScript/CSS,COM, PowerShell without compiling . For .NET 4.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 14
    Freejack is a MVC framework for quickly building dynamic websites using Freemarker as the template engine and Python for the controllers.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    The Virtual Commons (http://commons.asu.edu) is an open software initiative devoted to computational experiments on collective action and resource governance and funded by Arizona State University's Center for Behavior, Institutions, and the Environment (http://cbie.asu.edu). NOTE: we've moved our development to GitHub at https://github.com/virtualcommons - please look for the latest versions there.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Web-as-corpus tools in Java. * Simple Crawler (and also integration with Nutch and Heritrix) * HTML cleaner to remove boiler plate code * Language recognition * Corpus builder
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    "Yet Another Do-It-Yourself (Test) Automation Framework" specification. Use or modify one of the existing software implementations (hosted/referenced here), or implement the framework yourself. Download and read the spec for more details.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    Fressia Project is an effort to develop an Open Source general framework for Testing Automation. It's intended for users (testers) that want a simple tool which can be used just out of the box. It's does not requires any complicated configuration stuff
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    THIS PROJECT IS DEAD. For the real appcelerator project, please visit http://www.appcelerator.com
    Downloads: 1 This Week
    Last Update:
    See Project
  • 20
    A J2EE Web Dev Framework, Struts style MVC, Event Driven like JSF and Ajax-enabled Client Scripting like YUI, Fine grained event binding, access to server variables in JavaScript & Webpages, Easy integration with Struts, No custom tags & No complex API.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 21
    Photon provides very fast access to data containers (queues, maps, etc.) in shared memory - it can retrieve millions of data records per second. It also uses some RDB concepts like transactions and crash recovery. See web site for details.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 22
    Clairv is a Java framework based on Apache Lucene that adds search capability to your applications. Distributed indices over different machines are supported. A web front end will also be provided.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 23
    Design and develop Recommendation and Adaptive Prediction Engines to address eCommerce opportunities. Build a portfolio of engines by creating and porting algorithms from multiple disciplines to a usable form. Try to solve NetFlix and other challenges.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    BugEye is an XML-based unit test creation framework. Being XML-based, it can be easily translated to almost any language. The current translations are C#, Java, JavaScript, and Visual Basic. Future translations include C++, Python, Perl, and PHP.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    A drop-in framework for adding tagging (folksonomy) capabilities to existing applications
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • 2
  • Next