Showing 121 open source projects for "python web crawler"

View related business solutions
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 1
    elFinder
    elFinder is a file manager for web similar to that you use on your computer. Written in JavaScript using jQuery UI, it just work's in any modern browser. Its creation is inspired by simplicity and convenience of Finder.app program used in Mac OS X.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 2
    Liferay Portal

    Liferay Portal

    The world's leading open source portal

    Liferay Portal is the world's leading enterprise open source portal framework, offering integrated Web publishing and content management, an enterprise service bus and service-oriented architecture, and compatibility with all major IT infrastructure. Check GitHub for our latest releases: https://github.com/liferay/liferay-portal/releases https://github.com/liferay/liferay-ide/releases
    Leader badge
    Downloads: 138 This Week
    Last Update:
    See Project
  • 3

    gdpr

    Tool to maintain gdpr data protection declaration

    Admins often maintain multiple web pages, each of which under EU-GDPR requires a privacy statement. In order to keep them coherent, up-to-date and at the same time avoiding doing the same work multiple times, this project provides a tool to automatically create the appropriate statements for each page from a single source. The project is currently available in PHP, however if anyone is willing to provide a version in Python or Perl or whatever, it is more than welcome. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4

    Ganglia

    Scalable, distributed monitoring system for high-performance computing

    Ganglia is a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids. It is based on a hierarchical design targeted at federations of clusters. Supports clusters up to 2000 nodes in size.
    Downloads: 22 This Week
    Last Update:
    See Project
  • Smart Business Texting that Generates Pipeline Icon
    Smart Business Texting that Generates Pipeline

    Create and convert pipeline at scale through industry leading SMS campaigns, automation, and conversation management.

    TextUs is the leading text messaging service provider for businesses that want to engage in real-time conversations with customers, leads, employees and candidates. Text messaging is one of the most engaging ways to communicate with customers, candidates, employees and leads. 1:1, two-way messaging encourages response and engagement. Text messages help teams get 10x the response rate over phone and email. Business text messaging has become a more viable form of communication than traditional mediums. The TextUs user experience is intentionally designed to resemble the familiar SMS inbox, allowing users to easily manage contacts, conversations, and campaigns. Work right from your desktop with the TextUs web app or use the Chrome extension alongside your ATS or CRM. Leverage the mobile app for on-the-go sending and responding.
    Learn More
  • 5
    PyLucid is a Open Source web content management system written in Python using the Django Framework. fully customizable output, expandable with plugins, i18n, L10n, Revision controled, support many database engines, WSGI conform and many more...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6

    Roxy Fileman

    Web file manager

    Free file browser for CKEditor and TinyMCE. Can be used in any web application. Ready for use with ASP .NET and PHP - all scripts are included. User unterface completely separated from the server side logic. Language independant server side scipts - can be implemented in any programming language - PHP, ASP .NET, Python etc. Latest versions is available at http://www.roxyfileman.com/download
    Downloads: 3 This Week
    Last Update:
    See Project
  • 7
    AMPPS

    AMPPS

    AMPPS is a LAMP/MAMP/WAMP stack

    AMPPS is a stack of Apache, MySQL, PHP, Perl & Python. AMPPS enables you to focus more on using applications rather than maintaining them. With AMPPS you can create a website by installing any of the 330+ Apps, customizing it, and then simply publishing it on the internet via a wide choice of hosting service providers. A complete package on your desktop, same like the server that provides many open source web applications.
    Downloads: 15 This Week
    Last Update:
    See Project
  • 8

    iFlux

    Tornado Web Based Framework

    iFlux was rebooted!!! We are developing a Tornado Web Based Framework. Still in planning phase. Check us on openhub too: https://www.openhub.net/p/iflux Used to be: PHP Framework project based on Model-View-Controller MVC Desing Patern. iFlux is a MyFuses extension that makes easy build applications with i18n, form mapping, template engine like smarty and other advanced features.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9

    sitecheck

    Modular web site spider for web developers.

    More than just a link checker, sitecheck is a website spider (also known as a crawler) which can assist with SEO by testing an entire site plus both inbound links from search engines and outbound links to other sites for the following issues: looping redirects (HTTP 301/302), broken links (HTTP 404), server errors (HTTP 500), spelling mistakes, low readability scores (using the Flesch Reading Ease test), missing/empty/duplicate meta tags, duplicate content, slow page speed, W3C validation...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Automated RMM Tools | RMM Software Icon
    Automated RMM Tools | RMM Software

    Proactively monitor, manage, and support client networks with ConnectWise Automate

    Out-of-the-box scripts. Around-the-clock monitoring. Unmatched automation capabilities. Start doing more with less and exceed service delivery expectations.
    Learn More
  • 10
    A collection of pure Python algorithms and data structures
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11

    LinkChecker

    check links in web documents or full websites

    New Homepage: http://wummel.github.io/linkchecker/ Linkchecker features: - recursive and multithreaded checking and site crawling - output in colored or normal text, HTML, SQL, CSV, XML or a sitemap graph in different formats - HTTP/1.1, HTTPS, FTP, mailto:, news:, nntp:, Telnet and local file links support - restrict link checking with regular expression filters for URLs - proxy support -...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 12

    Spondulas

    Spondulas is browser emulator designed to retrieve web pages for hunti

    Spondulas is browser emulator and parser designed to retrieve web pages for hunting malware. It supports generation of browser user agents, GET/POST requests, and SOCKS5 proxy. It can be used to parse HTML files sent via e-mail. Monitor mode allows a website to be monitored at intervals to discover changes in DNS or content over time. Autolog mode creates an investigation file that documents redirection chains. The retrieved web pages are parsed for links and reported to an output file. More...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13

    SaWALi Web Application Library

    The SaWALi is a website management tool written in Python.

    The SaWALi Web Application Library is a Python application that aims to provide a reasonably complete set of components for operating a multi-purpose website. Taking advantage of the Pylons Framework, SaWALi is fully-customisable and inherently-extensible. All of SaWALi's administrative and public interfaces can be modified to suit a website's userbase— from its document editors and server error pages down to its public-facing pages and site maps.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    tomato's Web Application Common Components -- project aimed on building commonly used components for web applications.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    TurboDiesel

    TurboDiesel

    Платформа создания Web-приложений

    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Strawberry
    Strawberry allows you to store, manage, classify and consult your preferred links. As a web application (running with Mother framework), you can access your bookmarks from everywhere if runned on a server.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    htc-py converts XML data into HTML web-pages.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    This is a Django based application for creating database backed or email forms. It features an innovative drag and drop interface for building forms, a workflow for reviewing forms, and infinite customization. As of 12/1/2013, primary development has moved to http://github.com/carsongee/formunculous
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Crawler
    Crawler is a bare-bones spider designed to quickly and effectively build an index of all files and pages on a given Web site as well as the link relationship (both incoming and outgoing) between each page. More open source at https://github.com/fcc.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    The goal of this project is to write a software which can create out of simple stylesheet the templates of common templatesystems like the ones in vbulletin, Drupal, Wordpress, Joomla, ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    The product for Plone (Archetypes based) designed for management of web presentations of conferences. It has tools for conferee registration, article insertion and reviewing, conference activities management, conference calendar, and reservation.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    ** Guys I have built a much more powerful Fully Featured CMS system at: https://github.com/MacdonaldRobinson/FlexDotnetCMS Macs CMS is a Flat File ( XML and SQLite ) based AJAX Content Management System. It focuses mainly on the Edit In Place editing concept. It comes with a built in blog with moderation support, user manager section, roles manager section, SEO / SEF URL
    Downloads: 2 This Week
    Last Update:
    See Project
  • 23
    WebInspector is a websites watcher, a python console program that periodically checks a list of websites for changes and updates. If such an update is detected, selected by the user program (or programs) is executed. By default it's a web browser.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    jSEO -- Pluggable SEO (Search Engine Optimization) for dynamic JEE web applications
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    Sphene Community Tools is a collection of django applications which are designed to be easily pluggable into any django project. It currently consists of a full featured board and wiki application.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • 2
  • 3
  • 4
  • 5
  • Next