Showing 88 open source projects for "python web crawler"

View related business solutions
  • Gen AI apps are built with MongoDB Atlas Icon
    Gen AI apps are built with MongoDB Atlas

    Build gen AI apps with an all-in-one modern database: MongoDB Atlas

    MongoDB Atlas provides built-in vector search and a flexible document model so developers can build, scale, and run gen AI apps without stitching together multiple databases. From LLM integration to semantic search, Atlas simplifies your AI architecture—and it’s free to get started.
    Start Free
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 1
    Tyriel is an open-source search engine written in python and designed to run within a small group of sites (but potentially extensible to a greater scope).
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    A web based application that can search newsgroup names very easy. Use can search use Regular Expression for names and search by popularity.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    JeeZez is a distributed information mangement/publishing framework. Currently the focus is to develop a module for software-management, but more modules will follow.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    Frosttie (FROnt-end SchemaTron Text Internet Engine) takes XHTML pages and processes them with various user-definable filters such a W3C's WAI, Section 508 (US) web usability compliance, ad removal, etc. It can be used with zKnowMan.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Simple, Secure Domain Registration Icon
    Simple, Secure Domain Registration

    Get your domain at wholesale price. Cloudflare offers simple, secure registration with no markups, plus free DNS, CDN, and SSL integration.

    Register or renew your domain and pay only what we pay. No markups, hidden fees, or surprise add-ons. Choose from over 400 TLDs (.com, .ai, .dev). Every domain is integrated with Cloudflare's industry-leading DNS, CDN, and free SSL to make your site faster and more secure. Simple, secure, at-cost domain registration.
    Sign up for free
  • 5
    Omseek has been renamed to Xapian. Xapian is a Search Engine Library, written in C++ with bindings for Perl, Python, PHP, Java, Tcl, C# and Ruby. It allows you to easily add advanced indexing and search facilities to your applications.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    An applet for GNOME to search in the Web.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    Network-centric Graphic/Photo database program with web-based interface, automatic thumbnail generation, flexible indexing, and automatic file updates.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    Webhunter is a distributed, multi-threaded web crawler designed for both general indexing and crawling the web for focused content.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    Private project for stream of specific tags from all main social networks.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Build Securely on Azure with Proven Frameworks Icon
    Build Securely on Azure with Proven Frameworks

    Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

    Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
    Download Now
  • 10
    This is a collection of REST specifications, and implementations of those specs, for very low-level information sharing and workflow operations using REST actions over HTTP. Implementations are in various languages, mainly Java, Python, and Ruby.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    The Meme Machine generates a visual and spoken narrative among connected nodes and the world wide web, in an expanding network using open source algorithms. The computers exhibit eerie self-deterministic behaviours.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    PyEsp - Enhanced/Evolving/Extensible Semantic Profiling. This Python program will sort and filter search results by applying semantic profiling on web pages. The program will learn the user preferences and profiling will be done on the client computer.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    Work it! is a job post fetcher. It can fetch jobs posts on multiple websites, and store in a local database for later reviewing. Setup as an automated process for nightly (or daily) scanning. Then use viewer to scan at your leisure.
    Downloads: 0 This Week
    Last Update:
    See Project