Showing 13 open source projects for "web crawler bot"

View related business solutions
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Get Started Free
  • 1
    WebEmailsExtractor

    WebEmailsExtractor

    WebEmailsExtractor - get emails and phones from websites to list

    WebEmailsExtractor is a powerful desktop application designed for marketers, sales teams, recruiters, and researchers who need to build targeted contact lists quickly and effectively. Simply input your starting URLs, and let our intelligent crawler do the rest. Unlimited Crawl Depth + Unlimited Concurrent URLs + Keyword Filter + A lot more in Pro Version.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 2
    SPM - Monitoring  system

    SPM - Monitoring system

    Monitoring Tool for your IT Environment

    ...With SPM Monitoring Systems, you can monitor your network, servers, applications, and services with ease, and receive timely alerts when issues arise. Host Availability Monitoring. Agent-Based Monitoring: CPU,RAM,Storage,Network,EventLogs etc. SNMP Monitoring. Web Site Monitoring. Notification System: E-Mail, SMS, Push, Telegram Bot (also control via telegram bot) and Sound Notifications. Logging. Web Console. Control by Telegram Bot. Agents for Windows and Linux. SPM Monitoring Systems is a reliable and efficient solution for monitoring your IT environment. With its comprehensive features and flexible notification system, you can stay on top of your infrastructure's health and performance.
    Downloads: 8 This Week
    Last Update:
    See Project
  • 3
     Abdal Web Traffic Generator

    Abdal Web Traffic Generator

    create useful statistics and traffic on your site

    This tool will have the ability to create useful statistics and traffic on your site and actually help rank your statistics on sites like Alexa and so on.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 4
    Abot

    Abot

    Fast and flexible C# framework for building customizable web crawlers

    Abot is an open source C# web crawler framework designed to help developers efficiently crawl and process web content. It focuses on speed, flexibility, and extensibility while handling the complex low-level tasks involved in web crawling. It manages essential components such as multithreading, HTTP requests, scheduling, and link parsing so developers can focus on processing the collected data.
    Downloads: 2 This Week
    Last Update:
    See Project
  • Cut Data Warehouse Costs by 54% Icon
    Cut Data Warehouse Costs by 54%

    Easily migrate from Snowflake, Redshift, or Databricks with free tools.

    BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
    Try Free
  • 5
    OpenWebSpider
    OpenWebSpider is an Open Source multi-threaded Web Spider (robot, crawler) and search engine with a lot of interesting features!
    Downloads: 6 This Week
    Last Update:
    See Project
  • 6
    DotNetWikiBot Framework

    DotNetWikiBot Framework

    Make robots for MediaWiki-powered sites!

    The DotNetWikiBot Framework was developed so that it can offer a helping hand with many complicated and routine tasks of wiki site development and maintenance. DotNetWikiBot Framework is a cross-platform full-featured client API, that allows you to build programs and web robots easily to manage information on MediaWiki-powered sites. DotNetWikiBot Framework can also be used for learning C# and .NET.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 7

    WordList Generator

    Generate wordlists using different methods

    WordList Generator is used to generate word lists. Methods: -Web Crawler -Search Engine Crawler -Random -Brute Force
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    arachnode.net is an open source Web crawler for downloading, indexing and storing Internet content including e-mail addresses, files, hyperlinks, images, and Web pages and is written in C# using SQL Server 2008. See http://arachnode.net for the LATEST.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    ZeroSearch World Wide Web it's a crawler that found and download all file in site we insert to start the search. See all image, video and other to your preferite site or create your personal internet database to found news or information.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Go from Code to Production URL in Seconds Icon
    Go from Code to Production URL in Seconds

    Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

    Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
    Try it free
  • 10
    A C# coded web crawler that analyzes pagerank, total links, no follow links, and make a ranking for their best-positioned pages in Google
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    A toolkit for crawling information from web pages by combining different kinds of "actions". Actions are simple operations such as navigation to a specified url or extraction of text from the html. Also available is a graphic user interface.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    Lan-Crawler is a crawler and indexer of public network files shared via SMB shares (Windows shares and UNIX systems running Samba). Meta data is downloaded for films and music. A dynamic Web UI is provided for searching files.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    Crawler.NET is a component-based distributed framework for web traversal intended for the .NET platform. It comprises of loosely coupled units each realizing a specific web crawler task. The main design goals are efficiency and flexibility.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next