Showing 25 open source projects for "web crawler bot"

View related business solutions
  • $300 Free Credits for Your Google Cloud Projects Icon
    $300 Free Credits for Your Google Cloud Projects

    Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

    Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
    Start Free Trial
  • Cut Data Warehouse Costs by 54% Icon
    Cut Data Warehouse Costs by 54%

    Easily migrate from Snowflake, Redshift, or Databricks with free tools.

    BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
    Try Free
  • 1
    Bot Framework Web Chat

    Bot Framework Web Chat

    A highly-customizable web-based client for Azure Bot Services

    This repository contains code for the Bot Framework Web Chat component. The Bot Framework Web Chat component is a highly-customizable web-based client for the Bot Framework V4 SDK. The Bot Framework SDK v4 enables developers to model conversation and build sophisticated bot applications. This repo is part of the Microsoft Bot Framework, a comprehensive framework for building enterprise-grade conversational AI experiences. ...
    Downloads: 14 This Week
    Last Update:
    See Project
  • 2
    WebMagic

    WebMagic

    A scalable web crawler framework for Java

    WebMagic is a scalable crawler framework. It covers the whole lifecycle of crawler, downloading, url management, content extraction and persistent. It can simplify the development of a specific crawler. WebMagic is a simple but scalable crawler framework. You can develop a crawler easily based on it. WebMagic has a simple core with high flexibility, a simple API for html extracting. It also provides annotation with POJO to customize a crawler, and no configuration is needed. Some other...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 3
    Bot Framework Emulator

    Bot Framework Emulator

    Locally test and debug chat bots built with the Bot Framework SDK

    Bot Framework Emulator is a desktop application that allows bot developers to test and debug bots, either locally or remotely. Using the Emulator, you can chat with your bot and inspect the messages that your bot sends and receives. The Emulator displays messages as they would appear in a web chat UI and logs JSON requests and responses as you exchange messages with your bot.
    Downloads: 11 This Week
    Last Update:
    See Project
  • 4
    Slack Machine

    Slack Machine

    A simple, yet powerful and extendable Slack bot

    Slack Machine is a simple, yet powerful and extendable Slack bot framework. More than just a bot, Slack Machine is a framework that helps you develop your Slack workspace into a ChatOps powerhouse. Slack Machine is built with an intuitive plugin system that lets you build bots quickly but also allows for easy code organization. A plugin can look as simple as this:
    Downloads: 9 This Week
    Last Update:
    See Project
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Try It Free
  • 5
    grammY

    grammY

    The Telegram Bot Framework

    grammY makes it easy to create Telegram bots. Both for beginners and at scale. You want grammY because it is easy to use. It is very powerful and always up to date. It has the best documentation in town. It is extremely efficient and scales up effortlessly. It has a thriving ecosystem of plugins, a friendly community chat, seamless integrations with web frameworks and databases, and so much more.
    Downloads: 7 This Week
    Last Update:
    See Project
  • 6
    Zendriver

    Zendriver

    A blazing fast, async-first, undetectable webscraping

    Zendriver is a modern Python web automation and scraping framework that leverages the Chrome DevTools Protocol to provide fast, asynchronous control over real browser instances. Unlike traditional tools that rely on Selenium or WebDriver, Zendriver communicates directly with the browser through CDP, enabling higher performance and more precise control over browser behavior.
    Downloads: 6 This Week
    Last Update:
    See Project
  • 7
    Botonic

    Botonic

    Build chatbots and conversational experiences using React

    Botonic is a full-stack Javascript framework to create chatbots and modern conversational apps that work on multiple platforms, web, mobile and messaging apps (Messenger, Whatsapp, Telegram, etc). Building modern applications on top of messaging apps like Whatsapp or Messenger is much more than creating simple text-based chatbots. Botonic is a full-stack serverless framework that combines the power of React and Tensorflow.js to create amazing experiences at the intersection of text and...
    Downloads: 6 This Week
    Last Update:
    See Project
  • 8
    tirreno

    tirreno

    Security framework for devs and product teams

    tirreno is a security framework. tirreno [tir.ˈrɛ.no] helps understand, monitor, and protect your product from threats, fraud, and abuse. While classic cybersecurity focuses on infrastructure and network perimeter, most breaches occur through compromised accounts and application logic abuse that bypasses firewalls, SIEM, WAFs, and other defenses. tirreno detects threats where they actually happen: inside your product. tirreno is a few-dependency, "low-tech" PHP/PostgreSQL application....
    Downloads: 9 This Week
    Last Update:
    See Project
  • 9
    Gerapy

    Gerapy

    Distributed Crawler Management Framework Based on Scrapy

    Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js. Someone who has worked as a crawler with Python may use Scrapy. Scrapy is indeed a very powerful crawler framework. It has high crawling efficiency and good scalability. It is basically a necessary tool for developing crawlers using Python. If you use Scrapy as a crawler, then of course we can use our own host to crawl when crawling, but when the crawl is very large, we can’t...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Host LLMs in Production With On-Demand GPUs Icon
    Host LLMs in Production With On-Demand GPUs

    NVIDIA L4 GPUs. 5-second cold starts. Scale to zero when idle.

    Deploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
    Try Free
  • 10
    ReconSpider

    ReconSpider

    Most Advanced Open Source Intelligence (OSINT) Framework

    ...Reconnaissance is a mission to obtain information by various detection methods, about the activities and resources of an enemy or potential enemy, or geographic characteristics of a particular area. A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering).
    Downloads: 6 This Week
    Last Update:
    See Project
  • 11
    CEF Python

    CEF Python

    Python bindings for the Chromium Embedded Framework (CEF)

    Python bindings for the Chromium Embedded Framework (CEF). CEF Python is an open source project founded by Czarek Tomczak in 2012 to provide Python bindings for the Chromium Embedded Framework (CEF). The Chromium project focuses mainly on Google Chrome application development while CEF focuses on facilitating embedded browser use cases in third-party applications. Lots of applications use CEF control, there are more than 100 million CEF instances installed around the world. There are...
    Downloads: 6 This Week
    Last Update:
    See Project
  • 12
    chat-bubble

    chat-bubble

    Simple chatbot UI for the Web with JSON scripting

    Simple chatbot UI for the Web with JSON scripting.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    taskt

    taskt

    Free and open-source robotic process automation (rpa)

    taskt (formerly sharpRPA) is the first truly free, easy-to-use, and open-source process automation client built on the .NET Framework in C#. taskt allows you to build and design process automation without needing to write application code. taskt allows you to automate the boring stuff and create efficienies by giving you the power to craft a digital workforce that executes and performs rule-based automation. No API? No Problem! Included is a "what you see is what you get" bot designer with...
    Downloads: 8 This Week
    Last Update:
    See Project
  • 14
    koa-isbot

    koa-isbot

    Fast Middleware detect bot crawler for Koa

    Koa detects robots. Fast Middleware detects bot crawler for Koa.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 15
    ShadowSocksShare

    ShadowSocksShare

    Python ShadowSocks framework

    This project obtains the shared ss(r) account from the ss(r) shared website crawler, redistributes the account and generates a subscription link by parsing and verifying the account connectivity. Since Google plus will be closed on April 2, 2019, almost all the available accounts crawled before come from Google plus. So if you are building your own website, please keep an eye on the updates of this project and redeploy using the latest source code.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Mojo-Webqq

    Mojo-Webqq

    Perl-based smart QQ client framework

    Mojo-Webqq is an unofficial Perl client and bot framework for the QQ messaging platform’s web endpoints, built on the Mojolicious real-time web stack. It manages login flows, session refresh, and long-polling or websocket-style message reception to deliver events into an asynchronous event loop. Plugins and hooks let developers implement auto-replies, keyword filters, logging, forwarding, and integrations with external services or databases.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    Claudia Bot Builder

    Claudia Bot Builder

    Create chat bots for Facebook Messenger, Slack, Amazon Alexa, etc.

    Claudia Bot Builder helps developers create and deploy chat-bots for various platforms in minutes to AWS Lambda. It simplifies the messaging workflows, automatically sets up the correct web hooks, and guides you through configuration steps, so that you can focus on important business problems and not have to worry about infrastructure code. This code is enough to operate bots for all supported platforms.
    Downloads: 8 This Week
    Last Update:
    See Project
  • 18
    Catberry

    Catberry

    Catberry is an isomorphic framework

    Catberry is an isomorphic framework for building universal front-end apps using components, Flux architecture and progressive rendering. Catberry builds a bundle for running the application in a browser as a Single Page Application. Cat-Components – similar to web-components but organized as directories, can be rendered on the server and published/installed as NPM packages. The entire architecture of the framework is built using the Service Locator pattern, which helps to manage module dependencies and create plugins, and Flux, for the data layer. Search crawler receives a full page from the server. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    wechat4u.js

    wechat4u.js

    JavaScript implementation of WeChat wechat web interface

    JavaScript implementation of WeChat WeChat web interface, compatible with Node and browsers, WeChat robot. Export and import necessary data to keep WeChat login bot.botData. Modify contact remarks bot.updateRemarkName(UserName, RemarkName). Modify group name bot.updateChatRoomName(ChatRoomUserName, NewName). Forward message bot.forwardMsg(msg, toUserName). Revoke message bot.revokeMsg(MsgID, toUserName). A class of methods that send a message that returns the full response data on success....
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    DotNetWikiBot Framework

    DotNetWikiBot Framework

    Make robots for MediaWiki-powered sites!

    The DotNetWikiBot Framework was developed so that it can offer a helping hand with many complicated and routine tasks of wiki site development and maintenance. DotNetWikiBot Framework is a cross-platform full-featured client API, that allows you to build programs and web robots easily to manage information on MediaWiki-powered sites. DotNetWikiBot Framework can also be used for learning C# and .NET.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 21
    ** Guys I have built a much more powerful Fully Featured CMS system at: https://github.com/MacdonaldRobinson/FlexDotnetCMS Macs CMS is a Flat File ( XML and SQLite ) based AJAX Content Management System. It focuses mainly on the Edit In Place editing concept. It comes with a built in blog with moderation support, user manager section, roles manager section, SEO / SEF URL
    Downloads: 2 This Week
    Last Update:
    See Project
  • 22
    Globsy is a PHP bot framework for the Google Talk network. Globsy can be executed from a regular browser on a PHP enabled server, connect to the Google Talk network and continue running in the background, without the browser needing to remain open.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 23
    yuik is an abstract widget library for creating GUIs. The actual frontend can be chosen at runtime which allows the program to run under Tk, as a shell program, and even as a web-application. More frontends like an irc-bot, wxWidgets, or XUL are planned.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    JIB - Java IM Bot, aimed to built a pluggable, customizable, expandable and dynamic bot framework for instant messager. With JIB user can control remote IM Bots over web based interface, configure bots to perform various tasks or custom behavior.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    WWW::BookBot is a perl bot framework to fetch web e-texts with catalog, books and chapters.
    Downloads: 1 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next