Search Results for "web crawler source code" - Page 5
Sort By:
Showing 188 open source projects for "web crawler source code"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Enterprise-grade ITSM, for every businessFreshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.
-
1
GitDiagram
AI tool that converts GitHub repositories into interactive diagrams
GitDiagram is an open source web application designed to help developers quickly understand the structure and architecture of GitHub repositories by automatically generating interactive diagrams. It analyzes repository metadata such as the file tree and project documentation to build a visual representation of how different components of a project relate to one another. It uses an AI-powered pipeline to interpret repository structure and transform that information into system design diagrams... -
2
Big-AGI
AI suite powered by state-of-the-art models and providing advanced AI
Big-AGI is a comprehensive, open-source AI workspace built to serve as a powerful multi-model interface for developers, researchers, and professionals who want deep control over generative AI workflows and outputs. It unifies access to multiple large language models (LLMs) and AI services through a modern web UI that emphasizes efficient interaction, flexibility, and extensibility, enabling users to conduct multi-model chats, execute code, generate images, and perform voice or text-based tasks all in one place. ... -
3
nanochat
The best ChatGPT that $100 can buy
nanochat is a from-scratch, end-to-end “mini ChatGPT” that shows the entire path from raw text to a chatty web app in one small, dependency-lean codebase. The repository stitches together every stage of the lifecycle: tokenizer training, pretraining a Transformer on a large web corpus, mid-training on dialogue and multiple-choice tasks, supervised fine-tuning, optional reinforcement learning for alignment, and finally efficient inference with caching. Its north star is approachability and... -
4
Browser MCP
Browser MCP is a Model Context Provider (MCP) server
Browser MCP is an MCP server plus browser integration that lets AI apps automate the user’s real browser instead of launching a separate automation session. By adapting a Playwright-style approach to control the running browser profile, it reuses logged-in sessions and cookies, which reduces re-authentication friction and helps avoid some bot-detection heuristics. The server exposes structured tools for navigation, element interaction, and artifact capture (DOM, screenshots, logs), all... -
Earn up to 16% annual interest with Nexo.Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.
-
5
Open SaaS
Open source SaaS boilerplate for React, NodeJS apps with Wasp stack
Open SaaS is a free and open source starter template designed to help developers quickly build and launch Software-as-a-Service applications. It is built on the Wasp full stack framework, which combines React, NodeJS, and Prisma to manage both client and server code within a unified architecture. Open SaaS provides a production-ready foundation that includes common SaaS functionality such as authentication, payments, analytics, and file uploads. -
6
Chatbox
The Ultimate AI Copilot on Your Desktop
Chatbox is a cross-platform desktop AI client designed to give you a fast, polished, and private way to work with modern language models. It runs locally on Windows, macOS, and Linux, keeping your conversations and data stored on your own device. Chatbox acts as a unified interface for popular LLMs like ChatGPT, Claude, Gemini, and local models via Ollama, making it easy to switch providers without changing tools. Built with an ergonomic UI, it’s optimized for long sessions, prompt... -
7
AI Agents Masterclass
Follow along with my AI Agents Masterclass videos
AI Agents Masterclass is an educational open-source repository designed to teach developers how to build, train, and deploy intelligent AI agents using modern tooling and workflow patterns. The project includes structured lessons, code examples, and practical exercises that cover foundational concepts like prompt engineering, chaining agents, tool usage, plan execution, evaluation, and safety considerations. -
8
Rhino
On-device Speech-to-Intent engine powered by deep learning
Rhino is Picovoice's Speech-to-Intent engine. It directly infers intent from spoken commands within a given context of interest, in real-time. The end-to-end platform for embedding private voice AI into any software in a few lines of code. Design with no limits on top of a modular platform. Create use-case-specific voice AI models in seconds. Develop voice features with a few lines of code using intuitive and cross-platform SDKs. Deliver voice AI everywhere: on-device, mobile, web browsers,... -
9
Eigent
The Open Source Cowork Desktop to Unlock Your Exceptional Productivity
Eigent is an open-source cowork desktop application designed to help you build, manage, and deploy a custom AI workforce. It enables multiple specialized AI agents to collaborate in parallel, turning complex workflows into automated, end-to-end tasks. Built on the CAMEL-AI multi-agent framework, Eigent emphasizes productivity, flexibility, and transparent system design. You can run Eigent fully locally for maximum privacy and data control, or choose a cloud-connected experience for quick... -
Try Google Cloud Risk-Free With $300 in CreditUse your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
-
10
Better Chatbot
Just a Better Chatbot. Powered by MCP Client & Workflows
Better‑chatbot is an AI chatbot framework powered by MCP protocols and workflows, allowing developers to deploy and integrate AI-powered chat systems with ease. Integrates all major LLMs: OpenAI, Anthropic, Google, xAI, Ollama, and more. MCP protocol, web search, JS/Python code execution, data visualization. Custom agents, visual workflows, artifact generation. Custom agents, visual workflows, artifact generation. Realtime voice chat with full MCP tool integration. -
11
Gradio
Create UIs for your machine learning model in Python in 3 minutes
Gradio is the fastest way to demo your machine learning model with a friendly web interface so that anyone can use it, anywhere! Gradio can be installed with pip. Creating a Gradio interface only requires adding a couple lines of code to your project. You can choose from a variety of interface types to interface your function. Gradio can be embedded in Python notebooks or presented as a webpage. A Gradio interface can automatically generate a public link you can share with colleagues that... -
12
seq2seq-couplet
Play couplet with seq2seq model
...Its purpose is not general machine translation, but a specialized text generation task in which the model produces a matching second line for a given first line in the style of traditional couplets. The repository includes the code needed to train the model, configure file paths and hyperparameters, and evaluate progress through loss and BLEU score tracking. It also supports serving the trained model through a web service, allowing users to interact with the system after training is complete. In addition to local execution, the project includes Docker files, which make it easier to package and deploy the application in a more reproducible way. ... -
13
JMusicBot
A Discord music bot that's easy to set up and run yourself
...Clean and beautiful menus. Supports many sites, including Youtube, Soundcloud, and more. Supports many online radio/streams. Supports local files. Playlist support (both web/youtube and local) This bot (and the source code here) might not be easy to edit for inexperienced programmers. The main purpose of having the source public is to show the capabilities of the libraries, to allow others to understand how the bot works, and to allow those knowledgeable about java, JDA, and Discord bot development to contribute. -
14
Qwen2-Audio
Repo of Qwen2-Audio chat & pretrained large audio language model
Qwen2-Audio is a large audio-language model by Alibaba Cloud, part of the Qwen series. It is trained to accept various audio signal inputs (including speech, sounds, etc.) and perform both voice chat and audio analysis, producing textual responses. It supports two major modes: Voice Chat (interactive voice only input) and Audio Analysis (audio + text instructions), with both base and instruction-tuned models. It is evaluated on many benchmarks (speech recognition, translation, sound... -
15
WhatsApp MCP Server
WhatsApp MCP server enabling AI access to chats and messaging
whatsapp-mcp is an open source Model Context Protocol (MCP) server that enables AI agents to interact directly with a user’s WhatsApp account through a structured interface. It acts as a bridge between WhatsApp and large language models, allowing controlled access to messages, chats, and contacts. whatsapp-mcp is composed of two main components: a Go-based bridge that connects to the WhatsApp Web API and stores data locally, and a Python-based MCP server that exposes tools for AI... -
16
Chatbot
A full-featured, hackable Next.js AI chatbot built by Vercel
The Vercel Chatbot repository provides a full-featured, production-ready template for building modern AI chat applications using Next.js and the Vercel AI SDK. It is designed to give developers a fast starting point for deploying conversational interfaces with streaming responses and scalable infrastructure. The project integrates server components, authentication, and persistent storage to support real-world usage scenarios. It supports multiple AI providers through a unified gateway,... -
17
DeepDetect
Deep Learning API and Server in C++14 support for Caffe, PyTorch
The core idea is to remove the error sources and difficulties of Deep Learning applications by providing a safe haven of commoditized practices, all available as a single core. While the Open Source Deep Learning Server is the core element, with REST API, and multi-platform support that allows training & inference everywhere, the Deep Learning Platform allows higher level management for training neural network models and using them as if they were simple code snippets. Ready for applications... -
18
ML.NET
Open source and cross-platform machine learning framework for .NET
With ML.NET, you can create custom ML models using C# or F# without having to leave the .NET ecosystem. ML.NET lets you re-use all the knowledge, skills, code, and libraries you already have as a .NET developer so that you can easily integrate machine learning into your web, mobile, desktop, games, and IoT apps. ML.NET offers Model Builder (a simple UI tool) and ML.NET CLI to make it super easy to build custom ML Models. These tools use Automated ML (AutoML), a cutting edge technology that... -
19
Jimp
An image processing library written entirely in JavaScript for Node
An image processing library for Node written entirely in JavaScript, with zero native dependencies. If you're using this library with TypeScript the method of importing slightly differs from JavaScript. Instead of using require, you must import it with ES6 default import scheme. If you're using a web bundles (webpack, rollup, parcel) you can benefit from using the module build of jimp. Using the module build will allow your bundler to understand your code better and exclude things you aren't... -
20
SWE-agent
SWE-agent takes a GitHub issue and tries to automatically fix it
SWE-agent turns LMs (e.g. GPT-4) into software engineering agents that can resolve issues in real GitHub repositories. On the SWE-bench, the SWE-agent resolves 12.47% of issues, achieving state-of-the-art performance on the full test set. We accomplish our results by designing simple LM-centric commands and feedback formats to make it easier for the LM to browse the repository, and view, edit, and execute code files. We call this an Agent-Computer Interface (ACI). -
21
Mosec
A high-performance ML model serving framework, offers dynamic batching
Mosec is a high-performance and flexible model-serving framework for building ML model-enabled backend and microservices. It bridges the gap between any machine learning models you just trained and the efficient online service API. -
22
ClawPort
Open-source AI agent command center for Claude Code agent teams
ClawPort is an open-source web-based dashboard designed to act as a centralized command center for managing and interacting with OpenClaw AI agent systems. It provides a visual interface that replaces fragmented terminal-based workflows, allowing users to monitor, control, and communicate with multiple agents from a single location. The platform is built to improve visibility into multi-agent environments, offering insights into agent activity, task execution, and system performance in real... -
23
Lagent
A lightweight framework for building LLM-based agents
Lagent is a lightweight open-source framework designed to help developers build autonomous agents powered by large language models. The framework provides tools and abstractions that allow language models to interact with external tools, execute tasks, and perform multi-step reasoning processes. Instead of using LLMs only for text generation, Lagent enables developers to transform models into agents capable of performing actions such as retrieving data, executing code, or interacting with APIs. ... -
24
VibeKit
Run Claude Code, Gemini, Codex in a clean, isolated sandbox
Vibekit is an open-source toolkit focused on rapid prototyping and building of AI-driven experiences, particularly those that integrate multimodal inputs, reactive interfaces, and context-aware behaviors. It provides a set of abstractions and utilities that let developers connect generative models to UI frameworks, sensors, event streams, and external services without having to build plumbing from scratch. Instead of treating AI models as black boxes behind simple prompts, Vibekit encourages... -
25
Modelence
Modelence is an all-in-one TypeScript platform
Modelence is an all-in-one TypeScript platform aimed at helping teams ship production web apps with far less boilerplate than a typical full-stack setup. It positions itself as a Supabase-style experience tailored toward MongoDB-centric development, bundling common backend needs like authentication, database integration, and observability into a cohesive framework. The project is built to support modern application workflows where product teams want to move quickly without stitching together...
