Search Results for "extensible web spider"
Sort By:
Showing 26 open source projects for "extensible web spider"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Atera - an All-in-one platform for IT managementYour IT essentials, integrated & elevated. Take your IT management from automated to autonomous, download Atera's agent to start your free trial!
-
1
Python-Spider
Python3 web crawler practice
...As part of the author’s public learning-path repositories, python-spider likely includes examples of HTTP requests, HTML parsing, maybe concurrency or scheduling to crawl multiple pages, and techniques to handle common web-scraping issues. For people wanting to get hands-on with building scrapers, collecting data, or learning how to navigate web programming in Python, this repository acts as a didactic reference or starting point. -
2
Node Crawler
Web Crawler/Spider for NodeJS + server-side jQuery
Most powerful, popular and production crawling/scraping package for Node, happy hacking. -
3
Heritrix
Internet Archive's open-source, web-scale, web crawler project
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project. Heritrix (sometimes spelled heretrix, or misspelled or missaid as heratrix/heritix/heretix/heratix) is an archaic word for heiress (woman who inherits). Since our crawler seeks to collect and preserve the digital artifacts of our culture for the benefit of future researchers and generations, this name seemed apt. -
4
Mako
An extremely fast, production-grade web bundler based on Rust
Mako is a new web bundler for web apps, libraries, and frameworks. It's designed to be fast, reliable, and easy to use. It has been used in hundreds of projects in production by Ant Group, and other companies. If you are looking for a modern web bundler, Mako is the right choice. -
Stop vibe-debugging.AppSignal's MCP server hands Claude, Cursor, or Zed your real errors, traces, and the deploy that shipped them. AI writes the fix; you review the diff.
-
5
Logbook
An extensible Java library for HTTP request and response logging
Logbook is an extensible Java library to enable complete request and response logging for different client- and server-side technologies. It satisfies a special need by a) allowing web application developers to log any HTTP traffic that an application receives or sends b) in a way that makes it easy to persist and analyze it later. This can be useful for traditional log analysis, meeting audit requirements or investigating individual historic traffic issues. -
6
Prism
Lightweight, robust, elegant syntax highlighting
Prism is a lightweight, extensible syntax highlighter, built with modern web standards in mind. It’s used in millions of websites, including some of those you visit daily. -
7
React ChatBotify
A modern React library for creating flexible and extensible chatbots
Welcome to React ChatBotify, an intuitive and versatile library that allows you to build responsive chatbots with ease. Whether you're aiming to create a simple FAQ bot or a sophisticated conversational interface integrated with Large Language Models (LLMs), React ChatBotify provides the tools and flexibility you need to bring your vision to life. -
8
Servant
Haskell DSL for describing, serving, querying, mocking web apps
Servant provides a type-level domain-specific language (DSL) in Haskell for describing web APIs. From a single API specification, developers can derive server implementations, client libraries, documentation, and more—ensuring consistency and type safety across the stack. We have a tutorial that introduces the core features of servant. After this article, you should be able to write your first server web services, learning the rest from the haddocks' examples. The core documentation can be... -
9
Lyricist
Missing I18N/L10N (internationalization/localization) multiplatform
Jetpack Compose greatly improved the way we build UIs on Android, but not how we interact with strings. stringResource() works well, but doesn't benefit from the idiomatic Kotlin like Compose. Lyricist tries to make working with strings as powerful as building UIs with Compose, i.e., working with parameterized string is now typesafe, use of when expression to work with plurals with more flexibility, and even load/update the strings dynamically via an API. -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
10
SurveyJS
JavaScript Survey and Form Library
SurveyJS Form Library is distributed as npm packages and as scripts and style sheets that you can reference on your page. You can use it in any React, Angular, Vue, Knockout, or jQuery application. React, Angular, Knockout, and Vue3 are supported natively. To communicate with the server, the libraries use JSON objects that represent form schemas (content and layout of a form) and form results (answers). You have the option to build dynamic JSON-driven forms using our free full-featured... -
11
Papis
Powerful and highly extensible command-line based document
Papis is a powerful and highly extensible CLI document and bibliography manager. With Papis, you can search your library for books and papers, add documents and notes, import and export to and from other formats, and much much more. Papis uses a human-readable and easily hackable .yaml file to store each entry's bibliographical data. It strives to be easy to use while providing a wide range of features. And for those who still want more, Papis makes it easy to write scripts that extend its... -
12
Werkzeug
The comprehensive WSGI web application library
...Includes a response object that can wrap other WSGI applications and handle streaming data. Includes a routing system for matching URLs to endpoints and generating URLs for endpoints, with an extensible system for capturing variables from URLs. Includes HTTP utilities to handle entity tags, cache control, dates, user agents, cookies, files, and more. -
13
Perfetto
Production-grade client-side tracing, profiling, and analysis
Perfetto is a production-grade tracing platform for Android, Linux, and Chrome that captures extremely detailed information about what a system is doing over time. It’s designed around a low-overhead producer/consumer model: instrumented components (“producers”) write binary events into shared memory buffers and a collector (“service”) reliably streams them to storage. The data model spans kernel and userspace, so you can stitch together CPU scheduling, app lifecycles, binder/IPC hops, GPU... -
14
Kingfisher
Lightweight, pure-Swift library for downloading images from the web
Kingfisher is a powerful, pure-Swift library for downloading and caching images from the web. It provides you a chance to use a pure-Swift way to work with remote images in your next app. Asynchronous image downloading and caching. Loading image from either URLSession-based networking or local provided data. Useful image processors and filters provided. Multiple-layer hybrid cache for both memory and disk. Fine control on cache behavior. Customizable expiration date and size limit.... -
15
BentoCache
Bentocache is a robust multi-tier caching library for Node.js app
Bentocache is a flexible caching library for Python that supports multiple backends like memory, disk, and Redis. It offers decorators for easy function-level caching and is designed to be lightweight, extensible, and developer-friendly. Bentocache is well-suited for performance optimization in web apps, scripts, and data pipelines. -
16
ClojureDart
Clojure dialect for Flutter and Dart
ClojureDart is a modern dialect of Clojure that compiles to Dart, enabling developers to create native mobile, desktop, web, and CLI applications using the Flutter and Dart ecosystem with Clojure syntax while offering production-ready performance. You should get the sample running either in Chrome or as a desktop app. Compiles Clojure code into Dart to produce mobile, desktop, and web apps. Production-ready toolchain, with stable compiler used in real-world apps. -
17
SIP.js
A simple, intuitive, and powerful JavaScript signaling library
A JavaScript library that enables WebRTC-based real-time communication over the SIP (Session Initiation Protocol), allowing voice and video calling in web applications. -
18
Right Consents Community
Open and extensible platform to manage consents and preferences
Right Consents is a Consent and Preference Management Platform which leverage consent to another scope than cookies, where consent based processing implies conformity, like receipt preservation and consent dissemination to third-part software or company. More information at https://right-consents.fairandsmart.io/ -
19
Javaluator
A java infix evaluator based on "Shunting Yard" algorithm.
... - Constants support: e, pi, etc ... - Variables support: Example sin(x) for x = pi/4. - Highly configurable: Reduce the built-in operator or function sets, define your own brackets. - Extensible: Define your own grammar, or extends the existing one. - Localizable: Define localized names for functions or constants. - Syntax check - Small footprint: 26kB, no additionnal library required. - Fully documented Please visit the project site to learn more : http://javaluator.fathzer.com If you use Javaluator in your product, we will be happy to add a link to your product in the Javaluator web site. ... -
20
That project aims at providing a clean API, and the corresponding C++ implementation, for the basis of Airline IT Business Object Model (BOM), ie, to be used by several other Open Source projects, such as RMOL, Air-Sched, Travel-CCM, OpenTREP, etc.
-
21
Rush Stack
Monorepo for tools developed by the Rush Stack community
...Track our progress on the News page and Roadmap. These major tools are developed under the Rush Stack umbrella. Rush, the scalable monorepo build orchestrator. Heft, an extensible build system that interfaces with Rush, API Extractor, coordinates API reviews for library packages, and generates .d.ts rollups. API Documenter, generates your API documentation website. -
22
Android Saripaar
UI form validation library for Android
Android Saripaar is a simple, feature-rich and powerful rule-based UI form validation library for Android. It is the SIMPLEST UI validation library available for Android. Built on top of Apache Commons Validator, a validation framework with proven track record on the web, desktop and mobile platforms. Declarative style validation using Annotations. Extensible, now allows Custom Annotations. Synchronous and Asynchronous validations, you don't have to worry about threading. Supports both BURST and IMMEDIATE modes. Works with Stock Android Widgets, no custom view dependencies. Isolates validation logic using rules. -
23
That project aims at providing a clean API and a simple implementation, as a C++ library, of a Travel-oriented Distribution System. It corresponds to the simulated version of the real-world Computerized Reservation Systems (CRS).
-
24
That project aims at providing a clean API and a simple implementation, as a C++ library, of an Airline-related Inventory Management system. That library uses the Standard Airline IT C++ object model (http://sf.net/projects/stdair).
-
25
That project aims at delivering a reference implementation of a library, estimating and serving average prices paid for air travel products. It is not intended for use by an actual airline, but rather by simulators or other airline-related modules of