Search Results for "data structures"
Sort By:
Showing 38 open source projects for "data structures"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
Immutable.js
Immutable collections for JavaScript
...The data structures that Immutable.js provides include List, Stack, Map, OrderedMap, Set and more. These structures are highly efficient on modern JavaScript VMs, and minimize the need to cache or copy data. -
2
wombat
Lightweight Ruby DSL for scraping structured data from web pages
...The DSL approach helps make scraping definitions more readable and maintainable, especially when dealing with multiple fields or nested data structures. Because it is implemented as a Ruby library, it integrates easily into Ruby applications and scripts that need to gather information from web pages. Wombat also includes examples and tests that demonstrate how scraping definitions can be written and executed within Ruby environments. -
3
Agrona
High Performance data structures and utility methods for Java
Agrona provides a library of data structures and utility methods that are a common need when building high-performance applications in Java. Many of these utilities are used in the Aeron efficient reliable UDP unicast, multicast, and IPC message transport and provides high-performance buffer implementations to support the Simple Binary Encoding Message Codec. -
4
CyberScraper 2077
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
CyberScraper 2077 is not just another web scraping tool – it's a glimpse into the future of data extraction. Born from the neon-lit streets of a cyberpunk world, this AI-powered scraper uses OpenAI, Gemini and LocalLLM Models to slice through the web's defenses, extracting the data you need with unparalleled precision and style. -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
5
Toapi
Convert websites into structured APIs automatically with Python tool
Toapi is a Python library designed to transform ordinary websites into usable API services. Instead of building a traditional web crawler that collects and stores data before exposing it through an API, Toapi simplifies the process by allowing developers to define data structures that automatically generate an API layer from existing web pages. It works by parsing HTML content from a source site and mapping selected elements into structured data that can be returned as JSON through API endpoints. ... -
6
watercrawl
AI-ready web crawler that extracts and structures website content
WaterCrawl is an open source web crawling and data extraction platform designed to transform website content into structured data suitable for machine learning and AI workflows. It enables developers and researchers to crawl web pages, extract meaningful information, and convert it into formats that are easier to process and analyze. It provides a modern crawling system that can automatically navigate links, control crawl depth, and collect content from targeted sections of a website.... -
7
diskover-community
Open source file indexing & storage analytics powered by Elasticsearch
Diskover Community Edition is an open source file system indexing and storage analytics platform designed to help organizations understand and manage large volumes of file data. It crawls file systems and indexes metadata using Elasticsearch, enabling fast search, analysis, and organization of files stored across different storage systems. It allows administrators and users to explore file structures, monitor storage usage, and gain insights into how data is distributed across infrastructure. By indexing file metadata from sources such as local file systems, network shares like NFS and SMB, and cloud storage, the tool provides a centralized way to analyze heterogeneous storage environments. ... -
8
Python API for JMComic
Python crawler and API for downloading JMComic albums and images
...It includes command-line functionality and configuration files so users can customize download behavior, directory structures, and performance settings without modifying code. It also supports plugin-based extensions that allow additional processing. -
9
AWS CDI SDK
AWS Cloud Digital Interface (CDI) SDK
The AWS Cloud Digital Interface (CDI) SDK is the library which implements the low-latency reliable transport of data between systems in the cloud including AWS Media Services and Amazon EC2 instances. The SDK takes care of the complex task of ensuring that large amounts of data are seamlessly transferred across the AWS network using multi-path technology to ensure lossless quality without the need for extensive network buffering and delay. The SDK consists of two main API layers, depending... -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
10
Quickwit
Sub-second search & analytics engine on cloud storage
...However, we only support ES aggregation DSL, the query DSL support is planned for Q2 2023. The core difference and advantage of Quickwit are its architecture built from the ground to search on cloud storage. We optimized IO paths, revamped the index data structures and made search stateless and sub-second on cloud storage. Quickwit is open-source under the GNU Affero General Public License Version 3 - AGPLv3. Fundamentally, this means you are free to use Quickwit for your project if you don't modify Quickwit. However, if you do and you are distributing your modified version to the public, you have to make the modifications public. -
11
Faved
Free open-source bookmark manager with customisable nested tags
...It provides a clean web-based interface where users can store, organize, and search bookmarks without relying on third-party cloud services. Instead of just listing URLs, Faved supports customizable nested tags, helping users categorize their bookmarks in hierarchical structures that reflect personal workflows or project needs. All data is stored locally by default, which enhances privacy and eliminates dependency on external servers or vendor lock-in. The application is lightweight and built to launch quickly, with minimal complexity in setup or use, making it suitable for developers and non-technical users alike. ... -
12
Aeron
Efficient UDP unicast, UDP multicast, and IPC message transport
...A design goal for Aeron is to be the highest throughput with the lowest and most predictable latency of any messaging system. Aeron integrates with Simple Binary Encoding (SBE) for the best possible message encoding and decoding performance. Many of the data structures used in the creation of Aeron have been factored out to the Agrona project. -
13
Scrapling
An adaptive Web Scraping framework
Scrapling is an adaptive web scraping framework designed to handle everything from a single HTTP request to large-scale, concurrent crawls. Built for modern websites, it intelligently adapts to structural changes by automatically relocating elements when page layouts update. The framework includes advanced fetchers capable of bypassing anti-bot protections such as Cloudflare Turnstile using stealth and browser automation techniques. Its powerful spider system supports multi-session crawling,... -
14
AMBIT:Chemical Structure DB&Web Service
Chemical structures database & machine learning with web services API
AMBIT offers a cheminformatics data management for chemical substances, structures and nanomaterials. Flexible structure, similarity and study queries storage, descriptor calculation and predictive models building via REST web services.User interface for creating read across assessment and generating reports, aligned with regulatory and industrial requirements. -
15
Simple components for Ada
A software components library
The Simple components for Ada library provides implementations of smart pointers for automatically collected objects (using reference counting), object persistence, unbounded and bounded arrays of smart pointers, generic unbounded arrays of private objects and plain pointers, generic sets, maps, arbitrary precision arithmetic, B-trees, directed graphs, directed weighted graphs, stacks, and storage pools. It also includes table management, string editing, IEEE 754 support, and infix expression parsing tools. Implementations of some lock-free shared data structures are provided. -
16
dirhunt
Web crawler that finds hidden web directories without brute force
Dirhunt is an open source security tool designed to discover web directories and analyze website structures without relying on brute-force techniques. Instead of sending large numbers of guess-based requests, it operates as a specialized crawler that intelligently explores websites to identify accessible or hidden directories. Dirhunt can detect directories that expose “Index Of” listings, which may reveal files and other resources that were not intended to be publicly visible. It can also... -
17
X-RAY
The next web scraper, see through the <html> noise
Supports strings, arrays, arrays of objects, and nested object structures. The schema is not tied to the structure of the page you're scraping, allowing you to pull the data in the structure of your choosing. The API is entirely composable, giving you great flexibility in how you scrape each page. Paginate through websites, scraping each page. X-ray also supports a request delay and a pagination limit. -
18
json4sapnw
Another JSON extension for SAP ABAP
This is a SAP addon to handle JSON data within SAP ABAP Programs. It comes in the customer exchange namespace /CEX/ and has to be installed as an SAP transport request. The addon supports object oriented JSON methods to process deep structured JSON data. Building JSON data from SAP data objects and parsing JSON data back to SAP data objects are supported. See the WIKI for some examples. Thanks to the SAP community and especially to Rüdiger Plantiko for the basic work... -
19
The Mooty Tool Kit (MTK) is a feature-rich Bash tool kit that makes it easy for you to perform High Performance Administration (HPA) task in your environment. HPA task include: * Mass-management of computers * Deployment of files * Collection of system data reports * And much, much more The MTK leverages existing Network Operating System infrastructure, so it is very light, flexible, portable and powerful. The kit comes with multiple tools that make mass management simple and...
-
20
DTEv2 (PHP template engine)
The completely data-driven template engine in PHP.
Have you ever thought why you need to use "if", "else", etc in an HTML template with a template engine written in PHP even when PHP can do it? In fact, there is no technical reason supporing it. Here, we provide you a pure data-driven template solution so that no control flow structures are ever allowed in HTML templates. Document Template Engine version 2 (DTEv2) is a template engine written in PHP. It is completely data-driven. So HTML template files and their corresponding PHP source codes are totally separated. In addition, when you edit template files in Dreamweaver the template pieces does not confuse Dreamweaver. ... -
21
-
22
OpenOdb is a web-based generic relational database. Written in php/mysql it provides an organic multi-user environment to collaborate on administrative data. Users can create models, forms, structures and reports.
-
23
Graph visualization using hyperbolic geometry (hyperbolic trees, but also general graphs). Applications cover web site structures, topic maps, organisational charts and wikis.
-
24
MIRS - Model/vIew aRchitect Server MIRS takes as input View specification in XML, and bounds it to a program (Model) via data structures, i.e, program variables are associated with some visual representation.
-
25
Syntax Desktop is a innovative publishing system to manage content website. It has an attractive GUI, with DHTML elements. With Syntax you can insert news, photos, document, tree data structures into your website.