Search Results for "data capture framework"
Sort By:
Showing 163 open source projects for "data capture framework"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
1
spatial-framework-for-hadoop
The Spatial Framework for Hadoop allows developers
The Spatial Framework for Hadoop allows developers and data scientists to use the Hadoop data processing system for spatial data analysis. For tools, samples, and tutorials that use this framework, head over to GIS Tools for Hadoop. At the root level of this repository, you can build a single jar with everything in the framework using Apache Ant. Alternatively, you can build a jar at the root level of each framework component. ... -
2
Apache InLong
Apache InLong - a one-stop integration framework for massive data
Apache InLong is a one-stop integration framework for massive data that provides automatic, secure and reliable data transmission capabilities. InLong supports both batch and stream data processing at the same time, which offers great power to build data analysis, modeling and other real-time applications based on streaming data. InLong (应龙) is a divine beast in Chinese mythology who guides the river into the sea, and it is regarded as a metaphor of the InLong system for reporting data streams. ... -
3
Siddhi Core Libraries
Stream Processing and Complex Event Processing Engine
Fully open source, cloud-native, scalable, micro streaming, and complex event processing system capable of building event-driven applications for use cases such as real-time analytics, data integration, notification management, and adaptive decision-making. Event processing logic can be written using Streaming SQL queries via graphical and source editors, to capture events from diverse data sources, process and analyze them, integrate with multiple services and data stores, and publish output to various endpoints in real time. ... -
4
Logstash
Centralize, transform and stash your data
Logstash is a server-side data processing pipeline that dynamically ingests data from numerous sources, transforms it, and ships it to your favorite “stash” regardless of format or complexity. It supports and ingests data of all shapes, sizes and sources, dynamically transforms and prepares this data, and transports it to the output of your choice. Logstash is extensible, with over 200 plugins available to let you create and configure your pipeline how you choose. -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
5
Apache Hudi
Upserts, Deletes And Incremental Processing on Big Data
Apache Hudi (pronounced Hoodie) stands for Hadoop Upserts Deletes and Incrementals. Hudi manages the storage of large analytical datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem compatible storage). Apache Hudi is a transactional data lake platform that brings database and data warehouse capabilities to the data lake. Hudi reimagines slow old-school batch data processing with a powerful new incremental processing framework for low latency minute-level analytics. Hudi provides efficient upserts, by mapping a given hoodie key (record key + partition path) consistently to a file id, via an indexing mechanism. ... -
6
ElasticJob
Distributed scheduled job framework
ElasticJob is a distributed scheduling solution consisting of two separate projects, ElasticJob-Lite and ElasticJob-Cloud. ElasticJob-Lite is a lightweight, decentralized solution that provides distributed task sharding services. ElasticJob-Cloud uses Mesos to manage and isolate resources. It uses a unified job API for each project. Developers only need code one time and can deploy at will. Support job sharding and high availability in distributed system. Scale out for throughput and... -
7
HugeGraph
A graph database that supports more than 100+ billion data
HugeGraph is a convenient, efficient, and adaptable graph database compatible with the Apache TinkerPop3 framework and the Gremlin query language. HugeGraph supports fast import performance in the case of more than 10 billion Vertices and Edges Graph, millisecond-level OLTP query capability, and can be integrated into big data platforms like Hadoop or Spark for OLAP analysis. The main scenarios of HugeGraph include correlation search, fraud detection, and knowledge graph. ... -
8
ProM is the comprehensive, extensible framework for process mining. Process Mining deals with the a-posteriori analysis of (business) processes using enactment logs.
-
9
SymmetricDS
Database Replication, Filtered Synchronization, and Transformation
SymmetricDS is database replication and file synchronization software. It is a platform-independent, web-enabled, and database-agnostic synchronization tool. With initial data load, bidirectional change data capture, conflict resolution, and data transformation, it is a comprehensive data replication solution. -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
10
Prowide Core
Java framework for SWIFT [tm] MT (FIN) messaging
Prowide Core (previously known as WIFE) is an open source Java framework for managing SWIFT MT messages. The library key features are the comprehensive Java model for all MT message types, along a straight-forward parsing and building API. The project is active since 2006, production ready and commercially supported. For detail information on the support package options please check: https://www.prowidesoftware.com/services SWIFT is a trademark of S.W.I.F.T. SCRL.... -
11
MentDB Projects
Generalized Interoperability and Strong AI
MentDB is an open-source platform driving research into next-generation AI and universal data exchange. Our architecture is built around the revolutionary Mentalese Query Language (MQL). MentDB Weak (Generalized Interoperability): A unified data layer enabling seamless data exchange and application integration (SOA, ETL, Data Quality). We eliminate data silos through a single, generalized data language. MentDB Strong (Strong AI / AGI): The framework for exploring and building Machine Consciousness, free will, and advanced ethical reasoning systems. ... -
12
MOA - Massive Online Analysis
Big Data Stream Analytics Framework.
A framework for learning from a continuous supply of examples, a data stream. Includes classification, regression, clustering, outlier detection and recommender systems. Related to the WEKA project, also written in Java, while scaling to adaptive large scale machine learning. -
13
Magnolia CMS
Java CMS that delivers smartphone simplicity on an enterprise scale
Magnolia is an open Java CMS that delivers smartphone simplicity on an enterprise-scale. The mobile-inspired HTML5 user interface works through customisable, task-focused Apps, a notification stream called the Pulse, and a system of Favorites for quickly accessing the workspace. Magnolia CMS allows organizations to orchestrate online services, sales and marketing across all digital channels, maximizing the impact of every touchpoint. Magnolia’s open-source technology, support of open... -
14
Framework that aims to get high productivity in enterprise software development. It uses a layer application division model, implementing some design patterns. It also allows the development of n-tier applications with data access technology independ
-
15
jfBackup
Enterprise Tape Backup Solution (Windows Server 2008R2+)
...Features: - Volume Shadow Backups (backup open files) - Full Backups of Remote and Local Volumes (client/server model) - Tape Changer (multi-tape backups w/ barcode reader support) - software compression (zlib) - email notification Not Supported (yet): - Incremental Backups - Image Backups (bare-metal restores) - SQL Backups (volume shadow backup should capture SQL data in restorable state) - File Meta Data (file attributes, ACLs, etc.) - Restore in place (restored files need to be moved back into place) -
16
CloudI is an open-source private cloud computing framework for efficient, secure, and internal data processing. CloudI provides scaling for previously unscalable source code with efficient fault-tolerant execution of ATS, C/C++, Erlang/Elixir, Go, Haskell, Java, JavaScript/node.js, OCaml, Perl, PHP, Python, Ruby, or Rust services. The bare essentials for efficient fault-tolerant processing on a cloud!
-
17
Amazon Kinesis Flink Connectors
Contains various Apache Flink connectors to connect to AWS data
This library contains various Apache Flink connectors to connect to AWS data sources and sinks. This repository contains various Apache Flink connectors to connect to AWS Kinesis data sources and sinks. Flink maintain backwards compatibility for the Sink interface used by the Firehose Producer. This project is compatible with Flink 1.x, there is no guarantee it will support Flink 2.x should it release in the future. -
18
This project moved to GitHub in 2021 and is available at: https://cbrinkrolf.github.io/VANESA/ This tool is a platform-independent software to create individual pathways and to examine biological networks of distributed, heterogeneous data sources, e.g. KEGG, BRENDA. VANESA also offers Petri net modeling of extended hybrid Petri nets which can be also simulated using the OpenModelica framework.
-
19
proreports
Simple Reporting System
ProReports is simple reporting system designed to generate reports in popular office formats - PDF, XLS, RTF, HTML, TXT, XML, JSON, CSV, PNG, GIF. These reports are generated based on the definition in the internal database system. ProReports supports jrxml (JasperReport) format. This type of report templates can be prepared in external editor, such as iReport. Also user can prepare report in internal format of ProReports (simple Visual Programming Language mixed with PHP5 and JAVA or... -
20
BestBooks
BestBooks Accounting Application Framework (BAAF)
Accounting is hard, and writing software for accounting is even more difficult. BestBooks solves this problem with its Accounting Application Framework. This framework enables accountants and developers to build accounting systems without having to know the entire accounting terminology. Over the years, BestBooks has been one of the most successful Accounting Application Framework software. This platform is enterprise grade and has a lot to offer when it comes to security and data encryption. ... -
21
WhyLogs Java Library
Profile and monitor your ML data pipeline end-to-end
This is a Java implementation of WhyLogs, with support for Apache Spark integration for large scale datasets. Understanding the properties of data as it moves through applications is essential to keeping your ML/AI pipeline stable and improving your user experience, whether your pipeline is built for production or experimentation. WhyLogs is an open source statistical logging library that allows data science and ML teams to effortlessly profile ML/AI pipelines and applications, producing log... -
22
Poli
An easy-to-use BI server built for SQL lovers. Power data analysis
...Utilize the power of dynamic SQL with query variables to connect Filters and Charts. Capture the snapshot of historical data. Free up space in your own database. Three system level role configurations + Group based report access control. Custom the language pack and translations just for your audience. Auto refresh, drill through, fullscreen, embeds, color themes + more features in development. -
23
ksqlDB
The database purpose-built for stream processing applications
Build applications that respond immediately to events. Craft materialized views over streams. Receive real-time push updates, or pull current state on demand. Seamlessly leverage your existing Apache Kafka® infrastructure to deploy stream-processing workloads and bring powerful new capabilities to your applications. Use a familiar, lightweight syntax to pack a powerful punch. Capture, process, and serve queries using only SQL. No other languages or services are required. ksqlDB enables you... -
24
JHotDraw is a two-dimensional graphics framework for structured drawing editors that is written in Java. It is based on Erich Gamma's JHotDraw, which is copyright 1996, 1997 by IFA Informatik and Erich Gamma.
-
25
Advanced RecyclerView
RecyclerView extension library which provides advanced features
This RecyclerView extension library provides Google's Inbox app like swiping, Play Music app like drag-and-drop sorting and expandable item features. Works on API level 14 or later. Reduces library conflicts, easy to integrate with existing code. Looks difficult at a glance, but gives great flexibility like the original RecyclerView. Swipe dismiss and swipe pinning operation. (like Google's Inbox app). Smooth item reordering with linear list (LinearLayoutManager). It behaves like the...
