Kylo
Kylo is an open source enterprise-ready data lake management software platform for self-service data ingest and data preparation with integrated metadata management, governance, security and best practices inspired by Think Big's 150+ big data implementation projects. Self-service data ingest with data cleansing, validation, and automatic profiling. Wrangle data with visual sql and an interactive transform through a simple user interface. Search and explore data and metadata, view lineage, and profile statistics. Monitor health of feeds and services in the data lake. Track SLAs and troubleshoot performance. Design batch or streaming pipeline templates in Apache NiFi and register with Kylo to enable user self-service. Organizations can expend significant engineering effort moving data into Hadoop yet struggle to maintain governance and data quality. Kylo dramatically simplifies data ingest by shifting ingest to data owners through a simple guided UI.
Learn more about Kylo
Apache NiFi
An easy to use, powerful, and reliable system to process and distribute data. Apache NiFi supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic. Some of the high-level capabilities and objectives of Apache NiFi include web-based user interface, offering a seamless experience between design, control, feedback, and monitoring. Highly configurable, loss tolerant, low latency, high throughput, and dynamic prioritization. Flow can be modified at runtime, back pressure, data provenance, track dataflow from beginning to end, designed for extension. Build your own processors and more. Enables rapid development and effective testing. Secure, SSL, SSH, HTTPS, encrypted content, and much more. Multi-tenant authorization and internal authorization/policy management. NiFi is comprised of a number of web applications (web UI, web API, documentation, custom UI's, etc). So, you'll need to set up your mapping to the root path.
Learn more about Apache NiFi
MuleSoft Anypoint Platform
5.0 out of 5 stars
(1 Rating)
MuleSoft is an agentic control plane designed to help enterprises govern, orchestrate, and secure AI agents, APIs, applications, models, and data across complex digital environments. The platform supports multi-agent governance, API management, integration, automation, and gateway federation from one unified control plane. With solutions such as MuleSoft Agent Fabric, MuleSoft Omni Gateway, Agent Registry, Agent Scanners, and Agent Broker, organizations can discover agents, manage interactions, reduce shadow AI, and coordinate workflows across ecosystems. MuleSoft also helps teams turn existing APIs and applications into governed tools that AI agents can safely discover and use. Its platform supports developers and business users with natural language development, prebuilt connectors, monitoring, API governance, and integration tools. MuleSoft is built to help enterprises scale AI adoption with stronger compliance, observability, security, and operational confidence.
Learn more about MuleSoft Anypoint Platform
Datavolo
Capture all your unstructured data for all your LLM needs. Datavolo replaces single-use, point-to-point code with fast, flexible, reusable pipelines, freeing you to focus on what matters most, doing incredible work. Datavolo is the dataflow infrastructure that gives you a competitive edge. Get fast, unencumbered access to all of your data, including the unstructured files that LLMs rely on, and power up your generative AI. Get pipelines that grow with you, in minutes, not days, without custom coding. Instantly configure from any source to any destination at any time. Trust your data because lineage is built into every
pipeline. Make single-use pipelines and expensive configurations a thing of the past. Harness your unstructured data and unleash AI innovation with Datavolo, powered by Apache NiFi and built specifically for unstructured data. Our founders have spent a lifetime helping organizations make the most of their data.
Learn more about Datavolo