Dimodelo

SelectDB is a modern data warehouse based on Apache Doris, which supports rapid query analysis on large-scale real-time data. From Clickhouse to Apache Doris, to achieve the separation of the lake warehouse and upgrade to the lake warehouse. The fast-hand OLAP system carries nearly 1 billion query requests every day to provide data services for multiple scenes. Due to the problems of storage redundancy, resource seizure, complicated governance, and difficulty in querying and adjustment, the original lake warehouse separation architecture was decided to introduce Apache Doris lake warehouse, combined with Doris's materialized view rewriting ability and automated services, to achieve high-performance data query and flexible data governance. Write real-time data in seconds, and synchronize flow data from databases and data streams. Data storage engine for real-time update, real-time addition, and real-time pre-polymerization.

Agile Data Engine is a comprehensive DataOps platform designed to streamline the development, deployment, and operation of cloud-based data warehouses. It integrates data modeling, transformations, continuous deployment, workflow orchestration, monitoring, and API connectivity within a single SaaS solution. The platform's metadata-driven approach automates SQL code generation and data load workflows, enhancing productivity and agility in data operations. Supporting multiple cloud database platforms, including Snowflake, Databricks SQL, Amazon Redshift, Microsoft Fabric (Warehouse), Azure Synapse SQL, Azure SQL Database, and Google BigQuery, Agile Data Engine offers flexibility in cloud environments. Its modular data product framework and out-of-the-box CI/CD pipelines facilitate seamless integration and continuous delivery, enabling data teams to adapt swiftly to changing business requirements. The platform also provides insights and statistics on data platform performance.