Alibaba Cloud DataHub
DataHub supports various SDKs and APIs and provides multiple third-party plug-ins such as Flume and Logstash. You can import data to DataHub in an efficient manner. The DataConnector module can synchronize imported data to downstream storage and analysis systems in real time, such as MaxCompute, OSS, and Tablestore. You can import heterogeneous data that is generated by applications, websites, IoT devices, or databases to DataHub in real time. You can manage the data in a unified manner by using DataHub. You can also deliver the data to downstream systems such as analysis systems and archiving systems. This way, you can build a data streaming pipeline and extract more data value.
Learn more
DataWorks
DataWorks is a Big Data platform product launched by Alibaba Cloud. It provides one-stop Big Data development, data permission management, offline job scheduling, and other features. DataWorks works straight ‘out-the-box’ without the need to worry about complex underlying cluster establishment and operations & management. You can drag and drop nodes to create a workflow. You can also edit and debug your code online, and ask other developers to join you. Supports data integration, MaxCompute SQL, MaxCompute MR, machine learning, and shell tasks. Supports task monitoring and sends alarms when errors occur to avoid service interruptions. Runs millions of tasks concurrently and supports hourly, daily, weekly, and monthly schedules. DataWorks is the best platform for building big data warehouses and provides comprehensive data warehousing services. DataWorks provides a full solution for data aggregation, data processing, data governance, and data services.
Learn more
Alibaba Cloud Tablestore
Tablestore enables seamless expansion of data size and access concurrency through data sharding and server load balancer technologies, providing storage of and real-time access to massive structured data. Three copies of data with high consistency, full host, service high availability and data high reliability. Provides full/incremental data tunnels, seamlessly interconnecting with various products for big data analysis and real-time stream computing. Distributed architecture, single table auto scaling, support of 10-PB-level data and 10-million-level access concurrency. Multi-dimensional and multi-level security protection and resource access management to ensure data security. The low latency, high concurrency, elastic resources and Pay-As-You-Go billing method of this service enables your risk control system to always operate in optimal conditions, allowing you to strictly control transaction risks.
Learn more
Alibaba Cloud Data Integration
Alibaba Cloud Data Integration is a comprehensive data synchronization platform that facilitates both real-time and offline data exchange across various data sources, networks, and locations. It supports data synchronization between more than 400 pairs of disparate data sources, including RDS databases, semi-structured storage, non-structured storage (such as audio, video, and images), NoSQL databases, and big data storage. The platform also enables real-time data reading and writing between data sources such as Oracle, MySQL, and DataHub. Data Integration allows users to schedule offline tasks by setting specific trigger times, including year, month, day, hour, and minute, simplifying the configuration of periodic incremental data extraction. It integrates seamlessly with DataWorks data modeling, providing an operations and maintenance integrated workflow. The platform leverages the computing capability of Hadoop clusters to synchronize HDFS data to MaxCompute.
Learn more