English | 中文
Lark Chinese name Skylark, sky stands for big data, and bird stands for ordinary and freedom.
LarkMidTable is a one-stop open source data center that realizes metadata management, data warehouse development, data quality management, data visualization, and realizes a product that efficiently empowers the data front desk and provides data services.
-
Meet many small businesses and provide one-stop solutions.
-
Make world-class products comparable to Google、Microsoft、Apple manufacturers.
-
Create value, generate value, and make the world a better place.
| Frame name | Frame use | The main function |
|---|---|---|
| Atlas | Metadata management | Core capabilities of metadata governance including data classification, centralized policy engine, data blood relationship, security and lifecycle management |
| Dolphin | Task scheduling | Visual DAG workflow task scheduling system |
| Flink | Offline and real-time computing framework | Based on Flink, one-stop solution to batch processing problems |
| Hive | data storage | MR-based data warehouse tools |
| Kylin | Analyze the database | Open source, distributed analytical data warehouse |
| Kafka | Message middleware | LinkedIn is implemented in Scala language and supports parallel loading of hadoop data |
| K8S | Container deployment | Deploying containerized applications is simple and efficient |
| Zookeeper | Distributed coordination service | Unified naming service, configuration management, cluster management, queue management |
| Applicable industry | E-commerce field | The financial sector | Communication field | Industrial field | ... |
|---|---|---|---|---|---|
| Data Center | database | Data quality | Metadata management | Real-time report | ... |
| Data platform | Offline calculation | Real-time calculation | Business algorithm | Artificial intelligence | ... |
| Data collection | Buried log | Alarm log | IoT data | Clickstream data | ... |
Please click Quick Start
Resource Library R&D Resource Library
Development Specification Vipshop Development Specification
To be completed:
Task management, log management, resource monitoring
completed:
Login function [Complete] Project management [Complete] User management [Complete] JSON formatting [Complete]
Actuator management [Complete] Linux installation and deployment [Complete] Data source management [Complete]