What are the representatives of offline digital warehouse open source?

Alibaba cloud Q & A 2022-05-15 04:44:49 阅读数:200


What are the representatives of offline digital warehouse open source ?

Take the answer 1:

Traditionally , Offline warehouse ( Open source to Hive/Spark As a representative , Close the source to Ali MaxCompute、Snowflake、AWS Redshift、Google BigQuery And so on , as well as Vertica、Oracle、HANA Etc IT manufacturer ), Flow computation ( With Flink/Spark Structured Streaming As a representative ), Data service layer (HBase、MySQL、ES、Redis etc. ) Together, it forms the standard architecture of big data processing :Lambda framework .Lambda The architecture provides real-time data services (serving) Ability . In recent years , With ClickHouse、Apache Doris、 Ali Hologres And so on , Write detailed data in real time + The flexible interactive query part realizes Lambda framework , In real time 、 flexibility 、 cost 、 Management, operation and maintenance and other aspects have reached a good balance . With 2021 Annual double 11 The perfect ending of , Application of real-time data warehouse technology in Alibaba double 11 The scene has also experienced many years of practice and development . From early chimney development based on different operations , To the data warehouse based on domain hierarchical modeling , Then to the new integrated one-stop architecture of analysis service integration , The development efficiency is gradually improved , Data quality is more guaranteed , It also precipitates more technological innovation .

版权声明:本文为[Alibaba cloud Q & A]所创,转载请带上原文链接,感谢。 https://primo.wiki/2022/135/202205101855023177.html