Alibaba cloud Q & A 2022-05-15 04:44:49 阅读数:200
What are the representatives of offline digital warehouse open source ？
Traditionally , Offline warehouse （ Open source to Hive/Spark As a representative , Close the source to Ali MaxCompute、Snowflake、AWS Redshift、Google BigQuery And so on , as well as Vertica、Oracle、HANA Etc IT manufacturer ）, Flow computation （ With Flink/Spark Structured Streaming As a representative ）, Data service layer （HBase、MySQL、ES、Redis etc. ） Together, it forms the standard architecture of big data processing ：Lambda framework .Lambda The architecture provides real-time data services （serving） Ability . In recent years , With ClickHouse、Apache Doris、 Ali Hologres And so on , Write detailed data in real time + The flexible interactive query part realizes Lambda framework , In real time 、 flexibility 、 cost 、 Management, operation and maintenance and other aspects have reached a good balance . With 2021 Annual double 11 The perfect ending of , Application of real-time data warehouse technology in Alibaba double 11 The scene has also experienced many years of practice and development . From early chimney development based on different operations , To the data warehouse based on domain hierarchical modeling , Then to the new integrated one-stop architecture of analysis service integration , The development efficiency is gradually improved , Data quality is more guaranteed , It also precipitates more technological innovation .
版权声明：本文为[Alibaba cloud Q & A]所创，转载请带上原文链接，感谢。 https://primo.wiki/2022/135/202205101855023177.html