課程簡介

案例背景:
An important characteristic of Twitter is its real-time nature. Consequently, many of Twitter’s projects need real time analytics as a platform service. During recent years, a number of teams are adopting Presto and Druid as real time analytics engines.

解決思路:
In this talk, We start with Twitter’s big data architecture, followed by a detail introduction of Presto and Druid. We will focus on our design and implementation of Presto Druid Connector, which provides real time query latency with full SQL functionality. Leveraging Presto Connectors, users are able to join data between a variety of data sources, without data copy, including Hadoop, Druid, MySQL, Elasticsearch, etc. With predicate and aggregation pushdown, we achieved sub second query latency with Presto Druid Connector. We will also share our production experience, and roadmaps.

成果：
通過開源項目Presto和Druid的研發(fā)，我們實現(xiàn)了大數(shù)據(jù)分析的實時處理，絕大多數(shù)的查詢可以做到一秒之內(nèi)完成，很好的支持了Twitter業(yè)務

目標收益

聽眾可以了解大數(shù)據(jù)系統(tǒng)設(shè)計
聽眾可以了解大數(shù)據(jù)架構(gòu)的演進
聽眾可以了解數(shù)據(jù)中臺的設(shè)計和實現(xiàn)

培訓對象

課程內(nèi)容

案例方向

---

智能數(shù)據(jù)分析/企業(yè)級大數(shù)據(jù)架構(gòu)演進/流式計算系統(tǒng)設(shè)計/數(shù)據(jù)庫的未來

案例背景

---

An important characteristic of Twitter is its real-time nature. Consequently, many of Twitter’s projects need real time analytics as a platform service. During recent years, a number of teams are adopting Presto and Druid as real time analytics engines.

收益

---

聽眾可以了解大數(shù)據(jù)系統(tǒng)設(shè)計
聽眾可以了解大數(shù)據(jù)架構(gòu)的演進
聽眾可以了解數(shù)據(jù)中臺的設(shè)計和實現(xiàn)

解決思路

---

In this talk, We start with Twitter’s big data architecture, followed by a detail introduction of Presto and Druid. We will focus on our design and implementation of Presto Druid Connector, which provides real time query latency with full SQL functionality. Leveraging Presto Connectors, users are able to join data between a variety of data sources, without data copy, including Hadoop, Druid, MySQL, Elasticsearch, etc. With predicate and aggregation pushdown, we achieved sub second query latency with Presto Druid Connector. We will also share our production experience, and roadmaps.

結(jié)果

---

通過開源項目Presto和Druid的研發(fā)，我們實現(xiàn)了大數(shù)據(jù)分析的實時處理，絕大多數(shù)的查詢可以做到一秒之內(nèi)完成，很好的支持了Twitter業(yè)務