来自 eBay 的 OLAP 分析引擎:Kylin

jopen 10年前

kylin-olap_m63l1.png
Kylin 是一个来自 eBay 公司开发的开源分布式OLAP 分析引擎,基于 Hadoop 提供 SQL 接口和 OLAP 接口,支持 TB 到 PB 级别的数据量。

- 超级快的 OLAP 引擎,具备可伸缩性:

Kylin is designed to reduce query latency on Hadoop for 10+ billions of rows of data

- 为 Hadoop 提供 ANSI-SQL 接口:

Kylin offers ANSI-SQL on Hadoop and supports most ANSI-SQL query functions

- 交互式查询能力:

Users can interact with Hadoop data via Kylin at sub-second latency, better than Hive queries for the same dataset

- MOLAP Cube:

User can define a data model and pre-build in Kylin with more than 10+ billions of raw data records

- 可与其他 BI 工具无缝集成,如 Tableau:

Kylin currently offers integration capability with BI Tools like Tableau. Integration with Microstrategy and Excel is coming soon

其它亮点:

  • 作业管理和监控

  • 压缩和编码的支持

  • Cube 的增量更新

  • Leverage HBase Coprocessor for query latency

  • Approximate Query Capability for distinct Count (HyperLogLog)

  • 易用的 Web 管理、构建、监控和查询 Cube 的接口

  • Security capability to set ACL at Cube/Project Level

  • 支持 LDAP 集成

来自 eBay 的 OLAP 分析引擎:Kylin

运行环境要求:

Hadoop

  • Hadoop: 2.2.0.2.0.6.0-61 or above

  • Hive: 0.12.0.2.0.6.0-61 or above

  • HBase: 0.96.0.2.0.6.0-61-hadoop2

Tested with Hortornworks distribution (HDP2.1.3), not tested with others yet.

Kylin Server

  • Command hadoop, hive, hbase is workable on your hadoop cluster

  • JDK Runtime: JDK7 (OpenJDK or Oracle JDK)

  • Maven

  • Git

  • Tomcat

  • Mysql

项目主页:http://www.open-open.com/lib/view/home/1412902618639