来自 eBay 的 OLAP 分析引擎:Kylin
jopen
10年前
Kylin 是一个来自 eBay 公司开发的开源分布式OLAP 分析引擎,基于 Hadoop 提供 SQL 接口和 OLAP 接口,支持 TB 到 PB 级别的数据量。
- 超级快的 OLAP 引擎,具备可伸缩性:
Kylin is designed to reduce query latency on Hadoop for 10+ billions of rows of data
- 为 Hadoop 提供 ANSI-SQL 接口:
Kylin offers ANSI-SQL on Hadoop and supports most ANSI-SQL query functions
- 交互式查询能力:
Users can interact with Hadoop data via Kylin at sub-second latency, better than Hive queries for the same dataset
- MOLAP Cube:
User can define a data model and pre-build in Kylin with more than 10+ billions of raw data records
- 可与其他 BI 工具无缝集成,如 Tableau:
Kylin currently offers integration capability with BI Tools like Tableau. Integration with Microstrategy and Excel is coming soon
其它亮点:
-
作业管理和监控
-
压缩和编码的支持
-
Cube 的增量更新
-
Leverage HBase Coprocessor for query latency
-
Approximate Query Capability for distinct Count (HyperLogLog)
-
易用的 Web 管理、构建、监控和查询 Cube 的接口
-
Security capability to set ACL at Cube/Project Level
-
支持 LDAP 集成
运行环境要求:
Hadoop
-
Hadoop: 2.2.0.2.0.6.0-61 or above
-
Hive: 0.12.0.2.0.6.0-61 or above
-
HBase: 0.96.0.2.0.6.0-61-hadoop2
Tested with Hortornworks distribution (HDP2.1.3), not tested with others yet.
Kylin Server
-
Command hadoop, hive, hbase is workable on your hadoop cluster
-
JDK Runtime: JDK7 (OpenJDK or Oracle JDK)
-
Maven
-
Git
-
Tomcat
-
Mysql