栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 前沿技术 > 大数据 > 大数据系统

近期关注的大数据开源项目

近期关注的大数据开源项目

截止至 2022-02-08

计算引擎
ServiceGit StarContributorsReleaseLicense
Apache Flink18.1k1005v1.14.3Apache-2.0

Apache Flink:https://github.com/apache/flink

数据开发
ServiceGit StarContributorsReleaseLicense
StreamX81023v1.2.1Apache-2.0
Apache Seatunnel3k42v1.5.7Apache-2.0
Apache Zeppelin5.6k362v0.10.1-rc1Apache-2.0
DataSphereStudio1.9k26v1.0.0Apache-2.0
Apache Beam5.3k879v2.36.0Apache-2.0
LarkMidTable68614Apache-2.0

StreamX:https://github.com/streamxhub/streamx

Apache Seatunnel(孵化中):https://github.com/apache/incubator-seatunnel

Apache Zeppelin :https://github.com/apache/zeppelin

DataSphereStudio:https://github.com/WeBankFinTech/DataSphereStudio

Apache Beam:https://github.com/apache/beam

LarkMidTable:https://github.com/wxgzgl/LarkMidTable

数据湖
ServiceGit StarContributorsReleaseLicense
Apache Iceberg2.4k226v0.13.0Apache-2.0
Apache Hudi2.8k238v0.10.1Apache-2.0
Delta Lake4k137v1.1.0Apache-2.0
Dremio1k4v20.0.0Apache-2.0
Alluxio5.5k1176v2.7.3Apache-2.0

Apache Iceberg:https://github.com/apache/iceberg

Apache Hudi:https://github.com/apache/hudi

DeltaLake:https://github.com/delta-io/delta

Dremio(数据湖加速):https://github.com/dremio/dremio-oss

Alluxio(内存文件系统): https://github.com/Alluxio/alluxio

数据治理
ServiceGit StarContributorsReleaseLicense
Apache Atlas1.2k114v2.2.0-rc1Apache-2.0
Amundsen3k191v6.4.6Apache-2.0
Datahub4.7k174v0.8.25Apache-2.0
metacat1.2k18v1.2.2Apache-2.0
Marquez91958v0.20.0Apache-2.0

Apache Atlas:https://github.com/apache/atlas

Lyft Amundsen:https://github.com/amundsen-io/amundsen

linkedin Datahub:https://github.com/linkedin/datahub

Netflix metacat:https://github.com/Netflix/metacat

Marquez:https://github.com/MarquezProject/marquez

查询引擎
ServiceGit StarContributorsReleaseLicense
Clickhouse22k910v21.10.6.2-stableApache-2.0
Trino4.9k558370Apache-2.0
TiDB30.3k719v5.0.6Apache-2.0
Apache Pinot3.8k210v0.9.3Apache-2.0
StarRocks2.1k69v2.0.1Elastic-2.0
Apache Kylin3.2k188v4.0.1Apache-2.0
Apache Druid11.5k476v0.22.1Apache-2.0
Apache Impala760164v4.0.0Apache-2.0
Elasticsearch58.4k1712v7.17.0SSPL + Elastic-2.0
Greenplum5k295v6.19.1Apache-2.0
Oceanbase4.1k116v3.1.2_CEMulanPubL-2.0

Clickhouse:https://github.com/ClickHouse/ClickHouse

Trino:https://github.com/trinodb/trino

TiDB:https://github.com/pingcap/tidb

Apache Pinot:https://github.com/apache/pinot

StarRocks:https://github.com/StarRocks/starrocks

Apache Kylin:https://github.com/apache/kylin

Apache Druid:https://github.com/apache/druid

Impala:https://github.com/apache/impala

Elasticsearch:https://github.com/elastic/elasticsearch

Greenplum:https://github.com/greenplum-db/gpdb

Oceanbase:https://github.com/oceanbase/oceanbase

分布式对象存储
ServiceGit StarContributorsReleaseLicense
MinIO31.5k3322022-02-07T08-17-33ZAGPL-3.0
SeaweedFS13.8k142v2.88Apache-2.0
JuiceFS4.8k47v1.0.0-beta1Apache-2.0
Apache Ozone458136v1.2.1Apache-2.0
LakeFS2.2k53v0.58.0Apache-2.0
Ceph10.1k1169v12.2.14LGPL-2.1 or LGPL-3

MinIO:https://github.com/minio/minio

SeaweedFS:https://github.com/chrislusf/seaweedfs

JuiceFS:https://github.com/juicedata/juicefs

Apache Ozone:https://github.com/apache/ozone

LakeFS:https://github.com/treeverse/lakeFS

Ceph:https://github.com/ceph/ceph

消息服务
ServiceGit StarContributorsReleaseLicense
Apache pulsar10.3k495v2.8.2Apache-2.0

Apache pulsar:https://github.com/apache/pulsar

任务调度
ServiceGit StarContributorsReleaseLicense
Apache DolphinScheduler7.3k302v2.0.3Apache-2.0
Apache Airflow24.7k19272.2.3Apache-2.0

Apache DolphinScheduler:https://github.com/apache/dolphinscheduler

Apache Airflow:https://github.com/apache/airflow

数据抽取
ServiceGit StarContributorsReleaseLicense
Apache Gobblin2k89v0.11.0Apache-2.0

Apache Gobblin:https://github.com/apache/gobblin

多租户JDBC接口
ServiceGit StarContributorsReleaseLicense
Apache kyuubi91461v1.4.1-incubatingApache-2.0

Apache kyuubi(孵化中):https://github.com/apache/incubator-kyuubi

其他 容器
ServiceGit StarContributorsReleaseLicense
Minikube23.2k714v1.25.1Apache-2.0

Minikube:https://github.com/kubernetes/minikube

网关服务
ServiceGit StarContributorsReleaseLicense
Apache APISIX8.3k270v2.12.0Apache-2.0

Apache APISIX:https://github.com/apache/apisix

转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/730537.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号