Global

Apache Spark - A unified analytics engine for large-scale data processing

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (

DataX是阿里云DataWorks数据集成的开源版本。

大数据入门指南 :star:

Apache Hadoop

Fluentd: Open-Source Log Collector ===================================

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

> 1. 根目录下 cat-client 模块以后不再维护，下个大版本更新计划移除。新版Java客户端参考：lib/java > 2. 管理端、服务端、告警服务均使用 cat-home 模块部署即可

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

🏆 Real-Time no-code, powerful and secure ORM 🚀 providing APIs and Docs without coding by Backend, and Frontend(Client) can customize response JSONs 🏆 实时 零代码、全功能、强安全 ORM 库 🚀 后端接口和文档零代码，前端(客户端) 定制返回 JSON 的数据和结构

The official home of the Presto distributed SQL query engine for big data

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library.

PredictionIO, a machine learning server for developers and ML engineers.