大数据入门指南 ⭐

phoenix scala kafka big-data spark yarn hive hadoop storm bigdata hbase zookeeper hdfs mapreduce flume azkaban sqoop

• Updated Jan 5, 2024
• Java

Mirror of Apache Sqoop

java big-data sqoop

• Updated Apr 8, 2021
• Java

💎🔥大数据学习笔记

mysql linux shell hive hadoop hbase zookeeper hdfs mapreduce flume sqoop

• Updated May 13, 2019
• Java

Exchangis is a lightweight,highly extensible data exchange platform that supports data transmission between structured and unstructured heterogeneous data sources

etl flink sqoop datax linkis dataspherestudio exchangis transmission-engine wedatasphere

• Updated Oct 28, 2025
• Java

A prototype project of big data platform, the source codes of the book Big Data Platform Architecture and Prototype

redis demo kafka spark prototype bigdata spark-streaming quickstart sparksql oozie sqoop spark-sql spark-streaming-examples sqoop-import spark-demo middle-end middle-office spark-examples

• Updated Aug 12, 2020
• Java

bigdata kettle ogg flume sqoop aliyun-maxcompute

• Updated Nov 5, 2026
• Java

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

spark hive hadoop bigdata cloudera handson cheatsheet flume basics sqoop cca175

• Updated Jan 22, 2019
• Python

The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Center and pgAdmin. This cluster is solely intended for usage in a development environment. Do not use it to run any production workloads.

airflow kafka spark cassandra hive hadoop schema-registry postgresql python3 pyspark hdfs flume hue zeppelin pgadmin4 kadmin sqoop conda-environment control-center

• Updated Feb 27, 2023
• Shell

大数据组件学习代码

python java elasticsearch spark hive hadoop clickhouse hbase flink sqoop iceberg datax cdh5 doris hudi dolphinscheduler

• Updated May 6, 2024
• Java

This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.

apache-spark yarn hive hadoop bigdata impala hbase pig apache-storm mapreduce flume oozie apache-kafka sqoop apache-solr hadoop-filesystem apache-ranger hiveql apache-atlas apache-knox

• Updated Jun 10, 2018
• Python

Repository used for Spark Trainings

python scala spark hive hadoop pyspark spark-streaming sqoop spark-ml hadoop-training spark-training

• Updated Apr 21, 2023
• Jupyter Notebook

IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.

workflow hadoop ingestion oozie sqoop sqoop2 workflow-automation workflow-scheduler hadoop-ecosystem hadoop-framework ibis cigna

• Updated Apr 13, 2022
• Python

云计算之hadoop、hive、hue、oozie、sqoop、hbase、zookeeper环境搭建及配置文件

hive hadoop hbase zookeeper pig flume oozie hue sqoop flume-ng

• Updated Apr 25, 2017
• Shell

Big data projects implemented by Maniram yadav

spark hive hadoop pig hdfs mapreduce flume pig-latin sqoop hadoop-mapreduce big-data-analytics hadoop-hdfs big-data-projects

• Updated May 5, 2018
• PigLatin

Data cleaning, pre-processing, and Analytics on a Health care data using Spark and Python.

python big-data spark hive sqoop spark-sql big-data-projects

• Updated Jul 19, 2023
• Jupyter Notebook

Cloudera_Material: Study Material to help people preparing for Cloudera CCA Spark and Hadoop Developer Exam (CCA175). Feel free to collaborate.

big-data spark hive hadoop bigdata cloudera pyspark cca flume certification sqoop cca175 hive-metastore sqoop-session sqoop-export sqoop-import

• Updated Apr 21, 2020

Export PostgreSQL tables to Google BigQuery

bigquery postgresql gcloud sqoop

• Updated Jun 14, 2021
• Scala

Docker Big Data Tools: This docker-compose file is configured to run multiple nodes. This is a Hadoop Cluster that contains the necessary tools that can be used in the BigData domain, It's a collection of docker containers that you can use directly.

mysql mongo kafka spark hive hadoop storm hbase zookeeper metabase hue nifi flink sqoop streamsets

• Updated Jul 6, 2021
• VBA

一个增量备份关系数据库(MySQL, PostgreSQL, SQL Server, SQLite, Oracle等)到hive的php脚本工具

mysql php hive sqoop

• Updated Jun 14, 2018
• PHP

网站点击流离线日志分析

hive hadoop etl mapreduce flume sqoop

• Updated Sep 13, 2018
• Java