Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

visualization javascript mysql python bigquery bi spark dashboard athena analytics postgresql snowflake mariadb business-intelligence redash redshift databricks hacktoberfest spark-sql

• Updated Nov 10, 2026
• TypeScript

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

python rust machine-learning sql big-data spark apache-spark arrow distributed-computing artificial-intelligence pyspark data-engineering parquet iceberg spark-sql apache-iceberg delta-lake datafusion lakehouse spark-connect

• Updated Nov 12, 2026
• Rust

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

kubernetes sql spark hive hadoop jdbc thrift data-lake hacktoberfest spark-sql

• Updated Nov 11, 2026
• Scala

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

microsoft emr machine-learning streaming spark apache-spark csharp fsharp analytics dotnet azure bigdata spark-streaming dotnet-core dotnet-standard databricks spark-sql tpcds hdinsight tpch

• Updated Nov 5, 2026
• C#

A Scala kernel for Jupyter

scala spark jupyter repl jupyter-notebook jupyter-kernels spark-sql

• Updated Nov 12, 2026
• Scala

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

arrow clickhouse simd vectorization spark-sql velox

• Updated Nov 12, 2026
• Scala

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

spark apache-spark mllib structured-streaming spark-sql spark-mllib mlflow delta-lake

• Updated Jan 28, 2025
• Scala

电商用户行为分析大数据平台

java spark hadoop sparkjava accumulator spark-sql kyro

• Updated Nov 16, 2022
• Java

Better SQL in Jupyter. 📊

mysql python bigquery postgres data-science sql presto hive jupyter clickhouse sqlite snowflake data-engineering redshift tsql spark-sql trino duckdb polars

• Updated Jun 29, 2026
• Python

🐍 Quick reference guide to common patterns & functions in PySpark.

documentation data-science data docs spark reference guide pyspark cheatsheet cheat quickstart references guides cheatsheets spark-sql pyspark-tutorial

• Updated Feb 21, 2023

Qubole Sparklens tool for performance tuning Apache Spark

performance scala spark simulation cluster scheduler scheduling performance-metrics performance-tuning performance-visualization performance-analysis sparkjava spark-job spark-applications spark-sql spark-mllib spark-ml

• Updated Jun 26, 2024
• Scala

The Internals of Spark SQL

spark apache-spark book internals spark-sql mkdocs-material

• Updated Oct 12, 2026

A data lakehouse on Databricks with the medallion architecture: PySpark, Spark SQL, Delta Lake and Unity Catalog. The project of the free Databricks bootcamp.

python sql apache-spark etl pyspark data-engineering data-analytics bootcamp beginner-friendly databricks data-pipeline spark-sql portfolio-project delta-lake lakehouse data-lakehouse unity-catalog medallion-architecture data-engineering-project data-with-baraa

• Updated Nov 6, 2026
• Jupyter Notebook

New Generation Opensource Data Stack Demo

python spark metabase cube dbt iceberg spark-sql datahub trino dagster trinodb

• Updated Feb 6, 2023
• Jupyter Notebook

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

react nodejs docker iot streaming kafka big-data spark apache-spark azure iothub spark-streaming sparksql kafka-streams streaming-data spark-sql servicefabric hdinsight cosmosdb eventhub

• Updated Nov 10, 2026
• C#

Practice Databricks coding skills with hands-on exercises. Import into Databricks Free Edition, write code, run assertions, check pass/fail. Covers Delta Lake, Spark SQL, PySpark, Auto Loader, medallion architecture, window functions, and more.

pyspark data-engineering databricks spark-sql delta-lake coding-practice medallion-architecture databricks-certification auto-loader

• Updated Oct 19, 2026
• Python

Use SQL to build ELT pipelines on a data lakehouse.

sql apache-spark etl pipelines data-engineering data-lake data-transfer delta data-integration upsert elt data-pipeline datalake data-ingestion spark-sql zeppelin-notebook apache-iceberg lakehouse incremental-updates

• Updated May 25, 2022
• JavaScript

Apache Spark™ and Scala Workshops

workshop spark apache-spark spark-sql spark-mllib spark-structured-streaming spark-workshops

• Updated Jul 29, 2024
• HTML

Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!

scala big-data spark sampling datasource spark-sql data-lakehouse

• Updated Jan 24, 2025
• Scala

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

nodejs python graphql docker machine-learning angular scala kafka big-data apache-spark mongodb hadoop avro twitter-api hbase spark-streaming parquet apache-flink kops spark-sql

• Updated Feb 1, 2019
• TypeScript