Name		Name	Last commit message	Last commit date
Latest commit History 8 Commits
.gitignore		.gitignore
README.md		README.md
iceberg.ipynb		iceberg.ipynb
iceberg.py		iceberg.py
main.py		main.py
practice.ipynb		practice.ipynb

Repository files navigation

BigData

About

BigData is a powerful data processing project that focuses on handling large-scale datasets using PySpark, Apache Iceberg, and Snapshot Management. This repository contains efficient ETL pipelines, data lake optimizations, and snapshot-based versioning for scalable and reliable big data analytics.

python apache-spark iceberg snapshots

Readme