AWS Data Engineer | Backend Developer | Distributed Systems Practitioner
I'm passionate about building scalable data platforms, event-driven systems, and AI-backed applications using AWS, Python, and modern backend technologies.
- π¨βπ» 8+ years experience building cloud-native solutions across Logistics, Healthcare, Insurance & Analytics domains.
- π Skilled in AWS (ECS, Lambda, Glue, Kinesis, DynamoDB, Redshift), PySpark, FastAPI, Terraform & SQL.
- π Strong background in data engineering, ETL pipelines, and distributed system design.
- π€ Practitioner of async backend patterns, monitoring frameworks, and high-throughput data workflows.
- π¦ Currently focused on making data platforms reliable, observable, and scalable at enterprise scale.
Designing robust, scalable ETL pipelines with:
- S3 + Glue + Redshift
- Event-driven architectures (EventBridge, Kinesis)
- Monitoring & alerting frameworks
Building RESTful and async backend services using:
- FastAPI + Docker + Terraform
- Kubernetes (Azure AKS / AWS ECS)
- Redis / DynamoDB caching strategies
Frontend & tooling work using:
- React + Ant Design
- Streamlit for analytics interfaces
Here are some highlighted projects:
| Repository | Focus |
|---|---|
| data_engineering_literacy | Core concepts & patterns for modern data engineering |
| PySpark_Exclusive_Learning | PySpark hands-on samples & transformation logic |
| aws_solutions_architect | Notes & use-cases on AWS architecture best practices |
| Python-DataStructures-and-Algorithms | Data structures & algorithm implementations |
| data_visualization_pandas | Pandas-based charts & exploratory data visualization |
| design_patterns_python | Python design patterns for reusable clean code |
(More projects available in the repo list)
- π LinkedIn: https://www.linkedin.com/in/siva-rajan-70286187
- π GitHub: https://github.com/citysiva180
- π¦ Twitter: https://twitter.com/siva92_dsc
- π Portfolio: https://www.shivthedev.tech