cloud-data

Real-time stock market analytics pipeline using Kafka, Airflow, dbt, Snowflake, and Power BI. Built with a modern Bronze–Silver–Gold architecture for streaming analytics.

End-to-end data engineering pipeline using Apache Airflow to orchestrate S3-to-Redshift ETL workflows with custom operators, staging, fact and dimension loads, SQL transformations, and automated data quality checks.

Get cloud data from INSAT in GIF form

Job-ready data engineering portfolio showcasing real-world pipelines, ETL workflows, data modeling, cloud data architecture, SQL, Python, snowflake and analytics engineering projects.

Production-grade batch data pipeline on GCP 📊 Tech Stack: GCP | Airflow | BigQuery | Terraform | Python

End-to-end Azure Data Engineering pipeline using Databricks, Delta Lake and ADLS Gen2. Medallion architecture (Bronze/Silver/Gold) with automated scheduling, monitoring and cost-optimized orchestration.

Projeto referente ao processo seletivo.

An advanced, open-source framework for retrieving, processing, and visualizing diverse cloud data. Built with Python, Docker, and integrated CI/CD workflows, this solution offers RESTful API integration, high-performance data analytics, and interactive visualization capabilities for scalable cloud data management.

Python-based cloud data pipeline demonstrating ETL, data quality checks, and containerized execution.

Urban Intelligence (CivicPulse) is an end-to-end cloud data platform designed to deliver reliable, transparent, and explainable city-service performance metrics.