atit

Optimized company matching algorithm by migrating a complex, Python-based process into Amazon Redshift SQL, significantly improving accuracy and performance, reducing runtime from over 2 hours to under 2 minutes. Designed and built a self-service web portal with Streamlit enabling ESG analysts to independently perform data validation, data quality checks and data overrides – removing dependency on engineering and accelerating operational workflows. Established a scalable CI/CD process using GitHub Actions and Terraform to automate the deployment of the self-service portal and backend services to AWS ECS Fargate, ensuring consistent, secure and reproducible releases.

Collaborated with cross-functional teams to design and implement a customer-facing reporting solution using dbt and Metabase on top of BigQuery, resulting in increased customer satisfaction. Designed and built robust data pipelines to ingest and integrate data from third-party platforms (e.g., Stripe, Zendesk) into the central data warehouse, enabling a unified, end-to-end view of Rezdy’s customer base for cross-functional business insights. Developed and maintained data pipelines using SQL, Python, and dbt, ensuring data accuracy and reliability for reporting purposes in BigQuery. Implemented self-service capabilities for internal teams by deploying Streamlit on Cloud Run, allowing ad-hoc data extraction and loading into the data warehouse; enabled external stakeholders to create custom dashboards and uncover insights independently using the GoodData BI tool. Designed, implemented and integrated testing automation as part of CI/CD pipeline using Terraform, Jenkins and GitHub Actions

Established End-to-End Data Platform: spearheaded the setup of a modern data platform from scratch, utilizing technologies such as Fivetran, Databrick and dbt to bring data from blockchain sources into a central repository (Lakehouse). Developed a Python-based Object-Oriented Programming module in AWS Lambda to facilitate extraction of complex blockchain data via API calls, and integrated it into the platform. Developed transformation processes using dbt on the Medallion architecture, ensuring efficient data integration and high data quality. Contributed to the development of best practices and coding standards for dbt, Databricks and Medallion framework usage within the organization. Developed an orchestration framework using Databricks Workflows to coordinate dependencies between the Fivetran landing process and the dbt transformation process. Used Terraform to automate deployment of AWS Lambdas and custom Fivetran connectors; supported BAU activities in the existing platform using P