I'm Chetan Kasar, a data engineering professional with 12+ years of experience, specializing in Oracle and PostgreSQL, Python, PySpark, and cloud data platforms. I design robust, scalable data pipelines, optimize SQL, and deliver reliable data-driven insights for e-commerce and financial services. I enjoy turning complex data into actionable business intelligence and collaborating with cross-functional teams to drive value. Currently I serve as Senior Data Engineer II at Pattern Technologies in Pune, where I architect fault-tolerant data pipelines, implement iceberg-format storage, and orchestrate workflows with Apache Airflow. In my free time I mentor peers and keep learning through courses on AWS, Spark, and data engineering best practices.

Chetan Kasar

I'm Chetan Kasar, a data engineering professional with 12+ years of experience, specializing in Oracle and PostgreSQL, Python, PySpark, and cloud data platforms. I design robust, scalable data pipelines, optimize SQL, and deliver reliable data-driven insights for e-commerce and financial services. I enjoy turning complex data into actionable business intelligence and collaborating with cross-functional teams to drive value. Currently I serve as Senior Data Engineer II at Pattern Technologies in Pune, where I architect fault-tolerant data pipelines, implement iceberg-format storage, and orchestrate workflows with Apache Airflow. In my free time I mentor peers and keep learning through courses on AWS, Spark, and data engineering best practices.

Available to hire

I’m Chetan Kasar, a data engineering professional with 12+ years of experience, specializing in Oracle and PostgreSQL, Python, PySpark, and cloud data platforms. I design robust, scalable data pipelines, optimize SQL, and deliver reliable data-driven insights for e-commerce and financial services. I enjoy turning complex data into actionable business intelligence and collaborating with cross-functional teams to drive value.

Currently I serve as Senior Data Engineer II at Pattern Technologies in Pune, where I architect fault-tolerant data pipelines, implement iceberg-format storage, and orchestrate workflows with Apache Airflow. In my free time I mentor peers and keep learning through courses on AWS, Spark, and data engineering best practices.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert

Language

English
Fluent

Work Experience

Senior Data Engineer II at Pattern Technologies
January 1, 2024 - Present
Project: Predict Shelf Domain: E-Commerce. Data Acquisition from AWS S3, AWS SQS, and AWS SNS using Spark SQL. Data Storage using Iceberg format (Data Lakehouse) and AWS Glue Catalog with day-hour level data partitioning. Data Transformation (SCD Type 1 & Type 2) using Spark SQL on Iceberg. Fault-tolerant data pipelines using Iceberg Write-Audit-Publish (WAP). Defining data quality checks (Audit) for Iceberg-based data lakehouse to ensure transactional atomicity. Orchestrating data pipelines with Apache Airflow MWAA.
Senior Data Engineer I at Pattern Technologies
January 1, 2023 - January 31, 2024
Designed and implemented fault-tolerant, cost-optimized, high-performance ETL pipelines. Consolidated three extract mechanisms (Full, Incremental, Customized) within single pipelines. Wrote and optimized large, dynamic SQL queries for complex business requirements using PostgreSQL and Snowflake. Integrated dynamic SQL with GitHub CI/CD and orchestrated parameterized queries with Airflow. Built an error framework for data quality and dashboards.
Data Engineer at Action Labs
October 1, 2021 - January 31, 2023
Data acquisition from S3 staging and raw buckets; processing with Glue jobs (Python and PySpark) and loading into S3 staging. Created external tables on S3 atop Snowflake storage integrations and external stages. Built incremental tables on external tables and fed Tableau dashboards. Developed Airflow (MWAA) DAGs for schedule/orchestration of fault-tolerant ETL pipelines. Implemented table audit mechanisms and alerting. Generated daily and monthly KPI dashboards.
Data Analyst at Aditya Birla Capital AMC
September 1, 2017 - August 31, 2019
Built near real-time Power BI dashboards and dashboards for senior management. Developed and optimized Oracle PL/SQL scripts for validations. Managed Oracle database schema, encryption (TDE), and data masking. Developed anomaly detection algorithms to monitor real-time data and detect unusual transactions.
Software Engineer – Oracle Database Developer / Junior DBA at EFkon India Pvt Ltd
June 1, 2016 - September 30, 2017
Developed, optimized, and managed Oracle database operations. Extracted required reports via Oracle SQL and built Oracle PL/SQL scripts for complex validations. Optimized database performance and managed backups and recovery.
Software Engineer – Oracle Database Developer at Capgemini
February 1, 2015 - June 30, 2016
Extracted required reports using Oracle SQL. Optimized complex SQL queries and monitored system anomalies, backups, and recoveries.

Education

Bachelor of Engineering (B.E.) in Electronics at AISSMS IOIT, Pune
June 1, 2009 - May 31, 2013

Qualifications

Data Science Prodegree
October 1, 2017 - March 31, 2018
AWS Solution Architect Professional
November 1, 2020 - December 31, 2020
AWS EMR and Spark 2 using Scala
April 27, 2021 - January 30, 2026
AWS Certified Developer - Associate
February 29, 2024 - January 30, 2026

Industry Experience

Software & Internet, Professional Services, Financial Services

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert

Hire a Data Analyst

We have the best data analyst experts on Twine. Hire a data analyst in Pune today.