I am a Senior Data Engineer & Architect with 12 years of IT experience across data engineering, analytics, architecture, and technical leadership. I have built cloud-native platforms on AWS (S3, Glue, EMR), Databricks, and Snowflake, and led migrations of on-premise data to cloud-native applications. I am adept at building scalable PySpark and SQL frameworks, optimizing SQL performance, and automating data workflows. I enjoy mentoring teams and collaborating with enterprise stakeholders to deliver high-impact solutions in regulated environments. I currently drive data engineering initiatives for healthcare data analytics, focusing on harmonized data models, end-to-end pipelines, and production support.

Surendra kumar A

I am a Senior Data Engineer & Architect with 12 years of IT experience across data engineering, analytics, architecture, and technical leadership. I have built cloud-native platforms on AWS (S3, Glue, EMR), Databricks, and Snowflake, and led migrations of on-premise data to cloud-native applications. I am adept at building scalable PySpark and SQL frameworks, optimizing SQL performance, and automating data workflows. I enjoy mentoring teams and collaborating with enterprise stakeholders to deliver high-impact solutions in regulated environments. I currently drive data engineering initiatives for healthcare data analytics, focusing on harmonized data models, end-to-end pipelines, and production support.

Available to hire

I am a Senior Data Engineer & Architect with 12 years of IT experience across data engineering, analytics, architecture, and technical leadership. I have built cloud-native platforms on AWS (S3, Glue, EMR), Databricks, and Snowflake, and led migrations of on-premise data to cloud-native applications. I am adept at building scalable PySpark and SQL frameworks, optimizing SQL performance, and automating data workflows. I enjoy mentoring teams and collaborating with enterprise stakeholders to deliver high-impact solutions in regulated environments.

I currently drive data engineering initiatives for healthcare data analytics, focusing on harmonized data models, end-to-end pipelines, and production support.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate

Work Experience

Data Engineer at Virtusa (Chase/JPMorgan: DocData)
February 1, 2022 - May 31, 2022
Developed Apache Spark / PySpark data pipelines using Python and AWS services (S3, EMR, Redshift, Glue, Athena) with Airflow for orchestration. Collaborated with business and technical stakeholders to translate requirements into compliant technical solutions and provided production support including incident management and performance tuning.
Data Engineer at LAAD
June 1, 2023 - October 31, 2023
Developed and optimized data processing pipelines for analytics use cases. Tech Stack: Python, PySpark, Databricks.
Data Engineer at DataOps
February 1, 2023 - June 30, 2023
Implemented cloud-based big data pipelines and orchestration frameworks to support data ingestion and analytics. Tech Stack: Apache Spark, PySpark, Python, Amazon S3, EMR, Redshift, AWS Glue, Athena, Airflow.
Data Engineer at Sutter Health Data Hub
September 1, 2016 - February 28, 2017
Contributed to Sutter Health Data Hub initiatives using Spark, PySpark, Python and AWS services (S3, EMR, Redshift, Glue, Athena, Airflow) to support data integration and analytics.
Data Warehousing & Reporting Specialist at GWBT (Tata Consultancy Services)
October 1, 2014 - August 31, 2016
Worked on GWBT Data Warehousing and Reporting using Oracle 12c, Netezza 7.2.1, Informatica PowerCenter 10.2, Toad, Autosys R11, Unix, Power BI.
Software/ETL Developer at Copper Advance Structure (CAS) - Tata Consultancy Services
March 1, 2011 - September 30, 2014
Core Java, Servlets, JSP, SQL, Unix involved in data engineering tasks across CAS projects.

Education

Add your educational history here.

Qualifications

B.Tech (Computer Science)
January 11, 2030 - January 18, 2026
B.Tech (Computer Science)
January 11, 2030 - January 18, 2026

Industry Experience

Healthcare, Life Sciences, Financial Services, Professional Services, Software & Internet, Telecommunications