I am a seasoned Senior Data Engineer with over 5 years of professional experience specializing in Big Data technologies, cloud computing, and data pipeline architectures. I have a strong background in Hadoop ecosystems and cloud platforms like Azure and AWS, enabling me to design and implement scalable, efficient ETL solutions and real-time streaming data workflows. My expertise extends to integrating data governance tools, managing metadata, and optimizing data processes for improved business insights. Throughout my career, I have worked extensively on cloud migrations, data warehousing, and real-time analytics solutions, collaborating across teams to translate business requirements into technical solutions. I am passionate about harnessing the power of cloud and big data to solve complex problems and drive data-driven decision making in organizations.

Kiran Kumar Manne

I am a seasoned Senior Data Engineer with over 5 years of professional experience specializing in Big Data technologies, cloud computing, and data pipeline architectures. I have a strong background in Hadoop ecosystems and cloud platforms like Azure and AWS, enabling me to design and implement scalable, efficient ETL solutions and real-time streaming data workflows. My expertise extends to integrating data governance tools, managing metadata, and optimizing data processes for improved business insights. Throughout my career, I have worked extensively on cloud migrations, data warehousing, and real-time analytics solutions, collaborating across teams to translate business requirements into technical solutions. I am passionate about harnessing the power of cloud and big data to solve complex problems and drive data-driven decision making in organizations.

Available to hire

I am a seasoned Senior Data Engineer with over 5 years of professional experience specializing in Big Data technologies, cloud computing, and data pipeline architectures. I have a strong background in Hadoop ecosystems and cloud platforms like Azure and AWS, enabling me to design and implement scalable, efficient ETL solutions and real-time streaming data workflows. My expertise extends to integrating data governance tools, managing metadata, and optimizing data processes for improved business insights.

Throughout my career, I have worked extensively on cloud migrations, data warehousing, and real-time analytics solutions, collaborating across teams to translate business requirements into technical solutions. I am passionate about harnessing the power of cloud and big data to solve complex problems and drive data-driven decision making in organizations.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
See more

Work Experience

Sr. Data Engineer at RBC, Canada
May 1, 2024 - Present
Led the development of data modeling strategies, improving system performance, scalability, and data governance using Collibra. Designed and optimized ETL pipelines and data warehouses using Azure Data Factory, Azure Databricks, and SSIS. Developed data movement and integration solutions involving cloud services such as Azure SQL Data Warehouse and HDInsight. Implemented Spark and Kafka streaming pipelines and managed workflows using Apache Oozie and Airflow. Migrated on-premises ETL processes to cloud environments and automated scripting tasks. Collaborated on multi-tier application deployments on AWS with strong focus on high availability and fault tolerance.
Data Engineer at Health Catalyst, India
August 31, 2022 - August 26, 2025
Designed and implemented PySpark-based data pipelines and processing tasks in AWS Glue environment. Developed and monitored Spark SQL queries and Spark streaming jobs integrated with Kafka for real-time data ingestion. Managed AWS environments including EC2 auto scaling and implemented cloud formation templates using Jenkins. Integrated Snowflake data warehouse with AWS S3 for complex data ingestion tasks. Automated workflows using Apache Airflow and handled data governance through Collibra integration. Delivered optimized ETL pipelines, data transformation and aggregation jobs, and managed NoSQL databases like HBase in big data ecosystems.

Education

Post Graduation Diploma at St. Clair College
January 1, 2024 - December 31, 2024
Diploma at Government Institute of Electronics
January 1, 2020 - December 31, 2020

Qualifications

Add your qualifications or awards here.

Industry Experience

Financial Services, Healthcare, Software & Internet, Professional Services