Available to hire
I am a Senior Data Engineer with over 4 years of experience specializing in building efficient ETL pipelines, developing data warehouses, and implementing scalable cloud infrastructure. I have a strong background in leveraging cutting-edge technologies like Apache Airflow, Kafka, Snowflake, and cloud platforms such as AWS and GCP to support real-time analytics and enhance data accuracy.
Throughout my career, I have successfully led teams, mentored junior engineers, and contributed to critical projects ranging from database migrations to backend API development. I am passionate about delivering robust data solutions that drive business insights and improve operational efficiency.
Skills
Language
English
Fluent
Hindi
Fluent
Work Experience
Senior Data Engineer at Ramani (YC W20)
January 1, 2024 - November 30, 2024Engineered and maintained scalable ETL pipelines using Apache Airflow and Kafka, increasing data processing efficiency and supporting real-time analytics for over 5TB of data across MongoDB and PostgreSQL databases. Introduced industry-standard data practices and developed data validation protocols, increasing data accuracy and reducing discrepancies across multiple datasets. Mentored junior data engineers, increasing team productivity through 1-on-1 training sessions and structured workshops focusing on advanced ETL processes and big data technologies.
Senior Data Engineer (Founding Member) at Complya (Techstars)
April 1, 2023 - December 31, 2023Spearheaded the development and implementation of the company's core data, backend, and cloud infrastructure from scratch, laying the foundation for scalable and efficient systems. Mentored a growing team of developers, significantly improving their technical skills, resulting in their productivity boost. Engineered data processing pipelines, reducing processing times and enhancing data-driven decision-making efficiency. Strategically optimized cloud infrastructure, achieving a 25% cost reduction, while maintaining high availability.
Senior Software Engineer - Data Engineering at Alopa
September 1, 2020 - March 31, 2023Pioneered the end-to-end development and maintenance of Snowflake data pipelines, leveraging Apache Airflow for automation and DBT for efficient data transformation, enabling real-time insights and tremendous increase in revenue generation. Achieved a monumental 6x acceleration in data operations, and decreased data discrepancies by 50% using SQL validation. Optimized Snowflake architecture for security, performance, and maintenance, reducing system downtime by 70%. Developed a reusable data model, enhancing customer forecasting accuracy by 35%.
Senior Data Engineer at Ramani (YC W20)
January 1, 2024 - November 30, 2024Engineered and maintained scalable ETL pipelines using Apache Airflow and Kafka, increasing data processing efficiency and supporting real-time analytics for over 5TB of data across MongoDB and PostgreSQL databases. Introduced industry-standards data practices and developed data validation protocols, increasing data accuracy and reducing discrepancies across multiple datasets. Mentored junior data engineers, increasing team productivity through 1-on-1 training sessions and structured workshops focusing on advanced ETL processes and big data technologies.
Senior Data Engineer (Founding Member) at Complya (Techstars)
April 1, 2023 - December 31, 2023Spearheaded the development and implementation of the company's core data, backend, and cloud infrastructure from scratch, laying the foundation for scalable and efficient systems. Mentored a growing team of developers, significantly improving their technical skills, resulting in their productivity boost. Engineered data processing pipelines, reducing processing times and enhancing data-driven decision-making efficiency. Strategically optimized cloud infrastructure, achieving a 25% cost reduction, while maintaining high availability.
Senior Software Engineer - Data Engineering at Alopa
September 1, 2020 - March 31, 2023Pioneered the end-to-end development and maintenance of Snowflake data pipelines, leveraging Apache Airflow for automation and DBT for efficient data transformation, enabling real-time insights and tremendous increase in revenue generation. Achieved a monumental 6x acceleration in data operations, and decreased data discrepancies by 50% using SQL validation. Optimized Snowflake architecture for security, performance, and maintenance, reducing system downtime by 70%. Developed a reusable data model, enhancing customer forecasting accuracy by 35%.
Education
Bachelor of Engineering (B.E.) at KLE Technological University, Hubballi, Karnataka, India
August 1, 2016 - June 30, 2020Bachelor of Engineering at KLE Technological University
August 1, 2016 - June 30, 2020Qualifications
Industry Experience
Software & Internet, Healthcare, Professional Services, Financial Services, Other
Skills
Hire a Programmer
We have the best programmer experts on Twine. Hire a programmer in Bengaluru today.