Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I am a Senior Data Engineer with over 5 years of experience specializing in Big Data technologies, cloud platforms, and scalable data pipeline designs. My expertise spans AWS, Azure, and GCP ecosystems, where I have built robust ETL/ELT solutions and implemented ML workflows that drive business analytics and compliance, particularly in financial services. I have a solid foundation in programming languages including Python, Scala, SQL, and R, with a strong passion for leveraging data to create insightful and efficient solutions. I thrive in collaborative Agile environments, mentoring teams and integrating DevOps practices with data engineering efforts. I continuously explore advancements in AI/ML, MLOps, and cloud infrastructure to enhance data governance, security, and operational excellence. My goal is to use my skills in data engineering and analytics to empower organizations with actionable insights and predictive models for strategic decision-making.…I am a Senior Data Engineer with over 5 years of experience specializing in Big Data technologies, cloud platforms, and scalable data pipeline designs. My expertise spans AWS, Azure, and GCP ecosystems, where I have built robust ETL/ELT solutions and implemented ML workflows that drive business analytics and compliance, particularly in financial services. I have a solid foundation in programming languages including Python, Scala, SQL, and R, with a strong passion for leveraging data to create insightful and efficient solutions. I thrive in collaborative Agile environments, mentoring teams and integrating DevOps practices with data engineering efforts. I continuously explore advancements in AI/ML, MLOps, and cloud infrastructure to enhance data governance, security, and operational excellence. My goal is to use my skills in data engineering and analytics to empower organizations with actionable insights and predictive models for strategic decision-making.

Ravi Krishna

Data Scientist, Developer, AI Engineer, +2





I am a Senior Data Engineer with over 5 years of experience specializing in Big Data technologies, cloud platforms, and scalable data pipeline designs. My expertise spans AWS, Azure, and GCP ecosystems, where I have built robust ETL/ELT solutions and implemented ML workflows that drive business analytics and compliance, particularly in financial services. I have a solid foundation in programming languages including Python, Scala, SQL, and R, with a strong passion for leveraging data to create insightful and efficient solutions. I thrive in collaborative Agile environments, mentoring teams and integrating DevOps practices with data engineering efforts. I continuously explore advancements in AI/ML, MLOps, and cloud infrastructure to enhance data governance, security, and operational excellence. My goal is to use my skills in data engineering and analytics to empower organizations with actionable insights and predictive models for strategic decision-making.…I am a Senior Data Engineer with over 5 years of experience specializing in Big Data technologies, cloud platforms, and scalable data pipeline designs. My expertise spans AWS, Azure, and GCP ecosystems, where I have built robust ETL/ELT solutions and implemented ML workflows that drive business analytics and compliance, particularly in financial services. I have a solid foundation in programming languages including Python, Scala, SQL, and R, with a strong passion for leveraging data to create insightful and efficient solutions. I thrive in collaborative Agile environments, mentoring teams and integrating DevOps practices with data engineering efforts. I continuously explore advancements in AI/ML, MLOps, and cloud infrastructure to enhance data governance, security, and operational excellence. My goal is to use my skills in data engineering and analytics to empower organizations with actionable insights and predictive models for strategic decision-making.

Available to hire

I am a Senior Data Engineer with over 5 years of experience specializing in Big Data technologies, cloud platforms, and scalable data pipeline designs. My expertise spans AWS, Azure, and GCP ecosystems, where I have built robust ETL/ELT solutions and implemented ML workflows that drive business analytics and compliance, particularly in financial services. I have a solid foundation in programming languages including Python, Scala, SQL, and R, with a strong passion for leveraging data to create insightful and efficient solutions.

I thrive in collaborative Agile environments, mentoring teams and integrating DevOps practices with data engineering efforts. I continuously explore advancements in AI/ML, MLOps, and cloud infrastructure to enhance data governance, security, and operational excellence. My goal is to use my skills in data engineering and analytics to empower organizations with actionable insights and predictive models for strategic decision-making.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Work Experience

Senior Data Engineer at Global Relay – Vancouver, BC

August 1, 2024 - Present

Designed and developed scalable ETL/ELT pipelines using AWS Glue, PySpark, and Athena, automating metadata ingestion and optimizing SQL queries over S3 data. Built and managed Snowflake stage area tables with Snowpipe integrations, enhancing financial reporting workflows. Architected enterprise-grade Data Lakes leveraging AWS services supporting real-time analytics and high-volume processing. Migrated complex Talend ETL workflows to a custom Python-based framework with scheduling capabilities. Built automated workflows with Apache Airflow and lightweight Flask services for monitoring and configuration. Ensured FINRA and GDPR compliance with encryption, access controls, and auditing. Leveraged Kafka for real-time event-driven architectures and optimized Snowflake database schemas to improve performance. Mentored offshore teams and utilized Databricks for big data transformations and analytics.

Senior Data Engineer at HSBC - India

December 1, 2022 - August 26, 2025

Collaborated with stakeholders to gather requirements and design scalable data pipelines using Azure Data Factory and Databricks. Built ETL/ELT workflows ingesting data into Azure Data Lake Gen2 and Synapse Analytics. Developed PySpark applications for data cleansing and transformation, integrated MongoDB for event-driven ingestion, and automated pipelines with Blob Triggers and scheduling. Applied SAS for customer behavior analysis and risk assessment ensuring audit readiness. Designed event-driven architectures and optimized cluster and pipeline runtime for cost efficiency. Managed CI/CD pipelines with Azure DevOps and Terraform for infrastructure as code. Worked extensively with SQL Server, Power BI, and integrated Apache Cassandra with Spark for advanced analytics in Agile environments.

Data Engineer at Birlasoft, India

April 1, 2021 - August 26, 2025

Built ETL pipelines using Apache Beam and Dataflow and orchestrated workflows via Cloud Composer for scheduling and monitoring. Managed BigQuery datasets with optimizations for analytics and cost savings. Developed Node.js and Python scripts for cloud data auditing, PII checks, and data ingestion. Created streaming pipelines with Spark, Kafka, and Pub/Sub for real-time analytics, and processed big data with Hadoop, Hive, Pig, and Sqoop on Dataproc. Applied dimensional modeling for data marts and designed dashboards in Power BI connected to BigQuery. Participated in cloud migration projects with full lifecycle ownership and developed ML models for fraud detection integrated with GCP pipelines.

Senior Data Engineer at Global Relay – Vancouver, BC

August 1, 2024 - Present

Designed and developed scalable ETL/ELT pipelines using AWS Glue, PySpark, and Athena, automating metadata ingestion and querying S3 data. Managed Snowflake stage area tables with Snowpipe and SnowSQL scripts, deployed enterprise-grade Data Lakes leveraging AWS services for real-time analytics. Migrated Talend ETL workflows to Python-based frameworks with scheduling and Control-M integration. Implemented secure data governance with Unity Catalog and Delta Lake, developed lightweight Flask services for job monitoring, and orchestrated workflows with Apache Airflow. Optimized Snowflake schemas, developed model monitoring dashboards using Databricks and Python, and ensured FINRA and GDPR compliance through encryption and audit automation. Mentored teams and handled high-volume financial datasets with Kafka event-driven architectures.

Senior Data Engineer at HSBC - India

December 31, 2022 - August 26, 2025

Collaborated with business units to gather requirements and built scalable data pipelines using Azure Data Factory and Databricks. Developed ETL/ELT workflows integrating structured and semi-structured data into Azure Data Lake Gen2 and Synapse. Automated ML model pipelines with Azure ML integration. Developed Java ETL utilities and Python/PySpark transformations. Created streaming data pipelines with Spark for near real-time processing. Used Terraform for Azure infrastructure automation and ensured security with SPN and App Registrations. Improved BI reporting integrating Power BI with SSAS, maintained big enterprise SQL Server DBs, and participated in Agile processes with cross-functional teams.

Data Engineer at Birlasoft, India

April 30, 2021 - August 26, 2025

Built scalable ETL pipelines using Apache Beam and Dataflow on GCP and orchestrated workflows with Cloud Composer (Airflow). Managed BigQuery datasets, optimized queries, and developed streaming pipelines with Spark and Kafka. Developed PySpark data cleansing and feature engineering for ML use cases, maintained Hadoop scripting for structured data processing, and applied dimensional modeling for data marts. Implemented GCP IAM policies for secure data access and built Power BI dashboards for analytics. Led cloud migration projects involving state agencies and developed fraud detection ML models integrated with data pipelines.