Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I’m a GCP Data Engineer with 5+ years of experience building and improving scalable data pipelines and cloud-based data solutions on Google Cloud Platform. I focus on designing reliable batch and streaming workflows, transforming data with SQL, Python, and PySpark, and delivering analytics-ready datasets in BigQuery. I enjoy optimizing performance and cost through BigQuery partitioning/clustering and careful query design, while also strengthening data trust with data quality checks, monitoring, and logging. Whether it’s orchestrating workflows with Cloud Composer (Airflow), integrating systems via Pub/Sub, or setting up secure access controls, I aim to create secure, high-performance pipelines that help teams make faster, better data-driven decisions.…I’m a GCP Data Engineer with 5+ years of experience building and improving scalable data pipelines and cloud-based data solutions on Google Cloud Platform. I focus on designing reliable batch and streaming workflows, transforming data with SQL, Python, and PySpark, and delivering analytics-ready datasets in BigQuery. I enjoy optimizing performance and cost through BigQuery partitioning/clustering and careful query design, while also strengthening data trust with data quality checks, monitoring, and logging. Whether it’s orchestrating workflows with Cloud Composer (Airflow), integrating systems via Pub/Sub, or setting up secure access controls, I aim to create secure, high-performance pipelines that help teams make faster, better data-driven decisions.

Mayuri Gaddam

Data Engineer, Software Engineer, Cloud Developer, +1





I’m a GCP Data Engineer with 5+ years of experience building and improving scalable data pipelines and cloud-based data solutions on Google Cloud Platform. I focus on designing reliable batch and streaming workflows, transforming data with SQL, Python, and PySpark, and delivering analytics-ready datasets in BigQuery. I enjoy optimizing performance and cost through BigQuery partitioning/clustering and careful query design, while also strengthening data trust with data quality checks, monitoring, and logging. Whether it’s orchestrating workflows with Cloud Composer (Airflow), integrating systems via Pub/Sub, or setting up secure access controls, I aim to create secure, high-performance pipelines that help teams make faster, better data-driven decisions.…I’m a GCP Data Engineer with 5+ years of experience building and improving scalable data pipelines and cloud-based data solutions on Google Cloud Platform. I focus on designing reliable batch and streaming workflows, transforming data with SQL, Python, and PySpark, and delivering analytics-ready datasets in BigQuery. I enjoy optimizing performance and cost through BigQuery partitioning/clustering and careful query design, while also strengthening data trust with data quality checks, monitoring, and logging. Whether it’s orchestrating workflows with Cloud Composer (Airflow), integrating systems via Pub/Sub, or setting up secure access controls, I aim to create secure, high-performance pipelines that help teams make faster, better data-driven decisions.

Available to hire

I’m a GCP Data Engineer with 5+ years of experience building and improving scalable data pipelines and cloud-based data solutions on Google Cloud Platform. I focus on designing reliable batch and streaming workflows, transforming data with SQL, Python, and PySpark, and delivering analytics-ready datasets in BigQuery.

I enjoy optimizing performance and cost through BigQuery partitioning/clustering and careful query design, while also strengthening data trust with data quality checks, monitoring, and logging. Whether it’s orchestrating workflows with Cloud Composer (Airflow), integrating systems via Pub/Sub, or setting up secure access controls, I aim to create secure, high-performance pipelines that help teams make faster, better data-driven decisions.

Skills

Experience Level

Expert

Expert

Expert

Expert

Beginner

Work Experience

GCP Data Engineer at Unique Infosolution Pvt Ltd

May 1, 2024 - Present

Analyzed migration requirements from legacy mainframe systems to GCP and supported planning for migration scope. Built batch ingestion workflows using Cloud Composer to orchestrate daily/hourly jobs that load data from Cloud Storage into BigQuery. Implemented fine-grained security using BigQuery authorized views and access controls. Wrote and optimized complex BigQuery SQL for transformation, cleansing, and aggregation for reporting and analytics. Developed DDL/DML scripts to load data from GCS into BigQuery, and ensured data quality and integrity using validation checks within Composer DAGs and transformation steps. Organized and maintained GCS buckets for raw, staging, and processed datasets. Monitored pipeline health and DAG execution via Cloud Monitoring, handling common failures and performance alerts with senior support.

GCP Data Engineer at Unique Infosolution Pvt Ltd

February 1, 2022 - April 30, 2024

Built an end-to-end data migration pipeline for insurance transactions and user data on GCP. Orchestrated ingestion from a landing zone into GCS using Apache Airflow, then transformed data with PySpark and loaded it into BigQuery staging. Loaded curated datasets into a BigQuery history layer for long-term, analytics-ready access. Created and managed GCP resources including Cloud Storage buckets and BigQuery datasets/tables across development, staging, and production. Implemented real-time pipelines using Google Cloud Pub/Sub into BigQuery for analytics. Developed batch and streaming processing pipelines with Dataflow (Apache Beam). Designed BigQuery authorized views to securely share curated datasets with ML models, dashboards, and reporting tools. Wrote and optimized SQL for ingestion, transformation, and reporting; deployed Airflow DAGs in Cloud Composer to orchestrate processing jobs and used GitHub for version control in an Agile workflow.