Akhil Chitneni

Led the migration of ETL workflows from Domo to Azure Data Factory and Databricks, migrating workloads to more efficient cloud-based infrastructure. Designed and deployed data pipelines in GCP using Cloud Functions, Pub/Sub, and Cloud Composer (Airflow) to ingest and process API-based data. Replaced legacy batch jobs with Airflow DAGs, eliminating manual triggers and log checks and enabling end-to-end visibility into daily marketing and sales data pipelines. Developed modular dbt models transforming raw marketing data into curated business-layer datasets within Snowflake and BigQuery. Automated extraction from Google Analytics, Meta (Facebook Ads), and Criteo using KNIME, and created data marts in Snowflake using dimensional modeling to support Sales and Marketing, boosting BI reporting speed. Implemented end-to-end ETL/ELT processes populating Snowflake data marts leveraging Snowpipe and Streams for near real-time availability. Established dbt test suites and source freshness checks,

Ingested data from disparate source systems using Azure Data Factory. Executed data validation via SSIS packages and stored procedures. Leveraged Redis for real-time processing and analytics, ingesting data into Azure Data Lake/Storage/SQL/Data Warehouse and processing in Azure Databricks. Implemented Spark Streaming for streaming analytics and integrated Azure Active Directory authentication for Cosmos DB requests. Scheduled data jobs with CRON expressions. Developed Spark applications using PySpark and Spark SQL, and orchestrated complex ETL workflows with Airflow or Luigi. Built Python scripts to automate ETL processes, and coordinated workflows via Apache Oozie. Gained experience with Alteryx, Kafka, and Fivetran for data prep and pipeline automation. Environment included Azure HDInsight, Databricks, CosmosDB, Snowflake, MongoDB, and Kafka.

Created data pipelines in Azure Data Factory to extract/transform/load data from Azure SQL, Blob storage, and SQL Data Warehouse, integrating data from multiple sources. Designed databases and platform architectures in Azure Cloud. Prepared dashboards in Power BI and developed Python-based ETL scripts. Demonstrated Agile delivery (Scrum/Kanban) and trained users on analytics capabilities. Built Spark/Scala code for faster data processing and deployed SSRS reports. Worked with SQL Server Integration Services (SSIS) for data transformations, and leveraged Kafka or Flink for real-time streaming solutions.