I am a Senior Data Engineer / AI Engineer with 10+ years of experience designing, building, and optimizing scalable data, analytics, and AI platforms across AWS, Azure, and GCP. I architect cloud-native data solutions, ML platform development, feature engineering, real-time inference, and production-grade MLOps, including integrating Large Language Models (LLMs) for enterprise capabilities such as semantic search, document summarization, and retrieval-augmented generation. I thrive in collaborative, Agile environments, guiding teams, ensuring data quality and governance, and translating complex data and AI concepts into actionable business insights. I am passionate about delivering reliable, cost-effective AI solutions that drive decision-making and innovation, and I enjoy partnering with data scientists and cross-functional stakeholders to productionize analytics and AI at scale.

Shivani

I am a Senior Data Engineer / AI Engineer with 10+ years of experience designing, building, and optimizing scalable data, analytics, and AI platforms across AWS, Azure, and GCP. I architect cloud-native data solutions, ML platform development, feature engineering, real-time inference, and production-grade MLOps, including integrating Large Language Models (LLMs) for enterprise capabilities such as semantic search, document summarization, and retrieval-augmented generation. I thrive in collaborative, Agile environments, guiding teams, ensuring data quality and governance, and translating complex data and AI concepts into actionable business insights. I am passionate about delivering reliable, cost-effective AI solutions that drive decision-making and innovation, and I enjoy partnering with data scientists and cross-functional stakeholders to productionize analytics and AI at scale.

Available to hire

I am a Senior Data Engineer / AI Engineer with 10+ years of experience designing, building, and optimizing scalable data, analytics, and AI platforms across AWS, Azure, and GCP. I architect cloud-native data solutions, ML platform development, feature engineering, real-time inference, and production-grade MLOps, including integrating Large Language Models (LLMs) for enterprise capabilities such as semantic search, document summarization, and retrieval-augmented generation.

I thrive in collaborative, Agile environments, guiding teams, ensuring data quality and governance, and translating complex data and AI concepts into actionable business insights. I am passionate about delivering reliable, cost-effective AI solutions that drive decision-making and innovation, and I enjoy partnering with data scientists and cross-functional stakeholders to productionize analytics and AI at scale.

See more

Language

English
Fluent

Work Experience

Sr. Data Engineer / AI Engineer at Regeneron
July 1, 2024 - Present
Led the end-to-end SDLC for 15+ large-scale data engineering and AI initiatives, delivering on time with high reliability. Tuned SQL Server performance; architected scalable AWS data platforms (RDS, Redshift) to boost query performance and data accessibility by up to 50%. Built distributed pipelines with Python, Spark, and Databricks for batch and real-time analytics; orchestrated event-driven workflows with Step Functions; implemented real-time streaming with Kinesis. Developed secure data lakes and governance via Glue Lake Formation; containerized with Docker/Kubernetes; designed ML pipelines and feature stores; productionized models; integrated LLMs for semantic search, document summarization, and Q&A; built RAG pipelines; monitored AI workloads with CloudWatch; automated ML/LLM CI/CD; explored agentic AI solutions to improve response times by 35%.
Data Engineer at Fandango
August 1, 2022 - June 1, 2024
Developed and managed ETL pipelines with Informatica; built feature-ready datasets and automated training data pipelines to support model experimentation. Designed Snowflake data models and optimized queries (40% faster). Used Amazon Athena for ad-hoc queries; automated preprocessing with Python/Boto3; implemented Lambda/Step Functions for serverless processing. Built data lakes on S3; tuned MongoDB and MySQL for analytics and ML training; enforced data security with IAM/Lake Formation. Integrated Kafka streams for near real-time analytics; wrote optimized SQL; built dimensional models; processed data on EMR/Databricks; collaborated with analytics and data science teams on feature engineering and CI/CD with Jenkins.
Data Engineer at Huntington Bank
October 1, 2020 - July 1, 2022
Developed automated PowerShell scripts to streamline data processing; leveraged Apache Spark for distributed processing. Designed data integration using Azure Synapse; managed SQL Server databases; built data workflows with Azure Data Factory and ADLS, and used Azure SQL DB. Implemented PySpark transformations and real-time analytics with Azure Stream Analytics; created serverless Azure Functions for automation. Collaborated with teams using Azure DevOps for CI/CD; built Power BI dashboards; employed Agile/Scrum; practiced data governance and security with IAM; managed cloud cost controls.
Jr. Data Engineer at Philips Healthcare
June 1, 2018 - September 30, 2020
Developed ETL workflows in Talend to ingest data into GCP Cloud Storage; built pipelines with BigQuery, Dataflow, Dataproc; used Spark/Hadoop for large-scale processing. Created serverless data solutions with Cloud Functions; orchestrated with Airflow; monitored with Stackdriver. Applied Scala for transformations; modeled data and validated quality; tuned Oracle performance; collaborated via GitHub; followed Agile/Kanban; contributed to data governance.
Data Analyst at Oracle, Hyderabad
May 1, 2014 - April 30, 2016
Designed and optimized SQL queries; automated ETL with SSIS; used Pandas/NumPy for cleaning and analysis; processed with Hadoop; built dashboards in Tableau; conducted statistical analyses; managed data storage on AWS S3/RDS; documented processes in Confluence; collaborated with teams via Git.

Education

Add your educational history here.

Qualifications

Add your qualifications or awards here.

Industry Experience

Healthcare, Media & Entertainment, Financial Services, Professional Services, Software & Internet