Available to hire
Hi! I’m Shikha Agarwal, a data engineer based in London, UK, with 4 years of hands-on experience building robust data pipelines, optimizing ETL/ELT processes, and delivering scalable cloud-based solutions. I specialize in Python, SQL, and Google Cloud Platform, and enjoy turning complex data into actionable insights.
I’m passionate about collaborating with cross-functional teams, writing clean, maintainable code, and continuously learning new technologies to drive performance improvements and better decision-making across the business.
Skills
Experience Level
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Language
English
Fluent
Work Experience
Data Engineer at Citibank
May 1, 2022 - August 1, 2023Automated Autosys job monitoring using Shell scripting, reducing manual checks and increasing pipeline reliability. Troubleshooted scheduling and performance issues across Solar workflows, improving batch stability and reducing delays. Built Python-based REST API ingestion pipeline delivering CDP data into AWS S3 & Hive, improving compliance reporting efficiency by 30%. Created ingestion APIs to load Oracle insurance data into HBase/Hive and S3 for downstream analytics. Engineered PySpark-based Bloomberg ETL pipeline delivering data to S3, Hive, and Oracle via Sqoop. Developed data quality scripts reducing job failures by 20% and improving SLAs.
Data Engineer at Guardian Life Insurance
November 1, 2019 - April 1, 2022Designed ETL pipelines using Syncsort & DataFunnel integrating policy, claims, and payment data into AWS S3. Built incremental ETL with CDC & SCD Type 2 for regulatory reporting and historical tracking. Led end-to-end development and deployment of the Smart Move analytical project using PySpark transformations, and orchestrating ETL workflows using Control-M. Processed COBOL Mainframe data and Bloomberg feeds using Syncsort, enabling seamless integration into AWS S3 and HDFS for enterprise and investment analytics.
PL/SQL Intern at Rxlogix
January 1, 2019 - May 1, 2019Developed and optimized PL/SQL procedures, views, and database objects, improving system performance by 15%. Reduced query runtime by 25% through indexing and tuning. Automated testing frameworks for stored procedures and views.
Education
M.Sc. Data Science at University of East London
September 1, 2023 - October 1, 2024B.Tech (Computer Science Engineering) at Galgotia University
September 1, 2015 - April 1, 2019M.Sc. Data Science (Distinction) at University of East London
September 1, 2023 - October 1, 2024B.Tech Computer Science Engineering (Distinction) at Galgotia University
September 1, 2015 - April 1, 2019Qualifications
SQL Intermediate Certified
January 11, 2030 - January 7, 2026SQL Advanced Certified
January 11, 2030 - January 7, 2026BigQuery Certified
January 11, 2030 - January 7, 2026SQL Intermediate & Advanced Certified
January 11, 2030 - January 21, 2026BigQuery Certified
January 11, 2030 - January 21, 2026Industry Experience
Financial Services, Software & Internet, Professional Services
Skills
Experience Level
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Hire a Data Scientist
We have the best data scientist experts on Twine. Hire a data scientist in London today.