YS

Yashika Sharma

Available to hire

Hi, I'm Yashika Sharma, a Senior Data Engineer with over five years of experience designing and building robust data pipelines, real-time processing systems, and scalable analytics platforms.

About

Hi, I’m Yashika Sharma, a Senior Data Engineer with over five years of experience designing and building robust data pipelines, real-time processing systems, and scalable analytics platforms. I enjoy owning the entire data lifecycle from ingestion to insights, and lately I’ve been focusing on integrating LLM-powered search and AI agent-based systems into production with a strong emphasis on performance and clean architecture.

I have a strong background in backend engineering, which helps me design cohesive and scalable data platforms that are built for production. I love working with new AI technologies and optimizing data workflows to help businesses make smarter decisions.

  • 6 years' experience
  • Joined July 2025

Languages

  • EnglishFluent

Industry experience

  • Software & Internet
  • Financial Services
  • Professional Services

Work experience· 4 roles

Senior Data Engineer · NortalAug 2023 – Present · 3 yrs 4 mos

Leading development of “Tarko,” an LLM-powered chatbot using Azure AI Foundry and multi-agent orchestration to automate user support and streamline information access. Built scalable batch and streaming ETL pipelines using S3, PySpark, Delta Lake, and Kafka for financial data, reducing latency and enabling near real-time insights via BigQuery and Looker. Deployed intelligent search on Azure with OpenSearch, AKS, and hybrid reranking, improving retrieval quality and system scalability. Tuned OpenSearch ingestion pipelines and joint indices for faster indexing and better performance in production. Automated data refresh workflows with Azure Logic Apps and supported Power BI reporting, reducing manual work and improving data timeliness.

Backend and Data Engineer · Alvin.aiJul 2023 – Jul 2025 · 2 yrs 1 mo

Developed a data governance engine with manual and automated tagging, supporting business glossary integration across UI, CLI, and API layers. Built and released a CLI (PyPI) using Typer and FastAPI, used by top 3 enterprise customers to manage metadata, trigger dbt actions, and surface regression reports on PRs. Improved impact analysis and lineage computation, reducing execution time by 30% and enabling column-level visibility. Extended the automated data catalog with manual lineage features to improve support for custom pipelines. Created onboarding and admin tools to streamline customer setup, reducing handoff time for sales and support teams.

Software Engineer · QuineSep 2021 – Jul 2025 · 3 yrs 11 mos

Built an automated pipeline with Django and PostgreSQL to capture and store daily log data with sub-second latency. Collected and normalized data from 95K+ blockchain projects across CoinMarketCap and V.Cent.co for internal analysis. Integrated Typeform API to aggregate multi-form responses into AWS RDS, improving data consolidation and accessibility. Developed an Auth0-based authentication system to capture user metadata and support a proof-of-concept for Git-linked NFTs.

Software Developer · Major League HackingAug 2020 – Jul 2025 · 5 yrs

Education

Bachelor of Technology · Guru Gobind Singh Indraprastha University, New Delhi, India2017 – 2021

Certifications and awards

Microsoft AZ-9002023
Microsoft DP-2032023
Snowflake COF-C022023

Hire Yashika Sharma today

Post a job and invite Yashika, or contact them directly. No hidden commission.

Post a job