I am a detail-focused Data Engineer with 10 years of experience in AI/ML, data warehousing, data forecasting, ETL/ELT projects, and stakeholder analysis. I have worked with a range of organizations from big tech to startups, and I excel at translating customer requirements into actionable project plans. I am motivated, agile-driven, and have exposure across Insurance, Finance, E-commerce, and Defence domains. I drive business value by turning data findings into practical recommendations, and I enjoy mentoring teammates to grow their capabilities and contribute to data-driven strategies. Beyond the technical work, I am passionate about building robust data platforms, enabling cross-functional collaboration, and guiding teams through data governance and scalable deployment practices to help the business advance.

Shikhar Jaiswal

I am a detail-focused Data Engineer with 10 years of experience in AI/ML, data warehousing, data forecasting, ETL/ELT projects, and stakeholder analysis. I have worked with a range of organizations from big tech to startups, and I excel at translating customer requirements into actionable project plans. I am motivated, agile-driven, and have exposure across Insurance, Finance, E-commerce, and Defence domains. I drive business value by turning data findings into practical recommendations, and I enjoy mentoring teammates to grow their capabilities and contribute to data-driven strategies. Beyond the technical work, I am passionate about building robust data platforms, enabling cross-functional collaboration, and guiding teams through data governance and scalable deployment practices to help the business advance.

Available to hire

I am a detail-focused Data Engineer with 10 years of experience in AI/ML, data warehousing, data forecasting, ETL/ELT projects, and stakeholder analysis. I have worked with a range of organizations from big tech to startups, and I excel at translating customer requirements into actionable project plans. I am motivated, agile-driven, and have exposure across Insurance, Finance, E-commerce, and Defence domains. I drive business value by turning data findings into practical recommendations, and I enjoy mentoring teammates to grow their capabilities and contribute to data-driven strategies.

Beyond the technical work, I am passionate about building robust data platforms, enabling cross-functional collaboration, and guiding teams through data governance and scalable deployment practices to help the business advance.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
See more

Language

English
Fluent

Work Experience

Lead Data Engineer / Architect at Drone Shield
January 1, 2025 - November 3, 2025
Leading the data engineering team to build a robust data platform supporting counter-drone products. Responsibilities include data modelling, designing data infrastructure, data governance and security, and mentoring. Building new data pipelines and migrating existing ones to Databricks with Delta Lake. Developing data APIs (Python FastAPI) and managing data migrations. Building a central data lake to store cross-team data for analytics. Working in an agile environment with backlog management in Jira; collaborating with infrastructure teams. Tech stack includes PySpark, S3/MinIO, Postgres, Dagster, Kubernetes, AWS ECR, monitoring with Grafana/Prometheus, GitLab CI/CD, Linux, and shell scripting.
Sr. Data Engineer at Macquarie Group
December 31, 2024 - December 31, 2024
Senior Data Engineer in the Legal and Corporate Division supporting Legal, Banking, Integrity Office, and Corporate Affairs. Built data pipelines to ingest vendor data via APIs, automated data delivery for stakeholders and reporting, and migrated pipelines from Oozie to Airflow. Worked with cross-functional teams to solve data problems, mentored peers, and contributed to governance and risk management. Tech stack included PySpark, Hive, Trino, Airflow, DBT, and CI/CD via Bamboo, with all workloads on Google Cloud.
Sr. Data Engineer at Mad Paws Pty Ltd
June 30, 2024 - June 30, 2024
End-to-end ownership of data requirements for the organization (4 business units). Designed and implemented data ingestion, processing, security, and presentation solutions. Built ELT processes extracting data from APIs, marketing data, external/internal databases, and file formats. Implemented fault-tolerant, scalable data solutions using Python, Redshift, and Stitch; built data marts with Redshift, Airflow, and DBT; optimized reporting with Tableau/Redash. Implemented real-time data pipelines using ClickHouse and configured real-time ETL to move data from MySQL to Redshift using AWS DMS/Glue/Scheduler. Established data governance for non-prod data with automated PII masking, and introduced MLOps pipelines with SageMaker. Led data science collaboration around a search ranking model and supported A/B testing.
Data Engineer / Contractor at Thomson Reuters
March 31, 2022 - March 31, 2022
Contractor working with Thomson Reuters in Pyrmont, Sydney. Developed and maintained marketing analytics algorithms in an agile setting. Built and maintained data pipelines for ANZ client base using PySpark, AWS Glue, and Snowflake. Generated churn prediction models with XGBoost and supported reporting via Tableau. Built ETL processes to ingest data from various sources into Azure data lakes; created data pipelines and dashboards; implemented CI/CD for ML models using Bitbucket and Atlassian pipelines. Contributed to cloud architecture discussions and API-oriented data sharing across teams.

Education

Master of IT (Data Analytics) at University of Technology Sydney (UTS)
July 1, 2019 - May 31, 2021
Bachelor of Technology (Computer Science) at Dr. APJ Abdul Kalam Technical University, Uttar Pradesh, India
July 1, 2012 - June 30, 2016

Qualifications

Databricks Certified Data Engineer Associate
April 1, 2025 - April 1, 2027
AWS Certified Associate Developer
August 1, 2020 - August 1, 2023
Salesforce Certified Platform App Builder
October 1, 2017 - November 3, 2025

Industry Experience

Financial Services, Software & Internet, Professional Services, Government, Media & Entertainment