Available to hire
I’m Abhijit Patil, a data engineer and software engineer with 15+ years of experience designing and delivering cloud-scale, AI-ready data solutions. I specialize in Python, PySpark, Databricks, Fabric, and the Azure ecosystem, with a strong focus on automation, optimization, and declarative data engineering.
I integrate software engineering practices like CI/CD, testing, and code reviews into data platforms to build robust, high-performance, and maintainable solutions. I’m excited about emerging technologies like Generative AI and enjoy mentoring teams, driving architecture decisions, and delivering trusted outcomes for stakeholders.
Skills
Work Experience
Tech Lead at Tata Consultancy Services – Sodexo
April 1, 2022 - November 7, 2025Designed and developed a scalable Azure data platform integrating ADF, Azure Databricks, and Azure SQL. Migrated finance data warehouse from SQL Server to Delta Lake on Azure Databricks, ensuring scalability and performance. Developed Lakehouse architecture with Delta Lake and streaming ingestion. Implemented CI/CD pipelines using Git and Azure DevOps, automating deployments for Databricks and ADF solutions. Designed and developed ADF pipelines which load data from ADLS to SQL. Applied data governance, performance tuning, and security best practices across Databricks layers. Deployed and managed Fabric pipelines for Dynamics 365 data integration, accelerating analytics readiness. Collaborated with platform engineers to manage VNets, Key Vaults, and Managed Identities for secure and isolated data operations. Migrated legacy SSIS to Azure Data Factory and Azure SQL, improving reliability and maintainability. Implemented metadata-driven frameworks to reduce pipeline maintenance effort by
Tech Lead at Tata Sons Private Limited
March 1, 2022 - March 1, 2022Designed and deployed ADF pipelines to ingest and process Excel and CSV files from SharePoint into SQL and ADLS. Automated multi-source ingestion using ADF pipelines with parameters and linked services for dynamic configuration. Integrated Azure Key Vault for credentials and connection security.
Data Engineer at Amdocs
February 1, 2021 - February 1, 2021Collaborated with cross-functional teams to translate operational and safety data into actionable insights, supporting decision-making in a complex environment. Developed automated data warehouse testing and validation scripts.
Administrator – ServiceNow at ServiceNow
September 1, 2017 - September 1, 2017Managed ITSM workflows and performed user/admin configurations.
Functional Test Engineer – BMC Remedy at BMC Remedy
August 1, 2016 - August 1, 2016Validated Incident, Problem, Change, Knowledge, Work Order, Asset, and Task workflows for telecom CRM environments.
Functional Test Engineer at Reliance
August 1, 2013 - August 1, 2013Validated customer care modules and CRM flows for telecom services.
Tech Lead at Tata Consultancy Services
April 1, 2022 - November 21, 2025Tech Lead for Sodexo engagement. Designed and developed a scalable Azure data platform integrating ADF, Azure Databricks, and Azure SQL. Migrated finance data warehouse from SQL Server to Delta Lake on Azure Databricks. Developed Lakehouse architecture with Delta Lake and streaming ingestion. Implemented CI/CD pipelines using Git and Azure DevOps, automating deployments for Databricks and ADF solutions. Designed and developed ADF pipelines loading data from ADLS to SQL. Applied data governance, performance tuning, and security best practices across Databricks’ layers. Deployed and managed Fabric pipelines for Dynamics 365 data integration. Collaborated with platform engineers to manage VNets, Key Vaults, and Managed Identities for secure and isolated data operations. Migrated legacy SSIS to Azure Data Factory and Azure SQL, improving reliability and maintainability. Implemented metadata-driven frameworks to reduce pipeline maintenance effort by 40%.
Tech Lead at Tata Consultancy Services
March 1, 2022 - March 1, 2022Designed and deployed ADF pipelines to ingest and process Excel and CSV files from SharePoint into SQL and ADLS. Automated multi-source ingestion using ADF pipelines with parameters and linked services for dynamic configuration. Integrated Azure Key Vault for credentials and connection security.
Reliance Functional Test Engineer at Reliance
August 1, 2013 - August 1, 2013Validated customer care modules and CRM flows for telecom services.
Education
Bachelor in Electronics and Telecommunication Engineering at Pune University
January 11, 2030 - January 1, 2008Bachelor in Electronics and Telecommunication Engineering at Pune University
January 11, 2030 - January 1, 2008Qualifications
Databricks Certified Data Engineer Professional
January 11, 2030 - November 7, 2025Databricks Certified Data Engineer Associate
January 11, 2030 - November 7, 2025Databricks Certified AI Fundamentals
January 11, 2030 - November 7, 2025DP-700 Fabric Data Engineer Associate
January 11, 2030 - November 7, 2025PL-300 Analyzing data with Microsoft Power BI
January 11, 2030 - November 7, 2025AZ-900 Microsoft Azure Fundamentals
January 11, 2030 - November 7, 2025ServiceNow Certified System Administrator
January 11, 2030 - November 7, 2025Databricks Certified Data Engineer Professional
January 11, 2030 - November 21, 2025Databricks Certified Data Engineer Associate
January 11, 2030 - November 21, 2025Databricks Certified AI Fundamentals
January 11, 2030 - November 21, 2025DP-700 Fabric Data Engineer Associate
January 11, 2030 - November 21, 2025PL-300 Analyzing data with Microsoft Power BI
January 11, 2030 - November 21, 2025AZ-900 Microsoft Azure Fundamentals
January 11, 2030 - November 21, 2025ServiceNow Certified System Administrator
January 11, 2030 - November 21, 2025Industry Experience
Software & Internet, Financial Services, Professional Services, Telecommunications
Skills
Hire a Full Stack Developer
We have the best full stack developer experts on Twine. Hire a full stack developer in Amstelveen today.