Available to hire
I’m Shanjeev Rajendran, a Lead Data Engineer and Snowflake Data Architect with 13+ years of experience designing and optimizing cloud-native data platforms. I excel at building high-performance data systems and automating pipelines using Python, PySpark, Snowflake, and Airflow. My track record includes pipeline automation, performance optimization, and cost reduction, all aimed at delivering enterprise-grade data solutions in consulting environments.
As a technical leader, I focus on scalable architecture, data governance, mentoring teams, and delivering reliable, repeatable results while continuously improving processes and tooling.
Skills
See more
Language
English
Fluent
Work Experience
Data Architect at Accenture Private Limited
April 1, 2021 - October 1, 2023Owned end-to-end architecture for HR and Cybersecurity data platforms, designing secure ingestion frameworks using Airflow, AWS Glue, Lambda, and S3 with automated dbt orchestration. Built a Python/Jinja-based framework to auto-generate DAGs from table/YAML configs with cross-DAG dependencies, reducing manual workflow creation effort by ~80%. Analyzed Snowflake deprecations impacting external tables and single-factor authentication; implemented alternative ingestion and authentication approaches to reduce remediation efforts. Migrated Python/Pandas-heavy AWS Glue workloads to PySpark, reducing processing time by ~60% and improving scalability. Implemented Snowflake data masking, secure views, and RBAC-based access control; optimized warehouse sizing and query performance using query profiles, achieving 15-20% reduction in compute costs.
Snowflake Data Architect at Best Buy
July 1, 2025 - September 1, 2025Deployed Snowflake Container Services to host Airflow and dbt workloads, reducing network overhead and improving pipeline execution times. Developed reusable dbt models to standardize data transformations, improve maintainability, and accelerate analytics delivery across business domains. Optimized Snowpark workloads to improve processing performance and prepare curated datasets for downstream ML and analytics use cases. Collaborated closely with product owners and Agile teams, contributing to sprint planning, code reviews, and production deployments.
Staff Data Engineer at Altimetrik India Private Limited
October 1, 2023 - June 1, 2025Led and mentored a team of 5 data engineers, owning technical design decisions and ensuring timely delivery of sprint commitments. Designed, executed, and optimized CI/CD pipelines to deploy database scripts from Bitbucket to Snowflake and capture execution status using Python in the Bitbucket pipeline, reducing time taken by 48x. Architected an enterprise Snowflake data warehouse integrating sales, inventory, and customer data, enabling scalable data marts and analytics-ready layers. Developed a Python/Snowpark automation framework for ETL testing covering all testing scenarios, leading to an 84% decrease in QA workload. Pioneered a new approach to define stored procedures in Snowflake using Python, reducing development/debugging time by one third and decreasing execution time by 20%. Built internal automation tools for data profiling, Snowflake code extraction, DDL generation, and ER diagram creation, reducing manual effort.
Data Engineering Specialist at Accenture Private Limited
April 1, 2021 - October 1, 2023Received 'Star of the Month' award for leadership and team performance, delivering enhanced outputs. Designed and implemented metadata-driven approach for dynamic data transformation, increasing scalability and efficiency of data ingestion framework. Implemented high-performance ingestion and transformation logic using Python and PySpark for structured and semi-structured data. Optimized Snowflake usage for large-scale datasets through warehouse right-sizing, query tuning, and workload isolation, balancing performance, reliability, and cost efficiency. Created and implemented an XML utility to generate complex flat-file structures from Snowflake tables, tailored to target system requirements. Led cross-functional team of 5 data engineers and 2 QA engineers, ensuring successful sprint goals.
Application Development Specialist at Accenture Private Limited
January 1, 2021 - April 1, 2021Built highly optimized Python plugin replacing legacy bash scripts, improving implementation speed by ~450x while meeting strict SLA requirements. Contributed to enhancement of an enterprise configuration analytics platform in the financial services domain. Interviewed and hired 30+ Python engineers, supporting team scaling and talent quality.
Data Engineer / Python Developer at Mercedes-Benz Research and Development India Private Limited
November 1, 2019 - April 1, 2021Designed and implemented metadata-driven data processing pipelines; implemented high-performance ingestion and transformation logic using Python and PySpark for structured and semi-structured data. Optimized Snowflake usage for large-scale datasets with warehouse right-sizing, query tuning, and workload isolation. Created an XML utility to efficiently generate intricate flat-file structures from Snowflake tables, tailored to target system requirements. Led a cross-functional team of data engineers and QA to deliver sprint goals. Built a Snowflake data warehouse integrating sales/inventory/customer data enabling scalable data marts.
Data Engineer / Python Developer at Tata Consultancy Services
November 1, 2012 - June 1, 2019Implemented Spark-based processing frameworks; built real-time data pipelines using Airflow and Python; migrated a key data analytics engine to Python/pandas; created automation to extract tabular data from PDFs; introduced Oracle DB as a graph data store and authored Gremlin queries for complex relationship analysis. Self-trained on the Python API of a proprietary engineering design tool to automate large-scale 3D rendering, completing ~29,800 parts in two days versus a 10-month manual effort.
Data Architect at Accenture Private Limited
September 1, 2025 - PresentOwned end-to-end architecture for HR and cybersecurity data platforms, designing secure ingestion frameworks using Airflow, AWS Glue, Lambda, and S3 with automated dbt orchestration. Built a Python/Jinja-based framework to auto-generate DAGs from table/YAML configs with cross-DAG dependencies, reducing manual workflow creation efforts by ~80%. Analyzed Snowflake deprecations impacting external tables and single-factor authentication, implementing alternative ingestion and authentication approaches to reduce remediation effort. Migrated Python/Pandas-heavy AWS Glue workloads to PySpark, reducing processing time by ~60% and improving scalability. Implemented Snowflake data masking, secure views, and RBAC-based access control, and optimized warehouse sizing and query performance using query profiles, resulting in 15–20% reduction in compute costs.
Staff Data Engineer at Altimetric India Private Limited
October 1, 2023 - June 30, 2025Deployed Snowflake Container Services to host Airflow and dbt workloads, reducing network overhead and improving pipeline execution times. Developed reusable dbt models to standardize data transformations, improve maintainability, and accelerate analytics delivery across business domains. Optimized Snowpark workloads to improve processing performance and prepare curated datasets for downstream ML and analytics use cases. Collaborated closely with product owners and Agile teams, contributing to sprint planning, code reviews, and production deployments.
Senior Data Engineer at Mercedes-Benz Research and Development India Private Limited
November 1, 2019 - April 1, 2021Customized Git cola GUI application with PyQt5/PyQt4 by implementing smart commit feature for linking Jira tickets to Git commits and integrating a separate interface for SVN version control. Re-vamped Python scripts for continuous delivery, reducing execution time by 45% and increasing fault tolerance. Developed an NLP-based meeting assistant using DeepSpeech for automated captioning and scheduling. Built a custom dashboard using Streamlit and Python to showcase clients' Key Performance Indicators.
Education
Bachelor of Engineering at A.C. College of Engineering and Technology
January 11, 2030 - January 1, 2012Bachelor of Engineering in Mechanical Engineering at AC College of Engineering and Technology
January 11, 2030 - January 1, 2012Qualifications
Snowflake SnowPro Core
January 1, 2025 - January 19, 2026Certified Kubernetes Application Developer (CKAD)
January 1, 2022 - January 19, 2026Neural Networks and Deep Learning
January 1, 2019 - January 19, 2026Snowflake SnowPro Core
January 1, 2025 - January 20, 2026Certified Kubernetes Application Developer (CKAD)
January 1, 2022 - January 20, 2026Neural Networks and Deep Learning
January 1, 2019 - January 20, 2026Industry Experience
Software & Internet, Professional Services, Financial Services, Manufacturing, Media & Entertainment
Skills
See more
Hire a Data Scientist
We have the best data scientist experts on Twine. Hire a data scientist today.