I have over 9 years of experience in Data engineering, loading data from different source system to cleaning and implementing transformations and providing curated data to marts and exposing them to Visualizations tools like powerBI and Tableau . I have worked in various domains like banking , insurance & real estate . I am freelancing on Data science models using RAG - langchain, embedding, vector DB - Natural language processing. I am here to work on my specialties and also learn new tools / technologies. I am looking out for some challenges

Randheer Reddy

I have over 9 years of experience in Data engineering, loading data from different source system to cleaning and implementing transformations and providing curated data to marts and exposing them to Visualizations tools like powerBI and Tableau . I have worked in various domains like banking , insurance & real estate . I am freelancing on Data science models using RAG - langchain, embedding, vector DB - Natural language processing. I am here to work on my specialties and also learn new tools / technologies. I am looking out for some challenges

Available to hire

I have over 9 years of experience in Data engineering, loading data from different source system to cleaning and implementing transformations and providing curated data to marts and exposing them to Visualizations tools like powerBI and Tableau .
I have worked in various domains like banking , insurance & real estate .
I am freelancing on Data science models using RAG - langchain, embedding, vector DB - Natural language processing.
I am here to work on my specialties and also learn new tools / technologies.
I am looking out for some challenges

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
See more

Language

English
Fluent
Hindi
Fluent
French
Beginner
Telugu
Fluent

Work Experience

Data & Analytics Engineer at Canadian Commercial Real Estate
August 1, 2022 - Present
Led the design and operation of monthly and daily data batches, ETL mapping diagrams, task distribution and issue resolution. Monitored Snowflake credits and Airflow costs; reported status to stakeholders, onboarded new resources, and documented processes. Automated manual tasks by ~20% using DBT models and Snowflake audit tables. Implemented data ingestion and orchestration via Airbyte and Fivetran; built and maintained DBT models with macros and seeds; established DBT tests to ensure data quality in CI/CD. Mentored junior team members and supported security/compliance efforts. Worked on RAG models, vector databases, and LangChain-based NLP solutions.
Consultant Data Engineer at Canadian Insurance Company
July 1, 2020 - July 1, 2022
Redesigned ETL pipelines with Databricks and AWS-backed architecture; implemented robust backups to S3; built wrapper APIs to ingest streaming data into Redshift; authored optimized Snowflake queries for management reports; improved Kafka architecture for parallelism and buffering; led the team in Spark DAG practices and sprint workflows; created supervised models from warehouse data and delivered consumable APIs with performance metrics.
Data Engineer at Canadian Banking Client
February 1, 2018 - June 1, 2020
Built batch data pipelines on Databricks; wrote PySpark scripts for file-server data ingestion into backend database; configured MongoDB as backend; set up Kafka on on-prem clusters for streaming claims data; documented architecture in Confluence; participated in sprint planning and grooming; migrated HDFS to S3 with zero data loss; initiated AWS Code Pipeline CI/CD with GitHub integration.
Data Developer at Digital Marketing Company
August 1, 2016 - January 1, 2018
Created architecture documents in Confluence; led sprint grooming and planning; contributed to team discussions; migrated existing HDFS workloads to S3 with robust backups; initialized AWS Code Pipeline workflows with GitHub integration.

Education

Graduation Diploma at Toronto, Ontario
April 1, 2016 - January 1, 2018
Bachelor's in Electronics and Communication at JNTU
January 11, 2030 - June 1, 2015

Qualifications

SnowPro Core Certified
January 11, 2030 - January 11, 2026

Industry Experience

Real Estate & Construction, Financial Services, Software & Internet, Professional Services, Education