✔ 10+ years of experience in Data Engineering, ETL/ELT development, Data Warehousing, and Big Data ecosystems, delivering scalable enterprise data solutions.
✔ Strong expertise in Azure Data Engineering stack, including Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and ADLS.
✔ Extensive experience building modern data platforms using Snowflake, with deep knowledge of Snowpipe, Streams, Tasks, and performance tuning.
✔ Proven ability to design and implement end-to-end ETL/ELT pipelines using Python, PySpark, and advanced SQL for large-scale data processing.
✔ Hands-on experience with dbt (Data Build Tool) for modular data transformations, automated testing, and data lineage tracking.
✔ Expertise in implementing Medallion Architecture (Bronze/Silver/Gold) using Delta Lake, ensuring data quality and scalability.
✔ Strong background in Big Data technologies, including Hadoop (HDFS, Hive, HBase), Spark, Kafka, and distributed data processing frameworks.
✔ Experience designing and managing data lake and lakehouse architectures, integrating cloud storage with modern data warehouses.
✔ Proficient in multi-cloud environments (Azure, AWS, GCP), delivering highly available and scalable data solutions.
✔ Experience with real-time and batch data processing using Kafka, Event Hubs, Kinesis, and Pub/Sub.
✔ Skilled in data warehouse (DWH) design, including Star and Snowflake schemas for enterprise analytics and reporting.
✔ Strong expertise in SQL performance tuning, query optimization, and large-scale data transformations.
✔ Experience building and operationalizing AI/ML data pipelines and feature engineering frameworks.
✔ Exposure to Generative AI (Azure OpenAI, Vertex AI, LLM APIs) for intelligent data processing and automation.
Work Experience
Education
Qualifications
Hire a AI Engineer
We have the best ai engineer experts on Twine. Hire a ai engineer in Saint Louis today.