Senior Data Engineer at iSOCRATES Inc.

Led development of an AI-driven log monitoring system (FastAPI, OpenAI LLMs) to analyze infrastructure and pipeline logs, detect failure patterns, and propose resolutions. Architected and operated Airflow-based ingestion, transformation, and staging DAGs. Built a production-grade backend system (Flask, Airflow, Redshift) that self-heals via AI log analysis to fix issues, re-sync data, and send multi-channel alerts. Created custom Airbyte connectors for large-scale ingestion of non-standard advertising and marketing data. Enhanced Apache Superset with custom backend APIs for organization-specific dashboards and analytics. Implemented secure outbound APIs with authentication and rate limiting for controlled data access.

Data Engineer at StackBOX

Architected the end-to-end data flow for a Target Setting SaaS including ETL pipelines, UDFs, triggers, crons, and backend APIs (Node.js, FastAPI, Redis). Built robust backend services with Python FastAPI and Redis caching on GCP, improving speed and reliability. Developed and optimized ETL pipelines processing millions of rows per hour using PySpark and related tools. Engineered complex SQL queries for sales reporting with advanced indexing, reducing dashboard load times by up to 90%. Led a team of three data engineers from 0 to 1 product development.

Data Engineer at Capgemini

Designed and optimized complex database logic using PL/SQL (Oracle) and T-SQL (SQL Server), improving query performance through tuning, debugging, and code optimization. Automated ETL workflows using Talend Studio for reliable data integration. Wrote Python scripts for data migration and cross-platform consistency.