Available to hire
I’m Manuel Meireles, a Senior Cloud Data Engineer with 10+ years of building scalable data platforms, streaming pipelines, and analytics architectures across GCP, Azure, and AWS. I design and operate enterprise data warehouses and lakehouses, delivering reliable, scalable analytics for complex business domains.
I’ve led multi-cloud data initiatives for fast-growing eCommerce and SaaS environments, building real-time streaming, data governance, and ML-ready data platforms. My work emphasizes measurable business impact, from accelerating reporting and reconciliation to modernising logistics ETL and enabling AI-powered data lineage and governance.
Language
English
Fluent
Work Experience
Senior Data Engineer – Architect at Eshopworld
February 1, 2018 - November 21, 2025Designed and operated a 10TB+ enterprise data warehouse and cloud data lake supporting analytics across checkout, payments, finance, and CRM. Built multi-cloud ingestion using Pub/Sub, Dataflow, BigQuery, and Apache Beam; delivered a high-throughput Kafka and Google Dataflow streaming pipeline processing 100k events/sec, reducing reporting latency to under 10 minutes. Led Finance Transformation by developing a dbt- and BigQuery-based Finance Data Mart enabling real-time reconciliation with partners and supporting key financial processes. Implemented CI/CD for data pipelines using Airflow, Python, Terraform; reduced deployment time and standardized environments. Automated finance reconciliation using Python Cloud Run functions, recovering $2M in previously untracked transactions. Modernised logistics ETL from batch to streaming (Kafka + Beam), reducing processing time from 24 hours to 30 minutes and handling 500k+ packages/month with 60M events. Built Terraform-driven CI/CD with Azure P
Lead Data Engineer at DAA – Dublin Airport
February 28, 2018 - February 28, 2018Designed a configuration-based ETL framework for Microsoft Navision, supporting retail data integration into EDW. Migrated 3TB of on-prem SQL Server workloads to Azure SQL Data Warehouse with zero data loss. Built ADF pipelines (Linked Services, Datasets, Azure SQL, Blob, Data Warehouse) to automate ingestion and transformations. Developed Spark SQL, T-SQL, and SSIS pipelines for business-critical retail, finance, and operations analytics workloads.
Lead Data Engineer at Farfetch
January 31, 2016 - January 31, 2016Designed enterprise Data Warehouse and SSAS tabular models to support global e-commerce analytics. Built clickstream analytics solutions enabling user behaviour insights and high-volume traffic monitoring. Implemented near-real-time sales monitoring pipelines using SQL Server Change Tracking (5-minute refresh). Optimised performance of large-scale analytical models and MDX queries to meet global SLA requirements.
BI Developer / Data Engineer at INDRA, Novabase, SONAE – Portugal
January 1, 2014 - January 1, 2014Designed data marts for HR, Finance, Marketing, and Production to support diverse business units. Built ETL processes with SSIS and T-SQL for complex data transformations across Oracle Exadata and SQL Server. Created OBIEE 11g Repository for marketing loyalty program analytics, enhancing customer insights. Developed 1TB+ SSAS cubes with performance optimisations for large-scale analytics.
Education
Master in Computer Science at Minho University, Portugal
January 11, 2030 - January 1, 2008Qualifications
Industry Experience
Retail, Software & Internet, Financial Services, Transportation & Logistics
Hire a Architect
We have the best architect experts on Twine. Hire a architect in Dublin today.