Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I’m a Principal Data Engineer focused on designing and operating enterprise data platforms using Databricks Lakehouse architecture, Unity Catalog governance, and metadata-driven pipelines. Over the past 6+ years, I’ve architected end-to-end solutions that integrate large numbers of data sources and business entities, with an emphasis on data quality, lineage, and secure access controls. I also enjoy building teams and capability—having recruited and trained engineers through a hands-on internal bootcamp—and I bring strong infrastructure and delivery experience using Infrastructure as Code (Terraform), CI/CD (Azure DevOps and GitHub Actions), and cross-cloud deployments across Azure, AWS, and GCP. My work often extends into analytics and ML enablement, including MLOps-style pipelines and model deployment patterns for production use cases.…I’m a Principal Data Engineer focused on designing and operating enterprise data platforms using Databricks Lakehouse architecture, Unity Catalog governance, and metadata-driven pipelines. Over the past 6+ years, I’ve architected end-to-end solutions that integrate large numbers of data sources and business entities, with an emphasis on data quality, lineage, and secure access controls. I also enjoy building teams and capability—having recruited and trained engineers through a hands-on internal bootcamp—and I bring strong infrastructure and delivery experience using Infrastructure as Code (Terraform), CI/CD (Azure DevOps and GitHub Actions), and cross-cloud deployments across Azure, AWS, and GCP. My work often extends into analytics and ML enablement, including MLOps-style pipelines and model deployment patterns for production use cases.

Nestor Peñate Castellano

Data Engineer, Software Engineer, DevOps Developer, +6





I’m a Principal Data Engineer focused on designing and operating enterprise data platforms using Databricks Lakehouse architecture, Unity Catalog governance, and metadata-driven pipelines. Over the past 6+ years, I’ve architected end-to-end solutions that integrate large numbers of data sources and business entities, with an emphasis on data quality, lineage, and secure access controls. I also enjoy building teams and capability—having recruited and trained engineers through a hands-on internal bootcamp—and I bring strong infrastructure and delivery experience using Infrastructure as Code (Terraform), CI/CD (Azure DevOps and GitHub Actions), and cross-cloud deployments across Azure, AWS, and GCP. My work often extends into analytics and ML enablement, including MLOps-style pipelines and model deployment patterns for production use cases.…I’m a Principal Data Engineer focused on designing and operating enterprise data platforms using Databricks Lakehouse architecture, Unity Catalog governance, and metadata-driven pipelines. Over the past 6+ years, I’ve architected end-to-end solutions that integrate large numbers of data sources and business entities, with an emphasis on data quality, lineage, and secure access controls. I also enjoy building teams and capability—having recruited and trained engineers through a hands-on internal bootcamp—and I bring strong infrastructure and delivery experience using Infrastructure as Code (Terraform), CI/CD (Azure DevOps and GitHub Actions), and cross-cloud deployments across Azure, AWS, and GCP. My work often extends into analytics and ML enablement, including MLOps-style pipelines and model deployment patterns for production use cases.

Available to hire

I’m a Principal Data Engineer focused on designing and operating enterprise data platforms using Databricks Lakehouse architecture, Unity Catalog governance, and metadata-driven pipelines. Over the past 6+ years, I’ve architected end-to-end solutions that integrate large numbers of data sources and business entities, with an emphasis on data quality, lineage, and secure access controls.

I also enjoy building teams and capability—having recruited and trained engineers through a hands-on internal bootcamp—and I bring strong infrastructure and delivery experience using Infrastructure as Code (Terraform), CI/CD (Azure DevOps and GitHub Actions), and cross-cloud deployments across Azure, AWS, and GCP. My work often extends into analytics and ML enablement, including MLOps-style pipelines and model deployment patterns for production use cases.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Intermediate

Language

English

Fluent

Spanish; Castilian

Fluent

Work Experience

Platform Engineer Lead at ComAve

July 1, 2025 - March 1, 2026

Provisioned and scoped a dedicated AWS account for a Databricks-based analytics prototype covering app usage and company-wide analysis. Led a team of Platform Engineers to design and deploy a secure, enterprise-grade AWS landing zone using Terraform. Focused on strengthening perimeter security and improving service availability while reducing infrastructure costs.

Platform Engineer at The Agile Monkeys

August 1, 2024 - June 1, 2025

Migrated an ingestion pipeline from AWS Managed Workflows for Apache Airflow (MWAA) to a self-managed Airflow deployment on Amazon ECS, significantly reducing service costs. Led MLOps for an embeddings-model pipeline (OpenCLIP/LAION-based), moving from SageMaker to a dedicated GPU-enabled deployment platform on ECS to support multi-model A/B testing. Evaluated vector database options for a RAG search engine product, including PGVector, Typesense, and Weaviate.

Senior Solution Engineer / Platform Design Lead (eCommerce modernization) at Apricode Tech (MANN+HUMMEL)

January 1, 2024 - July 1, 2024

Led the design of a microservices architecture for modernizing an online store, including a dedicated data-serving API layer to support the new platform’s data needs.

Founder & Independent Consultant at PerinqueFlow

January 1, 2021 - Present

Founded and led an independent technology consultancy. Recruited and technically led a Data Engineering team, including running a six-month internal bootcamp prior to deploying engineers onto client engagements. Built agentic AI workflow automations for business process optimization (e.g., invoice handling and document optimization/tailoring workflows).

Senior Data Platform Engineer at Kantar & Aztec (Aztec Group and Kantar)

January 1, 2021 - December 1, 2023

Built Azure Databricks ingestion, processing, and a data quality framework using a medallion Bronze/Silver pattern with Unity Catalog. Integrated Profisee Master Data Management (MDM) and enabled SCD modeling for Gold-layer data products. For platform delivery, implemented deployment flows and Infrastructure as Code across Azure Data Factory, SSAS, Synapse, and Azure Functions, including RBAC and CI/CD in Azure DevOps. Deployed under strict Zero Trust security policies and migrated IaC from ARM templates to Terraform.

Enterprise Data Platform Architect at Grupo DISA

January 1, 2021 - Present

Re-architected Grupo DISA’s enterprise data platform into a metadata-driven Databricks Lakehouse on Azure Databricks using a medallion Bronze/Silver/Gold pattern and Unity Catalog. Built ingestion and processing frameworks integrating 20+ heterogeneous sources and 1,000+ business entities. Implemented data quality rules for malformed record detection and personal data enrichment, and introduced Databricks Asset Bundles to standardize deployment of Gold-layer models (dimensional modeling with SCD for historical tracking). Integrated with the client’s Master Data Management (MDM) system and automated deployments with unit testing and validation. Migrated infrastructure provisioning from Azure Bicep to Terraform and implemented CI/CD in Azure DevOps, improving delivery throughput and reducing cost while increasing data quality issue detection.

Data Engineer at Grupo DISA

August 1, 2019 - January 1, 2021

Hired as the company’s sole Data Engineer, building the first Lakehouse using Azure Data Factory and Azure Databricks. Mentored Data Analytics and Data Science teams on PySpark and Databricks adoption, and developed an early medallion-style prototype that informed later platform patterns.

Big Data QA Automation Lead at Hewlett Packard (via Sogeti / BeyondSoft)

August 1, 2017 - August 1, 2019

Verified data consistency for an industrial IoT telemetry database using automated Python data quality rules. Later supported consulting on data context and contributed to the company’s first Databricks-based data engineering team.