Dhaka Technologies Limited Company - Senior Data Engineer / Data Architect - Databricks

Data Engineer is needed in Charlotte, United States.

Client: Dhaka Technologies Limited Company

Location: Charlotte, NC, us

Contract: Contract

Job Description

Dhaka Technologies Limited Company is hiring on behalf of our client for a Senior Data Engineer / Data Architect with deep Databricks and insurance domain expertise. This role is an onsite contract engagement in Charlotte, NC, requiring a minimum of 12 years of professional experience in data engineering and data architecture. The selected consultant will design, develop, and implement scalable enterprise data solutions on Databricks, collaborating with business stakeholders, data architects, engineers, analysts, and technology teams to create modern data platforms and analytics capabilities.

Requirements

Screening Note

Databricks and insurance domain experience are mandatory. Candidates must have 12+ years of experience.

Key Responsibilities

• Design and develop scalable data architecture and data engineering solutions using Databricks.
• Build and maintain robust ETL and ELT data pipelines using Databricks, Apache Spark, Python, and SQL.
• Design data lakes, lakehouse architectures, data warehouses, and enterprise data platforms.
• Develop high performance batch and streaming data pipelines.
• Implement data ingestion from multiple internal and external sources.
• Develop data transformation, cleansing, validation, and integration processes.
• Design scalable and reusable data models for analytics and reporting.
• Work with Delta Lake, Delta Live Tables, Unity Catalog, and Databricks Workflows where applicable.
• Optimize Spark jobs, SQL queries, pipelines, and data processing workloads.
• Implement data quality, data governance, security, lineage, and access control processes.
• Collaborate with data scientists, BI teams, business analysts, product owners, and application teams.
• Translate business requirements into technical data architecture and engineering solutions.
• Participate in architecture reviews and establish data engineering best practices.
• Troubleshoot production data issues and provide root cause analysis.
• Mentor junior and mid-level data engineers.
• Support cloud migration and modernization initiatives.

Insurance Domain Experience

Strong working knowledge of Property and Casualty (P& C) insurance data is highly preferred, along with other insurance lines. Hands-on experience with various insurance data domains such as policy, claims, billing, and underwriting is required.

Required Technical Skills

• Databricks
• Apache Spark and PySpark
• Python
• SQL
• Data engineering and data architecture
• ETL and ELT design and development
• Data lake and lakehouse architecture
• Delta Lake
• Data modeling
• REST APIs and data integration
• Git and CI/CD

Cloud Experience

Strong experience with at least one major cloud platform is required: Microsoft Azure, Amazon Web Services, or Google Cloud Platform. Azure Databricks experience is highly preferred.

Databricks Experience

• Databricks Workspace
• Delta Lake and Delta Live Tables
• Unity Catalog
• Databricks Workflows
• Databricks SQL
• Cluster configuration, optimization, and performance tuning
• Data governance and data security within Databricks
• CI/CD for Databricks

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
• Minimum of 12 years of professional experience in data engineering, data architecture, or related roles.
• Strong hands-on experience with Databricks and Apache Spark.
• Strong Python and SQL development experience.
• Proven experience designing enterprise-scale data platforms.
• Strong understanding of data modeling and data integration.
• Experience working in Agile and Scrum environments.
• Strong communication and stakeholder management skills.
• Insurance industry experience is mandatory.

Preferred Qualifications

• Databricks certification.
• Cloud platform certification.
• Experience with enterprise insurance platforms.
• Experience with Property and Casualty insurance data.
• Experience with data governance and master data management.
• Experience with real-time and streaming data.
• Experience with cloud migration and legacy modernization.
• Experience leading data architecture initiatives.

Additional Information

Work Arrangement: Onsite

Location: Charlotte, NC

Employment Type: Contract

Engagement Type: W2/1099

Final Interview:

Pay rate: $40-50/hr