Spark Eighteen - Data Engineer - Senior

Data Scientist is needed in New Delhi, India.

Client: Spark Eighteen

Location: New Delhi, DL, in

Contract: Freelance

Job Description

We’re passionate about building seamless digital experiences powered by robust and intelligent data systems. We’re on the lookout for a Data Engineer - Senior to architect and maintain high-performance data platforms that fuel decision-making and innovation.

If you enjoy designing scalable pipelines, optimising data systems, and leading with technical excellence, you’ll thrive in our fast-paced, outcome-driven culture.

You’ll take ownership of building reliable, secure, and scalable data infrastructure—from streaming pipelines to data lakes. Working closely with engineers, analysts, and business teams, you’ll ensure that data is not just available, but meaningful and impactful across the organization.

Requirements

• 6+ years of experience in Data Engineering and production-scale data platforms.
• Design and manage Apache Airflow pipelines for high-volume sensor, satellite, and third-party data ingestion.
• Build and optimize Apache Spark workloads for batch processing, geospatial analytics, and large-scale aggregations.
• Develop and maintain PostgreSQL, TimescaleDB, PostGIS, and DuckDB-based data solutions.
• Implement efficient data ingestion, transformation, and bulk-loading pipelines.
• Containerize and deploy applications using Docker and Docker Compose, including air-gapped environments.
• Collaborate with customer teams to translate business requirements into data products and analytical solutions.
• Ensure data quality, lineage, observability, performance, and SLA compliance.
• Troubleshoot production issues and optimize pipeline, database, and query performance.
• Create and maintain technical documentation, data models, and operational runbooks.
• Demonstrate strong proficiency in Python, SQL, Airflow, Spark, and PostgreSQL.
• Experience with geospatial and time-series data, S3-compatible storage, and secure customer environments.
• Strong communication, stakeholder management, and problem-solving skills.

Additional Information

Benefits include:

• Top-Tier Work Setup: Equipped with a premium MacBook and all necessary accessories.
• Flexible Schedules & Remote Support: Flexible working hours and emergency work-from-home days.
• Quarterly Performance Bonuses: Celebrate success with quarterly bonus opportunities.
• Learning is Funded Here: Conferences, courses, and certifications funded with a dedicated educational allowance.
• Family-First Culture: Includes birthday and anniversary vouchers, as well as maternity and paternity leaves.
• Celebrations & Gifting: Onboarding hampers, festive goodies, and company anniversary surprises.
• Team Bonding Moments: Quarterly lunches, dinners, and fun company retreats.
• Healthcare That Has You Covered: Comprehensive health insurance for you and your family.
• Extra Rewards for Extra Effort: Incentives and bonuses for weekend work and great referrals.