Software Resources, Inc. - Senior Data Engineer

Data Engineer is needed in Glendale, United States.

Client: Software Resources, Inc.

Location: Glendale, CA

Contract: Contract

Job Description

Software Resources has an immediate job opportunity for a Senior Data Engineer with a major corporation in Glendale, CA. This is a hybrid role requiring 2 days onsite (candidate may select onsite days) and is expected to last for 12+ months, with a pay rate of $90 - $93/hr DOE. We are seeking an experienced Sr. Data Engineer to support enterprise data engineering initiatives, designing, building, and optimizing scalable data solutions while collaborating with cross-functional teams to support data platform modernization efforts.

Requirements

Qualifications:

• 5+ years of data engineering experience developing and operating large-scale data pipelines.
• Deep hands-on experience with Databricks and Apache Spark (batch and streaming), including pipeline development in PySpark and/or Scala.
• Strong understanding of Spark architecture executors, stages, partitioning, shuffle, and performance tuning with the ability to explain tradeoffs to technical and non-technical stakeholders.
• Proficiency with Databricks platform tooling (API, SDK, CLI) for automation, auditing, governance, and operational troubleshooting.
• Proficient in SQL with advanced performance tuning capabilities.
• Hands-on production experience with Airflow (MWAA) for orchestrating data pipelines.
• Experience managing Databricks platform governance: ACLs, Unity Catalog, lineage, and access provisioning.
• Proficiency in Python and at least one additional language (Scala, Kotlin, or SQL-driven pipeline tooling).
• Experience designing and optimizing scalable ETL/ELT pipelines integrating diverse structured and unstructured data sources.
• AWS-primary experience (compute, storage, networking, IAM); experience with other cloud providers is transferable.
• Proficiency with Docker and Kubernetes for building and maintaining containerized data platform services.
• Working knowledge of networking concepts to diagnose cross-platform integration and connectivity issues.
• Familiarity with Snowflake and comparable tooling relative to the Databricks ecosystem.
• Experience designing and implementing CI/CD and DevOps practices (Git-based workflows).
• Experience implementing data quality checks, monitoring, and logging for pipeline reliability.
• Self-starting problem solver with strong analytical and communication skills; willingness to learn new tooling and trends.
• Familiar with Scrum and Agile methodologies.
• Bachelor’s Degree in Computer Science, Information Systems, or a related field, or equivalent work experience; Master’s Degree is a plus.

Required Qualifications:

• Strong experience with Databricks.
• Advanced Python development skills.
• Experience with Terraform and Infrastructure as Code.
• 5+ years of relevant data engineering experience.
• Ability to participate in architecture and system design discussions.
• Strong problem-solving and data platform implementation experience.

Preferred Qualifications:

• Experience with AWS.
• Cloud-based data platform experience.
• Data pipeline optimization and automation expertise.

Required Education:

• BA/BS

Company Overview

Software Resources, founded more than 3 decades ago, is a trusted staffing partner specializing in Technology (IT, Creative, & Marketing), Finance, & Accounting placements. We work with companies nationwide that need skilled professionals and connect them with candidates looking for the right opportunity. We are always looking for professionals at all experience levels and in various specialties to meet our clients’ hiring needs. As a member of our team, you will have access to benefits including medical, dental, and vision coverage, a 401(k) with company match, short-term disability, and life insurance with AD&D.

If this position interests you, we encourage you to apply. You can view all our job openings at Software Resources Careers.