Calance US - Senior Cloud Data Engineer (AWS / PySpark / Serverless)

Cloud Developer is needed in Torrance, United States.

Client: Calance US

Location: Torrance, CA

Contract: Contract

Job Description

Position: Senior Cloud Data Engineer (AWS / PySpark / Serverless)

Job Ref#: 43883 - JIH5JP00003893

Duration: 12+ Months (On-Going Contract)

Location: HYBRID - Torrance, CA 90501

Pay Rate: $70.00 - $74.00 per hour (W2 Only)

HYBRID: Must be able to work ONSITE 4 days a week (LOCAL CANDIDATE ONLY)

Responsibilities

• Design, develop, and maintain robust ETL/ELT pipelines using AWS Glue for large-scale data processing
• Build serverless applications and microservices using AWS Lambda for real-time and batch data processing
• Implement data transformation logic using PySpark for distributed computing on large datasets
• Develop and optimize SQL queries for data extraction, transformation, and loading processes
• Implement Infrastructure as Code (IaC) using AWS CloudFormation, CDK, or Terraform
• Design event-driven architectures using AWS services, such as EventBridge, SQS, and SNS
• Develop RESTful APIs and web services using Node.js for data access and integration
• Mentor junior developers and provide technical guidance to the team
• Collaborate with data scientists, analysts, and stakeholders to understand requirements
• Participate in code reviews and maintain high coding standards
• Document technical designs, processes, and best practices
• Develop and maintain web applications using Node.js, Java, and Python. Design and implement RESTful APIs and microservices. Experience with AWS services (EC2, S3, Lambda, RDS, etc.)
• Write clean, maintainable, and efficient code while adhering to best practices. Troubleshoot and debug applications to ensure optimal performance

Requirements

• 5+ years of Software Development experience with 3+ years in Cloud environments
• Strong proficiency in Python with extensive experience in PySpark for big data processing
• Hands-on experience with AWS Glue for ETL pipeline development and management
• Proven expertise in AWS Lambda for serverless application development
• Solid understanding of Node.js for API development and backend services
• Experience with SQL and NoSQL databases (PostgreSQL, MySQL, MongoDB, DynamoDB)
• Proficiency in AWS services including S3, IAM, CloudWatch, and VPC
• Experience with CI/CD pipelines and DevOps practices
• Understanding of Infrastructure as Code tools (CloudFormation, CDK, Terraform)
• Familiarity with version control systems (Git) and agile development methodologies
• Strong understanding of data warehousing concepts and dimensional modeling
• Experience with data formats (JSON, Parquet, Avro, ORC) and data serialization
• Understanding of data security, privacy, and compliance requirements
• Strong understanding of front-end technologies (HTML, CSS, JavaScript, frameworks like React or Angular)

Desired Skills

• Knowledge of data streaming technologies (Kinesis, Kafka) is a plus

Calance Consultant Benefits Offerings

• EPO/PPO Medical Plans
• HMO/PPO Dental programs
• Vision - VSP (Vision Plan Summary)
• 401K Retirement vesting program (VOYA)
• Paid Bi-Weekly/Direct Deposit
• Flex Spending Plan
• Voluntary Life, AD&D, STD or LTD plans