LVTLABS-Magus - AWS Data Engineer

Data Scientist is needed in Atlanta, United States.

Client: LVTLABS-Magus

Location: Atlanta, GA, us

Contract: Freelance

Job Description

The role requires an experienced Data Engineer with expertise in AWS data services such as S3, Glue, Lambda, Redshift, and KMS. The candidate should possess strong SQL knowledge and experience with AWS Cloud Development Kit (CDK). The individual must be adept at designing and implementing data pipelines, handling large volumes of data, performing data cleansing and validation, and developing ETL processes. The role also involves integrating CI/CD pipelines, deploying cloud artifacts, and working with scheduling frameworks such as Airflow and AWS Step Functions.

Requirements

Must Have:

• AWS Data service experience (S3, GLUE, Lambda, Redshift, KMS, etc.)
• Strong SQL knowledge
• AWS CDK knowledge
• 8+ years of experience in Data Engineering with AWS services
• Proficient in Python, SQL, and Git
• Working knowledge of designing and implementing data pipelines on cloud providers (AWS preferred)
• Experience with large volumes of data from various sources; able to perform data cleansing and validation
• Hands-on ETL development experience with AWS services (Glue, Glue Crawlers, Lambda, Redshift, Athena, S3, EC2, IAM)
• Knowledge of monitoring and logging mechanisms (AWS CloudWatch, setting up alerts)
• Deployment knowledge in the cloud and ability to integrate CI/CD pipelines
• Experience working with scheduling frameworks (Airflow, AWS Step Functions)
• Excellent communication skills and ability to work collaboratively with other teams

Education

Bachelor’s Degree (preferred)

Locations

Toronto ON, Atlanta GA, and Remote.