Realign LLC - Amazon Web Service (AWS) Cloud Computing

Cloud Developer is needed in Plano, United States.

Client: Realign LLC

Location: Plano, TX

Contract: Contract

Job Description

Job Type: Contract

Job Category: IT

Job Title: Amazon Web Service (AWS) Cloud Computing

Location: Wilmington, DE / Plano, TX - onsite

Duration: 6 months

Key Responsibilities:

• Data Pipeline Development: Design, develop, and implement efficient and scalable ETL/ELT processes using Apache Spark with Java, integrating data from diverse sources into data lakes (e.g., S3) and data warehouses (e.g., Redshift).
• AWS Service Utilization: Leverage a range of AWS services for data storage, processing, and analytics, including S3, Redshift, Glue, EMR, Lambda, Kinesis, and DynamoDB.
• Performance Optimization: Optimize Spark applications and data pipelines for performance, cost-efficiency, and reliability, including tuning Spark configurations and utilizing appropriate AWS resources.
• Data Modeling and Architecture: Design and implement data models for structured and unstructured data, and contribute to the overall data architecture strategy within an AWS environment.
• Collaboration and Communication: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
• Monitoring and Troubleshooting: Implement monitoring solutions for data pipelines and infrastructure, and troubleshoot issues to ensure data quality and system stability.
• Security and Governance: Implement data security measures and adhere to data governance policies within the AWS ecosystem.
• Documentation: Create and maintain comprehensive documentation for data engineering processes, designs, and deployments.

Requirements

• Programming Expertise: Strong proficiency in Java, with experience in developing Spark applications.
• Big Data Technologies: In-depth knowledge and hands-on experience with Apache Spark, including Spark SQL, DataFrames, and RDDs.
• Cloud Computing: Extensive experience with AWS services, particularly those related to data engineering (S3, Redshift, Glue, EMR, Kinesis, Lambda).
• Data Warehousing and Lakes: Experience with data warehousing concepts and technologies (e.g., Redshift, Snowflake) and building data lakes on S3.
• Databases: Proficiency in SQL and experience with both relational and NoSQL databases.
• Strong understanding and practical experience in designing and implementing ETL/ELT processes.
• Problem-Solving: Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data issues.
• Communication: Strong communication and collaboration skills to work effectively within a team and with various stakeholders.

Additional Information

Required Skills: SERVICENOW SECOPS DEVELOPER