Hastha Solutions - Data Engineer - Contract - Melbourne/Sydney

AI Engineer is needed in Melbourne, Australia.

Client: Hastha Solutions

Location: Melbourne, VIC, au

Contract: Contract

Job Description

Urgent requirement of Data Engineer - Contract - Melbourne/Sydney.

Requirements

Essential Experience:

• 5+ years of Data Engineering experience in enterprise environments.
• 3+ years of hands-on experience working with Azure Databricks and Apache Spark.
• Proven experience delivering data solutions on Azure cloud platforms.
• Experience designing and implementing scalable data pipelines and data lake architectures.
• Strong experience with Agile delivery methodologies.
• Ability to work independently and contribute immediately within a project-based environment.
• Strong stakeholder management and communication skills.

Key Responsibilities:

• Design, develop, and optimize data pipelines using Azure Databricks and Apache Spark.
• Build and maintain robust ETL/ELT frameworks to ingest, transform, and load data from multiple source systems.
• Develop scalable data solutions leveraging Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.
• Implement data quality, validation, and monitoring frameworks to ensure data integrity and reliability.
• Collaborate with solution architects, business analysts, data scientists, and stakeholders to deliver project outcomes.
• Optimize Spark workloads, cluster configurations, and data processing performance.
• Support deployment activities through CI/CD pipelines and DevOps practices.
• Troubleshoot production issues and provide timely resolution of data platform incidents.
• Contribute to technical documentation, knowledge transfer, and operational handover activities.
• Ensure adherence to security, governance, compliance, and enterprise data standards.

Additional Information

Duration: 6 Months and possible extension.

Eligibility: Australian/NZ Citizens/PR Holders only.