Data Engineer - Contract - Melbourne/Sydney

Overview

An urgent contract opening is available for a Data Engineer working across Melbourne or Sydney. This role is suited to someone who can step in quickly and contribute in a project-based environment, with hands-on expertise in Azure data technologies.

Requirements

• At least 5 years of professional data engineering experience in enterprise settings.
• Minimum 3 years of practical experience with Azure Databricks and Apache Spark.
• Demonstrated success delivering data solutions on Microsoft Azure cloud platforms.
• Background in building scalable data pipelines and lake-based data architectures.
• Solid exposure to Agile delivery practices.
• Ability to work autonomously and add value from the outset.
• Strong capability in managing stakeholders and communicating clearly.

Key Responsibilities

• Create, enhance, and fine-tune data pipelines using Azure Databricks and Apache Spark.
• Develop and support dependable ETL and ELT processes for collecting, transforming, and loading data from varied source systems.
• Deliver scalable solutions using Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics.
• Put in place data quality, validation, and monitoring controls to maintain reliable and accurate data.
• Work closely with solution architects, business analysts, data scientists, and other stakeholders to achieve project goals.
• Improve Spark performance, cluster setup, and overall data processing efficiency.
• Assist with releases and deployments through CI/CD pipelines and DevOps practices.
• Investigate production problems and resolve incidents affecting the data platform in a timely manner.
• Prepare technical documentation, support knowledge transfer, and complete operational handover tasks.
• Maintain compliance with security requirements, governance policies, and enterprise data standards.

Additional Information

This is a 6-month contract role with a possibility of extension.

Only Australian citizens, New Zealand citizens, and permanent residents are eligible to apply.

For enquiries, contact jobs@hasthasolutions.com.