Data Engineer

Role Overview

We are looking for an experienced Data Engineer with 5 to 7 years of professional background to design, build, and fine-tune data platforms and pipelines that can scale. The position calls for strong hands-on capability in SQL, Databricks, Confluent Kafka, Azure Data Factory (ADF), and Azure Data Lake Storage (ADLS), along with practical knowledge of banking workflows and regulatory requirements. You will partner with teams across the business to help deliver reliable, data-led insights for key banking operations.

Key Responsibilities

• Create, enhance, and support reliable, scalable data pipelines using Azure Data Factory and Databricks.
• Set up both scheduled and near real-time ingestion flows using Confluent Kafka.
• Develop efficient data models and implement ETL/ELT transformations with SQL, Spark, and related tooling.
• Design and administer data storage layers in Azure Data Lake Storage.
• Maintain strong standards for data accuracy, consistency, and governance.
• Enable data movement and integration between enterprise systems such as core banking and CRM platforms.
• Improve processing speed and scalability for large data volumes.
• Work with stakeholders to understand needs and convert them into technical solutions.
• Ensure solutions align with banking compliance, privacy, and regulatory obligations.
• Investigate and resolve issues affecting production data pipelines.

Required Skills and Experience

The role requires solid expertise in SQL, including advanced queries, optimization, and data modeling. Practical experience with Databricks, Spark, and PySpark is essential, as is exposure to Confluent Kafka and event-driven architectures. Candidates should also have working knowledge of Azure Data Factory and Azure Data Lake Storage. A sound understanding of data warehousing principles and familiarity with CI/CD and DevOps practices in data platforms are important.

Preferred Domain Knowledge

Experience in banking or financial services is preferred. Familiarity with core banking environments, as well as exposure to payments, lending, and wealth management processes, will be an advantage. Knowledge of regulatory areas such as KYC and AML is also desirable.

Soft Skills

Strong analytical thinking, problem-solving ability, clear communication, and effective stakeholder engagement are important for this role. The ideal candidate should be comfortable working in a fast-moving environment and demonstrate ownership along with a collaborative approach.

Qualifications

A bachelor’s or master’s degree in a relevant field is required. Azure or data engineering certifications are preferred.

Location Requirement

Candidates must be based in the UAE and have prior banking domain experience.