Senior Data Engineer
HyROI Solutions- An ISO-certified company
Doha, Doha Municipality, Qatar ・ 契約
最初に応募しよう
- 経験
- 6歳以上
- 給料
- —
- 求人情報
- 1
- 投稿済み
- 4時間前
- 作業モード
- 在任中
- 教育
- Bachelors or Masters in Accounting, Business, Computer Science, Information Systems, or Engineering
- 再開する
- 応募必須
勤務地
仕事内容
About the Role
We are seeking an experienced Data Engineer proficient in Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric. This position involves architecting, building, and maintaining data pipelines, lakes, and warehouses on Azure, supporting data-driven decision-making for various stakeholders. The successful candidate will collaborate with diverse teams to develop scalable and efficient data architectures.
Key Responsibilities
- Design and implement ETL pipelines using Azure Data Factory to extract, transform, and load data from multiple sources including on-premise, cloud storage, SQL/NoSQL databases, REST APIs, and flat files.
- Ensure data integrity through rigorous validation, transformation rules, and error handling mechanisms within pipelines.
- Automate data orchestration across storage systems, databases, and analytics platforms employing ADF pipelines and Data Flows.
- Develop and manage data lakes and warehouses on Azure Synapse Analytics, integrating services such as Azure SQL Data Warehouse and Azure Data Lake.
- Conduct batch and real-time analytics through data transformations supporting OLAP and OLTP models.
- Optimize the performance and scalability of Azure Synapse workloads, leveraging serverless SQL pools, Spark Pools, and integration pipelines.
- Leverage Microsoft Fabric for unified data integration, collaborative workflows, and building advanced analytics and AI-driven insights.
- Implement secure, cloud-based data architectures following best practices in security, governance, and compliance (including GDPR and CCPA adherence).
- Develop and maintain continuous integration and deployment pipelines using Azure DevOps, GitHub Actions, and Azure Pipelines.
- Automate routine operational tasks with Azure Logic Apps and Power Automate to enhance efficiency.
- Report directly to the QT Project Manager and execute assigned tasks effectively.
Qualifications and Skills
- Over 6 years' experience in data engineering with a focus on cloud data pipeline construction and management.
- Advanced skills with Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric platforms.
- Strong command of SQL, T-SQL, and Azure SQL Database management.
- Knowledge of Azure data storage solutions including Azure Blob Storage and Data Lake.
- Experience with big data tools such as Hadoop and Spark integrated within Azure Synapse or Databricks.
- Familiarity with DevOps methodologies, particularly CI/CD for data pipelines.
- Deep understanding of data governance, data quality standards, and cloud security implementation.
- Additional familiarity with Power BI, Azure Machine Learning, or similar BI/AI technologies is advantageous.
- Bachelor’s or Master’s degree in Accounting, Business, Computer Science, Information Systems, or Engineering.
Preferred Certifications (Not required)
- Microsoft Certified: Azure Data Engineer Associate
- Microsoft Certified: Azure Synapse Analytics
- Microsoft Certified: Azure AI Engineer Associate
- Certified Azure Solutions Architect Expert
Additional Information
The role is based onsite in Doha, Qatar, under contract employment. The candidate will coordinate closely with the QT Project Manager. Emphasis is placed on ensuring secure, compliant, and high-performing data engineering solutions within Azure.