Intermediate Data Engineer

About the Role

The Government of Alberta is advancing its Digital Regulatory Assurance System (DRAS) through a modernization initiative, seeking an Intermediate Data Engineer to contribute toward building enterprise-scale data infrastructure. This position involves primarily remote work with occasional onsite meetings in Edmonton, Alberta, approximately 3–4 times per month. The engagement is expected to last about 12 months, with a potential extension of six more months, requiring 36.25 work hours per week.

Key Responsibilities

• Design and implement scalable data architecture in Azure cloud and hybrid environments.
• Develop and maintain ETL/ELT pipelines utilizing Azure Databricks, Delta Lake, Azure Data Factory, and Azure Synapse Analytics.
• Create data workflows using Python with PySpark and SQL to support enterprise data processes.
• Manage data storage and organization using Azure Data Lake Storage Gen2.
• Integrate multiple data sources including ServiceNow, APIs, and geospatial systems.
• Build semantic data models, data marts, and analytics-ready datasets to enable business intelligence.
• Apply data governance principles including metadata management, data lineage, and security compliance.
• Design and maintain secure RESTful APIs through Azure API Management.
• Optimize data pipeline performance and monitor operational health of data systems.
• Leverage AI-assisted tools for coding, automation, testing, and documentation to enhance development efficiency.
• Provide support for regulatory analytics and upcoming AI-related projects.

Qualifications and Experience

• Post-secondary degree or diploma in Computer Science or related discipline.
• Minimum one year experience applying AI-driven code generation, automation, or data analysis techniques.
• At least three years working with Azure Databricks components including Delta Lake, workflows, jobs, notebooks, and cluster management.
• Over three years designing analytics-ready platforms leveraging Power BI, Azure Synapse, semantic data modeling, and data marts.
• Two or more years managing Databricks data governance including metadata and security controls.
• Four or more years experience with Git version control systems.
• Three or more years managing various Azure services such as Storage, SQL, Synapse, Networking, Managed Identities, and Service Principals.
• Five or more years proficiency in Python (specifically PySpark) and SQL for enterprise-level ETL and ELT solutions.

Preferred Additional Skills

• Six or more years conducting business and data requirements analysis.
• Extensive experience with Microsoft SQL Server (6+ years).
• Experience working with Microsoft Fabric services (2+ years).
• Previous exposure to Government of Alberta cloud environments (1+ year).
• Familiarity with Talend ETL tools (2+ years).
• Proficiency in REST API development (3+ years).
• Cross-functional software development experience (5+ years).
• Experience integrating ServiceNow (1+ year).
• Knowledge of messaging systems like Azure Service Bus or ActiveMQ (3+ years).

Work Details and Terms

• Location: Edmonton, Alberta, Canada (Remote with required onsite meetings).
• Hours: 36.25 hours per week (7.25 hours daily).
• Duration: Approximately 12 months with possibility for 6 months extension.
• Interview Schedule: Between 27 and 31 July 2026.