Specialist - Architecture

Responsibilities

· Lead the architecture, design, and implementation of advanced analytics solutions using Azure Databricks and Microsoft Fabric.

· Apply deep expertise in big data technologies, data engineering, cloud computing, Azure Databricks, and strong SQL skills to deliver scalable solutions.

· Work closely with business stakeholders and IT teams to understand requirements and deliver effective, business-aligned solutions.

· Oversee end-to-end implementation of data solutions, ensuring alignment with business requirements and industry best practices.

· Lead the development of data pipelines and ETL processes using Azure Databricks, PySpark, and other relevant tools.

· Integrate Azure Databricks with Azure services such as Azure Data Lake, Azure Synapse, Azure Data Factory, and on-premises systems.

· Provide expertise in Spark; Scala experience is an added advantage.

· Demonstrate strong Microsoft Fabric expertise, including pipeline development, notebook development, semantic modelling, real-time intelligence, and related scenarios.

· Provide technical leadership and mentorship to the data engineering team, fostering a culture of continuous learning and improvement.

· Ensure proper documentation of architecture, processes, and data flows while maintaining compliance with security and governance standards.

· Promote best practices for code quality, data security, scalability, and maintainability.

· Stay current with the latest developments in Databricks and associated technologies to support continuous innovation.

Essential Skills

· Mandatory French-speaking capability.

· Strong experience with Azure Databricks, including cluster management, notebook development, and Delta Lake.

· Proficiency in big data technologies such as Hadoop and Spark, along with data processing frameworks such as PySpark.

· Deep understanding of Azure services, including Azure Data Lake, Azure Synapse, and Azure Data Factory.

· Experience with Power BI, SSRS, SSAS, and SKU migration from P-SKU to F-SKU.

· Experience with ETL/ELT processes, data warehousing, and data lake development.

· Strong SQL skills and familiarity with NoSQL databases.

· Experience with CI/CD pipelines and version control systems such as Git.

· Knowledge of cloud security best practices.

Soft Skills

· Mandatory French-speaking capability.

· Excellent communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.

· Strong problem-solving skills and a proactive approach to identifying and resolving issues.

· Leadership skills, with the ability to manage and mentor a team of data engineers.

Nice-to-Have Skills

· Power BI experience for dashboarding and reporting.

· Microsoft Fabric experience for analytics and integration tasks.

· Spark Streaming experience for processing real-time data streams.

· Familiarity with Azure Resource Manager templates for infrastructure as code practices.

Experience

1. Demonstrated expertise of 12 years in developing data ingestion and transformation pipelines using Databricks/Synapse notebooks and Azure Data Factory.

2. Solid understanding and hands-on experience with Delta tables, Delta Lake, and Azure Data Lake Storage Gen2.

3. Experience using Auto Loader and Delta Live Tables for seamless data ingestion and transformation.

4. Proficiency in building and optimizing query layers using Databricks SQL.

5. Demonstrated experience integrating Databricks with Azure Synapse, ADLS Gen2, and Power BI for end-to-end analytics solutions.

6. Prior experience developing, optimizing, and deploying Power BI reports.

7. Familiarity with modern CI/CD practices, especially in the context of Databricks and cloud-native solutions.

Please Note

· This role will support approximately 10 to 12 projects in parallel.

· The candidate should be flexible to work across time zones based on customer alignment.

· The candidate should be open to weekend support for migrations, if required.