Big Data Lead

Fabric – Data Engineer Key Responsibilities Design, develop, and orchestrate end-to-end data pipelines using Microsoft Fabric Build scalable and reusable data frameworks, including: Config-driven pipeline architecture Centralized configuration tables supporting multiple pipelines Develop and maintain Spark notebooks and pipelines Implement ETL/ELT processes using SQL, Spark, and Python Perform data modeling and transformations for analytics and reporting Collaborate with architectural and engineering teams to design robust solutions Ensure adherence to enterprise standards including: Confluence documentation CI/CD pipelines Code quality and deployment guidelines Support deployments across multiple client environments Own deliverables end-to-end with minimal supervision Required Skills & Experience Must-Have 8+ years of experience as a Data Engineer Strong experience with Microsoft Fabric (2+ years of work experience in Fabric) OR strong background in Azure Synapse Analytics with Azure data services (ADF, Databricks, Delta tables etc.) Good to have Fabric certified candidates Hands-on experience with: SQL Data Modeling ETL / ELT Pipelines Experience with Spark notebooks and pipelines or Python experience for data engineering use cases Create Semantic models and generate BI reports Proven ability to design and orchestrate scalable data solutions Experience working in environments with CI/CD processes for deployments Nice-to-Have Experience building generic or reusable data frameworks Familiarity with enterprise documentation standards (e.g., Confluence) Soft Skills Self-starter and quick learner Strong sense of ownership and accountability Ability to work independently in a fast-paced environment Clear communicator with good collaboration skills