Senior Specialist - Data Engineering

Must-Have Skills

· Strong SQL skills, including complex queries, joins, data analysis, and experience with SQL Data Warehouse or Azure SQL.

· Experience with Azure Synapse and PySpark for data processing and transformation.

· Hands-on experience building, maintaining, and enhancing ETL/ELT and big data pipelines.

· Working knowledge of the MSBI stack on Azure.

· Working knowledge of Azure Data Factory and Azure Data Lake Storage.

· Experience with data validation, data quality checks, and pipeline monitoring.

· Strong troubleshooting and problem-solving skills, with the ability to resolve data and pipeline-related issues.

· Experience with Azure DevOps, Git version control, and CI/CD practices.

· Ability to perform requirement analysis and translate business needs into technical solutions.

· Strong analytical thinking, with the ability to derive insights and inferences from data.

· Good verbal and written communication skills, along with effective coordination abilities.

· Ability to work independently as an individual contributor while collaborating effectively with technical leads and stakeholders.

· Experience creating and maintaining technical specifications, wiki documentation, and implementation documents.

· Ability to provide regular status updates and maintain Azure DevOps work items.

Good-to-Have Skills

· Hands-on experience with Power BI and BI reporting or dashboard development.

· Knowledge of Cosmos DB, Cosmos scripting, and experience implementing pipelines using Cosmos DB.

· Experience with version control tools and practices, including Azure DevOps, Git, and CI/CD.

· Experience with Azure Analytics services.

· Experience working with marketing campaign data and campaign analytics.

· Knowledge of data platform product telemetry analytics.

· Understanding of big data architecture and data engineering best practices.

· Experience with advanced data visualization and dashboarding using Power BI.

· Experience with data pipeline optimization, performance tuning, and cost optimization.

· Strong presentation and whiteboarding skills, with the ability to communicate technical solutions to stakeholders.

· Software engineering mindset, with a focus on clean, scalable, reusable, and maintainable code.