Sr Data Engineer (Databricks)
Unison Group· Bharat
About this role
Position Overview:
- Lead the design, architecture, and optimization of enterprise-scale data pipelines using Azure Databricks for ACDP projects, driving innovation in DATA & AI initiatives.
- Leverage 7-8 years of expertise to mentor teams, ensure scalability, and deliver mission-critical data solutions.
Key Responsibilities:
- Architect and implement end-to-end data pipelines with Azure Databricks (notebooks, jobs, clusters) for ingestion, ETL/ELT, and complex transformations, incorporating Medallion Architecture (Bronze, Silver, Gold) using Delta Lake for ACID compliance, versioning, schema evolution, and data quality.
- Provide hands-on leadership in Databricks Spark (PySpark, Scala, SQL), Delta Live Tables, Structured Streaming, and Unity Catalog for advanced governance, security, and multi-workspace management.
- Integrate with Azure ecosystem including ADLS Gen2, Azure SQL Database, Serverless/Dedicated SQL Pools; orchestrate via Databricks workflows and hybrid ADF triggers for high-volume ACDP workloads.
- Design and deploy CI/CD pipelines using Azure DevOps, Bicep for infrastructure-as code, and advanced automation for Databricks workspaces, emphasizing zero downtime deployments and cost optimization.
- Champion data quality, validation, cleansing with Databricks expectations/constraints, and compliance via RBAC, encryption, and Purview; mentor on best practices for Photon engine, auto-scaling, spot instances, and performance tuning
- Collaborate with senior analysts, data scientists, and executives to translate complex business requirements into reusable Databricks components, fostering AI/ML integration.
- Drive monitoring, troubleshooting, and optimization for petabyte-scale processing, including unstructured data handling, data modeling, and streaming from Kafka/Event Hubs
Required Qualifications:
- 7-8+ years in data engineering, with deep Azure Databricks expertise for big data processing in high-demand environments
- Advanced proficiency in Python/PySpark, SQL, Scala; strong data architecture and distributed systems experience
- Proven track record in cloud-native solutions (AZ-900+ preferred), CI/CD, and mentoring junior engineers
- Excellent communication for stakeholder alignment and documentation
Preferred: Power BI, Power Automate, Azure ML, enterprise governance tools.
Frequently Asked Questions
Is the salary disclosed for the Sr Data Engineer (Databricks) position at Unison Group?
The salary for this Sr Data Engineer (Databricks) role at Unison Group is not publicly listed. Click "Apply Now" to learn more about the compensation package on their official careers page.
Where is the Sr Data Engineer (Databricks) position at Unison Group located?
This Sr Data Engineer (Databricks) role at Unison Group is based in Bengaluru, Karnataka, India. The position is listed as on-site or hybrid. Check the full job description or apply directly to confirm the work arrangement.
Is the Sr Data Engineer (Databricks) role at Unison Group full-time or part-time?
This is listed as a Full time position. It is posted as a Sr Data Engineer (Databricks) role in the Bharat department at Unison Group.
Which team or department does the Sr Data Engineer (Databricks) at Unison Group belong to?
This Sr Data Engineer (Databricks) position is part of the Bharat department at Unison Group. See the full job description for more information about the team structure and responsibilities.
How do I apply for the Sr Data Engineer (Databricks) position at Unison Group?
Click the "Apply Now" button on this page. You will be redirected to Unison Group's official application portal hosted on workable where you can submit your application directly.
When was the Sr Data Engineer (Databricks) job at Unison Group posted?
This Sr Data Engineer (Databricks) position at Unison Group was posted on Oct 2, 2026. Apply as soon as possible — early applications are often reviewed first.
Sr Data Engineer (Databricks)
Unison Group
You'll be redirected to Unison Group's official application page on workable.