Manager - Data Engineering
American Express
Data Engineering Manager - Databricks & Lakehouse
Unison Group· Bharat
About this role
Role Summary
We are seeking an experienced Data Engineering Manager with strong Databricks and modern cloud data engineering expertise to lead the design, development and operation of scalable enterprise data solutions. The role combines technical leadership, people management, architecture oversight and delivery accountability. The successful candidate will establish engineering standards, reusable frameworks and robust practices for secure, governed, reliable and cost-efficient Lakehouse solutions.
Key Responsibilities
Lead, mentor and support a team of data engineers, setting technical direction and encouraging engineering best practices.
Design, build and operate scalable data pipelines and Lakehouse solutions using Databricks, Apache Spark, Delta Lake, SQL, Python and cloud-native services.
Define standards for ingestion, transformation, orchestration, automated testing, deployment, observability, monitoring and production support.
Collaborate with business, analytics, data science, architecture, security and platform teams to translate requirements into high-quality data solutions.
Champion reusable and metadata-driven frameworks, automation, Medallion Architecture patterns and modern data engineering practices.
Embed data quality, security, governance, privacy and compliance controls across pipelines and data products.
Review solution designs, code and deployment approaches to maintain consistency, resilience, maintainability and operational reliability.
Optimize Databricks workloads for performance, scalability, reliability and cost efficiency.
Support Agile delivery, including backlog refinement, sprint planning, estimation, risk management, continuous improvement and technical roadmap development.
Required Qualifications & Experience
Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, Data Science or a related discipline.
Significant professional experience in data engineering, including experience leading or managing data engineering teams.
Strong hands-on experience with Databricks and Lakehouse-based architectures.
Advanced proficiency in Apache Spark / PySpark, SQL, Python, Delta Lake, ETL/ELT, data pipeline development and orchestration.
Strong understanding of Medallion Architecture, distributed processing and modern cloud data-platform patterns.
Experience implementing CI/CD, automated testing, logging, monitoring, alerting and controlled deployment practices.
Working knowledge of data governance, lineage, data quality, security, privacy and role-based access control.
Proven experience optimizing large-scale workloads for performance, reliability and cost.
Experience conducting design and code reviews and establishing engineering standards.
Strong stakeholder management, problem-solving and written and verbal communication skills.
Preferred Qualifications
Experience with Azure Databricks, Unity Catalog and the broader Azure data ecosystem.
Experience building reusable, configuration-driven or metadata-driven ingestion and transformation frameworks.
Exposure to Azure DevOps, Git-based CI/CD, infrastructure as code and automated release controls.
Frequently Asked Questions
Is the salary disclosed for the Data Engineering Manager - Databricks & Lakehouse position at Unison Group?
The salary for this Data Engineering Manager - Databricks & Lakehouse role at Unison Group is not publicly listed. Click "Apply Now" to learn more about the compensation package on their official careers page.
Where is the Data Engineering Manager - Databricks & Lakehouse position at Unison Group located?
This Data Engineering Manager - Databricks & Lakehouse role at Unison Group is based in Bengaluru, Karnataka, India. The position is listed as on-site or hybrid. Check the full job description or apply directly to confirm the work arrangement.
Is the Data Engineering Manager - Databricks & Lakehouse role at Unison Group full-time or part-time?
This is listed as a Full time position. It is posted as a Data Engineering Manager - Databricks & Lakehouse role in the Bharat department at Unison Group.
Which team or department does the Data Engineering Manager - Databricks & Lakehouse at Unison Group belong to?
This Data Engineering Manager - Databricks & Lakehouse position is part of the Bharat department at Unison Group. See the full job description for more information about the team structure and responsibilities.
How do I apply for the Data Engineering Manager - Databricks & Lakehouse position at Unison Group?
Click the "Apply Now" button on this page. You will be redirected to Unison Group's official application portal hosted on workable where you can submit your application directly.
When was the Data Engineering Manager - Databricks & Lakehouse job at Unison Group posted?
This Data Engineering Manager - Databricks & Lakehouse position at Unison Group was posted on Oct 16, 2026. Apply as soon as possible — early applications are often reviewed first.
Data Engineering Manager - Databricks & Lakehouse
Unison Group
You'll be redirected to Unison Group's official application page on workable.