Senior Databricks Engineer
EXL Talent Acquisition Team
Senior Databricks Engineer
About this role
We are looking for a Senior Databricks Engineer with 7+ years of experience in data engineering and strong hands-on expertise in Databricks and Apache Spark. The ideal candidate will design and build scalable data pipelines, optimize large-scale data processing, and work with cloud-based data platforms.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
- Develop and optimize PySpark/Spark jobs for large-scale data processing.
- Build reliable ETL/ELT pipelines using Databricks workflows, Delta Lake, and SQL.
- Implement data transformations, data quality checks, and performance optimization.
- Work with cloud data platforms such as AWS, Azure, or GCP.
- Optimize Spark jobs, cluster configurations, partitioning, joins, and data processing performance.
- Collaborate with data engineers, data scientists, analysts, and business teams to deliver data solutions.
- Implement best practices for CI/CD, version control, monitoring, and production support.
- Troubleshoot data pipeline and performance issues in production environments.
Required Skills
- 7+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Strong expertise in Apache Spark / PySpark.
- Experience with Delta Lake, Databricks Workflows, and Spark SQL.
- Strong proficiency in Python and SQL.
- Experience building and optimizing large-scale ETL/ELT pipelines.
- Experience with at least one cloud platform: AWS, Azure, or GCP.
- Good understanding of data warehousing, data modeling, and distributed data processing.
- Experience with Git and CI/CD practices.
Preferred Skills
- Experience with Unity Catalog and Databricks governance.
- Experience with Azure Data Factory, AWS Glue, or similar orchestration tools.
- Knowledge of streaming technologies such as Kafka or Spark Structured Streaming.
- Experience with Infrastructure as Code or cloud automation.
- Databricks certifications are a plus.
Frequently Asked Questions
Is the salary disclosed for the Senior Databricks Engineer position at numentica?
The salary for this Senior Databricks Engineer role at numentica is not publicly listed. Click "Apply Now" to learn more about the compensation package on their official careers page.
Where is the Senior Databricks Engineer position at numentica located?
This Senior Databricks Engineer role at numentica is based in Saidapet. The position is listed as on-site or hybrid. Check the full job description or apply directly to confirm the work arrangement.
Is the Senior Databricks Engineer role at numentica full-time or part-time?
This is listed as a Full time Direct Hire position. It is posted as a Senior Databricks Engineer role at numentica.
How do I apply for the Senior Databricks Engineer position at numentica?
Click the "Apply Now" button on this page. You will be redirected to numentica's official application portal hosted on zohorecruit where you can submit your application directly.
When was the Senior Databricks Engineer job at numentica posted?
This Senior Databricks Engineer position at numentica was posted on Sep 15, 2026. Apply as soon as possible — early applications are often reviewed first.
Senior Databricks Engineer
numentica
You'll be redirected to numentica's official application page on zohorecruit.