Senior Technical Lead
HCLTech
Senior Technical Lead
About this role
Job Summary
Role:
- Configure Databricks Auto Loader or Apache Spark Structured Streaming to securely subscribe to the relevant SAP AEM topics.
- Develop the PySpark/SQL data pipelines to process the incoming JSON payloads through the Delta Lake layers.
- Carry out data modelling in Databricks.
- Expose the Delta tables to the visualisation layer.
- Ensure that the data pipelines are optimised.
Skillsets:
- Expert in Apache Spark Structured Streaming and Databricks Auto Loader.
- Fluent in PySpark and Databricks SQL.
- Proven experience building Databricks architecture patterns.
Familiarity with Unity Catalog for data governance and access control.
Key Responsibilities
Role:
- Configure Databricks Auto Loader or Apache Spark Structured Streaming to securely subscribe to the relevant SAP AEM topics.
- Develop the PySpark/SQL data pipelines to process the incoming JSON payloads through the Delta Lake layers.
- Carry out data modelling in Databricks.
- Expose the Delta tables to the visualisation layer.
- Ensure that the data pipelines are optimised.
Skillsets:
- Expert in Apache Spark Structured Streaming and Databricks Auto Loader.
- Fluent in PySpark and Databricks SQL.
- Proven experience building Databricks architecture patterns.
Familiarity with Unity Catalog for data governance and access control.
Skill Requirements
Role:
- Configure Databricks Auto Loader or Apache Spark Structured Streaming to securely subscribe to the relevant SAP AEM topics.
- Develop the PySpark/SQL data pipelines to process the incoming JSON payloads through the Delta Lake layers.
- Carry out data modelling in Databricks.
- Expose the Delta tables to the visualisation layer.
- Ensure that the data pipelines are optimised.
Skillsets:
- Expert in Apache Spark Structured Streaming and Databricks Auto Loader.
- Fluent in PySpark and Databricks SQL.
- Proven experience building Databricks architecture patterns.
Familiarity with Unity Catalog for data governance and access control.
Other Requirements
Role:
- Configure Databricks Auto Loader or Apache Spark Structured Streaming to securely subscribe to the relevant SAP AEM topics.
- Develop the PySpark/SQL data pipelines to process the incoming JSON payloads through the Delta Lake layers.
- Carry out data modelling in Databricks.
- Expose the Delta tables to the visualisation layer.
- Ensure that the data pipelines are optimised.
Skillsets:
- Expert in Apache Spark Structured Streaming and Databricks Auto Loader.
- Fluent in PySpark and Databricks SQL.
- Proven experience building Databricks architecture patterns.
Familiarity with Unity Catalog for data governance and access control.
Frequently Asked Questions
Is the salary disclosed for the Senior Technical Lead position at HCLTech?
The salary for this Senior Technical Lead role at HCLTech is not publicly listed. Click "Apply Now" to learn more about the compensation package on their official careers page.
Where is the Senior Technical Lead position at HCLTech located?
This Senior Technical Lead role at HCLTech is based in City Of London, United Kingdom. The position is listed as on-site or hybrid. Check the full job description or apply directly to confirm the work arrangement.
How do I apply for the Senior Technical Lead position at HCLTech?
Click the "Apply Now" button on this page. You will be redirected to HCLTech's official application portal hosted on successfactors where you can submit your application directly.
When was the Senior Technical Lead job at HCLTech posted?
This Senior Technical Lead position at HCLTech was posted on Aug 24, 2026. Apply as soon as possible — early applications are often reviewed first.
Senior Technical Lead
HCLTech
You'll be redirected to HCLTech's official application page on successfactors.