Databricks SME

Company Description

Version 1 has celebrated 30 years in business and continues to be trusted by global brands to deliver technology and transformation solutions that drive customer success. Our deep expertise enables our customers to navigate the rapidly evolving technology landscape. We foster strong partnerships with global technology leaders including Microsoft, AWS, Oracle, Red Hat, OutSystems, Snowflake, ensuring that our customers are provided with the highest quality solutions and services. 

 We’re an award-winning employer reflecting how our employees are at the very heart of  what we do: 

• UK & Ireland's premier AWS, Microsoft & Oracle partner 
• 3300+ strong, €350/£300m revenue business 
• 10+ years as a Great Place to Work in Ireland & UK 
• Best Workplace for Women in the UK & Ireland by GPTW 
• Best Workplace for Wellbeing in the UK by GPTW 

We’re a core values driven company, we hire people who share our values, and we reward those who display and foster them, it’s deeply embedded within our DNA. Invest in us and we’ll invest in you!. 

Job Description

The Role 

We are looking for a Databricks Platform SME to join Version 1’s Data & AI Practice, with strong Databricks expertise and the ability to take primary ownership of our Databricks platform. You will be responsible for Databricks administration, governance, entitlements, performance optimisation, and overall operational management, while contributing to scalable, cloud-native data solutions that enable analytics and AI at scale. 

This is a delivery-focused role for an experienced engineer who enjoys solving complex data challenges, takes ownership of platform outcomes, and applies strong engineering discipline in real-world environments.

What You’ll Be Doing 

• Partnering with business and technology stakeholders to build and enhance reliable, scalable data platforms  
• Taking primary ownership of the Databricks platform, including administration, governance, entitlements, optimisation, and operational management 
• Managing Databricks workspaces, users, groups, access controls, platform configuration, performance, reliability, and cost efficiency 
• Building and maintaining cloud‑native data solutions on AWS  
• Supporting production systems by troubleshooting issues and implementing continuous improvements 
• Ensuring solutions are production‑ready: secure, tested, observable, and cost‑efficient 
• Optimising data performance, reliability, and data quality in live environments 
• Designing, building, and operating batch and streaming data pipelines  
• Developing high‑throughput, low‑latency data processing systems  
• Orchestrating data workflows using Airflow or similar orchestration tools  
• Writing clean, efficient, and well‑tested code following software engineering best practices  
• Collaborating closely with product, analytics, and platform teams  

Qualifications

What You’ll Bring 

• 8+ years’ experience in hands‑on data platform engineering roles 
• Strong Databricks expertise, including platform administration, entitlements/access management, governance, performance optimisation, and operational management 
• Hands-on experience managing Databricks workspaces, clusters, jobs, notebooks, and production Spark workloads 
• Demonstrated ability to manage and optimize Databricks platform operations at scale 
• At least 2 Databricks platform implementations from design to production in the last 4 years. 
• Strong hands‑on coding skills in Python, Java, or similar languages, with strong SQL capability  
• Proven experience building and operating batch and streaming pipelines in production  
• Hands‑on experience using dbt for transformations and Airflow (or equivalent) for orchestration  
• Solid understanding of data modelling, data quality, and production data systems 
• Experience working with relational databases such as Postgres or SQL Server  
• Familiarity with CI/CD pipelines, testing frameworks, and monitoring / observability tooling

Nice to Have 

• Databricks Professional Certification 
• Experience enabling ML, AI, or GenAI workloads through strong data foundations 
• Exposure to modern BI and analytics tooling 
• Experience working in regulated or security‑conscious environments 
• Consulting or client‑facing delivery experience 

Additional Information

Why Version 1? 

 At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their wellbeing, professional growth, and financial stability. 

• Share in our success with our Quarterly Performance-Related Profit Share Scheme, where employees collectively benefit from a share of our company's profits 
• Strong Career Progression & mentorship coaching through our Strength in Balance & Leadership schemes with a dedicated quarterly Pathways Career Development programme 
• Flexible/remote working, Version 1 is tremendously understanding of life events and people’s individual circumstances and offer flexibility to help achieve a healthy work life balance 
• Financial Wellbeing initiatives including; Pension, Private Healthcare Cover, Life Assurance, Financial advice and an Employee Discount scheme 
• Employee Wellbeing schemes including Gym Discounts, Bike to Work, Fitness classes, Mindfulness Workshops, Employee Assistance Programme and much more. Generous holiday allowance, enhanced maternity/paternity leave, marriage/civil partnership leave and special leave policies 
• Educational assistance, incentivised certifications, and accreditations, including AWS, Microsoft, Oracle, and Red Hat 
• Reward schemes including Version 1’s Annual Excellence Awards & ‘Call-Out’ platform. 
• Environment, Social and Community First initiatives allow you to get involved in local fundraising and development opportunities as part of fostering our diversity, inclusion and belonging schemes. 

And many more exciting benefits… drop us a note to find out more.    

Version 1 is an equal opportunities employer. 

We are committed to building a diverse, inclusive and respectful workplace where everyone feels valued and able to thrive. We welcome applications from people of all backgrounds, identities and lived experiences, and we value the different perspectives people bring including those shaped by disability and neurodiversity. 

We want every candidate to have a positive and accessible recruitment experience. If you need reasonable adjustments at any stage of the process, please contact your recruiter at Version 1. We will consider all requests carefully, respectfully and confidentially. 

Video links: https://www.youtube.com/watch?v=F_d3ELTH5zo