Senior Software Engineer / Lead Software Engineer(BigData)

Senior Software Engineer / Lead Software Engineer(BigData)

Location: Krakow, Poland(Hybrid) 

6 Months contract

We are looking for a Senior Software Engineer with experience in Big Data processing technologies and techniques who is comfortable working alongside a strong, international team of engineers, to build applications for a key Client initiative. 

Whilst core skills are listed below, We are mainly looking for passionate people who are looking to continually improve and challenge themselves to work in a highly disciplined, verifiable manner.

What you’ll do:

• Work with the Product Owner and IT Analyst to understand stakeholder requirements 
• Be responsible for building and managing data processing components and storage technologies 
• Be responsible for onboarding new data sources and constructing data processing pipelines to present required views of data for application developers 
• Work with Data Scientists to productionise proactively developed analytics 
• Ensure that development is undertaken in line with continuous integration and test-driven development philosophies and that code quality standards and processes are adhered to. 
• Work with Architects to both validate designs and ensure adherence to the agreed approach 
• Carry out unit testing to ensure the quality of delivered components  

What you need to have to succeed in this role

Core Skills / Characteristics: 

• Practical experience with Apache Spark 

• Strong experience with programming languages (Java/Scala) 

Good to Have: 

• Experience with Apache Hadoop (Yarn, HDFS) 

• Experience with Spring framework 

• Knowledge of Airflow  

• Experience with databases (SQL, Elasticsearch) 

• Experience in Python 

• Experience of deploying services on Google Cloud Platform 

• Practical knowledge of Maven, Git