Senior Big Data Engineer
Gaming Innovation Group, Malta
Job Description
As a Senior Big Data Engineer, you will assume a pivotal role in taking ownership of the analysis, design, building, and support of major realtime big data projects. With a wealth of expertise, the Senior Big Data Engineer designs, creates, and maintains ETL processes, data integrations, and data pipelines, ensuring seamless handling of vast amounts of data. Leveraging extensive knowledge, the engineer develops high-performance services to efficiently process, store, and analyse large datasets using optimised code.
Aiming to maintain data accuracy and reliability, the Senior Big Data Engineer takes the lead in designing and implementing data validation and quality checks tailored to meet specific business needs. Troubleshooting live production systems is a regular part of the engineer's responsibilities, ensuring smooth operations and swift issue resolution. Demonstrating an innovative spirit, the engineer actively tests and implements new technologies, staying abreast of the latest advancements relevant to current and future projects.
As a senior member of the team, the engineer guides and mentors associate colleagues, fostering their growth and skill development within the organisation. With excellent collaboration and communication skills, the Senior Big Data Engineer collaborates across various company functions, identifying and analysing data requirements to deliver customised solutions. Staying up-to-date with the ever-evolving landscape of big data technologies comes naturally to the engineer, ensuring the team remains at the forefront of innovation.
The Senior Big Data Engineer's expertise and experience significantly contribute to the team's success through code reviews, promoting best practices and implementing robust solutions across all aspects of big data endeavours. Embracing this vital role, the Senior Big Data Engineer is instrumental in driving data-driven excellence, harnessing the power of information for strategic decision-making, and fostering organisational growth and success.
Requirements:
- Strong object oriented programming skills - ideally Python and/or Java
- Experience with big data technologies such as Spark, Kafka, Nifi, and Big Data datastores
- Strong understanding of schema design methodologies and data models
- Expert in extracting large datasets using SQL, familiarity with SQL databases
- Strong experience with cloud computed and/or distributed systems
- Excellent analysis and problem solving skills
- Strong communication amp; collaboration skills
- Strong understanding of data requirements for the iGaming Business
Benefits:
- Great career development opportunities
- 100% remote or hybrid working model
- International Health Insurance
- Health and Wellbeing Package (350 EUR per year)
- Birthday Day Off
- Me Time - 1 day off per year
- Lunches in the office for free