Senior Data Engineer

(1295) Our Client is an OVO Group, a big family of companies united by a single vision: to get to zero carbon, fast. The OVO Group’s mission is to drive progress towards net zero carbon living. We call this Plan Zero – and it shows how we’ll be fighting the climate crisis and transforming the way people use energy over the next decade. To do this, we need the sharpest minds. Are you up for the challenge? Do great green things with OVO Energy So much has changed since we launched in 2009. Our goal remains the same though: make energy Responsibilities A proven track record of designing, building, monitoring and managing large-scale data products, pipelines, tooling and platforms. Working on streaming ETL solutions utilising streaming data processing tools (e.g. Kafka Streams, Kinesis, Spark or similar). Developing a segmentation solution framework to rebuild the current solution together with a team of TS(JS) engineers. You will be comfortable working in an agile software development environment and have experience in CI/CD and deployment strategies. Analyzing current data processing using Datadog or similar solutions. Requirements Knowledge of best practices and methodologies in Data Warehousing with at least 5 years of experience Python or another programming language (Scala, Typescript, Java, Kotlin) Experience with BigQuery, Data Fusion Experience in working on GCP or any other cloud provider Experience in building and supporting ETL pipelines using SQL technologies Experience working in an Agile development process Experience with Kafka, Kafka Connect or similar would be a plus Experience with database administration and MSSQL would be an advantage Experience with Docker & Kubernetes, Terraform would be a plus Upper-intermediate English Critical thinking and problem-solving skills