• Location: England, London
  • Date Posted: 11th Dec, 2020
  • Reference: GCPBDE


Big Data Engineer - Google Cloud

GCP, GCP datastores, GCP Dataproc, Hadoop, NoSQL

Permanent

London



Summary:

A new opportunity has arisen with an amazing company in London for and experienced Big Data Engineer with GCP expertise. My client is a young logistics firm and one of the fastest growing in the UK. They are looking for self-driven, curious and creative BigData engineers to join their data engineering team and architect an automated, scalable and reliable BigData platform. You will be working very closely with their Data Scientists and analysts and be working on some of the very latest technologies.



Responsibilities:
  • Develop reliable and scalable production components
  • Use Kafka to build data stream pipelines
  • Troubleshoot data clusters
  • Build and integrate machine learning algorithms
  • Have a cloud native approach
  • Participate in technical design meetings within the product engineering team to solve some real operational issues




Skills and experience:
  • Excellent knowledge of GCP infrastructure and services
  • GCP datastores, GCP Dataproc, GCP Pub/Sub
  • Hadoop
  • Good experience of streaming frameworks, e.g. Spark, Flink
  • Experience with (Cloud-based) NoSQL databases
  • Linux and Terraform scripting experience
  • Experience building CI/CD pipelines using Jenkins
  • Experience of deployment of a containerised environment
  • Kubernetes
  • Python or Go languages




This role offers a competitive salary, pension, flexible working, and huge potential for growth!



***Please apply with your latest CV for immediate consideration***







Similar Jobs

Computational Biologist
England, London