• Location: Poland
  • Date Posted: 23rd Jul, 2021
  • Reference: 23072021LM

Looking for DataOps Engineer who will be delivering data-analytics pipelines to move data from business systems into the data lake.

You'll be biased towards reuse and automation of the process to minimize manual steps, as well as writing tests to monitor data as it moves along the pipeline to ensure its quality.

You will have experience in/with:

  • DataOps, ingesting data into data pipelines, and testing of data quality within the pipeline
  • Creating automated and reusable DataOps pipelines
  • Apache Kafka within an Event Driven Architecture
  • Operations/ETL
  • AWS services
  • CI/CD pipelines

Nice to have

  • Python / AWS Glue / Lenses/KSQL/Kafka Streams / Terraform

If you are worrying that your experience or skillset doesn`t match 100% - do not hesitate and get in touch with me today as I will be happy to discuss with you the possible flexibility with this position.

Interested in the role or know someone, please get in touch with via email l.marchlewski@frgconsulting.com or call 020 3826 6696 / +48 22 104 08 22

Similar Jobs

Data Engineer / AI - Wroclaw
Poland, Wrocław

Data Engineer
Poland, Masovia, Warsaw

Big Data Engineer - Fully Remote

Data Engineer- Warsaw- Up to 180pln/hour
Poland, Masovia, Warsaw

Global Data Engineer
Poland, Masovia, Warsaw