Looking for DataOps Engineer
who will be delivering data-analytics pipelines to move data from business systems into the data lake.
You'll be biased towards reuse and automation of the process to minimize manual steps, as well as writing tests to monitor data as it moves along the pipeline to ensure its quality. You will have experience in/with:
Nice to have
- DataOps, ingesting data into data pipelines, and testing of data quality within the pipeline
- Creating automated and reusable DataOps pipelines
- Apache Kafka within an Event Driven Architecture
- AWS services
- CI/CD pipelines
- Python / AWS Glue / Lenses/KSQL/Kafka Streams / Terraform
If you are worrying that your experience or skillset doesn`t match 100% - do not hesitate and get in touch with me today as I will be happy to discuss with you the possible flexibility with this position.
Interested in the role or know someone, please get in touch with via email email@example.com or call 020 3826 6696 / +48 22 104 08 22