Responsibilities:
We are looking for a
software developer with a strong background in Data engineering
and
data management technologies. You will be responsible for the following:
- Development of our client's data engineering pipelines and data lakes
- Work closely with product owners and developers to collaboratively refine functional requirements and build infrastructure to deliver on those requirements
- Collaborate with other developers and architects to build out scalable data architectures
- Maintain high-quality code
- Expand and improve test automation, continuous integration, and continuous delivery within the pipelines
Qualifications:
- BS or MS in Computer Science or related technical field
- 3 to 6 years of software development experience in Python, Airflow or any similar ETL technologies
- 3 to 6 years of experience working on Redshift or similar data warehouses, Spark, either via PySpark or Scala
- Knowledge of techniques used to optimise web and backend service performance
- Experience with JavaScript, HTML, CSS, and JQuery and programming languages like PHP or Go is a plus
- Team player with Agile development experience
- Experience with
CI/CD
using Jenkins is a plus - A strong background in algorithms is preferable
- Experience with data science and machine learning is a plus
- Experience with Cloud providers like AWS, Google or Azure is a plus