Roles and Responsibilities:
– Designing and building data architectures including the design and set-up of scalable modern Data Platforms incl. infrastructure-as-code, proper CI/CD, solid DevOps and the best-fit technologies for the use case.
– Working hand-in-hand with the BI developers deploying data pipelines and transformations that turn the raw data into relevant datasets and insights (e.g. using Databricks, Azure Data Factory, Fabric or DBT).
– Working with Data Scientists deploying machine learning into scalable services in a perfect fit with the data architecture (e.g. using MLFlow).
– Assisting the project team in deploying data applications including, if needed, close-to real-time architectures such as streaming pipelines (e.g. using Spark Structured Streaming or Azure Functions)
– Develop and deploy (both hybrid cloud & full cloud) data architectures in Microsoft Azure.
– Leverage Open-Source technology in building scalable and best-practice set-ups (incl. Spark & Python)
– Work with external vendors and partner technologies including (but not limited to) Azure
– Embrace project management aimed towards getting the job done. This will include working with client data engineers and data scientists but also with business stakeholders
– Solid knowledge of SQL and coding skills in general.

Qualifications:

– BS or MS in Computer Science or related technical field.