Data Engineer with Dataiku

Position : Data Engineer with Dataiku+Databricks(Language French/Dutch+English).

Job description

You are familiar with Dataiku and Databricks

You demonstrate and use your developer experience to develop and maintain complex data transformation steps using Databricks and Dataiku under specific guidelines (dev vs automation node, use of Dataiku’s low code recipes, etc.)

Responsibilities

• Develop and maintain complex data transformation steps using Dataiku under specific guidelines (dev vs automation node, use of Dataiku’s low code recipes, etc.)

• Leverage Databricks compute to enhance data processing and efficiency (performance, costs) under governance of Tech Lead

• Ensure data quality and integrity throughout the data transformation lifecycle

• Realize knowledge transfer within the Project team and the Business team which will take over the responsibility to run the projects in the future.

• You will be dedicated to a specific project, with other Databricks and Dataiku developers, rebuilding in Dataiku some complex SAS programs.

Required Skills

• Proven experience working with Dataiku for data processing, model deployment and web App creation.

• Experience handling unstructured text data and applying advanced analytics techniques.

• Proficiency in Python, SQL, and ML frameworks

• Ability to work collaboratively in Agile organization with non-technical people

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field

• Minimum 2 years of experience with Dataiku (Dataiku Developer certification)

Languages

• Fluent in either Dutch or French

• Fluent in English