Overview
We are looking for a
Data Engineer
with around 4 years of experience to strengthen our data team. The role focuses on designing, building, and optimizing
data pipelines
using modern cloud platforms and
Databricks
. The ideal candidate is passionate about data engineering, enjoys solving complex problems, and has hands-on experience with both traditional and modern data technologies.
Responsibilities
- Design, develop, and maintain
scalable ETL/ELT pipelines
on
Databricks
and other platforms. - Integrate structured and unstructured data from multiple sources, ensuring quality and reliability.
- Optimize data processing performance and implement monitoring solutions.
- Collaborate with analysts, scientists, and business teams to deliver data solutions aligned with business needs.
- Manage
data lake and data warehouse environments
(Delta Lake, Snowflake, Azure Synapse, or similar). - Contribute to best practices, documentation, and data governance standards.
- Troubleshoot issues in ingestion, transformation, and data availability.
Required Skills & Experience
- ~4 years of professional experience as a Data Engineer.
- Strong expertise in
Databricks (Spark, Delta Lake, PySpark)
. - Advanced skills in
SQL
and programming (Python required, Scala/Java a plus). - Experience with
cloud platforms
(Azure, AWS, or GCP). - Solid knowledge of
data warehousing
and
data modelling
principles. - Familiarity with
streaming technologies
(Kafka, Event Hubs, Kinesis, etc.). - Experience with
CI/CD
and version control (Git). - Good understanding of
data governance and data quality frameworks
.
Soft Skills
- Strong problem-solving mindset, attention to detail.
- Ability to work in agile, cross-functional teams.
- Effective communicator with both technical and non-technical stakeholders.
- Adaptability to new technologies and evolving business needs.
Education & Certifications
- Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
- Relevant certifications (Azure Databricks, Azure Data Engineer, AWS Big Data, etc.) are a plus.
Solliciteren