Job 1000 van 1000


Report this listing

Solliciteren



Senior Data Engineer


Job description:
We are seeking an experienced Transformation Speed Layer Engineer to join our data engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures that enable fast and reliable data transformation and processing.
Design, develop, and maintain data pipelines and architectures that enable fast data transformation and processing.
Work with cross-functional teams to identify and prioritize data transformation requirements.
Ensure data quality, integrity, and security throughout the data transformation process.
Collaborate with data scientists and analysts to develop and optimize data models and algorithms.
Optimize data pipeline performance, scalability, and reliability.
Develop and maintain technical documentation for data pipelines and architectures.
Bachelor's degree in computer science, Engineering, or a related field.
Language – Pyspark and Java
Data modelling , Data Ingestion , Data Warehouse
Real time Service - Kafka Spark Steaming , flink
Disturbed processing – Hadoop , HDFS , Cloudera , Hive
At least 5 years of experience in data engineering, software development, or related field.
Experience in working on Azure platform
Experience with data processing technologies such as Apache Beam, Apache Spark, or similar.
Experience with cloud-based data platforms such as Google Cloud, Amazon Web Services, or Microsoft Azure.
Experience with containerization technologies
Familiarity with machine learning and data science concepts.

Solliciteren

Meer banen van je zoekopdracht