Senior Data Engineer
Adyen
Senior Data Engineer
Adyen is seeking a Senior Data Engineer to join their Amsterdam office, focusing on building high-quality data pipelines and architectures on their Big Data Platform. The role involves collaborating with stakeholders, championing data best practices, and optimizing performance. Candidates need over 7 years of experience and proficiency in Python, PySpark, Airflow, Hadoop, Spark, Kafka, SQL, and Git.
Senior Data Engineer
Adyen is seeking a Senior Data Engineer to join their Amsterdam office, focusing on building high-quality data pipelines and architectures on their Big Data Platform. The role involves collaborating with stakeholders, championing data best practices, and optimizing performance. Candidates need over 7 years of experience and proficiency in Python, PySpark, Airflow, Hadoop, Spark, Kafka, SQL, and Git.
Salary
Core Qualifications
Technical (Must-have)
Soft Skills
Key Responsibilities
- Engage with stakeholders to understand requirements and craft effective solutions.
- Design, develop, deploy and operate high-quality production ELT pipelines and data architectures.
- Integrate data from various sources and formats, ensuring compatibility, consistency, and reliability.
- Design scalable architectures.
- Establish and advocate for best practices in performance, code quality, data validation, data governance, and discoverability.
- Ensure data is accurate, complete, reliable, relevant, and timely.
- Implement rigorous testing, monitoring and validation protocols for code and data.
- Identify and resolve performance bottlenecks in data pipelines and systems.
- Optimize query performance and resource utilization to meet SLAs and performance requirements.