Amsterdam
1 day ago
Data Engineer
Adyen
Amsterdam
1 day ago
Data Engineer
Adyen is seeking a Data Engineer II to join their Amsterdam office, focusing on building high-quality data pipelines on their Big Data Platform. The role requires 3+ years of experience, proficiency in Python, PySpark, Airflow, Hadoop, Spark, Kafka, SQL, and Git, and involves collaborating with stakeholders, ensuring data quality, and optimizing performance.
On-siteFull-timeMid LevelPythonPySpark
Data Engineer
Adyen is seeking a Data Engineer II to join their Amsterdam office, focusing on building high-quality data pipelines on their Big Data Platform. The role requires 3+ years of experience, proficiency in Python, PySpark, Airflow, Hadoop, Spark, Kafka, SQL, and Git, and involves collaborating with stakeholders, ensuring data quality, and optimizing performance.
On-siteFull-timeMid LevelPython
Salary
Not specified
Core Qualifications
Technical (Must-have)
PythonPySparkApache AirflowApache HadoopApache SparkApache KafkaSQLGitPytestData EngineeringSoftware EngineeringData GovernanceData ValidationPerformance OptimizationELT
Soft Skills
CommunicationSelf-starterInnovationMentoringCollaboration
Key Responsibilities
- Engage with stakeholders to understand requirements and craft effective solutions.
- Design, develop, deploy and operate high-quality production ELT pipelines and data architectures.
- Integrate data from various sources and formats, ensuring compatibility, consistency, and reliability.
- Establish and share best practices in performance, code quality, data validation, data governance, and discoverability.
- Participate in mentoring and knowledge sharing initiatives.
- Ensure data is accurate, complete, reliable, relevant, and timely.
- Implement testing, monitoring and validation protocols for code and data, leveraging tools such as Pytest.
- Identify and resolve performance bottlenecks in data pipelines and systems.
- Improve query performance and resource utilization to meet SLAs and performance requirements.
Data EngineerFinancial ServicesBig DataPythonPySparkApache AirflowApache SparkApache KafkaSQLAmsterdam