Data Engineer

מספר מקומות |
5-6 שנים |
משרה מלאה
| 06/07/2022
תיאור משרה

Own, maintain and improve the data lake pipeline
Create ELT/Streaming processes and SQL queries to bring data to/from the data warehouse and other data sources
Create new features from scratch, enhance existing features, and optimize existing functionality
Collaborate with various stakeholders across the company like data developers, data science, etc, in order to deliver team tasks. Work closely with all business units and engineering teams to develop a strategy for long-term data platform architecture
Ensure adherence to coding best practices and development of reusable code
Face the challenges of testing and constant monitoring your large scale data pipeline while maintaining CI/CD approach

דרישות התפקיד

4+ years of experience as a Data Engineer with direct experience in SQL (e.g., Redshift/Postgres/MySQL), data modeling, data warehousing, and building ELT/ETL pipelines
3+ years of experience in scalable data architecture, fault-tolerant ETL, and monitoring of data quality in the cloud
2+ years of Python development experience
Experience working with cloud environments (AWS preferred) and big data technologies (EMR, EC2, S3, Snowflake, Spark, Hive, Airflow)
Love to explore new technologies and Fast and self-learner: you can quickly master concepts, disciplines and methods
BS or MS degree in Computer Science or a related technical field - An advantage