לצערנו המשרה כבר לא בתוקף

Big Data Engineer

5-6 שנים |
משרה מלאה
| 27/04/2021
תיאור משרה

For a software company developing a platform that facilitates online commerce, with offices in the center.
We’re looking for an experienced Data Engineer to join our amazing Data department and work in a complex and challenging data environment, developing new pipeline and exciting features
What’s the job?
End to end development of data models, from gathering the data sources, develop ETL or stream processes to front end data model solutions for users, helping our clients to make smarter decisions.
Dealing with structured and unstructured data.
Design and implement data pipelines for multiple data sources.
Re-design infrastructure for greater scalability and lower latency.
Monitor & Maintain production streaming and batch applications.
Taking full ownership of designing, building, testing and deployment of data products. משרה 102717

דרישות התפקיד

Relevant Bachelor degree – preferably CS, Engineering/ Information Systems.
Proficiency with Python, SQL, Java or Scala.
3 or more years of experience in data streaming tools and processes (Kafka, AirFlow, ELK, Spark etc.)
3 or more years of experience in extracting data from unstructured data sources (S3, ORC, Paquet files etc.)
Experience creating and optimizing big data processes, pipelines and architectures
Experience with big data solutions like SnowFlake, Redshift, Redis, Aerospike, Impala, Presto, Bigquery, Hive, etc.
3 or more years of experience in data modeling, BI solutions development (DWH, ETL) and SW development practices – Agile, CI/CD, TDD.
Ability to work independently and multi-task to meet deadlines
Ability to learn new technologies
Ability to work in a dynamic environment while providing solutions for complex business requirements