לצערנו המשרה כבר לא בתוקף
High Tech Company
We are looking for senior Data Engineer to join our data science team! Get ready to work with everything connected to data: expanding and optimizing our data pipeline architecture as well as data flows, building and improving our data systems and collecting data for cross-functional teams. משרה 102244
-5+ years of experience as a Data Engineer
-5+ years of experience with data warehousing technologies such as Amazon Redshift, Snowflake, Redis, MongoDB and experience with BI solutions development (DWH, ETL)
-5+ years of experience in SQL and ETL tools like SSIS\ Informatica
-5+ years of experience with Python
-5+ years of experience in open-source Big Data tools like Hadoop, Hive, Spark, Presto, Sqoop
-Experience with data platforms architecture, in particular, Big Data architecture , Deep understanding of big data storage formats, especially Apache Parquet, Snappy
-Experience with AWS cloud services like S3 , EMR , Athena, Lambda, Kinesis, Glue, etc.
-Experience with Docker and Kubernetes, Fargate, ECS and CI/CD based on Jenkins.
-Experience with Cython, numpy, pandas, koalas, pyarrow, fastparquet, scipy, celery, async.io, django
-Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
-Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
-willing to collaborate and problem solve in an open team environment.
-Flexible and adaptable in regard to learning and understanding new technologies.
-B.Sc. or higher degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field
-Experience with Linux admi