Data Engineer

CrazyLabs, a leading mobile game publisher with over 3.52B global downloads, is looking for a Data Engineer to help maintain and grow our Python-based BI and data pipelines solution. 

 The Data Engineer will work on integrating data from multiple resources, both internal and external, manipulating and streaming it into the company DWH. The Data Engineer will also construct, test, and maintain complex cloud-based architectures such as Google BigQuery and Amazon Redshift and large-scale data processing systems. 

 We are looking for a candidate that will work independently as a team member in an Agile fast-paced development environment under the direction and supervision of a senior technical lead.

 Responsibilities

  • Design, develop, test, and implement data pipelines and ETL processes using Python, AirFlow and Jenkins.
  • High-quality development in Python of data pipelines that integrates with multiple 3rd party sources
  • Develop unit and integration test procedures
  • Write documentation of new or existing programs to ensure effective communication
  • Comply with deadlines and work well under pressure while meeting multiple production objectives

MUST HAVE:

  • 3+ years of experience as a Data Engineer / ETL developer / BI Architect 
  • 2+ years of experience with any programming language as a software developer (Java/ Python)
  • Academic degree (BSc or MSc) in computer science / industrial engineering or related field
  • Fluency in English (verbal and written)
  • Excellent communication skills 

 

A strong advantage:

  • Experience with big data technologies (NoSQL, Spark, Hadoop, Streaming) - a strong advantage
  • Familiarity with RedShift, BigQuery, AirFlow, AWS, GIT, Jira – an advantage