As a Senior Data Engineer, you’ll be responsible for gathering and collecting data, storing it, doing batch processing or real-time processing on it, and serving it to data scientists and data analysts to easily query.
WHY JOIN THE BUSINESS INTELLIGENCE PLATFORM TEAM?
We are a passionate and positive team that is always working on new data engineering technology and exciting projects including new game launches.
We feel team members are most effective in working on what they are passionate about. We are all capable of working on any given project, and often shift tasks based on preference.
We own the data platform, contributing to the design, implementation, and maintenance of these data services so we aren’t shy about experimenting with new tech. However, we take a measured approach in order to minimize introducing unnecessary technical debt.
We collaborate with Analytics, Game Development, Platform and Publishing teams. Our data platform supports all kinds of data in an efficient environment that helps with analysis, customer care and company wide data-driven decisions.
WHAT YOU'LL DO
Understanding data source (10%)
Develop data processes for construction, mining, and modeling that are delivered to the data analyst/science team (30%)
Create large data warehouses by running some ETL (Extract, Transform and Load) that is used for analysis by the analyst/scientists (30%)
Install continuous pipelines of huge pools of filtered information so that data analyst/scientists can pull relevant data sets for their analyses (20%)
Develop, construct, test and maintain architectures such as databases and large-scale data processing systems (10%)
WHAT YOU’LL NEED TO BE SUCCESSFUL
BS in Computer Science or equivalent experience
5+ years of day-to-day working experience as data engineer
Experience with object-oriented and functional programming languages: Python, Scala etc.
Experience with RDBMS (MS-SQL, MYSQL etc.) and NoSQL (MongoDB, DynamoDB etc.)
Experience with Big Data query and application knowledge: Hive, Impala, Fluentd, Spark, Sqoop, Pig etc.
Experience with ETL and data integration tool : Airflow, Informatica PowerCenter
Experience with AWS cloud services: EC2, S3, EMR, Glue, RedShift, Athena etc.
Proficiency in general database administration concepts and efficient query writing
Excellent verbal and written communication skills
An eagerness to continually improve their skills, learn new technologies and is willing to take initiative beyond basic responsibilities