Data Engineer

Team: Data Engineering

Location: Sunnyvale, CA


What We Do:

Company: We provide an AI software platform that allows enterprises to design, build, experiment, customize, operate and own vertical AI solutions in a wide range of industries and areas, such as healthcare, industrial manufacturing and utilities, financial services, telecommunications, autonomous driving, and beyond. Petuum lets enterprises easily understand and apply AI to gain deep insight for better decision-making and improved productivity and efficiency. Our mission is to enable organizations to own, build and become informed users of their AI solutions, without relying on expensive talents.

Team: The Data Engineering team is the “hub of the wheel” and responsible for everything related to data - Collection of raw data, Storing the data, Analyzing the data, and creating tool to make business decision that fuels the AI/ML models developed on Petuum’s platform product.  We are extending our system with more data sources and in more formats as well as with more data transformations. Particularly, we distinguish our offering with AI/Model based transformations to enable fast and comprehensive data understanding and automatic data processing, and eventually to power user friendly experience.

 The Role:

The Data Engineer should be an expert familiar with all of the data warehousing technical components (e.g. ETL, Reporting, Data Model), infrastructure (e.g. hardware and software) and their integration. The ideal candidate will be responsible for developing overall architecture, high-level design, building the data pipeline and implementing data preprocessing components. The candidate must have extensive experience with Star Schemas, Dimensional Models, Data Marts, and Data Lake infrastructure. Excellent written and verbal communication skills are required as the candidate will work very closely with diverse teams.

 What You Will Do: 

  • Drive for key results as an individual contributor.
  • Work with team members to implement features.
  • Follow team engineering process and contribute to the development of sound engineering infrastructure.
  • Maintain high-quality code base which is well factored, performant and robust.
  • Be able to learn and grow in a dynamic and fast growing start up environment.
  • Be familiar with the mainstream data processing and AI/ML technologies.
  • Other duties as assigned.

 What You’ve Already Done:  

  • You have a Bachelor's Degree in Computer Science or related quantitative field. An advanced degree or equivalent practical work experience is a plus.
  • You have 4 + years of work experience.
  • 2-4 years of software development experience in one or more object-oriented languages, including Python, Java, C#, or C++.
  • Demonstrated strength in data modeling, ETL development, and Data warehousing.
  • Experience with Relational Database like Oracle, MS SQL, MySQL, PostgreSQL…
  • Experience with NoSQL and Big Data Technologies (Hadoop, Hive, Hbase, Pig, Spark, etc.)
  • Experience with AWS services including S3, Glue, Redshift, Athena, QuickSight, EMR, Kinesis and RDS.
  • Experience in working and delivering end-to-end projects independently.
  • Knowledge of distributed systems as it pertains to data storage and computing
  • Experience with data pipeline, server architectures, and distributed systems is a plus.
  • Startup experience is a plus.

 What You Already Know:   

  • Languages: Python and SQL. Experience with Bash/Shell, Java, C#/C++, R or Scala is a plus.
  • Frameworks/Libraries: Spark, Hadoop. Experience with TensorFlow, Torch/PyTorch, Caffe, CNTK, Scikit-Learn, Samza, or Storm is a plus.
  • Databases: Experience with SQL Server, MongoDB, AWS Cloud Storage, Microsoft Azure Storage, Google Cloud Storage, Cassandra, Amazon Redshift, Apache Hive, or Google BigQuery is a plus.
  • Platforms:  Experience with Windows Desktop/Server, Openstack/GCS/AWS, Firebase, Azure, Google Cloud Platform/App Engine.
  • Tools: Experience with Docker, Kubernetes, GitHub, Flink, Pulsar, or Kafka is a plus.

What We Offer for your Valuable Work: 

Petuum offers Medical, Dental, Vision, Life/Disability, Paid Time Off, Parental Leave, and more.   

Petuum is a welcoming workplace that considers applicants for employment without regard to, and does not discriminate on the basis of, gender, race, protected veteran status, disability, or any other legally protected status. Petuum is an at-will employer. 

Apply for this Job

* Required

When autocomplete results are available use up and down arrows to review
+ Add Another Education

U.S. Equal Opportunity Employment Information (Completion is voluntary)

Individuals seeking employment at Petuum are considered without regards to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation. You are being given the opportunity to provide the following information in order to help us comply with federal and state Equal Employment Opportunity/Affirmative Action record keeping, reporting, and other legal requirements.

Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Form CC-305

OMB Control Number 1250-0005

Expires 1/31/2020

Voluntary Self-Identification of Disability

Why are you being asked to complete this form?

Because we do business with the government, we must reach out to, hire, and provide equal opportunity to qualified people with disabilities1. To help us measure how well we are doing, we are asking you to tell us if you have a disability or if you ever had a disability. Completing this form is voluntary, but we hope that you will choose to fill it out. If you are applying for a job, any answer you give will be kept private and will not be used against you in any way.

If you already work for us, your answer will not be used against you in any way. Because a person may become disabled at any time, we are required to ask all of our employees to update their information every five years. You may voluntarily self-identify as having a disability on this form without fear of any punishment because you did not identify as having a disability earlier.

How do I know if I have a disability?

You are considered to have a disability if you have a physical or mental impairment or medical condition that substantially limits a major life activity, or if you have a history or record of such an impairment or medical condition.

Disabilities include, but are not limited to:

  • Blindness
  • Deafness
  • Cancer
  • Diabetes
  • Epilepsy
  • Autism
  • Cerebral palsy
  • Schizophrenia
  • Muscular dystrophy
  • Bipolar disorder
  • Major depression
  • Multiple sclerosis (MS)
  • Missing limbs or partially missing limbs
  • Post-traumatic stress disorder (PTSD)
  • Obsessive compulsive disorder
  • Impairments requiring the use of a wheelchair
  • Intellectual disability (previously called mental retardation)
Reasonable Accommodation Notice

Federal law requires employers to provide reasonable accommodation to qualified individuals with disabilities. Please tell us if you require a reasonable accommodation to apply for a job or to perform your job. Examples of reasonable accommodation include making a change to the application process or work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment.

1Section 503 of the Rehabilitation Act of 1973, as amended. For more information about this form or the equal employment obligations of Federal contractors, visit the U.S. Department of Labor's Office of Federal Contract Compliance Programs (OFCCP) website at

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.