LiveRamp is looking for engineers to help us maintain and scale our Big Data infrastructure. Our data infrastructure team operates one of the largest Hadoop deployments in the world, with 90,000 CPUs, 300TB of memory, and 30 PB of storage. We run 100,000 YARN applications and deliver billions of customer records per day to partners.

Running this many data applications takes a heavy support stack.  Zookeeper coordinates data deliveries.  HashiCorp Consul exposes services.  Vault stores secrets.  We use open-source tools when they make sense, but we aren’t afraid to get our hands dirty when they don’t -- we work at a scale that only a few companies in the world match and our most interesting tools come from solving those challenges.  

The most valuable part of our infrastructure is the 60+ engineers writing hundreds of big data applications on our infrastructure, across a dozen application teams.   These engineers are our customers, and our job is to work closely with them to support building efficient applications via both education and building the tools they need to get the job done.

You will:

  • Build big data applications and tooling to assist 60+ fellow developers in writing hundreds of big data applications on our infrastructure.
  • Ensure operational excellence and empower the organization to achieve a high level of technical productivity, reliability, and simplicity.
  • Act as technical point of contact for large re-architectures that touch all LiveRamp systems
  • Foster a positive environment of integrity, empowerment, initiative, and teamwork.
  • Be responsible for developing & managing our Spark environment
  • Be responsible for developing tools & infrastructure for data processing - set of libraries and/or scripts that would be utilized by product engineers - e.g. monitoring frameworks, integrations with various types of storages, regression/sandbox testing, format conversions, tools for debugging Spark.
  • Provide guidance and collaborate with product engineering teams in the context of their big data pipelines
  • Closely work with and iterate on feedback from your customers -- other developers.  You err on the side of shipping fast and iterating.

Your team will:

  • Maintain and scale our Big Data infrastructure.
  • Engineer scalable data processing engines of stunning complexity.
  • Build tools to empower LiveRamp’s developers to operate effectively and efficiently.
  • Deliver on the technical roadmap for LiveRamp’s core product offerings.

About you:

  • 5+ years of experience in big data engineering 
  • Have strong experience programming in Spark, Scala/Java or Python
  • You are familiar with setting, fine-tuning and managing Spark environments
  • Have a solid track record of operating in massive-scale data environments
  • Solid understanding of big data ecosystem - current trends, pros & cons of specific technologies (e.g. RDBMS vs NoSQL database, in-memory processing, disk I/O)
  • You keep up-to-date with cutting edge big data frameworks; you enjoy digging into the tradeoffs of Spark vs Flink vs MapReduce for a new project.
  • You are both productive and pragmatic -- software is only useful if it is used.
  • You have world-class debugging skills
  • You get excited by when you make a Hadoop application more efficient - but you get even more excited when you help developers be more efficient
  • You value fast and honest feedback while maintaining a lighthearted attitude

Bonus Points:

  • Familiar with streaming frameworks, e.g. Flink, Spark Streaming, Kafka
  • Past or active collaboration with Apache Open Source Community
  • Experience in managing infrastructure cost tradeoffs
  • You are familiar with maintaining Hadoop clusters
  • Experience with hosted Hadoop solutions (Dataproc)


  • People. Work with talented, collaborative, and friendly people who love what they do.
  • Food. Enjoy catered meals, boundless snacks, and the occasional food truck.
  • Fun. We host events such as game nights, happy hours, camping trips, and sports leagues.
  • Stock. Every employee is a stakeholder in our future. Health and Saving. Receive the benefits of comprehensive health, dental, vision and disability insurance along with a 401k matching plan.
  • Location. Work in the heart of San Francisco and take advantage of our commuter benefits.

More about us:

LiveRamp is the trusted platform that makes data accessible and meaningful. Our services power people-based customer experiences that improve the relevance of marketing and allow consumers to better connect with the brands and products they love. We thrive on solving the toughest technical and customer challenges, and we’re always looking for smart, compassionate people to help us blaze a trail.

We value strong engineers who are agile enough to hit the ground running and tackle challenges.

To all recruitment agencies: LiveRamp does not accept agency resumes. Please do not forward resumes to our jobs alias, LiveRamp employees or any other company location. LiveRamp is not responsible for any fees related to unsolicited resumes.

Apply for this Job

* Required


U.S. Equal Opportunity Employment Information (Completion is voluntary)

Individuals seeking employment at LiveRamp are considered without regards to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation. You are being given the opportunity to provide the following information in order to help us comply with federal and state Equal Employment Opportunity/Affirmative Action record keeping, reporting, and other legal requirements.

Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Form CC-305

OMB Control Number 1250-0005

Expires 1/31/2020

Voluntary Self-Identification of Disability

Why are you being asked to complete this form?

Because we do business with the government, we must reach out to, hire, and provide equal opportunity to qualified people with disabilities1. To help us measure how well we are doing, we are asking you to tell us if you have a disability or if you ever had a disability. Completing this form is voluntary, but we hope that you will choose to fill it out. If you are applying for a job, any answer you give will be kept private and will not be used against you in any way.

If you already work for us, your answer will not be used against you in any way. Because a person may become disabled at any time, we are required to ask all of our employees to update their information every five years. You may voluntarily self-identify as having a disability on this form without fear of any punishment because you did not identify as having a disability earlier.

How do I know if I have a disability?

You are considered to have a disability if you have a physical or mental impairment or medical condition that substantially limits a major life activity, or if you have a history or record of such an impairment or medical condition.

Disabilities include, but are not limited to:

  • Blindness
  • Deafness
  • Cancer
  • Diabetes
  • Epilepsy
  • Autism
  • Cerebral palsy
  • Schizophrenia
  • Muscular dystrophy
  • Bipolar disorder
  • Major depression
  • Multiple sclerosis (MS)
  • Missing limbs or partially missing limbs
  • Post-traumatic stress disorder (PTSD)
  • Obsessive compulsive disorder
  • Impairments requiring the use of a wheelchair
  • Intellectual disability (previously called mental retardation)
Reasonable Accommodation Notice

Federal law requires employers to provide reasonable accommodation to qualified individuals with disabilities. Please tell us if you require a reasonable accommodation to apply for a job or to perform your job. Examples of reasonable accommodation include making a change to the application process or work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment.

1Section 503 of the Rehabilitation Act of 1973, as amended. For more information about this form or the equal employment obligations of Federal contractors, visit the U.S. Department of Labor's Office of Federal Contract Compliance Programs (OFCCP) website at

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.