Sr. Staff Big Data Software Engineer, Data Streams
at Rivian Automotive
United States, California, Palo Alto
Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract.
As a company, we constantly challenge what’s possible, never simply accepting what has always been done. We reframe old problems, seek new solutions and operate comfortably in areas that are unknown. Our backgrounds are diverse, but our team shares a love of the outdoors and a desire to protect it for future generations.
We operate development centers in Plymouth, Michigan; Southern California (Irvine, Carson & LA); Silicon Valley (San Jose and Palo Alto); Vancouver, British Columbia; and Surrey, England; as well as a manufacturing facility in Normal, Illinois.
The automobile is the next big computing platform and data is fundamental to the digital products and services that will arise from it. Having Amazon as a major investor and partner allows us to be brave and innovative in this area. Our vehicles are the ultimate IoT devices and they generate high-quality data. Come be part of this revolution.
Rivian’s Cloud team is at the center of Rivian’s ‘data universe’, as well as at the center of all customer-facing business processes. Rivian’s Cloud model is the most progressive in the industry, collecting and processing petabytes of data from our customer fleet.
This is what you’ll do:
You will work on Rivian’s Cloud team as a Sr. Staff Big Data Software Engineer and be involved in designing, building, and deploying massively scalable ingestion and data processing pipelines to store and derive insight from data arriving from our connected vehicles.
Build out the data streaming stack for Rivian.
Work with the PM's, DBA teams and engineering teams build scalable data infrastructure, and reporting streams that can capture petabytes of data and process in Realtime.
Build, implement and monitor a data framework with real time monitoring tools.
Practice top level data security, implement encryption policies across data sets and data sources.
Develop and manage end-to-end project plans and ensure on-time delivery.
Work with business and engineering teams to identify scope, constraints, dependencies, and risks.
Identify risks and opportunities across the business and drive solutions.
Coordinate with project management, software architects, and other engineering teams in determining overall system solutions.
Build systems using Big Data, microservices, and distributed computing technologies.
Train and mentor other developers in Big Data technologies as a SME.
This is what you’ll need:
· Bachelor’s Degree in Computer Science or Engineering; Masters or Phd in the related field is a plus
· 12+ plus years programming in Python, Java or Scala
· Deep knowledge of Amazon’s AWS ecosystem
· Experience building big data applications using Spark, Flink, Beam or similar
· Experience developing or working on streaming processing engines
· Understanding of REST API services and applications
· Experience with AWS’s big data products – e.g. Aurora, Redshift, DynamoDB, Athena, Kinesis, S3
· Sound knowledge of designing and building highly scalable distributed and multitenant systems
· Working knowledge of Kubernetes, EKS, ECS is a plus
· Knowledge of software development technologies, processes, and tools (i.e., Agile software development)
· Database experience, including knowledge of storage internals of SQL and NoSQL services
· Understanding of cloud security models
This is where you’ll work:
Location: Palo Alto
Rivian is an equal opportunity employer and complies with all applicable federal, state, and local fair employment practices laws. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, sex, sexual orientation, gender, gender expression, gender identity, genetic information or characteristics, physical or mental disability, marital/domestic partner status, age, military/veteran status, medical condition, or any other characteristic protected by law.
Rivian is committed to ensuring that our hiring process is accessible for persons with disabilities. If you have a disability or limitation, such as those covered by the Americans with Disabilities Act, that requires accommodations to assist you in the search and application process, please email us at firstname.lastname@example.org.