Role: Senior Data Infrastructure Engineer

Reports to: Director, Infrastructure

Department: Engineering

Location: Remote, US or Germany

Job Type: Full Time, Exempt

 

Help us Shape the Future of Data

Anaconda is the world’s most popular data science platform. With more than 21 million users, the open source Anaconda Distribution is the easiest way to do data science and machine learning. We pioneered the use of Python for data science, champion its vibrant community, and continue to steward open-source projects that make tomorrow’s innovations possible. Our enterprise-grade solutions enable corporate, research, and academic institutions around the world to harness the power of open source for competitive advantage and groundbreaking research.

Anaconda is seeking people who want to play a role in shaping the future of enterprise machine learning, and data science. Candidates should be knowledgeable and capable, but always eager to learn more and to teach others. Overall, we strive to create a culture of ability and humility and an environment that is both relaxed and focused. We stress empathy and collaboration with our customers, open-source users, and each other. 

Here is what people love most about working here: We’re not just a company, we’re part of a movement. Our dedicated employees and user community are democratizing data science and creating and promoting open-source technologies for a better world, and our commercial offerings make it possible for enterprise users to leverage the most innovative output from open source in a secure, governed way.

 

Summary

Anaconda is seeking a talented Senior Data Infrastructure Engineer to join our rapidly-growing company. This is an excellent opportunity for you to leverage your experience and skills and apply it to the world of data science and machine learning.

 

What You’ll Do:

  • Help build our data foundation, data pipelines and ETL to enable the creation of insightful data for our Data Science, Engineering and Product teams.
  • Drive table design and architecture, transformation logic and efficient query development to support our growing data needs.
  • Build secure, scalable data infrastructure that enables self-service dashboards and automation of product experimentation results.
  • Implement testing and monitoring across the data infrastructure to ensure data quality from raw sources to downstream models.
  • Write documentation that supports code maintainability.
  • Enable data engineers to quickly promote prototypes to production.
  • Take complete ownership of the data quality, data mapping, business logic and transformation rules for the data feeds, and have a passion for high quality data.
  • Work closely with stakeholders to build next generation data integration capabilities.
  • Have a high sense of urgency to deliver projects as well as troubleshoot and fix data queries/ issues.
  • Collaboratively work and act as liaison with Infrastructure and Product teams to meet milestones in a fast-paced environment.

 

What You Need:

  • 8+ years of relevant experience inside the engineering domain.
  • Database experience with NoSQL, SQL and Big Query.
  • Experience with infrastructure as code (Terraform, Cloud Formation or Ansible).
  • Deep experience in ETL design and implementation using tools like Airflow, Kafka and Spark.
  • Experience working with very large data sets, and an understanding of how to write code that leverages the parallel capabilities of Python and database platforms.
  • Strong knowledge of database performance concepts like indices, segmentation, projections, and partitions.
  • A proficiency in Python or Scala.
  • Deep experience in designing, documenting and developing scalable data architecture and process flows.
  • Experience executing projects with Data Science and Engineering teams from start to finish.
  • To be self-directed/motivated with excellent organizational skills.
  • To be comfortable with changing requirements and priorities.
  • Experience with cloud infrastructure.
  • A team attitude: “I am not done, until WE are done”.
  • To embody our core values:  
    • Ability & Humility
    • Innovation & Action
    • Empathy & Connection
  • To care deeply about fostering an environment where people of all backgrounds and experiences can flourish.

 

What Will Make You Stand Out:

  • Experience working in a fast-paced startup environment.
  • Experience working in an open source or data science-oriented company.
  • Familiarity with the Hadoop ecosystem of tools.
  • Experience with Kafka or other eventing streaming technologies.
  • Experience with Spark.
  • Experience with container orchestration.

 

Why You’ll Like Working Here:

  • This is a unique opportunity to translate strong open source adoption and user enthusiasm into commercial product growth.
  • We are a dynamic company that rewards high performers.
  • We’re on the cutting edge of the enterprise application of data science, machine learning and AI.
  • Collaborative team environment that values multiple perspectives and clear thinking.
  • Employees-first culture.
  • Flexible working hours.
  • Medical, Dental, Vision, HSA, Life and 401K.
  • Health and Remote working reimbursement.
  • Paid parental leave - both mothers and fathers.
  • Pre-IPO stock options.
  • Open vacation policy.

 

An Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.

 

Apply for this Job

* Required

  
  


U.S. Equal Opportunity Employment Information (Completion is voluntary)

Individuals seeking employment at Anaconda are considered without regards to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation. You are being given the opportunity to provide the following information in order to help us comply with federal and state Equal Employment Opportunity/Affirmative Action record keeping, reporting, and other legal requirements.

Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.


Form CC-305

OMB Control Number 1250-0005

Expires 05/31/2023

Voluntary Self-Identification of Disability

Why are you being asked to complete this form?

We are a federal contractor or subcontractor required by law to provide equal employment opportunity to qualified people with disabilities. We are also required to measure our progress toward having at least 7% of our workforce be individuals with disabilities. To do this, we must ask applicants and employees if they have a disability or have ever had a disability. Because a person may become disabled at any time, we ask all of our employees to update their information at least every five years.

Identifying yourself as an individual with a disability is voluntary, and we hope that you will choose to do so. Your answer will be maintained confidentially and not be seen by selecting officials or anyone else involved in making personnel decisions. Completing the form will not negatively impact you in any way, regardless of whether you have self-identified in the past. For more information about this form or the equal employment obligations of federal contractors under Section 503 of the Rehabilitation Act, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

You are considered to have a disability if you have a physical or mental impairment or medical condition that substantially limits a major life activity, or if you have a history or record of such an impairment or medical condition.

Disabilities include, but are not limited to:

  • Autism
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, or HIV/AIDS
  • Blind or low vision
  • Cancer
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or hard of hearing
  • Depression or anxiety
  • Diabetes
  • Epilepsy
  • Gastrointestinal disorders, for example, Crohn's Disease, or irritable bowel syndrome
  • Intellectual disability
  • Missing limbs or partially missing limbs
  • Nervous system condition for example, migraine headaches, Parkinson’s disease, or Multiple sclerosis (MS)
  • Psychiatric condition, for example, bipolar disorder, schizophrenia, PTSD, or major depression

1Section 503 of the Rehabilitation Act of 1973, as amended. For more information about this form or the equal employment obligations of Federal contractors, visit the U.S. Department of Labor's Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.