Site Reliability Engineer - Data Engineering
The Wikimedia Foundation is looking for a Site Reliability Engineer (SRE) to join our team, reporting to the Director of Data Engineering. As an SRE on the Data Engineering team, you will be responsible for building, maintaining and operating the shared data infrastructure that empowers the use of data at the Foundation as well as the Wiki Movement. You will be part of a larger community of SREs where you'll have plenty of space and opportunities to learn and get familiar with our tech. For more details about our stack see: https://wikitech.wikimedia.org/wiki/Data_Engineering
We are a fully remote, internationally distributed team. With international travel resuming, we are hoping to again see each other in person 2-3 times a year during one of our off-sites (the last few have been in places like Majorca, New York and Prague), the Wikimedia All Hands (once a year in San Francisco), or Wikimania, the annual international conference for the Wiki community.
You are responsible for:
- Deployment, configuration and maintenance of the distributed data systems that comprise our data platform. Our stack includes Hadoop, Kafka, Spark, Cassandra, Presto, Druid, Airflow, Superset, DataHub, Turnilo
- Monitoring of systems and services, optimization of performance and resource utilization
- Cookbook/runbook implementation for common maintenance actions
- Development and maintenance of data platform infrastructure running on Kubernetes as well as bare metal
- Automation and streamlining of tasks as well as identifying process gaps
Skills and Experience:
- At least two of years experience in an SRE/Operations/DevOps role as part of a team
- Experience supporting high availability distributed production systems
- Comfortable with configuration management and orchestration tools (Puppet, Ansible, Chef, SaltStack, etc.), and modern observability infrastructure (monitoring, metrics and logging)
- Comfortable with shell and scripting languages such as Python, Go, Bash, Ruby
- Good understanding of Linux/Unix fundamentals and debugging skills
- Excellent written and verbal communication skills
- BS or MS degree, preferably in Computer Science, or equivalent work experience
Qualities that are important to us:
- Commitment to the mission of the organization and our values
- Commitment to our guiding principles
- Commitment to diversity, equity, and inclusion
- Cross-cultural sensitivity and awareness
- Collaborative working experience
Additionally, we’d love it if you have:
- Experience implementing containerization solutions (Docker, Kubernetes)
- Experience with package management for operating systems (Debian, etc)
- We are avid supporters (and users) of open source software; history of contributing to Open Source projects is valued
- Prior participation in the Wikimedia movement
About the Wikimedia Foundation
The Wikimedia Foundation is the nonprofit organization that operates Wikipedia and the other Wikimedia free knowledge projects. Our vision is a world in which every single human can freely share in the sum of all knowledge. We believe that everyone has the potential to contribute something to our shared knowledge, and that everyone should be able to access that knowledge freely. We host Wikipedia and the Wikimedia projects, build software experiences for reading, contributing, and sharing Wikimedia content, support the volunteer communities and partners who make Wikimedia possible, and advocate for policies that enable Wikimedia and free knowledge to thrive.
The Wikimedia Foundation is a charitable, not-for-profit organization that relies on donations. We receive donations from millions of individuals around the world, with an average donation of about $15. We also receive donations through institutional grants and gifts. The Wikimedia Foundation is a United States 501(c)(3) tax-exempt organization with offices in San Francisco, California, USA.
As an equal opportunity employer, the Wikimedia Foundation values having a diverse workforce and continuously strives to maintain an inclusive and equitable workplace. We encourage people with a diverse range of backgrounds to apply. We do not discriminate against any person based upon their race, traits historically associated with race, religion, color, national origin, sex, pregnancy or related medical conditions, parental status, sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, or any other legally protected characteristics.
If you are a qualified applicant requiring assistance or an accommodation to complete any step of the application process due to a disability, you may contact us at email@example.com or +1 (415) 839-6885.
U.S. Benefits & Perks
News from across the Wikimedia movement
Our Commitment to Equity
This is Wikimedia Foundation
Our Tech Stack