About Khan Academy

Khan Academy is a nonprofit with a mission to provide a free, world-class education to anyone, anywhere. We already reach millions of students every month and are growing rapidly. We’re building a library of high-quality instructional and practice resources that empowers learners and the teachers who support them. Whether they’re studying metaphors, mitosis, Marbury v. Madison, or multivariable calculus, we want to offer students the resources to realize that they can learn anything.

At Khan Academy, our Data Insights Group is growing in headcount, scope, and deliverables to drive our mission further. This group consists of Analysts, Analytics Engineers, and Efficacy & Research Scientists. We’re looking for an experienced Efficacy & Research Manager to help us change the world. We’ve built a talented team of people from a variety of backgrounds. We believe that the best way to provide impactful education is to create a diverse team of people from different backgrounds, races, religions, genders, sexual orientations, ages, and experiences. Together, we’re a team that is deeply invested in your future. 

About the role

The Efficacy & Research Manager oversees and contributes with the efficacy team to plan and execute rigorous research– both in-house and via 3rd parties, both in the US and internationally. These studies evaluate whether and how the use of our content and products impact teaching and learning.  This role is a “player-coach,” meaning that approximately half-time is on people and project management, and the other half is an independent contributor to the research agenda. The research will primarily focus on grades 6-12 core academic subjects and test prep (SAT, LSAT, Praxis Core).  In ten years, Khan Academy’s vision is to globally enable every K-14 core subject to be learned in conjunction with teachers and their physical classroom or independently. The Efficacy & Research Manager is an integral part of helping to achieve that mission by driving substantive, verifiable studies providing evidence of the efficacy of our content and products and using these insights for product improvement. 

What you'll do

Lead the US Efficacy & Research team and research agenda 

  • Serve as the people manager for two direct reports
  • Manage all aspects of research projects across our internal efficacy team and collaborations with external partners
  • Excel as a data journalist to communicate the main points of complex analyses to technical and non-technical audiences
  • Attend and present at industry conferences to increase the awareness of Khan Academy’s Efficacy & Research team.

Provided evidence of efficacy:

  • Define research questions and support research design with an analytic plan. When applicable, collaborate on developing new instruments, support IRB reviews, support data sharing agreements, establish recruitment strategies, and collect data on-site.
  • Conduct large-scale data extraction of Khan Academy usage data aligned to the required data elements from the analytic plan.
  • Conduct analyses using R programming skills to link multiple datasets and apply statistical models to determine the impact on outcomes.

Provide Evidence to Guide Product Improvements:

  • Develop a deep knowledge of Khan Academy products
  • Drive internal exploratory analyses to generate insights for product improvement and collaborate with cross-functional teams on implementing evidence-based improvements.

You may be a good fit if you have

  • 3+ years post-PhD experience in managing teams to conducting research in EdTech, or other educational companies, including successfully executing on and driving research outside of academia focused on understanding what works, under what conditions, and for whom.
  • Expertise in conducting complex analyses (e.g., multilevel modeling, PSM, DID, etc.) in R and generating data visualizations to communicate findings.
  • Proficient in SQL to query large datasets then transform/clean structured data to make fit-for-purpose datasets from platform/telemetry data for targeted research questions. 
  • Experience in applying learnings from research to guide teams for product improvement.

About our benefits

We may be a non-profit, but we reward our talented team extremely well!

  • Highly competitive salaries and annual bonuses
  • Ample paid time off as needed – we are about getting things done, not face time
  • Generous parental leave
  • Flexible work and time-off schedules to encourage work-family balance and holidays
  • A fun, high-caliber team that trusts you and gives you the freedom to be brilliant 
  • The ability to improve real lives and the opportunity to work on high-impact software and programs that are already defining the future of education
  • Affinity groups where parents, black and hispanic/latino, women and gender minorities, and LGBTQIA+ identified folks come together
  • And we offer all those other typical benefits as well: 401(k) + 4% matching & comprehensive insurance including medical, dental, vision, and life

Want to know more about us?

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, or Veteran status.

Apply for this Job

* Required