Senior Manager, Quality Engineering
About Panasonic Well:
Panasonic Well is a venture and business incubator from the Panasonic Group focused on pioneering new health and wellness solutions by connecting hardware, software and services through industry-leading, responsible AI. We are committed to building an ecosystem of technology that improves well-being for every generation.
Panasonic Well operates in the US as Panasonic Well LLC and in Japan as a division of Panasonic Holdings Corporation.
About The Role:
As a Senior Manager for Quality Engineering at Panasonic Well, you’ll lead a team of high performing quality assurance professionals in assuring the overall quality of Panasonic Well product offerings including Umi (our health and wellness coach) and the underlying platform. You’ll partner with the other engineering leaders, SRE, and Security to ensure that Panasonic Well and our customers are protected against unexpected outcomes, especially in the AI (non-deterministic) space. This role is accountable for the full quality strategy and responsible for AI-based testing, automated testing, and manual testing as needed; this role will partner with engineering, SRE, and security to ensure unit tests, observability, and security assurance practices are followed.
In this role, you will report directly to the Global Head of Engineering and AI and will play a critical role in the Engineering Leadership team.
What You’ll Get To Do:
- Lead a team of QA engineers, mentoring talent and fostering a culture of quality throughout the development lifecycle
- Ensure quality across Panasonic Well’s main product offerings including Umi, an AI-powered wellness coach, partnering with key engineering, SRE, and Security leaders.
- Develop comprehensive testing strategies for AI-powered applications, including evaluation frameworks that measure model performance and reliability
- Partner with Product and Engineering teams to define quality metrics that balance product innovation with reliability
- Design and implement automated testing infrastructure that scales with our AI products
- Establish processes for regression testing, user acceptance testing, and continuous quality improvement
- Analyze quality metrics to identify trends and recommend improvements to products and processes
- Stay current with emerging QA methodologies and tools particularly relevant to AI systems
- Design and implement robust evaluation benchmarks for large language model capabilities, safety, and alignment
- Develop testing frameworks to detect and mitigate harmful model outputs, hallucinations, and potential misuse risks
- Collaborate with research teams to translate frontier AI safety research into practical testing methodologies
- Stay informed of the AI teams’ systems to measure and track model performance across diverse use cases and deployment scenarios
- Lead red-teaming exercises to identify potential vulnerabilities in AI systems
- Define clear criteria for model release readiness from a quality and safety perspective
- Create scalable processes for human evaluation of model outputs across multiple dimensions
What You’ll Bring:
- 10+ years of experience in Quality Assurance, with at least 7 years in a leadership role
- Demonstrated experience developing testing strategies for AI/ML-powered applications
- Strong understanding of AI evaluation frameworks, agentic AI, prompt testing, and alignment methodologies
- Experience with automation frameworks and CI/CD pipelines
- Excellent communication skills and ability to collaborate across technical and non-technical teams
- Track record of building and scaling QA processes in fast-paced environments
- Bachelor's degree in Computer Science or related field (or equivalent experience)
- Expertise driving and delivering testing solutions for complex AI/ ML technology programs or products from inception to delivery. Including technical program/project management for consumer software products with AI, Data, and Cloud Infrastructure backgrounds. Health, lifestyle, and wellness experience is a plus.
- Strong collaboration and communication skills.
- Experience in working with cloud-based platforms and services.
- Excellent written and verbal communication skills, with the ability to articulate technical concepts to both technical and non-technical stakeholders effectively.
- Demonstrates critical thinking capabilities with strong attention to detail.
- Understands and deals well with rapid development cycles and constant change remains flexible and calm when facing uncertainty.
- Has the ability to find innovative ways to resolve problems both technical and processes.
- Preferred qualifications:
- Experience with large language model evaluation and testing
- Familiarity with AI safety and alignment concepts
- Knowledge of testing tools specific to machine learning systems
- Experience in a high-growth tech company
- Experience with model monitoring and observability in production environments
- Knowledge of relevant regulatory considerations and standards for AI systems
- Experience working directly with machine learning practitioners and AI researchers
What We Offer:
At Panasonic Well, we believe that the future of work is flexibility. Like many other leading Silicon Valley based businesses, we follow a hybrid workplace model post-pandemic. We believe this model is consistent with our goals of fostering a highly collaborative culture, promoting employee well-being, and developing a workplace that is engaging, equitable, and innovative.
Local (Bay Area) employees are expected to come into the office on Mondays & Wednesdays and optional on the other days of the week. Fully remote (Work From Home) employment may be available for select positions.
Grade level and salary ranges are determined primarily through the scope and complexity of the role along with a review of the applicant’s experience and skills, as well as alignment with geographic market data and equity with other team members.
Employee benefits include:
- Competitive compensation
- Comprehensive benefits (Medical, Dental, Vision, HSA, FSA)
- 401(k) with employer match
- Life & Short Term Disability Insurance
- Supplemental Medical Coverage
- Unlimited Vacation & Accrued Sick Leave
- 12 Company Holidays
- Paid Maternity & Parental Leave
- Paid Caregiver Leave
- Employee Assistance Program
- Group and 1-on-1 Career Coaching
- Pet Insurance
- Casual Dress Code
- Catered Lunch & Snacks
- Discounts on Panasonic products
- Company Social Events
We are proud to be an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender identity, sex, sexual orientation, national origin, disability status, protected veteran status, and any other characteristic protected by law or company policy. All qualified individuals are required to perform the essential functions of the job with or without reasonable accommodation. Pre-employment drug testing is required for safety sensitive positions or as may otherwise be required by contract or law. All candidates must have valid authorization to work in the U.S. Thank you for your interest.
Apply for this job
*
indicates a required field