About Trail of Bits

Trail of Bits helps secure the world's most targeted organizations and products. We combine high-end security research with a real-world attacker mentality to reduce risk and fortify code.

As a cybersecurity research and consulting firm, our team has worked on some of the most innovative software projects millions of people use worldwide. We help the best companies in the world — Epic Games, Google, Microsoft, Zoom, and others —  with their most complex security challenges by designing and building new technology, researching new techniques, and reviewing the security of the latest available products before they hit the market.

Our team considers developing and sharing our knowledge as a natural part of doing business. We push to publish every tool or project so the public — not just our clients — benefit from our expertise and innovations. It's a practice that's earned us industry accolades and helped contribute to our double-digit bottom-line growth.

Role

Our assurance team is responsible for reviewing high-assurance software in the tech, finance, and defense industries. Our evaluations allow our clients to make informed decisions about risk to their systems, including how to minimize or mitigate safety and security issues. In addition to dedicated teams focusing on application security, cryptography, blockchain security, and emerging platforms security, Trail of Bits has a machine learning (ML) practice that creates tools and techniques for the exploration of new attack surfaces and failures that can lead to the degradation of model performance, exploitation of ML system assets, and manipulation or lack of robustness of resulting ML outputs. Trail of Bits has also created and maintains more than 200 free and open-source tools (available in our GitHub repositories) and offers research and engineering services for the public and private sectors.

As a Senior Security Engineer, Machine Learning you will be a part of a new machine learning assurance team that aims to identify and taxonomize classes of failure modes which directly impact ML model performance, as well as novel hazards and threats that can compromise the ML operations pipeline for our clients. You will provide value to our clients through your expertise and experience within the ML development lifecycle as well performing risk assessments and threat modeling.

Responsibilities

  • Research and development of machine learning assurance frameworks and contributing to the shape of the new field of ML auditing and assurance.
  • Carrying out risk assessments and threat modeling on machine learning model capabilities and their failure modes.
  • Analysis of machine learning model degradation and failure from systematic defects.
  • Work directly with leading industry teams to review system code and architecture, and help assure their products through system analysis and modeling.
  • Develop and contribute to policy and regulatory frameworks to enable the assurance and auditing of machine learning and artificial intelligence to be deployed within mission critical applications.

Requirements

  • 3+ years of experience with the machine learning data pipeline or machine learning development lifecycle.
  • 3+ years of experience with systems, safety, or security engineering principles for mission critical applications.
  • 3+ years of experience performing or evaluating analysis methods to assess machine learning performance, safety, or security from system-level requirements (risk assessments, system hazard analysis, STPA, etc. included).
  • Knowledge of ISO 38507, ISO 25012 or similar AI standards such as EU Commission Ethics Guidelines for Trustworthy AI.
  • Excellent verbal & written communication skills.
  • Proven success working in a geographically dispersed and remote work environment.
  • Can adapt and drive innovation and performance in a rapidly changing field. 
  • Technical background to be able to look at systems and analyze their behaviors and realize their failures.

The US estimated base salary for this full-time W2 employee role is $175,000-$225,000, not including bonus and benefits. Our salary ranges are determined by role, level, location, and employment type. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by a variety of factors, include but not limited to work location, job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Company Perks

  • Before, during and after COVID-19, our workforce works flexibly. Many employees choose to work from home around the globe. As long as you deliver against your goals, we encourage you to harness your personal working style to let you work best.
  • Liberal expense policy for acquiring the equipment and software that help you do your job. If we need hardware to work effectively, we buy it. 
  • We offer exceptional and tailored technical, leadership and organizational training for our team members. Everyone is encouraged to identify additional opportunities for personal professional growth with working at Trail of Bits.
  • We routinely highlight the amazing work our employees do via our blog, product offerings, and conference talks. We celebrate you!
  • We're at the forefront of a number of markets and have the internal expertise and the ambition to capitalize on those opportunities. Our employees see their work in use and valued by many others.
Highlighting some of our US & Canadian Full-Time Employee Benefits:
  • Multiple generous health, vision, and dental insurance plans.
  • Ancillary benefits including life and disability insurance.
  • Retirement plan with 5% company matching.
  • 4 months paid parental leave.
  • Moving expenses to NY: $5,000 one-time.
  • Charitable donations matching up to $2,000.
  • One time $1,000 at home office expense stipend.
  • $500/year personal learning & development budget.
  • Executive coaching for managers & above.
  • Bonuses for recruiting, public speaking, tool releases, blog posts, academic posters, proposals, and whitepapers, and end-of-year bonuses based on company, team, and personal performance.
  • 20 days of PTO per year for vacation, sick, and personal time off.
  • 15 company holidays per year.
  • Carbon offsets for your personal and corporate carbon emissions through Project Wren.

Dedication to diversity, equity & inclusion

Trail of Bits is committed to creating and maintaining a diverse and inclusive workplace where our employees can thrive and be themselves! We welcome all persons into our community. We embrace the diversity of gender, gender identity or expression, race, color, religious creed, national origin, ancestry, age, physical and mental disabilities, medical condition, genetic characteristic, sexual orientation, marital status, family care or medical leave status, military or veteran status, or perceived membership in any of these groups.

Apply for this Job

* Required
resume chosen  
Dropbox Google Drive
(File types: pdf, doc, docx, txt, rtf)
Cancel

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Trail of Bits’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Form CC-305

OMB Control Number 1250-0005

Expires 05/31/2023

Voluntary Self-Identification of Disability

Why are you being asked to complete this form?

We are a federal contractor or subcontractor required by law to provide equal employment opportunity to qualified people with disabilities. We are also required to measure our progress toward having at least 7% of our workforce be individuals with disabilities. To do this, we must ask applicants and employees if they have a disability or have ever had a disability. Because a person may become disabled at any time, we ask all of our employees to update their information at least every five years.

Identifying yourself as an individual with a disability is voluntary, and we hope that you will choose to do so. Your answer will be maintained confidentially and not be seen by selecting officials or anyone else involved in making personnel decisions. Completing the form will not negatively impact you in any way, regardless of whether you have self-identified in the past. For more information about this form or the equal employment obligations of federal contractors under Section 503 of the Rehabilitation Act, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

You are considered to have a disability if you have a physical or mental impairment or medical condition that substantially limits a major life activity, or if you have a history or record of such an impairment or medical condition.

Disabilities include, but are not limited to:

  • Autism
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, or HIV/AIDS
  • Blind or low vision
  • Cancer
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or hard of hearing
  • Depression or anxiety
  • Diabetes
  • Epilepsy
  • Gastrointestinal disorders, for example, Crohn's Disease, or irritable bowel syndrome
  • Intellectual disability
  • Missing limbs or partially missing limbs
  • Nervous system condition for example, migraine headaches, Parkinson’s disease, or Multiple sclerosis (MS)
  • Psychiatric condition, for example, bipolar disorder, schizophrenia, PTSD, or major depression

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.

Please reach out to our support team via our help center.