ML Compiler Frontend Engineer
Etched is building the hardware for superintelligence.
GPUs and TPUs are flexible AI chips that can run many kinds of models: CNNs, RNNs, LSTMs, and more. But today, almost all AI workloads, from ChatGPT to self-driving cars, are done on one model architecture: transformers. Using flexible AI chips for transformers is very inefficient: <5% of the transistors on an H100 are used for matrix multiplication!
Etched is building a single-purpose chip exclusively for transformer inference. We only support transformers, but in exchange our chips have an order of magnitude more throughput and lower latency than an H100. With Etched, you can build products that would be impossible with GPUs, like tree-of-thought agents and ultra-low-latency audio chat bots.
Etched is looking for exceptional ML compiler frontend engineers to join our team and build production-grade integrations with today’s transformer libraries. The ideal candidate has experience working closely with LLMs in products and also understands how efficient inference works under the hood.
Responsibilities:
- Design and develop our integrations with current transformer-specific inference libraries, like TensorRT-LLM, TransformerEngine, Hugging Face TGI, and vLLM.
- Provide feedback to the firmware, compiler, and hardware teams based on compiler development work
- Ensure the software we expose to customers is reliable and production-grade as soon as our servers begin to ship
Requirements:
- 5+ years of experience writing production-grade software.
- Able to write production-grade code in Python
- Experience with LLMs to build products
- Experience with at least one of TensorRT, TensorRT-LLM, Transformer Engine, or vLLM
- Great understanding of how companies working with LLMs build their inference stacks
- 1+ year of work experience at a cloud provider
- Deeply creative and able to think from first principles
Desired qualifications:
- Experience with hardware design and development
- Proficiency with GPU programming
- Experience working in hardware simulation/emulation environments.
Benefits:
- Competitive salary and equity package
- Full medical, dental, and vision packages, with 100% of premium covered
- Work with world-class people and state-of-the-art AIs everyday
Etched is committed to fair and equitable compensation practices. Compensation is determined based on your qualifications and experience. Compensation packages also include generous equity in Etched.
We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or other legally protected statuses.
