Growth Marketing Intern
sarvam
Performance Engineer, On-Device Inference
sarvam· Infrastructure
About this role
About Sarvam
Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.
About the Role
Take Sarvam models from research-handoff state to production-ready artifacts on at least two of our target chipsets (Intel xPU, ARM xPU, Apple xPU, Nvidia / AMD GPUs). You'll own 1 - 2 (model, chipset) pairs end-to-end and partner with the consuming app team during integration.
What You’ll Do
Quantize, validate accuracy, benchmark, and document. Author the deployment workbook for each pair you own.
Embed part-time with consuming teams during integration; debug perf and accuracy issues alongside them.
Maintain and extend the team's benchmark harness.
What We're Looking For
3+ years on ML systems.
Solid PyTorch + ONNX export experience including the gotchas (dynamic shapes, control flow, custom ops).
Quantization in production on at least one real model.
Comfort with at least two of: ONNX Runtime, TensorRT, CoreML, OpenVINO, QNN, LiteRT.
Profiling fluency on at least one platform.
Bonus Points
Custom op authoring in any runtime.
Why Sarvam?
Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.
Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar
High ownership and high impact, from day one
Everything we do is AI-first, from the way we build and ship to the way we think about problems
You can work on problems that could change how an entire country learns, works, and communicates
If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.
Frequently Asked Questions
Is the salary disclosed for the Performance Engineer, On-Device Inference position at sarvam?
The salary for this Performance Engineer, On-Device Inference role at sarvam is not publicly listed. Click "Apply Now" to learn more about the compensation package on their official careers page.
Where is the Performance Engineer, On-Device Inference position at sarvam located?
This Performance Engineer, On-Device Inference role at sarvam is based in Bengaluru. The position is listed as on-site or hybrid. Check the full job description or apply directly to confirm the work arrangement.
Is the Performance Engineer, On-Device Inference role at sarvam full-time or part-time?
This is listed as a FullTime position. It is posted as a Performance Engineer, On-Device Inference role in the Infrastructure department at sarvam.
Which team or department does the Performance Engineer, On-Device Inference at sarvam belong to?
This Performance Engineer, On-Device Inference position is part of the Infrastructure department at sarvam. See the full job description for more information about the team structure and responsibilities.
How do I apply for the Performance Engineer, On-Device Inference position at sarvam?
Click the "Apply Now" button on this page. You will be redirected to sarvam's official application portal hosted on ashby where you can submit your application directly.
When was the Performance Engineer, On-Device Inference job at sarvam posted?
This Performance Engineer, On-Device Inference position at sarvam was posted on Jun 4, 2026. Apply as soon as possible — early applications are often reviewed first.
Performance Engineer, On-Device Inference
sarvam
You'll be redirected to sarvam's official application page on Ashby ATS.