Principal Engineer - Agentic AI Architect
About this role
Job Details:
Job Description:
Location: Shanghai, China
Role Overview
We are seeking a Principal Engineer – Agentic AI Architect to lead the design and development of next-generation agentic AI systems integrated with FPGA/ASIC platforms.
This role sits at the intersection of:
Large Language Models (LLMs)
Agent frameworks & autonomous systems
Retrieval-Augmented Generation (RAG)
Hardware-aware AI system design (FPGA / ASIC / EDA)
You will define architecture, drive technical strategy, and build scalable AI systems that bridge software intelligence and hardware acceleration.
Key Responsibilities
AI Architecture & System Design
Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration
Architect RAG pipelines for enterprise-scale knowledge integration
Define end-to-end AI system architecture from data ingestion → reasoning → action
Agentic AI & LLM Development
Develop advanced workflows using:
tool-using agents
planning & reasoning agents
multi-agent collaboration frameworks
Evaluate and integrate leading LLMs (open-source and proprietary)
Optimize prompt engineering, memory, and reasoning capabilities
Hardware-Aware AI Optimization
Co-design AI systems with:
FPGA acceleration
ASIC platforms
heterogeneous compute (CPU/GPU/FPGA)
Explore LLM inference optimization on FPGA (quantization, compilation, partitioning)
Collaborate with hardware teams on EDA and system integration
Framework & Platform Development
Build internal platforms using
LangChain
LlamaIndex
custom agent orchestration framework
Develop reusable components for:
memory management
tool integration
knowledge retrieval
Technical Leadership
Lead architecture reviews and guide engineering teams
Mentor senior engineers and influence cross-functional teams
Drive innovation in AI + hardware convergence
What Makes This Role Unique
Opportunity to define agentic AI architecture for hardware-driven systems
Work at the convergence of:
AI reasoning systems
FPGA acceleration
next-generation computing platforms
High-impact role influencing future AI + semiconductor integration
Impact
You will help shape how AI agents interact with hardware, enabling:
intelligent system orchestration
real-time decision-making pipelines
scalable AI deployment on FPGA platforms
Summary
This role is ideal for a senior technical leader who can:
bridge LLM + Agentic AI + RAG with FPGA/ASIC system architecture
and drive innovation in next-generation AI systems.
Qualifications:
Master’s or Bachelor’s degree with 10+ years of experience in one or more of the following:
AI/ML systems
Distributed systems
Hardware–software co-design
Recognized expertise in AI/ Large Language Models (LLMs)
Deep understanding of:
LLM architectures and inference
RAG systems and vector databases
Agentic AI / autonomous agents
Hands-on experience building:
Production-grade LLM applications
Multi-step reasoning and orchestration workflows
Scalable and reliable AI systems in production
Strong background in:
FPGA / ASIC / EDA systems
Heterogeneous computing architectures
Familiarity with:
Hardware acceleration for AI workloads
Performance optimization across system stack
Technical Skills
Programming:
Python
C++ (preferred)
Experience with:
Distributed systems design
APIs and microservices architecture
Cloud and/or edge AI deployment
Hands-on experience with:
LLM fine-tuning, quantization, and model distillation
On-device / edge AI deployment
Robotics, autonomous systems, or real-time AI pipelines
Knowledge of:
Compiler stacks (e.g., MLIR, TVM)
AI model optimization for FPGA platforms
Job Type:
RegularShift:
Shift 1 (China)Primary Location:
Shanghai, ChinaAdditional Locations:
Posting Statement:
All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.Frequently Asked Questions
Is the salary disclosed for the Principal Engineer - Agentic AI Architect position at altera?
Where is the Principal Engineer - Agentic AI Architect position at altera located?
Is the Principal Engineer - Agentic AI Architect role at altera full-time or part-time?
Which team or department does the Principal Engineer - Agentic AI Architect at altera belong to?
How do I apply for the Principal Engineer - Agentic AI Architect position at altera?
You'll be redirected to altera's official application page on Workday.