AI Agent Evaluation Engineer - Bengaluru
1 week ago

Job summary
We are seeking a seasoned QA professional to lead evaluation and testing efforts for AI and LLM-based systems. The ideal candidate will have deep experience in validating conversational agents, conducting safety and adversarial assessments, and working with Google's Agent Development Kit (ADK) and Vertex AI ecosystem.Responsibilities
- AI / LLM Testing Expertise: At least 2 years dedicated experience testing or evaluating AI systems, conversational agents, or large language models (LLMs).
- Safety & Red Teaming: Hands-on experience with safety evaluations is mandatory.
Job description
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.
Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.
Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Access all high-level positions and get the job of your dreams.
Similar jobs
Bike Evaluation Engineer
1 month ago
We are seeking a skilled Bike Evaluation Engineer to join our team. · A Bike Evaluation Engineer is responsible for evaluating the performance of two-wheelers by testing their various components, · systems and design principles. The ideal candidate should have experience with bik ...
Engineer, Design Evaluation Engineering
2 weeks ago
The Design Evaluation Engineer is a developing professional with growing competence in design evaluation. This role involves resolving moderately complex problems with moderate guidance. · Independently perform hardware and software bench evaluations · ...
Engineer, Design Evaluation Engineering
5 days ago
The Design Evaluation Engineer is a developing professional with growing competence in design evaluation. This role involves resolving moderately complex problems with moderate guidance. · ...
Engineer, Design Evaluation Engineering
1 month ago
The Design Evaluation Engineer is a developing professional with growing competence in design evaluation. · Independently perform hardware and software bench evaluations · ...
Design Evaluation Engineer
3 days ago
The Design Evaluation Engineer is a developing professional with growing competence in design evaluation. This role involves resolving moderately complex problems with moderate guidance. · ...
Design Evaluation Engineer
1 month ago
Analog Devices is seeking an intelligent and versatile product engineer to join our agile advanced data converters group. · ...
Design Evaluation Engineer
1 month ago
Come join Analog Devices (ADI) – a place where Innovation meets Impact. For more than 55 years, Analog Devices has been inventing new breakthrough technologies that transform lives. · ...
Senior Engineer, Design Evaluation Engineer
3 weeks ago
The Senior Design Evaluation Engineer is a senior technical position working on complex and critical evaluation projects. · Lead architecture, design, and development of embedded software for consumer audio devices. · Develop and optimize firmware for audio DSPs, SoCs, and microc ...
Analogue Devices is seeking a skilled product engineer for their advanced data converters group. The successful candidate will work with design teams to develop and release products from definition through production. · Interface with cross-functional teams throughout the product ...
Staff Engineer, Design Evaluation Engineering
2 weeks ago
This technical lead role will lead the Bench Eval (Validation) activities on any new product development of ASIC and SOC products developed in the newly formed Digital ASIC Business Unit of Analog Devices. · The ideal candidate will be technically strong and will have the experie ...
Senior Engineer, Design Evaluation Engineer
2 weeks ago
We are seeking a highly skilled Senior Design Evaluation Engineer to lead firmware and embedded software development for our next-generation consumer audio products. · The ideal candidate has deep expertise in wireless audio, DSP integration, Bluetooth LE Audio, and low-power emb ...
Senior Engineer, Design Evaluation Engineer
3 weeks ago
We are seeking a highly skilled Principal Embedded Software Engineer to lead firmware and embedded software development for our next-generation consumer audio products, · Lead architecture, design, and development of embedded software for consumer audio devices. · ...
Urgent Hiring- Evaluation Engineer
1 month ago
The Evaluation Engineer is responsible for inspecting used cars and providing accurate evaluation reports.Conduct end-to-end inspection of used vehicles (mechanical, electrical, body, and interior). · Perform test drives to assess engine performance. · ...
AI Agent Evaluation Engineer
4 weeks ago
We are seeking a seasoned QA professional to lead evaluation and testing efforts for AI and LLM-based systems. · At least 2 years dedicated experience testing or evaluating AI systems, conversational agents, or large language models (LLMs). · Proven track record of designing, ex ...
AI Agent Evaluation Engineer
2 weeks ago
We seek a seasoned QA professional to lead evaluation and testing efforts for AI systems. · Lead evaluation and testing efforts for AI systems. · ...
Senior Engineer, Design Evaluation Engineering
1 month ago
Analog Devices is seeking an intelligent and versatile product engineer to join our agile advanced data converters group.Minimum BE/B Tech in Electrical/Electronics/Communication Engineering3+ years experience working in wireless transceiver or telecommunications industryKnowledg ...
Staff Engineer, Design Evaluation Engineering
1 month ago
This technical lead role will lead the Bench Eval (Validation) activities on any new product development of ASIC and SOC products developed in the newly formed Digital ASIC Business Unit of Analog Devices. · The ideal candidate will be technically strong and will have the experie ...
Senior Engineer, Design Evaluation Engineering
1 month ago
Analog Devices Inc. is seeking an intelligent and versatile product engineer to join our agile advanced data converters group. · ...
AI Agent Evaluation Engineer
5 days ago
Job Description · As an AI Agent Evaluation Engineer at Brillio, you will be responsible for developing synthetic testing environments and simulation strategies to stress-test agents under various real-world conditions. · Design scalable evaluation datasets and metrics to test ag ...
AI Agent Evaluation Engineer
2 weeks ago
We are seeking a seasoned QA professional to lead evaluation and testing efforts for AI and LLM-based systems. ...