AI Agent Evaluation Engineer - Bengaluru

Only for registered members Bengaluru, India

1 week ago

Default job background

Job summary

We are seeking a seasoned QA professional to lead evaluation and testing efforts for AI and LLM-based systems. The ideal candidate will have deep experience in validating conversational agents, conducting safety and adversarial assessments, and working with Google's Agent Development Kit (ADK) and Vertex AI ecosystem.

Responsibilities

  • AI / LLM Testing Expertise: At least 2 years dedicated experience testing or evaluating AI systems, conversational agents, or large language models (LLMs).
  • Safety & Red Teaming: Hands-on experience with safety evaluations is mandatory.

Lorem ipsum dolor sit amet
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.

Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.

Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Get full access

Access all high-level positions and get the job of your dreams.



Similar jobs

  • Only for registered members Bengaluru

    We are seeking a skilled Bike Evaluation Engineer to join our team. · A Bike Evaluation Engineer is responsible for evaluating the performance of two-wheelers by testing their various components, · systems and design principles. The ideal candidate should have experience with bik ...

  • Only for registered members Bengaluru

    The Design Evaluation Engineer is a developing professional with growing competence in design evaluation. This role involves resolving moderately complex problems with moderate guidance. · Independently perform hardware and software bench evaluations · ...

  • Only for registered members India, Bangalore

    The Design Evaluation Engineer is a developing professional with growing competence in design evaluation. This role involves resolving moderately complex problems with moderate guidance. · ...

  • Only for registered members Bangalore Full time

    The Design Evaluation Engineer is a developing professional with growing competence in design evaluation. · Independently perform hardware and software bench evaluations · ...

  • Only for registered members India, Bangalore

    The Design Evaluation Engineer is a developing professional with growing competence in design evaluation. This role involves resolving moderately complex problems with moderate guidance. · ...

  • Only for registered members India, Bangalore

    Analog Devices is seeking an intelligent and versatile product engineer to join our agile advanced data converters group. · ...

  • Only for registered members India, Bangalore

    Come join Analog Devices (ADI) – a place where Innovation meets Impact. For more than 55 years, Analog Devices has been inventing new breakthrough technologies that transform lives. · ...

  • Only for registered members Bengaluru, Karnataka

    The Senior Design Evaluation Engineer is a senior technical position working on complex and critical evaluation projects. · Lead architecture, design, and development of embedded software for consumer audio devices. · Develop and optimize firmware for audio DSPs, SoCs, and microc ...

  • Only for registered members India, Bangalore

    Analogue Devices is seeking a skilled product engineer for their advanced data converters group. The successful candidate will work with design teams to develop and release products from definition through production. · Interface with cross-functional teams throughout the product ...

  • Only for registered members Bengaluru

    This technical lead role will lead the Bench Eval (Validation) activities on any new product development of ASIC and SOC products developed in the newly formed Digital ASIC Business Unit of Analog Devices. · The ideal candidate will be technically strong and will have the experie ...

  • Only for registered members India, Bangalore

    We are seeking a highly skilled Senior Design Evaluation Engineer to lead firmware and embedded software development for our next-generation consumer audio products. · The ideal candidate has deep expertise in wireless audio, DSP integration, Bluetooth LE Audio, and low-power emb ...

  • Only for registered members Bengaluru

    We are seeking a highly skilled Principal Embedded Software Engineer to lead firmware and embedded software development for our next-generation consumer audio products, · Lead architecture, design, and development of embedded software for consumer audio devices. · ...

  • Only for registered members Bangalore

    The Evaluation Engineer is responsible for inspecting used cars and providing accurate evaluation reports.Conduct end-to-end inspection of used vehicles (mechanical, electrical, body, and interior). · Perform test drives to assess engine performance. · ...

  • Only for registered members Bengaluru, Karnataka

    We are seeking a seasoned QA professional to lead evaluation and testing efforts for AI and LLM-based systems. · At least 2 years dedicated experience testing or evaluating AI systems, conversational agents, or large language models (LLMs). · Proven track record of designing, ex ...

  • Only for registered members Bangalore

    We seek a seasoned QA professional to lead evaluation and testing efforts for AI systems. · Lead evaluation and testing efforts for AI systems. · ...

  • Only for registered members Bengaluru

    Analog Devices is seeking an intelligent and versatile product engineer to join our agile advanced data converters group.Minimum BE/B Tech in Electrical/Electronics/Communication Engineering3+ years experience working in wireless transceiver or telecommunications industryKnowledg ...

  • Only for registered members Bengaluru, Karnataka

    This technical lead role will lead the Bench Eval (Validation) activities on any new product development of ASIC and SOC products developed in the newly formed Digital ASIC Business Unit of Analog Devices. · The ideal candidate will be technically strong and will have the experie ...

  • Only for registered members Bengaluru, Karnataka

    Analog Devices Inc. is seeking an intelligent and versatile product engineer to join our agile advanced data converters group. · ...

  • Brillio Bengaluru

    Job Description · As an AI Agent Evaluation Engineer at Brillio, you will be responsible for developing synthetic testing environments and simulation strategies to stress-test agents under various real-world conditions. · Design scalable evaluation datasets and metrics to test ag ...

  • Only for registered members Bengaluru

    We are seeking a seasoned QA professional to lead evaluation and testing efforts for AI and LLM-based systems. ...