Jobs
>
Bengaluru

    Gen AI Automation Tester - Bengaluru, India - PwC India

    PwC India
    Default job background
    Description

    Location:Bangalore

    Experience Required: 4 to 7 years

    Job Description:


    • Design, develop, and maintain automated test frameworks and scripts for chat interface applications utilizing LLMs, ensuring comprehensive coverage of all functionalities and user scenarios.


    • Understand Retrieval Augmented Generation(RAG) strategy to improve testing for knowledge-intensive tasks by retrieving relevant documents or data that can be used as references or benchmarks for evaluating the LLM's responses


    • Evaluate chat interactions for adherence to conversational design principles, ensuring responses are accurate, relevant, and delivered within acceptable time frames.


    • Perform thorough regression testing when bugs are resolved and when there are updates to LLMs or application features.


    • Collaborate with development teams to understand application features and integration points for Large Language Models, identifying potential areas for automation.


    • Execute automated and manual test cases, analyze test results, identify and document defects, and work closely with developers to ensure they are addressed promptly.


    • Monitor the performance of LLMs in the chat interface, identifying any issues with latency, accuracy, or relevance of responses.


    • Stay up-to-date with the latest developments in AI, machine learning, and chatbot technologies to continually improve testing strategies and tools.


    • Collaborate with product managers and UX designers to ensure the chat application meets the highest standards of user satisfaction and engagement.


    • Ensure compliance with data privacy and security policies during the testing process, especially when handling sensitive user data.


    • Provide detailed reports and documentation on test activities, results, insights, and recommendations for improving the application's quality and performance.

    Tools Exposure Expected:


    Automation Testing: Selenium, Appium, TestComplete.


    Programming Languages: Python, JavaScript, or Java, which are commonly used in test script

    development.


    API Testing: e.g., Postman, REST-Assured) for testing chat application interfaces and integrations.


    Machine Learning Models: For how LLM function


    Test Case Design: conversational flows, edge cases, and user intents in chat applications.


    Bias and Fairness: Awareness of potential biases in AI models


    • Security Testing of chat interface


  • CGI

    Automation Tester

    1 week ago


    CGI Bengaluru, India

    Experience as Automation Tester · Experience in Robot Framework & Browser Library is MUST · Experience Performance Testing is advantage · Experience in JIRA · Experience in git repository · **Allier savoir et faire** · Alors que la technologie s'inscrit au cœur de la transformati ...

  • Tech Platinum Consulting

    Automation Tester

    1 week ago


    Tech Platinum Consulting Bengaluru, India

    Position - Automation Tester · Location -Bangalore · **Automation Tester Responsibilities**: · - Designing and developing test automation scripts. · - Using test automation guidelines. · - Researching issues in software through testing. · - Collaborating with QA Analysts and Soft ...

  • Bultaminds Venture

    Automation Testers

    1 week ago


    Bultaminds Venture Bengaluru, India

    Job Title · Automation Testers · Work Experience · 3years -6years · **Skills**: · Automation testing with java · Location · Banglore - Karnataka, India · **kill Set: · - ** · **kill Set: · - ** · - Experience in **web automation** tester with **Java**: · - Should have experience ...

  • QA InfoTech

    Automation Tester

    1 day ago


    QA InfoTech Bengaluru, India

    · Must-Have Skills · 1. Demonstrated experience in writing /updating tests based on requirements in an Agile environment · 2. Demonstrated experience in Test automation using Python(priority 1) or Java · 3. They need to know how to set up a library, test script, python, automate ...

  • Black & White Business Solutions

    Automation Tester

    1 day ago


    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **Technology** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · - Roles and Responsibilities: · - Building automated tests using tools such as Selenium, Protractor, ...

  • Shell

    Automation Tester

    1 week ago


    Shell Bengaluru, India

    **The Role**: · The Automation Tester will be responsible for design and develop test Frameworks and automate tests using Selenium, BDD with Python Behave WebDriver. Develop automated tests to test Web Services and REST APIs. · Work closely with Scrum team members to clarify requ ...

  • Qualimatrix

    Automation Tester

    1 week ago


    Qualimatrix Bengaluru, India

    Automation Tester - 5 years of experience in Specflow and c# is mandatory · Mandatory Skills: · C # · BDD/TDD · Specflow · Selenium · Experience · - 5 yrs · Location · - Remote · **Salary**: From ₹50,000.00 per month ...

  • Awaz

    Automation Tester

    1 week ago


    Awaz Bengaluru, India

    We have an opening for **Automation Tester **for fulltime position with a leading client in **Bengaluru.** · **Skills**: Automation Testing, Selenium. · **Technical Skills**: Must possess 1-6 years of experience in Automation testing; At least 1 year in Selenium, UFT, Jenkins, JI ...

  • CGI

    Automation Tester

    1 week ago


    CGI Bengaluru, India

    Company Profile: · Job Title: Automation Tester · Position: Automation Tester · Experience: 5- 10 Years · Category: Software Development/ Engineering · Main location: India, Karnataka, Bangalore · Position ID: J · Employment Type: Full Time · **Insights you can act on** · While ...

  • Talent Basket

    Automation Tester

    1 week ago


    Talent Basket Bengaluru, India

    MNC firm hiring · Vacancy: Automation Tester · Exp: 5 - 7 years · Location: Kochi / Trivandrum / Bangalore · **NP- immediate to 30 days ONLY** · Skills · - Selenium · Java · Communication skills · Vacancy · - Automation Tester · Exp yr · Location - Kochi Infopark · NP - Immediate ...

  • 3 Dots Consultants

    Automation Tester

    1 week ago


    3 Dots Consultants Bengaluru, India

    We are looking for a highly-skilled test automation engineer to design automation tests. Test automation engineers' duties include designing automation scripts and finding solutions for automation problems. You should also be committed to developing skills in order to provide up- ...

  • Altitude Recruitment

    Automation Tester

    1 week ago


    Altitude Recruitment Bengaluru, India

    **Job Title - Automation Testers - Java script & Node JS** · **Job Type - Contract role** · **Location - Bangalore/ Pune** · Altitude Recruitment is a specialist recruitment agency with offices in both Australia and India, we have recently been briefed on a number of new End-To-E ...

  • Simplify3x Software Private Limited Company

    Automation Tester

    1 week ago


    Simplify3x Software Private Limited Company Bengaluru, India

    Immediate Joiner* · Looking for Automation Tester with 4-7 yrs of experience · skill · - Java Selenium, Cucumber BDD · Location - BCIT, Block 1, Ground Floor Bhartiya City, RK Hegde Nagar, Bangalore · **Salary**: Up to ₹1,800,000.00 per year · **Benefits**: · - Flexible schedule ...

  • Princeton IT America

    Automation Tester

    2 days ago


    Princeton IT America Bengaluru, Karnataka, India

    The Automation Tester will be responsible for design and develop test Frameworks and automate tests using Selenium, BDD with Python Behave WebDriver. Develop automated tests to test Web Services and REST APIs. · The role of automation SME is an independent role who can develop, e ...

  • POWER IT SERVICES

    Automation Tester

    3 days ago


    POWER IT SERVICES Bengaluru, India

    Greetings from Power IT Services · JD for Automation Tester. · 1. 3-8 years' experience · 2. Selenium, Java Strong developer skills · 3. Building CI/CD pipeline via Jenkins/Codefresh · 4. Experience in building automation frameworks · **Salary**: Up to ₹1,000,000.08 per year · S ...

  • Princeton IT America

    Automation Tester

    5 days ago


    Princeton IT America Bengaluru, Karnataka, India

    **Location**: Bangalore (MUST work from office 2-3 days a week) · - **Required skills**:_ · - 7-8+ years of proven experience as a manual and Automation tester(Selenium with Python) · - Experience with bug-tracking systems such as JIRA, ADO · - Attention to detail, ability to fol ...

  • SKS Enterpprise

    Automation Tester

    1 week ago


    SKS Enterpprise Bengaluru, India

    **Position Name -** Automation Tester** · **Location - **Bangalore** · **Experience Range - **3 - 5 years** · **Mandatory Requirement**: · - Experience in designing and executing automated tests using frameworks such as Selenium, Appium, or similar. · - Familiarity with test mana ...

  • Yoofoo Technologies India Private Limited

    Automation Tester

    4 days ago


    Yoofoo Technologies India Private Limited Bengaluru, India

    6 to 8 years exp · Requires Automation Tester with Selenium and JMeter experience · **Salary**: ₹283, ₹1,370,675.53 per year · Schedule: · - Day shift · Ability to commute/relocate: · - Bangalore, Karnataka: Reliably commute or planning to relocate before starting work (required) ...

  • Arm

    Automation Tester

    7 hours ago


    Arm Bengaluru, Karnataka, India

    **Job Overview**: · This role is based 100% in Bengaluru, India. Occasional international travel may be required for company events, special team meetings and/or workshops. There is also a requirement for on-call. · **Responsibilities**: · Supporting Requirements Gathering: Busin ...

  • Siemens

    Automation Tester

    1 week ago


    Siemens Bengaluru, India

    Siemens founded the new business unit Siemens Advanta (formerly known as Siemens IoT Services) on April 1, 2019, with its headquarter in Munich, Germany. It has been crafted to unlock the digital future of its clients by offering end-to-end support on their outstanding digitaliza ...