This website uses cookies to ensure you get the best experience on our website. By continuing to use this site, you agree to our cookie  & privacy policy.Accept

checked This is a sample alert

Consultant-Lead QA Automation Engineer (AI/ML & Gen AI)

  • Full Time
  • Hybrid - Bengaluru
  • 12 months
  • Project posted on: 24/08/2026
add_new View Project Details

Consultant-Lead QA Automation Engineer (AI/ML & Gen AI)

  • Technology
  • Quality Assurance (QA) & Testing
  • DevOps
  • Cloud Computing

Hybrid - Bengaluru

Full Time

12 months

 24/08/2026

Assignment Details

Key Responsibilities

  • Design and execute V&V strategies for classical ML and GenAI/ agentic systems.
  • Define test plans, tests cases, and execute them
  • Evaluate AI models for accuracy, performance, safety, robustness, hallucinations, bias, and correctness.
  • For GenAI, rely on LangSmith for LLM observability, tracing, monitoring, and evaluation, for offline and online evaluation
  • For classical ML UC, ensure V&V tests are done during the whole life cycle of the model (ML monitoring)
  • Build scalable automation frameworks using Python & PyTest integrated with CI/CD pipelines.
  • Develop automated test suites for APIs, microservices, and AI pipelines.
  • Perform sanity, integration, functional, regression, and UAT testing across QA, UAT, and Prod environments.
  • Implement automation strategies: Keyword-driven, Data-driven, BDD, Hybrid frameworks.
  • Analyze test results and provide insights to engineering teams.
  • Log and track defects using standard bug-reporting tools.
  • Maintain high-quality documentation for all test processes and reports.

Skills Required

Skills & Experience

  • 4–5 years of experience in software testing and test automation.
  • Strong hands-on programming experience in Python.
  • Strong experience with PyTest and automation framework development.
  • Good understanding of AI/ML concepts and data science metrics applicable to classical ML and GenAI use cases.
  • Experience testing AI applications, chatbots, LLM/GenAI solutions, or AI-driven products.
  • Knowledge of GenAI testing, AI model evaluation, and V&V methodologies.
  • Experience with Git, GitHub Copilot, and CI/CD pipelines.
  • Good understanding of API and microservices testing.
  • Experience working with Azure and/or AWS cloud environments.
  • Working knowledge of databases such as:
    • MySQL
    • PostgreSQL
    • Oracle
    • SQL Server
    • NoSQL databases
  • Strong analytical, problem-solving, verbal, and written communication skills.
  • Experience working in multi-stakeholder delivery models, including onshore/offshore environments.
  • Qualification: B.E./B.Tech or equivalent technical qualification.

Industry

IT Services & Consulting

Experience Required:

6+ years

Additional Skills:

  • Python
  • Automation Engineer
  • Test Automation
  • Gen AI
  • MySQL
  • AI/ML
  • AWS
  • Github
  • Copilot
  • V&V Strategies
  • UAT
  • Pytest
  • Azure

No of open positions:

1

Similar Freelance Projects you can apply to

View More Projects btn btn

How it works

  • 1

    Build your
    skill profile

  • 2

    Strengthen it
    with feedback

  • 3

    Determine your
    optimal fee level

  • 4

    Apply for matching
    projects

  • 5

    Get finalized

  • 6

    Stay Engaged

Build your skill prodile

Project
step1
shape_step

Request feedback from prior projects and/or work stints

shape_step

Determine your optimal fee level

  • starFeeBee helps consultants understand how to price their services.
  • starEnter your skill & location to get ranges for what similar professionals have charged on projects.
  • starUnlock more details e.g., best paying sub-skills, ranges by projects durations, by simply adding a benchmark from a orior projects.
graph_step2
shape_step

Apply for matching projects

shape_step

Get finalized!

Project
step5
shape_step

Stay Engaged!

Project
step6
shape_step

More than 3000 clients rely on Flexing It today

Frequently asked questions.

We host both full-time & part-time projects from top clients for 100+ skill categories. We also help connect experts like you with clients for short consultation calls called Flexperts

You just need to create a ‘boutique firm’ account during the registration process. The rest of the application process remains the same.

Our freelancers fee benchmarking tool, FeeBee helps our freelancers and consultants find out what their peers charged for similar projects. Built on 600K+ verified benchmarks, registered users get unlimited access to it.

As a freelancing platform, we do not provide permanent positions or full-time job to our consultant network.

Flexing It will be involved end to end right from contracts to invoicing. Once you are finalized, your payment details are transparently laid out in your contract terms with your client and our team actively liaises with the client finance team to ensure timely payments.

We do not charge any fee or commission from you. Your fee quote will be paid out to you in full as per your project contract.

planGet alerts for new project opportunities.