This website uses cookies to ensure you get the best experience on our website. By continuing to use this site, you agree to our cookie  & privacy policy.Accept

checked This is a sample alert

Consultant QA Automation Engineer

  • Full Time
  •  On-Site - Bangalore
  • 6 months
  • Project posted on: 28/03/2024

Consultant QA Automation Engineer

  • Information Technology
  • Quality Assurance & Testing

On-Site - Bangalore

Full Time

6 months


Assignment Details

Our client, a leading global specialist in energy management and automation is looking to engage with a Consultant QA Automation Engineer Requirements for RAG Applications

Key responsibilities:
Quality Evaluation
i) Evaluate Model Outputs:
-Develop automated tests to assess the quality of RAG-generated responses.
-Verify correctness, coherence, and relevance of answers.
ii) Test Automation:
-Create test scripts for end-to-end testing.
-Implement regression, functional, and performance tests.

Continuous Integration and Deployment (CI/CD)
i) CI/CD Pipelines:
-Set up and maintain CI/CD pipelines for RAG applications.
-Automate deployment, testing, and monitoring.
ii) Version Control:
-Proficiency with Git or other version control systems.
-Collaborate with development teams to manage code changes.

Monitoring and Reporting
i) System Health Monitoring:
-Implement monitoring tools to track application performance.
-Detect anomalies, bottlenecks, and errors.
ii) Reporting and Documentation:
-Document test results, issues, and improvements.
-Communicate findings to stakeholders.

Domain-Specific Knowledge
i) Generative AI and RAG:
-Understand how RAG models work.
-Adapt QA strategies to the unique challenges of generative content.
ii) Compliance (if applicable):
-Ensure compliance with industry-specific guidelines.
-Validate RAG responses against regulatory requirements.

Duration: 6 months (extendable to 9 months)
Capacity: Full time
Location: Bengaluru

Skills Required

- Relevant experience in QA Automation Engineer in Generative AI Space.
- AI and ML Concepts: Understand fundamental concepts related to artificial intelligence and machine learning. Familiarity with large language models (LLMs) and their applications.
- Semantic Search Techniques: Knowledge of semantic search algorithms, Ability to optimize search queries for efficient retrieval.
- Database Management: Experience with databases (e.g., SQL, NoSQL), Understand data ingestion, storage, and retrieval.

About the Client

A leading global specialist in energy management and automation


IT Services & Consulting

Minimum Experience:

8+ years

Additional Skills:

  • machine learning
  • QA
  • RAG Applications
  • Continuous Integration and Deployment
  • artificial intelligence
  • QA automation engineer
  • Retrieval-augmented generation

No of open positions:


How it works

  • 1

    Build your
    skill profile

  • 2

    Strengthen it
    with feedback

  • 3

    Determine your
    optimal fee level

  • 4

    Apply for matching

  • 5

    Get finalized

  • 6

    Stay Engaged

Build your skill prodile


Request feedback from prior projects and/or work stints


Determine your optimal fee level

  • starFeeBee helps consultants understand how to price their services.
  • starEnter your skill & location to get ranges for what similar professionals have charged on projects.
  • starUnlock more details e.g., best paying sub-skills, ranges by projects durations, by simply adding a benchmark from a orior projects.

Apply for matching projects


Get finalized!


Stay Engaged!


Similar Freelance Projects you can apply to.

View More Projects btn btn

More than 3000 clients rely on Flexing It today

Frequently asked questions.

We host both full-time & part-time projects from top clients for 100+ skill categories. We also help connect experts like you with clients for short consultation calls called Flexperts

You just need to create a ‘boutique firm’ account during the registration process. The rest of the application process remains the same.

Our freelancers fee benchmarking tool, FeeBee helps our freelancers and consultants find out what their peers charged for similar projects. Built on 600K+ verified benchmarks, registered users get unlimited access to it.

As a freelancing platform, we do not provide permanent positions or full-time job to our consultant network.

Flexing It will be involved end to end right from contracts to invoicing. Once you are finalized, your payment details are transparently laid out in your contract terms with your client and our team actively liaises with the client finance team to ensure timely payments.

We do not charge any fee or commission from you. Your fee quote will be paid out to you in full as per your project contract.