This website uses cookies to ensure you get the best experience on our website. By continuing to use this site, you agree to our cookie  & privacy policy.Accept

checked This is a sample alert

Consultant - Data Quality (DQ) and ETL Engineer

  • Full Time
  •  Hybrid - Mumbai Metropolitan Region
  • 6 months
  • Project posted on: 5/12/2025
add_new View Project Details

Consultant - Data Quality (DQ) and ETL Engineer

  • Technology
  • Cloud Computing
  • Quality Assurance (QA) & Testing

Hybrid - Mumbai Metropolitan Region, Bengaluru, Bengaluru

Full Time

6 months

 5/12/2025

Assignment Details

Our client, a leading global specialist in energy management and automation is seeking an experienced Data Quality (DQ) and ETL Engineer to ensure the integrity, reliability, and governance of our data platform. This role is a hybrid of development, operations, and data governance.

Key Responsibilities: 

  • Design, develop, and deploy scalable ETL/ELT solutions using AWS Glue (PySpark) and Python, IDQ (Informatica Data Quality) to ingest and transform high-volume data.
  • Write and optimize complex SQL queries and stored procedures.
  • Manage and orchestrate automated data workflows using AWS Step Functions or Apache Airflow.
  • Define, implement, and enforce robust Data Quality (DQ) rules (completeness, accuracy, and consistency) across all stages of the data lifecycle.
  • Develop and manage automated data validation frameworks and monitoring tools to proactively detect and report anomalies.
  • Conduct continuous Data Profiling to understand data lineage, identify gaps, and ensure compliance with governance standards.
  • Perform deep technical troubleshooting and root cause analysis (RCA) on pipeline failures and data quality exceptions.
  • Optimize the performance of ETL jobs and queries to improve data freshness and system efficiency.
  • Collaborate with data architects and business users to align pipeline design with data modelling best practices (e.g., star schema).
  • 2+ years of dedicated experience working with the AWS data ecosystem.
  • AWS Certified Data Analytics – Specialty or AWS Certified Developer/Informatica DQ certification is highly preferred.

Skills Required

  • Data Engineering & ETL/ELT Development: Hands-on experience building scalable pipelines using AWS Glue (PySpark), Python, and SQL.
  • Cloud Data Workflow Orchestration: Proficiency with AWS Step Functions or Apache Airflow for automated pipeline scheduling and monitoring.
  • Data Quality & Governance: Strong command over IDQ (Informatica Data Quality), rule implementation, data profiling, and automated validation frameworks.
  • Troubleshooting & Performance Optimization: Ability to perform RCA for pipeline failures and optimize ETL jobs and queries for efficiency and data freshness.

About the Client

A leading global specialist in energy management and automation

Industry

IT Services & Consulting

Experience Required:

3+ years

Additional Skills:

  • SQL
  • Python
  • ETL/ELT
  • AWS
  • Data Quality
  • Software Development - Python
  • Data Analytics
  • Pyspark
  • AWS Glue

No of open positions:

1

Similar Freelance Projects you can apply to

View More Projects btn btn

How it works

  • 1

    Build your
    skill profile

  • 2

    Strengthen it
    with feedback

  • 3

    Determine your
    optimal fee level

  • 4

    Apply for matching
    projects

  • 5

    Get finalized

  • 6

    Stay Engaged

Build your skill prodile

Project
step1
shape_step

Request feedback from prior projects and/or work stints

shape_step

Determine your optimal fee level

  • starFeeBee helps consultants understand how to price their services.
  • starEnter your skill & location to get ranges for what similar professionals have charged on projects.
  • starUnlock more details e.g., best paying sub-skills, ranges by projects durations, by simply adding a benchmark from a orior projects.
graph_step2
shape_step

Apply for matching projects

shape_step

Get finalized!

Project
step5
shape_step

Stay Engaged!

Project
step6
shape_step

More than 3000 clients rely on Flexing It today

Frequently asked questions.

We host both full-time & part-time projects from top clients for 100+ skill categories. We also help connect experts like you with clients for short consultation calls called Flexperts

You just need to create a ‘boutique firm’ account during the registration process. The rest of the application process remains the same.

Our freelancers fee benchmarking tool, FeeBee helps our freelancers and consultants find out what their peers charged for similar projects. Built on 600K+ verified benchmarks, registered users get unlimited access to it.

As a freelancing platform, we do not provide permanent positions or full-time job to our consultant network.

Flexing It will be involved end to end right from contracts to invoicing. Once you are finalized, your payment details are transparently laid out in your contract terms with your client and our team actively liaises with the client finance team to ensure timely payments.

We do not charge any fee or commission from you. Your fee quote will be paid out to you in full as per your project contract.