This website uses cookies to ensure you get the best experience on our website. By continuing to use this site, you agree to our cookie  & privacy policy.Accept

checked This is a sample alert

Consultant-Lead Data Engineer

  • Full Time
  • Hybrid - Bengaluru
  • 6 months
  • Project posted on: 17/07/2026
add_new View Project Details

Consultant-Lead Data Engineer

  • Data and Analytics
  • Business Intelligence
  • Database Management & SQL
  • Data Mining & Pattern Recognition

Hybrid - Bengaluru

Full Time

6 months

 17/07/2026

Assignment Details

Key Responsibilities

 

  • Lead the design, development, and deployment of scalable data pipelines using AWS Glue, Apache Spark, and PySpark.
  • Design and implement modern Lakehouse architecture leveraging Apache Iceberg.
  • Build and maintain robust ETL/ELT pipelines using Python and dbt.
  • Develop and manage workflow orchestration using Apache Airflow or AWS-native orchestration services.
  • Design and optimize data models, ETL processes, and SQL queries for Amazon Redshift and analytical workloads.
  • Establish best practices for CI/CD, source control using GitHub, and automated testing.
  • Collaborate with business stakeholders, architects, and cross-functional teams to translate business requirements into technical solutions.
  • Provide technical leadership, mentor engineering teams, and drive code quality, performance optimization, and architectural best practices.
  • Ensure data quality, governance, reliability, and operational excellence across data platforms.

Skills Required

Skills and Experience

 

  • 8+ years of experience in Data Engineering, with experience leading technical teams.
  • Strong hands-on expertise in AWS Glue, Apache Spark, PySpark, and Python.
  • Experience with dbt for data transformation, testing, and documentation.
  • Hands-on knowledge of Apache Iceberg and Lakehouse architecture.
  • Experience with Apache Airflow for workflow orchestration.
  • Strong expertise in Amazon Redshift, SQL optimization, and performance tuning.
  • Experience with GitHub, GitHub Actions, Jenkins, AWS CodePipeline, or similar CI/CD tools.
  • Solid understanding of data modeling, partitioning strategies, and performance optimization.
  • Excellent problem-solving, communication, and stakeholder management skills.

Industry

IT Services & Consulting

Experience Required:

7+ years

Additional Skills:

  • Data Engineer
  • Pyspark
  • Python
  • Amazon Redshift
  • Apache Iceberg
  • Apache
  • Airflow
  • AWS glue
  • ETL/ELT pipelines
  • Apache Spark
  • AWS SageMaker

No of open positions:

1

Similar Freelance Projects you can apply to

View More Projects btn btn

How it works

  • 1

    Build your
    skill profile

  • 2

    Strengthen it
    with feedback

  • 3

    Determine your
    optimal fee level

  • 4

    Apply for matching
    projects

  • 5

    Get finalized

  • 6

    Stay Engaged

Build your skill prodile

Project
step1
shape_step

Request feedback from prior projects and/or work stints

shape_step

Determine your optimal fee level

  • starFeeBee helps consultants understand how to price their services.
  • starEnter your skill & location to get ranges for what similar professionals have charged on projects.
  • starUnlock more details e.g., best paying sub-skills, ranges by projects durations, by simply adding a benchmark from a orior projects.
graph_step2
shape_step

Apply for matching projects

shape_step

Get finalized!

Project
step5
shape_step

Stay Engaged!

Project
step6
shape_step

More than 3000 clients rely on Flexing It today

Frequently asked questions.

We host both full-time & part-time projects from top clients for 100+ skill categories. We also help connect experts like you with clients for short consultation calls called Flexperts

You just need to create a ‘boutique firm’ account during the registration process. The rest of the application process remains the same.

Our freelancers fee benchmarking tool, FeeBee helps our freelancers and consultants find out what their peers charged for similar projects. Built on 600K+ verified benchmarks, registered users get unlimited access to it.

As a freelancing platform, we do not provide permanent positions or full-time job to our consultant network.

Flexing It will be involved end to end right from contracts to invoicing. Once you are finalized, your payment details are transparently laid out in your contract terms with your client and our team actively liaises with the client finance team to ensure timely payments.

We do not charge any fee or commission from you. Your fee quote will be paid out to you in full as per your project contract.

planGet alerts for new project opportunities.