Back to jobs

AWS/Databricks Cloud Data Engineer

Pay
$85,000–125,000/yearAnnual period assumed — pay source
Salary At Moser Consulting, we believe in pay transparency and fairness. The $85k-$125k salary range for this role is not just a number—it’s a reflection of the value we place on the skills and experience our employees bring to our team. We are committed to offering a competitive salary that aligns with the industry standards and the unique competencies you bring to our community. Benefits
Read the full posting
Work setting
On-site — work setting source
Work setup in the employer’s posting: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type in the employer’s posting: Full-Time
From the employer’s posting

What you’ll work on

Full posting
  • Build and maintain AWS-native pipelines (Lambda, ECS, EKS, S3) for genomic data

  • Generate and manage sequencing and post-sequencing data processing workflows

  • Build and maintain data acquisition pipelines from databases, flat-files, and REST APIs

  • Troubleshoot pipeline failures, query performance, and data quality issues

  • Create and maintain technical, operational, and data mapping documentation

From the employer’s posting
Build and maintain AWS-native pipelines (Lambda, ECS, EKS, S3) that ingest and store genomic data retrieved via API calls
Generate and manage sequencing and post-sequencing data processing workflows in support of genomics data science models
Assist in building and maintaining data acquisition pipelines from diverse sources including databases, flat-files, and REST APIs
Proactively troubleshoot and resolve pipeline failures, query performance issues, data quality concerns
Create and maintain technical documentation, operational documentation, data flow diagrams, and data mapping documents

What you’ll bring

All qualifications

Core experience

  • Experience with dimensional modeling, SCDs, and medallion architecture
  • Experience with API-based access patterns for retrieving and integrating data from external systems
  • Proven ability to adapt in a fast-paced consulting environment, including managing time effectively and handling multiple tasks simultaneously
  • Experience implementing and managing role-based access control (RBAC), including group/permissions management for secure system access
  • Hands-on experience with Amazon ECS and/or EKS for container orchestration
  • Experience with API development in both consumer and producer capacities (REST APIs)

Preferred experience

  • Strong Python experience across pipeline development, ETL, and data engineering tasks, with exposure to complex datasets from disparate batch and streaming sources and an emphasis on low latency, high throughput, and cost-efficiency; pandas experience a plus
  • Experience with version control systems (Git) and agile development frameworks
  • Experience with Datadog or similar observability and monitoring platforms
  • Familiarity with Dagster or other modern data orchestration frameworks
Qualification wording
Experience with dimensional modeling, SCDs, and medallion architecture
Experience with API-based access patterns for retrieving and integrating data from external systems
Proven ability to adapt in a fast-paced consulting environment, including managing time effectively and handling multiple tasks simultaneously
Experience implementing and managing role-based access control (RBAC), including group/permissions management for secure system access
Hands-on experience with Amazon ECS and/or EKS for container orchestration
Experience with API development in both consumer and producer capacities (REST APIs)
Strong Python experience across pipeline development, ETL, and data engineering tasks, with exposure to complex datasets from disparate batch and streaming sources and an emphasis on low latency, high throughput, and cost-efficiency; pandas experience a plus
Experience with version control systems (Git) and agile development frameworks
Experience with Datadog or similar observability and monitoring platforms
Familiarity with Dagster or other modern data orchestration frameworks

Benefits in the posting

Full benefits wording
  • Our unique culture is our competitive edge. It fosters happiness, health, and low stress, even in an industry known for its demands. This is why we’re consistently recognized as one of the Best Places to Work in Indiana. We provide our employees with an inspiring workspace, a fun and collaborative atmosphere, and a generous compensation package. But that’s not all.
  • Fully Invested 401K Plan: We help secure your future with a fully invested 401K plan.
  • PPO and HDHP Medical Plans: Choose the health insurance program that best fits your needs.
  • Employer-Paid Dental and Vision Plans: We cover dental and vision plans, ensuring our employees have access to comprehensive health care.
  • Wellness Program: We promote a healthy lifestyle with our wellness program.

From the employer’s posting.

About Moser Consulting

For more than 25 years we have formed partnerships and grown through open and honest collaboration with our clients, partners, and employees.

In the employer’s words · Read in context

Apply at Moser Consulting

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 21, 202628 days ago
Recorded sightings
28
Last seen by us
Nov 18, 2026
Reposted
once since Sep 24, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications. We count a repost when the same title and location comes back as a new listing within 60 days of the last one coming down. Some hiring systems expire listings on a schedule, so repost rates vary by system.

How this job compares

Pay

Lower than most similar jobs

$85K–$125K against $127K–$190K, the middle half of what similar US postings state.

From 2,396 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 28

Similar jobs usually come down between day 6 and day 56.

From 14,168 similar postings that came down. Coming down is not always a hire.

Moser Consulting is hiring

1 open job

Open jobs by the week we first saw them, last 12 weeks.

  • 100% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • AWS
  • Datadog
  • Docker
  • MySQL
  • PostgreSQL
  • S3
  • Terraform
  • Dagster
  • PySpark
Where the posting names them
- Experience implementing and managing role-based access control (RBAC), including group/permissions management for secure system access - Strong Python experience across pipeline development, ETL, and data engineering tasks, with exposure to complex datasets from disparate batch and streaming sources and an emphasis on low latency, high throughput, and cost-efficiency; pandas experience a plus - Leveraging SQL and python data tooling develop scalable, optimized ETL/ELT pipelines to ingest, transform, and load large, complex datasets from disparate sources (batch and streaming). Streamlining for low latency, high throughput and cost-efficiency.
- Strong Python experience across pipeline development, ETL, and data engineering tasks, with exposure to complex datasets from disparate batch and streaming sources and an emphasis on low latency, high throughput, and cost-efficiency; pandas experience a plus - Leveraging SQL and python data tooling develop scalable, optimized ETL/ELT pipelines to ingest, transform, and load large, complex datasets from disparate sources (batch and streaming). Streamlining for low latency, high throughput and cost-efficiency. - Experience with API development in both consumer and producer capacities (REST APIs)
- Experience with version control systems (Git) and agile development frameworks - Design and document end-to-end testing plans for Python-based applications - PySpark experience for large-scale distributed data processing
Description We are seeking a Senior Cloud Data Engineer to join our consulting team. In this role, you will design, build, and maintain scalable data pipelines and acquisition workflows across cloud and on-premises environments, contributing to the full spectrum of data engineering – from ingestion through transformation and delivery. You will collaborate with cross-functional teams to translate business requirements into robust data solutions, while upholding best practices in architecture, cloud infrastructure, documentation, and continuous improvement. This position sits within our genomics organization, providing senior-level, strategic technical leadership alongside two existing engineers to build out AWS-based data pipelines that support genomic data science models — hands-on, production AWS pipeline-building experience is the top priority for this role. Role Responsibilities
- Collaborate effectively with cross-functional teams and communicate progress to technical and non-technical stakeholders - Build and maintain AWS-native pipelines (Lambda, ECS, EKS, S3) that ingest and store genomic data retrieved via API calls - Generate and manage sequencing and post-sequencing data processing workflows in support of genomics data science models
Requirements - Top priority: proven, hands-on experience designing and building AWS-based data pipelines end-to-end (API ingestion through storage and delivery) - Must-have: hands-on experience working with High Performance Computing (HPC) clusters
- Experience with dimensional modeling, SCDs, and medallion architecture - Previous cloud experience required; AWS preferred with hands-on exposure to Lambda, S3, and Docker - Experience implementing and managing role-based access control (RBAC), including group/permissions management for secure system access
- Terraform or infrastructure-as-code (IaC) experience for cloud resource provisioning - Database experience with databases such as AWS RDS, MySQL, or PostgreSQL - Familiarity with D3.js for building custom data visualizations
- PySpark experience for large-scale distributed data processing - Experience with Datadog or similar observability and monitoring platforms - Familiarity with Dagster or other modern data orchestration frameworks
- Experience with API-based access patterns for retrieving and integrating data from external systems - Lambda functions must be developed and deployed via code/infrastructure-as-code (e.g., CloudFormation, Terraform, CDK, SAM) — GUI/console-based Lambda creation is not acceptable - Hands-on experience with Amazon ECS and/or EKS for container orchestration
- Familiarity with Dagster or other modern data orchestration frameworks - Terraform or infrastructure-as-code (IaC) experience for cloud resource provisioning - Database experience with databases such as AWS RDS, MySQL, or PostgreSQL
- Experience with Datadog or similar observability and monitoring platforms - Familiarity with Dagster or other modern data orchestration frameworks - Terraform or infrastructure-as-code (IaC) experience for cloud resource provisioning
- Design and document end-to-end testing plans for Python-based applications - PySpark experience for large-scale distributed data processing - Experience with Datadog or similar observability and monitoring platforms

Your next step

Complete your application on moser-consulting.breezy.hr. The employer’s form will show what is required.

Applying through Breezy HR

  • No account needed.

Already applied? Track this application

Job description

View original posting ↗

About Moser

For more than 25 years we have formed partnerships and grown through open and honest collaboration with our clients, partners, and employees. We are best known for taking great care of our clients, our dedication to creating a work environment where employees do their best work, and our deep commitment to continuous improvement. Our consultants work in a collaborative and fast-paced environment, are self-motivated, and are passionate about evolving technology. It is no accident that we are recognized as one of the Best Places to Work in Indiana for 10 consecutive years.

Internally, we believe in building strong teams from the top down with a focus on values in our Model-Coach-Care philosophy. Our leadership are encouraged and trained to model good practices, mentor other employees and each other, and show empathy and caring in all interactions. This is the base of our core values: Accountability, Balance, Collaboration, Focus, Integrity, Social Responsibility, Support and Transparency.

Moser Consulting believes in equal opportunity for all people and is committed to enabling a diverse, equitable, and inclusive culture. We foster a spirit of unity that respects the remarkable individuality of everyone's culture, history, and service.

Description

We are seeking a Senior Cloud Data Engineer to join our consulting team. In this role, you will design, build, and maintain scalable data pipelines and acquisition workflows across cloud and on-premises environments, contributing to the full spectrum of data engineering – from ingestion through transformation and delivery. You will collaborate with cross-functional teams to translate business requirements into robust data solutions, while upholding best practices in architecture, cloud infrastructure, documentation, and continuous improvement. This position sits within our genomics organization, providing senior-level, strategic technical leadership alongside two existing engineers to build out AWS-based data pipelines that support genomic data science models — hands-on, production AWS pipeline-building experience is the top priority for this role.

Role Responsibilities
  • Participate in team stand-ups and other agile ceremonies to support project delivery
  • Assist in building and maintaining data acquisition pipelines from diverse sources including databases, flat-files, and REST APIs
  • Leverage development design patterns and best practices across workloads.
  • Support data modeling efforts including dimensional models and semantic layers for analytics under senior guidance
  • Proactively troubleshoot and resolve pipeline failures, query performance issues, data quality concerns, notebook timeouts, data model inconsistencies, semantic model refresh errors, and capacity throttling using monitoring tools and query optimization techniques
  • Participate in requirement gathering meetings and translate business needs into technical specifications
  • Engage in ongoing learning through online trainings, certifications, and mentorship opportunities
  • Create and maintain technical documentation, operational documentation, data flow diagrams, and data mapping documents
  • Collaborate effectively with cross-functional teams and communicate progress to technical and non-technical stakeholders
  • Build and maintain AWS-native pipelines (Lambda, ECS, EKS, S3) that ingest and store genomic data retrieved via API calls
  • Generate and manage sequencing and post-sequencing data processing workflows in support of genomics data science models
    Requirements
    • Top priority: proven, hands-on experience designing and building AWS-based data pipelines end-to-end (API ingestion through storage and delivery)
    • Must-have: hands-on experience working with High Performance Computing (HPC) clusters
    • Experience with dimensional modeling, SCDs, and medallion architecture
    • Previous cloud experience required; AWS preferred with hands-on exposure to Lambda, S3, and Docker
    • Experience implementing and managing role-based access control (RBAC), including group/permissions management for secure system access
    • Strong Python experience across pipeline development, ETL, and data engineering tasks, with exposure to complex datasets from disparate batch and streaming sources and an emphasis on low latency, high throughput, and cost-efficiency; pandas experience a plus
    • Leveraging SQL and python data tooling develop scalable, optimized ETL/ELT pipelines to ingest, transform, and load large, complex datasets from disparate sources (batch and streaming). Streamlining for low latency, high throughput and cost-efficiency.
    • Experience with API development in both consumer and producer capacities (REST APIs)
    • CI/CD experience with modern DevOps tooling and deployment pipelines
    • Experience with API-based access patterns for retrieving and integrating data from external systems
    • Lambda functions must be developed and deployed via code/infrastructure-as-code (e.g., CloudFormation, Terraform, CDK, SAM) — GUI/console-based Lambda creation is not acceptable
    • Hands-on experience with Amazon ECS and/or EKS for container orchestration
    • Demonstrated ability to learn new technologies quickly and apply them to solve problems
    • Strong attention to detail and commitment to producing high-quality work
    • Excellent oral and written communication skills
    • Professionalism and ethics including trust, positive attitude, commitment, honesty, collaboration, and approachability
    • Proven ability to adapt in a fast-paced consulting environment, including managing time effectively and handling multiple tasks simultaneously
    Preferred Skills
    • Experience with version control systems (Git) and agile development frameworks
    • Design and document end-to-end testing plans for Python-based applications
    • PySpark experience for large-scale distributed data processing
    • Experience with Datadog or similar observability and monitoring platforms
    • Familiarity with Dagster or other modern data orchestration frameworks
    • Terraform or infrastructure-as-code (IaC) experience for cloud resource provisioning
    • Database experience with databases such as AWS RDS, MySQL, or PostgreSQL
    • Familiarity with D3.js for building custom data visualizations
    Where You'll Work

    Moser Consulting has 2 local, Indianapolis, IN offices. You will be able to work a hybrid/onsite schedule, flexing your time between either office.

    Salary

    At Moser Consulting, we believe in pay transparency and fairness. The $85k-$125k salary range for this role is not just a number—it’s a reflection of the value we place on the skills and experience our employees bring to our team. We are committed to offering a competitive salary that aligns with the industry standards and the unique competencies you bring to our community.

    Benefits

    For over a quarter of a century, Moser Consulting has been a beacon for top-tier IT talent who excel in self-management. Our people are our greatest asset. We don’t just hire the best—we welcome them into our family, connect them with opportunities, and empower them to create innovative solutions to technology challenges.

    Our unique culture is our competitive edge. It fosters happiness, health, and low stress, even in an industry known for its demands. This is why we’re consistently recognized as one of the Best Places to Work in Indiana. We provide our employees with an inspiring workspace, a fun and collaborative atmosphere, and a generous compensation package. But that’s not all.

    We also offer a suite of benefits designed to support and enrich our employees’ lives. These include:

    • Training Opportunities: We believe in lifelong learning and provide numerous avenues for skill enhancement.
    • Fully Invested 401K Plan: We help secure your future with a fully invested 401K plan.
    • PPO and HDHP Medical Plans: Choose the health insurance program that best fits your needs.
    • Employer-Paid Dental and Vision Plans: We cover dental and vision plans, ensuring our employees have access to comprehensive health care.
    • Onsite Fitness Center: Stay fit and healthy with our state-of-the-art fitness center.
    • Wellness Program: We promote a healthy lifestyle with our wellness program.
    • Catered Lunches: Enjoy delicious catered lunches regularly.

    At Moser Consulting, we don’t just offer jobs—we offer careers, growth, and a chance to join a thriving community. Come, be a part of our family.

    Moser Consulting is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a professional.

    Demand for Data Engineer roles

    New Data Engineer postings at the employers we follow are up 14% over the last 6 weeks compared with the 6 before.

    Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 860, the most 1,353, and the latest week had 1,020.
    August 17Last week

    Each bar is one week of new postings. The darkest bars are the last 6 weeks.

    Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

    About the role

    We file this job under Data Engineer, by the work the posting describes.

    Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

    Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

    An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

    US government figures for database architects

    Median yearly pay, May 2025
    $139,500
    Expected change, 2025 to 2035
    9.4% more jobsagainst 3.5% for all jobs

    The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

    Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

    Source details

    View original posting ↗

    Source notes

    Source excerpts

    Selected passages from the saved posting. Check the full description for conditions and exceptions.

    Pay
    Salary At Moser Consulting, we believe in pay transparency and fairness. The $85k-$125k salary range for this role is not just a number—it’s a reflection of the value we place on the skills and experience our employees bring to our team. We are committed to offering a competitive salary that aligns with the industry standards and the unique competencies you bring to our community. Benefits
    Location & working pattern

    Indianapolis, IN

    Where You'll Work Moser Consulting has 2 local, Indianapolis, IN offices. You will be able to work a hybrid/onsite schedule, flexing your time between either office. Salary
    Work authorization

    No clear work-authorization passage found. Eligibility is unconfirmed.

    Find answers in the posting

    AI
    How answers work

    AI selects complete passages from this posting. Check them for conditions and exceptions.

    Uses this posting and your question. No profile needed.