Back to jobs

Senior Data Engineer – Capacity Planning & Forecasting

Pay
Pay not listedSimilar roles state $127K–$189K
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: FULL_TIME
From the employer’s posting

What you’ll work on

Full posting
  • Design and maintain ETL/ELT pipelines for cloud billing, telemetry and financial data

  • Build forecasting models for future compute demand and capacity needs

  • Calculate cost metrics such as cost per GPU hour and cost per million tokens

  • Find idle, underused and inefficient cloud capacity to cut costs

  • Build dashboards tracking capacity, utilization and projected demand

From the employer’s posting
Design, develop, and maintain scalable ETL/ELT data pipelines
Build forecasting models to predict future compute demand
Calculate key infrastructure cost metrics, including:
Identify cost optimization opportunities, including idle resources, underutilized infrastructure, and inefficient capacity commitments.
Develop dashboards and reporting solutions to track available capacity, committed capacity, utilization, and projected demand.

What you’ll bring

All qualifications

Core experience

  • Strong proficiency in SQL, including complex queries, joins, window functions, and query optimization.
  • Proficiency in Python for data processing, automation, and analytical workflows.
  • Experience with Pandas, PySpark, or similar data processing frameworks.
  • Hands-on experience building scalable ETL/ELT pipelines.
  • Strong understanding of data warehousing, data modeling, and distributed data processing.
  • Experience with Apache Spark, Airflow, Kafka, Trino, or similar technologies.

Preferred experience

  • Familiarity with GPU/TPU infrastructure and AI/ML workload consumption is desirable.
  • Experience in cloud infrastructure analytics or FinOps.
  • Understanding of machine learning inference workloads and compute economics.
  • Experience working with large-scale infrastructure telemetry datasets.
Qualification wording
Strong proficiency in SQL, including complex queries, joins, window functions, and query optimization.
Proficiency in Python for data processing, automation, and analytical workflows.
Experience with Pandas, PySpark, or similar data processing frameworks.
Hands-on experience building scalable ETL/ELT pipelines.
Strong understanding of data warehousing, data modeling, and distributed data processing.
Experience with Apache Spark, Airflow, Kafka, Trino, or similar technologies.
Familiarity with GPU/TPU infrastructure and AI/ML workload consumption is desirable.
Experience in cloud infrastructure analytics or FinOps.
Understanding of machine learning inference workloads and compute economics.
Experience working with large-scale infrastructure telemetry datasets.
Education & alternatives
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Statistics, Mathematics, or a related quantitative discipline. -
Apply at Virtasant

Posting record

Report an error

Actively hiringFirst seen by us 1 day ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 20, 20261 day ago
Recorded sightings
2
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$127K–$189K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 2,448 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 1

Early. Similar jobs usually come down between day 6 and day 56.

From 14,766 similar postings that came down. Coming down is not always a hire.

Virtasant is hiring

2 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • AWS
  • Azure
  • GCP
  • Kafka
  • Looker
  • Power BI
  • Spark
  • Tableau
  • Trino
  • Airflow
  • pandas
  • PySpark
Where the posting names them
- Proficiency in Python for data processing, automation, and analytical workflows. -
The candidate should demonstrate strong problem-solving skills, ownership, attention to detail, and the ability to collaborate across engineering and business teams. Core Competencies: Data Engineering | SQL | Python | Cloud Analytics | Capacity Planning | Demand Forecasting | Infrastructure Optimization | FinOps | Data Modeling | Business Analytics
- Strong proficiency in SQL, including complex queries, joins, window functions, and query optimization. -
- Analyze cloud infrastructure consumption and billing data across AWS, GCP, Azure, or other cloud platforms. -
- Experience working with AWS, Google Cloud Platform, or Microsoft Azure. -
- Experience with Apache Spark, Airflow, Kafka, Trino, or similar technologies. -
- Experience with Tableau, Power BI, Looker, or similar visualization tools. -
- Experience with Pandas, PySpark, or similar data processing frameworks. Data Engineering

Your next step

Complete your application on virtasant.teamtailor.com. The employer’s form will show what is required.

Applying through Teamtailor

  • No account needed.

Already applied? Track this application

Job description

View original posting ↗

Senior Data Engineer – Capacity Planning & Forecasting

Type: Remote | Brazil, Mexico, Chile, or Colombia
Coverage: Pacific Hours (8:00 AM – 5:00 PM PST)
Experience: 10+ years
Organization: Data Platform / Infrastructure Engineering

Job Description:

We are looking for an experienced Data Engineer to join our Data Platform organization, focusing on infrastructure capacity planning, forecasting, utilization analytics, and cost optimization.

The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and analytical data models that integrate infrastructure telemetry, cloud consumption, workload demand, and financial data.

This role will play a critical part in enabling data-driven infrastructure investment decisions by providing visibility into compute, GPU, TPU, storage, and cloud resource utilization, forecasting future capacity requirements, and identifying cost optimization opportunities.

The candidate will collaborate closely with Infrastructure Engineering, Data Science, Finance, Procurement, and Business Operations teams to build reliable data products that support strategic capacity planning.

Key Responsibilities:

Data Engineering & Pipeline Development:

Design, develop, and maintain scalable ETL/ELT data pipelines to ingest, process, and transform large volumes of infrastructure and cloud consumption data.

Integrate data from multiple sources, including cloud billing systems, infrastructure telemetry, workload management platforms, and financial systems.

Develop optimized data models and analytical datasets for infrastructure utilization, capacity tracking, and cost reporting.

Implement data validation, reconciliation, monitoring, and quality checks to ensure data accuracy and reliability.

Optimize data pipelines for performance, scalability, and operational efficiency.

Capacity Planning & Forecasting:

Develop data-driven solutions to monitor and forecast infrastructure capacity requirements.

Analyze historical and current utilization trends across GPU, TPU, CPU, memory, and storage resources.

Build forecasting models to predict future compute demand based on workload growth and business requirements.

Identify capacity constraints, resource bottlenecks, underutilization, and potential infrastructure risks.

Support capacity planning through demand forecasting, scenario analysis, and capacity optimization.

Develop dashboards and reporting solutions to track available capacity, committed capacity, utilization, and projected demand.

Cloud Cost & Infrastructure Analytics:

Analyze cloud infrastructure consumption and billing data across AWS, GCP, Azure, or other cloud platforms.

Develop cost attribution models to understand infrastructure spending across workloads, teams, and business units.

Calculate key infrastructure cost metrics, including:

Cost per GPU hour

Cost per CPU hour

Cost per workload/job

Cost per inference request

Cost per million tokens

Identify cost optimization opportunities, including idle resources, underutilized infrastructure, and inefficient capacity commitments.

Partner with Finance and Procurement teams to reconcile infrastructure costs and support financial planning.

Data Modeling & Analytics:

Design and maintain dimensional and analytical data models for infrastructure capacity and financial reporting.

Develop reusable datasets and metrics to support operational and strategic decision-making.

Perform root-cause analysis of utilization anomalies, cost fluctuations, and capacity deviations.

Build automated reports and dashboards to provide actionable insights to stakeholders.

Ensure consistency between operational telemetry, consumption records, and financial reporting.

Stakeholder Collaboration:

Work closely with Infrastructure Engineering teams to understand workload patterns, infrastructure architecture, and capacity requirements.

Collaborate with Finance and Procurement teams on infrastructure budgeting, cloud commitments, and cost forecasting.

Partner with Data Science and Machine Learning teams to understand AI/ML workload requirements and compute consumption patterns.

Translate complex technical and financial data into meaningful insights and recommendations for leadership.

Qualifications:

Required Technical Skills:

Programming & Data Processing

Strong proficiency in SQL, including complex queries, joins, window functions, and query optimization.

Proficiency in Python for data processing, automation, and analytical workflows.

Experience with Pandas, PySpark, or similar data processing frameworks.

Data Engineering

Hands-on experience building scalable ETL/ELT pipelines.

Strong understanding of data warehousing, data modeling, and distributed data processing.

Experience with Apache Spark, Airflow, Kafka, Trino, or similar technologies.

Knowledge of data quality frameworks, pipeline monitoring, and data governance.

Cloud & Infrastructure

Experience working with AWS, Google Cloud Platform, or Microsoft Azure.

Understanding of cloud billing, resource utilization, and consumption datasets.

Knowledge of compute, storage, networking, and infrastructure resource metrics.

Familiarity with GPU/TPU infrastructure and AI/ML workload consumption is desirable.

Capacity Planning & Forecasting

Understanding of capacity management, resource utilization, and demand forecasting.

Experience analyzing historical trends and predicting future resource requirements.

Knowledge of time-series forecasting, statistical modeling, and scenario analysis.

Ability to identify infrastructure bottlenecks and resource optimization opportunities.

Visualization & Reporting

Experience with Tableau, Power BI, Looker, or similar visualization tools.

Ability to develop operational dashboards and executive-level reporting.

Preferred Qualifications:

Experience in cloud infrastructure analytics or FinOps.

Exposure to GPU/TPU capacity planning and AI/ML infrastructure.

Understanding of machine learning inference workloads and compute economics.

Experience working with large-scale infrastructure telemetry datasets.

Knowledge of infrastructure cost allocation and unit economics.

Experience supporting financial forecasting, budgeting, or procurement decisions.

Key Performance Indicators (KPIs):

Data pipeline reliability and successful execution rates.

Accuracy and completeness of infrastructure utilization data.

Accuracy of capacity demand forecasts.

Visibility into infrastructure capacity and resource consumption.

Identification of cloud cost optimization opportunities.

Reduction in manual reporting and reconciliation efforts.

Timeliness and accuracy of capacity and financial reporting.

Educational Qualifications:

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Statistics, Mathematics, or a related quantitative discipline.

Equivalent practical experience in Data Engineering, Infrastructure Analytics, or Capacity Planning will also be considered.

Ideal Candidate Profile:

The ideal candidate is a technically strong Data Engineer with an analytical mindset and an understanding of infrastructure economics. They should be comfortable working with large-scale datasets, developing reliable data pipelines, analyzing resource utilization, and translating complex data into actionable capacity and cost optimization insights.

The candidate should demonstrate strong problem-solving skills, ownership, attention to detail, and the ability to collaborate across engineering and business teams.

Core Competencies: Data Engineering | SQL | Python | Cloud Analytics | Capacity Planning | Demand Forecasting | Infrastructure Optimization | FinOps | Data Modeling | Business Analytics

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Austin, Latin America, US

Senior Data Engineer – Capacity Planning & Forecasting Type: Remote | Brazil, Mexico, Chile, or Colombia Coverage: Pacific Hours (8:00 AM – 5:00 PM PST) Experience: 10+ years Organization: Data Platform / Infrastructure Engineering Job Description:
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.