Time since we first saw it
Day 21
Similar jobs usually come down between day 6 and day 56.
At Eightfold, jobs usually come down by about day 68.
From 13,974 similar postings that came down, and 9 of Eightfold’s. Coming down is not always a hire.
Bengaluru, KA, IN; Bengaluru, KA, IN
Live, first seen by us 21 days agoEmployment type in the employer’s posting: FULL_TIMEFrom the employer’s posting
Design and maintain Apache Iceberg tables and their partitioning, compaction and snapshots
Deploy, operate and performance-tune open-source data warehouse clusters
Build robust batch and streaming ETL/ELT pipelines with data quality guarantees
Run KEDA-based event-driven autoscaling on Kubernetes for data workloads
Provision cloud and Kubernetes infrastructure as code with Terraform, Helm and GitOps
Design and maintain Apache Iceberg tables, including schema evolution, partitioning strategies, snapshot management, compaction, and metadata optimization.
Deploy, operate, and performance-tune open-source datawarehouse clusters, covering FE/BE sizing, materialized views, query profiling, caching, and resource isolation.
Develop robust batch and streaming pipelines with strong guarantees around data quality, idempotency, backfills, and observability.
Design and implement KEDA-based scaling for data workloads, triggered by queue depth, Kafka lag, or custom metrics
Provision and maintain cloud and Kubernetes infrastructure using tools like Terraform, Helm, and GitOps workflows (ArgoCD/Flux).
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 21
Similar jobs usually come down between day 6 and day 56.
At Eightfold, jobs usually come down by about day 68.
From 13,974 similar postings that came down, and 9 of Eightfold’s. Coming down is not always a hire.
3 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Today we run on Redshift and Databricks, and we’re migrating to StarRocks across 8+ regions distributed globally on AWS, Azure, and Oracle Cloud.
Experience operating production-grade, multi-region cloud platforms across AWS, Azure, or OCI, with a focus on scalability, reliability, performance, and cost efficiency.
Our platform is built from the ground up, operating at scale across Azure and AWS, deployed in multiple regions globally, including IL4-compliant environments for US Government, supporting users in 100+ countries and 30+ languages.
Experience operating and performance-tuning analytical query engines such as StarRocks, ClickHouse, Trino, or similar distributed data warehouses.
Define SLOs, build monitoring and alerting (Prometheus, Grafana, or similar), participate in on-call, and lead incident retrospectives.
Design and maintain Apache Iceberg tables, including schema evolution, partitioning strategies, snapshot management, compaction, and metadata optimization.
What We Need: 5+ years of experience designing, building, and operating large-scale data platforms, lakehouse architectures, and distributed analytical systems Hands-on expertise with Apache Iceberg / Hudi and Parquet, including partitioning, schema evolution, compaction, snapshot management, and storage optimization.
Design and implement KEDA-based scaling for data workloads, triggered by queue depth, Kafka lag, or custom metrics, so you balance cost against latency.
Run event-driven autoscaling on Kubernetes.
Provision and maintain cloud and Kubernetes infrastructure using tools like Terraform, Helm, and GitOps workflows (ArgoCD/Flux).
Proficiency in building reliable batch and streaming pipelines using Apache Spark and Flink, with strong fundamentals in data quality, idempotency, fault tolerance, and observability.
Complete your application on app.eightfold.ai. The employer’s form will show what is required.
Already applied? Track this application
New Data Engineer postings at the employers we follow are up 14% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Bengaluru, KA, IN; Bengaluru, KA, IN
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.