Time since we first saw it
Day 46
Similar jobs usually come down between day 6 and day 54.
At Dowjones, jobs usually come down by about day 29.
From 11,032 similar postings that came down, and 7 of Dowjones’s. Coming down is not always a hire.
Data Engineer
Bangalore
Live, first seen by us 46 days ago- Pay
- Pay not listed
- Work setting
- Not stated
- Employment
Full-time — employment source
Employment type in the employer’s posting: Full time
From the employer’s posting
What you’ll work on
Full postingDevelop, deploy and maintain scalable ETL/ELT pipelines in GCP
Tune BigQuery performance with partitioning, clustering and materialized views
Deploy pipeline code and infrastructure with Terraform and CircleCI
Add logging, alerting and data quality checks to pipelines
Help implement BigLake components for unified data governance
From the employer’s posting
Develop, deploy, and maintain scalable ETL/ELT pipelines in GCP
Implement and utilize BigQuery features like Partitioning, Clustering, and Materialized Views
Utilize Terraform and CircleCI for deploying and managing pipeline code and related infrastructure
Implement robust logging, alerting, and data quality checks within pipelines
Assist in the implementation of BigLake components to ensure structured and unstructured data is accessible with unified governance
Tools in this posting
- Python
- SQL
- BigQuery
- GCP
- Snowflake
- Terraform
- PySpark
Source — Tool mentions in context
Key Responsibilities The Data Engineer will primarily focus on the development, deployment, and operational maintenance of the data pipelines. ● Pipeline Development & Maintenance: Develop, deploy, and maintain scalable ETL/ELT pipelines in GCP using Cloud Composer and PySpark on Dataproc following established architectural patterns. ● Performance Optimization: Implement and utilize BigQuery features like Partitioning, Clustering, and Materialized Views to improve query performance and contribute to GCP cost management. ● Data Integration: Assist in the implementation of BigLake components to ensure structured and unstructured data is accessible with unified governance. ● Code & Infrastructure Deployment: Utilize Terraform and CircleCI for deploying and managing pipeline code and related infrastructure to ensure a modular and reproducible environment. ● Data Operations & Monitoring: Implement robust logging, alerting, and data quality checks within pipelines to actively monitor data flow and ensure data reliability. ● Collaboration: Work with senior engineers and cross-functional teams to understand business requirements and translate them into efficient data solutions. ● Skill Development: Proactively seek out and learn new GCP services and tools to enhance data processing capabilities. Skills & Competencies ● Experience: Mid Level - 2 - 4 years of hands-on Data Engineering experience. ● GCP Proficiency: Solid knowledge of GCP services with a focus on BigQuery, DataForm, Cloud Composer, Cloud Storage, Cloud functions and Dataproc. ● Transformation Tools: Proficiency in Dataform for managing version-controlled SQL workflows and modeling within BigQuery. ● Strong Coding: Excellent Python and SQL skills. You write modular code that is easy to test and maintain. ● Architectural Knowledge: Solid understanding of Data Modeling (Star Schema, Snowflake) and Data Operations. ● Automation Mindset: Experience with CI/CD tools and Infrastructure-as-Code is essential. ● Domain Knowledge: Experience in the News or Media industry is a strong plus. Equal Opportunity Employer
Posting record
Report an error- Status in our records
- Live
- First seen by us
- Sep 20, 202646 days ago
- Recorded sightings
- 30
- Last seen by us
- Nov 4, 2026
- Employer says posted
- Sep 17, 2026
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
How this job compares
Dowjones is hiring
2 open jobs
Open jobs by the week we first saw them, last 12 weeks.
- Takes jobs down at a usual pace
Your next step
Check the employer’s posting for the current role and application details.
Applying through Workday
- You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
- “Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
- Your application status lives in that employer’s Candidate Home, under the same sign-in.
Already applied? Track this application
Demand for Data Engineer roles
New Data Engineer postings at the employers we follow are up 8% over the last 5 weeks compared with the 5 before.
Each bar is one week of new postings. The darkest bars are the last 5 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
US government figures for database architects
- Median yearly pay, May 2025
- $139,500
- Expected change, 2025 to 2035
- 9.4% more jobsagainst 3.5% for all jobs
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Job description
Job Description :
Key Responsibilities
The Data Engineer will primarily focus on the development, deployment, and operational
maintenance of the data pipelines.
● Pipeline Development & Maintenance: Develop, deploy, and maintain scalable ETL/ELT
pipelines in GCP using Cloud Composer and PySpark on Dataproc following established
architectural patterns.
● Performance Optimization: Implement and utilize BigQuery features like Partitioning,
Clustering, and Materialized Views to improve query performance and contribute to GCP
cost management.
● Data Integration: Assist in the implementation of BigLake components to ensure
structured and unstructured data is accessible with unified governance.
● Code & Infrastructure Deployment: Utilize Terraform and CircleCI for deploying and
managing pipeline code and related infrastructure to ensure a modular and reproducible
environment.
● Data Operations & Monitoring: Implement robust logging, alerting, and data quality
checks within pipelines to actively monitor data flow and ensure data reliability.
● Collaboration: Work with senior engineers and cross-functional teams to understand
business requirements and translate them into efficient data solutions.
● Skill Development: Proactively seek out and learn new GCP services and tools to enhance
data processing capabilities.
Skills & Competencies
● Experience: Mid Level - 2 - 4 years of hands-on Data Engineering experience.
● GCP Proficiency: Solid knowledge of GCP services with a focus on BigQuery, DataForm,
Cloud Composer, Cloud Storage, Cloud functions and Dataproc.
● Transformation Tools: Proficiency in Dataform for managing version-controlled SQL
workflows and modeling within BigQuery.
● Strong Coding: Excellent Python and SQL skills. You write modular code that is easy to
test and maintain.
● Architectural Knowledge: Solid understanding of Data Modeling (Star Schema,
Snowflake) and Data Operations.
● Automation Mindset: Experience with CI/CD tools and Infrastructure-as-Code is essential.
● Domain Knowledge: Experience in the News or Media industry is a strong plus.
Equal Opportunity Employer
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status or any other protected characteristic.
Reasonable Accommodation
We are committed to providing reasonable accommodation for qualified individuals with disabilities in our job application and/or interview process. If you need assistance or accommodation in completing your application or participating in an interview due to a disability, email us at humanresources@newscorp.com. Please put "Reasonable Accommodation" in the subject line and provide a brief description of the type of assistance you need. This inbox will not be monitored for application status updates.
Please refer to the privacy notice at the bottom of this page for submitting any data access, deletion, or other data subject rights requests, where permitted under your local laws and regulations.
This job is posted with NTS Technology Services Pvt. Ltd.
Source details
Source notes
Source excerptsSelected passages from the saved posting. Check the full description for conditions and exceptions.
- Pay
No pay amount identified in the saved description.
- Location & working pattern
Bangalore
Working pattern and location restrictions need checking in the full posting.
- Work authorization
No clear work-authorization passage found. Eligibility is unconfirmed.
AI answers unavailable
We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting