Time since we first saw it
Day 172
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
Bangalore, India · Bangalore, Karnataka, India
Open 5 months, first seen by us 172 days agoEmployment type: Full-timeFrom the employer’s posting
Department: EngineeringFrom the employer’s posting
Design and deploy ETL pipelines, data warehousing, and data delivery systems
Set and execute the strategic vision for the data platform
Find and fix performance bottlenecks in large-scale data processing
Implement data governance frameworks for quality, security and compliance
Mentor data engineers and lead code and architecture reviews
Design, develop, and deploy comprehensive data solutions encompassing ETL pipelines, data warehousing, data architecture, data cataloguing, and data delivery mechanisms
Develop and execute the strategic vision for the data platform
Identify and address performance bottlenecks within the data platform
Implement and maintain data governance frameworks to ensure data quality, accuracy, consistency, and security
Provide technical leadership and mentorship to data engineers and other team members
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
Prior experience working with Databricks and AWS cloud services.
Strong proficiency in big data technologies, including Apache Spark/PySpark, Apache Airflow and Apache Kafka.
Experience with Agile development methodologies and leading Agile teams.
Experience with programming languages such as Scala and Python for developing robust data pipelines.
Experience in working with Distributed Graph Databases.
Requirements: - Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. - Over 5 years of software development experience, with at least 2 years in a technical leadership role overseeing data engineering or data platform teams.
Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 172
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
2 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Strong proficiency in big data technologies, including Apache Spark/PySpark, Apache Airflow and Apache Kafka. - Experience with programming languages such as Scala and Python for developing robust data pipelines. - In-depth knowledge of both relational and non-relational databases, with the ability to design and optimize complex queries.
Preferred: - Prior experience working with Databricks and AWS cloud services. - Experience with Agile development methodologies and leading Agile teams.
- Over 5 years of software development experience, with at least 2 years in a technical leadership role overseeing data engineering or data platform teams. - Strong proficiency in big data technologies, including Apache Spark/PySpark, Apache Airflow and Apache Kafka. - Experience with programming languages such as Scala and Python for developing robust data pipelines.
- Proficiency in developing and maintaining CI/CD pipelines using tools like Jenkins and GitHub Actions. - Experience with Infrastructure as Code (IaC) tools such as Pulumi and Terraform for managing cloud resources. - Strong experience in writing and maintaining unit, integration, and end-to-end tests to ensure data pipeline reliability and accuracy.
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
LG Ad Solutions is a global leader in connected TV (CTV) and cross-screen advertising. We pride ourselves on delivering state-of-the-art advertising solutions that integrate seamlessly with today's ever-evolving digital media landscape.
We are seeking a highly skilled and experienced developer to join our team in the role of Senior Software Engineer II – Data Engineering & Platform. This pivotal role focuses on providing technical vision and leadership for a major business component, managing end-to-end processes that operate at a high scale, processing several petabytes of data daily. The ideal candidate will have a robust background in data engineering, coupled with a proven track record in technical leadership. You will collaborate with cross-functional teams to drive technical innovation and deliver robust, scalable solutions that meet our business needs.
Architect and Implement Scalable Data Solutions: Design, develop, and deploy comprehensive data solutions encompassing ETL pipelines, data warehousing, data architecture, data cataloguing, and data delivery mechanisms. Ensure these solutions are scalable, reliable, and maintainable to support evolving business needs.
Lead Data Platform Strategy: Develop and execute the strategic vision for the data platform, ensuring alignment with organizational objectives. Oversee the architecture and management of data systems to support efficient data storage, processing, and utilization.
Collaborate Cross-Functionally: Work closely with product managers, engineering teams, data scientists, and other stakeholders to design and implement effective data integration and hand-off mechanisms. Facilitate seamless data flow and accessibility across various systems and teams.
Optimize Performance and Scalability: Identify and address performance bottlenecks within the data platform. Implement strategies to enhance system performance, scalability, and reliability, ensuring the infrastructure can handle large-scale data processing efficiently.
Oversee Data Governance and Quality: Implement and maintain data governance frameworks to ensure data quality, accuracy, consistency, and security. Establish policies and procedures for data management, ensuring compliance with regulatory requirements and industry best practices.
Mentor and Lead Engineering Teams: Provide technical leadership and mentorship to data engineers and other team members. Foster a culture of innovation, ownership, and continuous learning within the team, guiding them through complex technical challenges and project deliveries.
Conduct Code and Architecture Reviews: Lead code and architecture reviews to maintain high standards of code quality and system design. Provide constructive feedback and ensure adherence to best practices and organizational standards.
Stay Abreast of Industry Trends: Keep up-to-date with emerging technologies, tools, and methodologies in data engineering and platform development. Evaluate and recommend new solutions to enhance the data platform's capabilities and efficiency.
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
Over 5 years of software development experience, with at least 2 years in a technical leadership role overseeing data engineering or data platform teams.
Strong proficiency in big data technologies, including Apache Spark/PySpark, Apache Airflow and Apache Kafka.
Experience with programming languages such as Scala and Python for developing robust data pipelines.
In-depth knowledge of both relational and non-relational databases, with the ability to design and optimize complex queries.
Hands-on experience with data visualization tools and techniques to present data insights effectively.
Proficiency in developing and maintaining CI/CD pipelines using tools like Jenkins and GitHub Actions.
Experience with Infrastructure as Code (IaC) tools such as Pulumi and Terraform for managing cloud resources.
Strong experience in writing and maintaining unit, integration, and end-to-end tests to ensure data pipeline reliability and accuracy.
Excellent problem-solving abilities with a keen attention to detail, capable of diagnosing and resolving complex technical issues.
Strong communication skills, with the ability to convey complex technical concepts to diverse audiences.
Proven ability to collaborate cross-functionally with product managers, data scientists, and other engineering teams to deliver cohesive data solutions.
Familiarity with data governance and security practices to ensure compliance and data integrity.
Preferred:
Prior experience working with Databricks and AWS cloud services.
Experience with Agile development methodologies and leading Agile teams.
Experience in working with Distributed Graph Databases.
LG Ad Solutions provides equal work opportunities to all team members and applicants, and it prohibits discrimination and harassment of any type on the basis of race, color, ethnicity, caste, religion, age, sex (including pregnancy), national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by our policies or federal, state, or local laws.
We want to ensure that our hiring process is accessible. If you need reasonable accommodation for any part of the application process because of a medical condition or disability, please send an email to careers@lgads.tv to let us know the nature of your request.
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Bangalore, Karnataka, India
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.