Time since we first saw it
Day 8
Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
Bengaluru, Karnataka, IND
Actively hiring, first seen by us 8 days agoEmployment type in the employer’s posting: full-timeFrom the employer’s posting
Design and govern the canonical event schema for AI interactions across surfaces
Build and operate streaming and batch ingestion pipelines on AWS with production SLAs
Architect tenantized data products that give 50+ teams self-serve metrics
Set data engineering standards for schema governance, naming, and data quality
Mentor engineers and lead cross-team architecture initiatives
Design and govern the canonical event schema
Build and operate streaming and batch ingestion pipelines on AWS with production SLAs
Architect tenantized data products that enable 50+ teams to onboard once and receive self-serve metrics
Drive data engineering standards across the organization: schema governance, naming conventions, data quality, operational excellence.
Elevate the engineering team through mentorship and technical leadership.
If you've built large-scale data products on AWS that other teams depend on
Write exemplary, production-quality code in Java, Scala, and Python
Own the design, implementation, and evolution of large-scale data architecture on AWS (Kinesis, EMR, Spark, Glue, Redshift, Athena, S3, Lake Formation)
SQL proficiency is expected as a baseline.
Actively hiringFirst seen by us 8 days ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 8
Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
665 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Our culture is built on ownership and craft. We write production-grade code in Java, Scala, and Python. We design schemas that dozens of teams consume. We hold each other to high engineering standards through rigorous code and design reviews, and we invest in mentorship because raising the bar across the team matters more than any individual contribution. We're transparent about what we are: a lean team executing an ambitious transformation from reactive reporting into a production data product organization built entirely on AWS. If you want to work somewhere your architectural decisions directly shape how an organization operates, where you'll have real autonomy to drive outcomes, and where the problems are genuinely hard and unsolved, this is the team. Basic qualifications - 7+ years of data engineering experience - 5+ years of development/programming/scripting language (Python/Java/Bash/Perl) experience - Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2 - Experience with data modeling, warehousing and building ETL pipelines - Experience leading engineering teams as a mentor or tech lead, or experience leading the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems Preferred qualifications - Experience in any Bigdata architecture, or experience managing full application stacks from the OS up through custom applications and experience with automation and any version control tools - Experience in Kafka, or experience in any Bigdata architecture and experience in Redshift - Experience in data warehouse technical architectures, data modeling, infrastructure components, ETL/ ELT and reporting/analytic tools and environments, data structures and hands-on SQL coding
If you've built large-scale data products on AWS that other teams depend on, thrive in ambiguity, and want to define how an organization measures AI-driven commerce at scale, we'd love to talk. Key job responsibilities - Own the design, implementation, and evolution of large-scale data architecture on AWS (Kinesis, EMR, Spark, Glue, Redshift, Athena, S3, Lake Formation), providing system-wide technical guidance and ensuring all data products meet production-grade reliability, scalability, and security standards - Write exemplary, production-quality code in Java, Scala, and Python to build streaming and batch data pipelines that process terabytes of telemetry data daily across distributed systems, with proper testing, lineage documentation, and quality controls. SQL proficiency is expected as a baseline. - Design and maintain the canonical event schema and standardized, reusable data products following data mesh governance principles that eliminate metric inconsistencies and enable self-service analytics for 50+ domain teams - Build and operate ETL and ELT pipelines using AWS-native services (Glue, EMR, Step Functions, Lambda) and JVM-based frameworks (Spark on Scala/Java) that transform raw telemetry into trusted, AI-ready datasets with defined SLAs for freshness and completeness - Architect real-time observability infrastructure and analytical workloads (Kinesis, Redshift, Athena, QuickSight) that provide actionable insights on user engagement, operational health, risk detection, quality monitoring, and compliance tracking - Collaborate with and influence peer Software Development Engineers, Applied Scientists, Product Managers, and Business Intelligence Engineers to define requirements, validate data quality, and align data product design with business and technical strategy - Define and enforce data governance standards across the organization including schema governance, Fine-Grained Access Control, data classification, naming conventions, and lineage tracking across all data products - Identify systemic data quality issues and architecture deficiencies, drive root-cause resolution, and automate manual processes to improve operational efficiency and eliminate recurring failures - Document data products, architectural decisions, and design patterns clearly to ensure ease of use, extensibility, and maintainability by team members and downstream consumers across the organization - Lead cross-team initiatives to enable GenAI capabilities through Amazon Quick Suite, defining how AI surfaces consume governed data while maintaining robust security, access controls, and auditability at scale A day in the life Your primary focus is owning the data architecture that powers AI-driven commerce for millions of sellers. Most of your day is spent writing Java, Scala, and Python code: building Spark pipelines on EMR, designing streaming ingestion on Kinesis, and optimizing how terabytes of interaction data flow through AWS infrastructure into governed, queryable products.
Key job responsibilities - Own the design, implementation, and evolution of large-scale data architecture on AWS (Kinesis, EMR, Spark, Glue, Redshift, Athena, S3, Lake Formation), providing system-wide technical guidance and ensuring all data products meet production-grade reliability, scalability, and security standards - Write exemplary, production-quality code in Java, Scala, and Python to build streaming and batch data pipelines that process terabytes of telemetry data daily across distributed systems, with proper testing, lineage documentation, and quality controls. SQL proficiency is expected as a baseline. - Design and maintain the canonical event schema and standardized, reusable data products following data mesh governance principles that eliminate metric inconsistencies and enable self-service analytics for 50+ domain teams - Build and operate ETL and ELT pipelines using AWS-native services (Glue, EMR, Step Functions, Lambda) and JVM-based frameworks (Spark on Scala/Java) that transform raw telemetry into trusted, AI-ready datasets with defined SLAs for freshness and completeness - Architect real-time observability infrastructure and analytical workloads (Kinesis, Redshift, Athena, QuickSight) that provide actionable insights on user engagement, operational health, risk detection, quality monitoring, and compliance tracking - Collaborate with and influence peer Software Development Engineers, Applied Scientists, Product Managers, and Business Intelligence Engineers to define requirements, validate data quality, and align data product design with business and technical strategy - Define and enforce data governance standards across the organization including schema governance, Fine-Grained Access Control, data classification, naming conventions, and lineage tracking across all data products - Identify systemic data quality issues and architecture deficiencies, drive root-cause resolution, and automate manual processes to improve operational efficiency and eliminate recurring failures - Document data products, architectural decisions, and design patterns clearly to ensure ease of use, extensibility, and maintainability by team members and downstream consumers across the organization - Lead cross-team initiatives to enable GenAI capabilities through Amazon Quick Suite, defining how AI surfaces consume governed data while maintaining robust security, access controls, and auditability at scale A day in the life Your primary focus is owning the data architecture that powers AI-driven commerce for millions of sellers. Most of your day is spent writing Java, Scala, and Python code: building Spark pipelines on EMR, designing streaming ingestion on Kinesis, and optimizing how terabytes of interaction data flow through AWS infrastructure into governed, queryable products. You'll be based in Bengaluru, working alongside a team split between Bengaluru and Seattle. Your mornings give you uninterrupted build time while Seattle is offline. You use this window for deep architectural work: writing design documents, pushing complex pipeline code, and leaving detailed code review feedback so your Seattle teammates wake up unblocked. During overlap hours, you join focused design reviews and cross-team discussions where your job is to bring clarity, shape schema decisions, and drive alignment across engineering teams consuming your data products.
We're a team of software engineers, data engineers, and business intelligence engineers split between Bengaluru and Seattle. We operate like a startup inside Amazon: small enough that every person's work is visible and consequential, but connected to a business growing at 7x year-over-year that serves 50+ domain teams, thousands third-party developers, and millions of sellers. Our customers are internal: the engineering teams building AI agents, the risk and trust teams protecting the ecosystem, the product managers tracking adoption, and the scientists improving model quality. We build for all of them simultaneously through governed, tenantized data products rather than one-off reports. Our culture is built on ownership and craft. We write production-grade code in Java, Scala, and Python. We design schemas that dozens of teams consume. We hold each other to high engineering standards through rigorous code and design reviews, and we invest in mentorship because raising the bar across the team matters more than any individual contribution. We're transparent about what we are: a lean team executing an ambitious transformation from reactive reporting into a production data product organization built entirely on AWS. If you want to work somewhere your architectural decisions directly shape how an organization operates, where you'll have real autonomy to drive outcomes, and where the problems are genuinely hard and unsolved, this is the team. Basic qualifications - 7+ years of data engineering experience - 5+ years of development/programming/scripting language (Python/Java/Bash/Perl) experience - Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2 - Experience with data modeling, warehousing and building ETL pipelines - Experience leading engineering teams as a mentor or tech lead, or experience leading the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems Preferred qualifications
- 7+ years of data engineering experience - 5+ years of development/programming/scripting language (Python/Java/Bash/Perl) experience - Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2 - Experience with data modeling, warehousing and building ETL pipelines - Experience leading engineering teams as a mentor or tech lead, or experience leading the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems Preferred qualifications - Experience in any Bigdata architecture, or experience managing full application stacks from the OS up through custom applications and experience with automation and any version control tools - Experience in Kafka, or experience in any Bigdata architecture and experience in Redshift - Experience in data warehouse technical architectures, data modeling, infrastructure components, ETL/ ELT and reporting/analytic tools and environments, data structures and hands-on SQL coding Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Own the architecture of a data product that makes AI-powered commerce measurable, trustworthy, and improvable for millions of sellers worldwide. Join SP-AI Data Products as a founding technical leader who will define how an entire organization observes, governs, and learns from every AI-driven interaction at scale, built entirely on AWS large-scale data processing infrastructure. We're at an inflection point. AI agents are replacing traditional seller workflows, generating 7.5 million interactions annually across 50+ internal product teams, with thousands of Developers building on the ecosystem. Every one of these innovations creates a measurement obligation, and right now there's no unified infrastructure to fulfill it. You'll change that. You're joining a small team transforming from traditional reporting into a production data product organization, and this role determines what that product becomes. You'll design and build on AWS services including Kinesis for real-time streaming ingestion, EMR and Spark for large-scale distributed data processing, Glue for ETL orchestration, Redshift and Athena for analytical workloads, S3 and Lake Formation for governed storage, and Lambda and Step Functions for event-driven pipeline automation.
Own the architecture of a data product that makes AI-powered commerce measurable, trustworthy, and improvable for millions of sellers worldwide. Join SP-AI Data Products as a founding technical leader who will define how an entire organization observes, governs, and learns from every AI-driven interaction at scale, built entirely on AWS large-scale data processing infrastructure. We're at an inflection point. AI agents are replacing traditional seller workflows, generating 7.5 million interactions annually across 50+ internal product teams, with thousands of Developers building on the ecosystem. Every one of these innovations creates a measurement obligation, and right now there's no unified infrastructure to fulfill it. You'll change that. You're joining a small team transforming from traditional reporting into a production data product organization, and this role determines what that product becomes. You'll design and build on AWS services including Kinesis for real-time streaming ingestion, EMR and Spark for large-scale distributed data processing, Glue for ETL orchestration, Redshift and Athena for analytical workloads, S3 and Lake Formation for governed storage, and Lambda and Step Functions for event-driven pipeline automation. What you'll own:
What you'll own: - Design and govern the canonical event schema: the unified measurement format that makes every AI interaction across every surface produce a comparable, correlated record. You define what gets measured and how. - Own end-to-end data architecture across telemetry layers (user engagement, action execution, domain response), ensuring cross-layer correlation through session-level tracing - Build and operate streaming and batch ingestion pipelines on AWS with production SLAs, serving real-time observability for leadership, risk teams, applied scientists, and product teams simultaneously - Architect tenantized data products that enable 50+ teams to onboard once and receive self-serve metrics (adoption, quality, risk, impact) without building custom pipelines - Drive data engineering standards across the organization: schema governance, naming conventions, data quality, operational excellence. You set the bar others build to. - Make architectural trade-offs that balance short-term delivery against long-term scalability: tiered storage, build-vs-buy decisions, schema evolution across dozens of consumers - Identify and resolve systemic architecture deficiencies, proposing and leading cross-team initiatives that unblock innovation for adjacent teams - Decompose complex, ambiguous problems into parallel workstreams executable by you and others, then reassemble them into cohesive solutions - Elevate the engineering team through mentorship and technical leadership. Your presence makes the team stronger, but the team doesn't require your presence to succeed. Why you'll love this role:
Why you'll love this role: - Founding-team impact: You're defining the architecture an entire organization builds on, not inheriting legacy systems - Breadth of influence: Your schema decisions, quality standards, and architectural patterns are consumed by risk teams, scientists, product managers, and leadership across the business - Technical depth at scale: Streaming infrastructure, cross-surface correlation, schema governance for 50+ consumers, production SLAs on AWS. Hard, consequential engineering. - Career-defining scope: Cross-cutting schema design and multi-team domain onboarding at this scale is the kind of work that shapes what comes next If you've built large-scale data products on AWS that other teams depend on, thrive in ambiguity, and want to define how an organization measures AI-driven commerce at scale, we'd love to talk.
- Founding-team impact: You're defining the architecture an entire organization builds on, not inheriting legacy systems - Breadth of influence: Your schema decisions, quality standards, and architectural patterns are consumed by risk teams, scientists, product managers, and leadership across the business - Technical depth at scale: Streaming infrastructure, cross-surface correlation, schema governance for 50+ consumers, production SLAs on AWS. Hard, consequential engineering. - Career-defining scope: Cross-cutting schema design and multi-team domain onboarding at this scale is the kind of work that shapes what comes next If you've built large-scale data products on AWS that other teams depend on, thrive in ambiguity, and want to define how an organization measures AI-driven commerce at scale, we'd love to talk. Key job responsibilities - Own the design, implementation, and evolution of large-scale data architecture on AWS (Kinesis, EMR, Spark, Glue, Redshift, Athena, S3, Lake Formation), providing system-wide technical guidance and ensuring all data products meet production-grade reliability, scalability, and security standards - Write exemplary, production-quality code in Java, Scala, and Python to build streaming and batch data pipelines that process terabytes of telemetry data daily across distributed systems, with proper testing, lineage documentation, and quality controls. SQL proficiency is expected as a baseline. - Design and maintain the canonical event schema and standardized, reusable data products following data mesh governance principles that eliminate metric inconsistencies and enable self-service analytics for 50+ domain teams - Build and operate ETL and ELT pipelines using AWS-native services (Glue, EMR, Step Functions, Lambda) and JVM-based frameworks (Spark on Scala/Java) that transform raw telemetry into trusted, AI-ready datasets with defined SLAs for freshness and completeness - Architect real-time observability infrastructure and analytical workloads (Kinesis, Redshift, Athena, QuickSight) that provide actionable insights on user engagement, operational health, risk detection, quality monitoring, and compliance tracking - Collaborate with and influence peer Software Development Engineers, Applied Scientists, Product Managers, and Business Intelligence Engineers to define requirements, validate data quality, and align data product design with business and technical strategy - Define and enforce data governance standards across the organization including schema governance, Fine-Grained Access Control, data classification, naming conventions, and lineage tracking across all data products - Identify systemic data quality issues and architecture deficiencies, drive root-cause resolution, and automate manual processes to improve operational efficiency and eliminate recurring failures - Document data products, architectural decisions, and design patterns clearly to ensure ease of use, extensibility, and maintainability by team members and downstream consumers across the organization - Lead cross-team initiatives to enable GenAI capabilities through Amazon Quick Suite, defining how AI surfaces consume governed data while maintaining robust security, access controls, and auditability at scale
Complete your application on www.amazon.jobs. The employer’s form will show what is required.
Already applied? Track this application
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Bengaluru, Karnataka, IND
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.