Time since we first saw it
Day 0
Early. Similar jobs usually come down between day 5 and day 54.
From 10,703 similar postings that came down. Coming down is not always a hire.
Work setup in the employer’s posting: TELECOMMUTEFrom the employer’s posting
Design, develop and optimize Python data pipelines for streaming market data with low latency
Integrate AWS services for ingestion, processing, storage and delivery of real-time and historical data
Provide L3 support for production incidents, including root cause analysis and fixes
Produce and maintain technical documentation for system understanding and knowledge transfer
Design, develop, and optimize Python-based data pipelines to process streaming market data with minimal latency
Integrate AWS cloud services to support ingestion, processing, storage, and delivery of real-time and historical data
Provide L3 support for production incidents, performing root cause analysis and implementing corrective actions
Produce and maintain comprehensive technical documentation to support system understanding and knowledge transfer
We are seeking a Senior Data Engineer to join an established secondary market ETF analytics platform with over 7 years of production history. The team ingests daily trading reports from multiple sources, including file providers, market data providers, spread data, and bookings, to produce analytics outputs. Built entirely on Python and AWS with a Data Lakehouse and data pipeline architecture, the project is transitioning toward a "run-org" model, requiring someone who can confidently pick up and evolve an existing codebase. Responsibilities Design, develop, and optimize Python-based data pipelines to process streaming market data with minimal latency Integrate AWS cloud services to support ingestion, processing, storage, and delivery of real-time and historical data Collaborate within a small agile team of 3 to 5 engineers, ensuring rapid decision-making and iterative development Participate in regular coordination meetings with client managers and internal development teams to align deliverables Produce and maintain comprehensive technical documentation to support system understanding and knowledge transfer Provide L3 support for production incidents, performing root cause analysis and implementing corrective actions Evaluate and adopt emerging technologies and methodologies to enhance pipeline performance and reliability Requirements 3+ years of experience in Data Software Engineering Proficiency in Python development within data engineering environments, emphasizing scalable and maintainable code Expertise in designing and implementing data lakehouse architectures and real-time streaming data pipelines Skills in integrating and managing AWS services, including S3, ECS, and EC2 Competency in working with Lambda, Step Functions, and EventBridge Familiarity with CloudWatch and DynamoDB for monitoring and NoSQL data management Capability to provide Level 3 production support for critical data engineering systems with strong troubleshooting abilities Understanding of financial or banking domain concepts, enabling effective collaboration with business stakeholders English proficiency at an Upper-Intermediate level (B2) or higher
Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 0
Early. Similar jobs usually come down between day 5 and day 54.
From 10,703 similar postings that came down. Coming down is not always a hire.
656 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordCheck the employer’s posting for the current role and application details.
Already applied? Track this application
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Poland
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.
We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting