São Carlos, SP, Brazil
Likely evergreen, first seen by us 1 day agoWork setup in the employer’s posting: RemoteFrom the employer’s posting
Employment type in the employer’s posting: Full-timeFrom the employer’s posting
Design, develop and maintain large-scale data pipelines using Spark and cloud-native tools
Optimize distributed processing workflows for performance, scalability and cost
Write clean, tested, well-documented code and review peers' code
Support deployments, monitoring, alerting and system reliability improvements
Guide peers and contribute to architecture discussions
Design, develop, and maintain large-scale data pipelines using Spark, and cloud-native technologies
Drive improvements in performance, cost efficiency, and scalability of data processing workloads.
Ensure software quality through clean, testable, and well-documented code, code reviews, and adherence to engineering standards.
Support release and operational processes, including deployments, monitoring, alerting, and continuous improvement of system reliability.
Provide technical guidance to peers, contributing to architecture discussions, code reviews, and promoting best engineering practices.
Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
Hands-on experience with cloud-native data platforms (AWS, GCP, or Azure), including services such as S3, Glue, Athena, or equivalent.
Solid experience in software or data engineering.
Expertise in building and optimizing large-scale data pipelines using Scala and Apache Spark.
Experience designing and operating highly parallelized data workloads.
Experience with functional programming (Scala) or languages such as Java, Python, or Rust.
What we expect from you - Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience. - Solid experience in software or data engineering.
Likely evergreenReposted 2 times since Aug 11, 2026. A role that keeps coming back is often kept open to collect applications rather than to fill one seat.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications. We count a repost when the same title and location comes back as a new listing within 60 days of the last one coming down. Some hiring systems expire listings on a schedule, so repost rates vary by system.
Day 1
Early. Similar jobs usually come down between day 6 and day 54.
At Experian, jobs usually come down by about day 9.
From 11,508 similar postings that came down, and 247 of Experian’s. Coming down is not always a hire.
24 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Expertise in building and optimizing large-scale data pipelines using Scala and Apache Spark. - Experience with functional programming (Scala) or languages such as Java, Python, or Rust. - Familiarity with modern data platform architectures and large-scale data ecosystems.
- Hands-on experience with cloud-native data platforms (AWS, GCP, or Azure), including services such as S3, Glue, Athena, or equivalent. - Expertise in building and optimizing large-scale data pipelines using Scala and Apache Spark. - Experience with functional programming (Scala) or languages such as Java, Python, or Rust.
Nice to have - Hands-on experience with cloud-native data platforms (AWS, GCP, or Azure), including services such as S3, Glue, Athena, or equivalent. - Expertise in building and optimizing large-scale data pipelines using Scala and Apache Spark.
Your key responsibilities - Design, develop, and maintain large-scale data pipelines using Spark, and cloud-native technologies, ensuring high performance, scalability, and reliability. - Solve complex data engineering challenges by designing efficient, resilient distributed systems and optimizing data processing workflows.
Complete your application on jobs.smartrecruiters.com. The employer’s form will show what is required.
Already applied? Track this application
Yes. We’ve followed one other Mid Data & Software Engineer job there since November 2026. It came down after 2 days.
New Data Engineer postings at the employers we follow are up 8% over the last 5 weeks compared with the 5 before.
Each bar is one week of new postings. The darkest bars are the last 5 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
We are looking for a Software Engineer to design, build, and evolve highly scalable and resilient data platform solutions that power Experian Marketing Services’ core products. In this role, you will work on large-scale, cloud-native data pipelines, optimize distributed processing systems, and ensure the reliability and performance of petabyte-scale workloads. You will operate within agile value stream teams, applying strong engineering practices and collaborating with global stakeholders to deliver high-quality, business-critical data solutions.
Your key responsibilities
What we expect from you
Nice to have
At Serasa Experian, we believe that diversity is essential for a healthier and more innovative work environment, where everyone can share experiences and express their ideas. That’s why we promote several initiatives to support inclusive recruitment and the professional development of our people.
We also have our affinity groups, created to empower and support individuals from underrepresented groups: ExperianPride (LGBTQIAPN+ community), Ubuntu (racial equity), Women in Experian (gender equity), Aspire (people with disabilities), and Connecting Generations (generations).
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Experian is a global data and technology company that powers opportunities for people and businesses around the world. We operate across a wide range of markets, including financial services, healthcare, automotive, agribusiness, insurance, among others. Experian invests in people and in advanced new technologies to unlock the power of data. We have an incredible team of 25,200 employees across 32 countries.
Our uniqueness is valuing yours. Experian’s people-centric, inclusive, and purpose-driven culture has been recognized with several awards — including World’s Best Workplaces™ 2025 (Fortune Global Top 25) and Great Place To Work™ in 26 countries, among others. Check out Experian Life on social media or explore our careers site to understand why. Experian is also proud to be an equal opportunity and affirmative action employer.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
São Carlos, SP, Brazil
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.