Senior Data Engineer

About The Weather Company:

The Weather Company is the world’s leading weather provider, helping people and businesses make more informed decisions and take action in the face of weather. Together with advanced technology and AI, The Weather Company’s high-volume weather data, insights, advertising, and media solutions across the open web help people, businesses, and brands around the world prepare for and harness the power of weather in a scalable, privacy-forward way. The world’s most accurate forecaster globally, the company reaches hundreds of enterprise clients and more than 360 million monthly active users via its digital properties from The Weather Channel (weather.com) and Weather Underground (wunderground.com).

AI is part of how we work:

Human judgment, expertise, and creativity remain essential and are amplified by AI. We expect everyone in this role to use AI thoughtfully and proactively to accelerate their performance, improve the quality of their work, and explore new possibilities. We are looking for people who are curious, adaptable, and excited to help shape an AI-enabled culture that delivers better outcomes for our customers and our company.

Job brief:

We’re seeking a Senior Data Engineer to design, build, and operate large-scale, data-intensive platforms in the cloud. In this role, you’ll be responsible for developing reliable data pipelines, scalable data processing systems, and high-availability architectures that support analytics, machine learning, and data science use cases.

You’ll work with modern big data technologies and AWS services, contribute hands-on code, lead smaller data initiatives, and mentor junior engineers. This is an ideal role for someone who thrives in complex data environments, values strong engineering fundamentals, and enjoys turning raw data into dependable, production-ready systems.

The impact you'll make:

• Designs and implements sophisticated software systems using either object-oriented or functional programming techniques implemented in Python, Scala or Java languages.
• Participate in, and adhere to, professional software engineering practices using such tools and methodologies as Agile Software Development, Test Driven Development, Continuous Integration, Source Code Management (git), Jira, and Stash
• Maintain an advanced level of proficiency with Computer Science/Software Engineering knowledge.
• Work well independently and as part of a team, mentoring junior engineers in routine, less-complex tasks, and leading small projects
• Other duties as assigned.

What you've accomplished:

• Bachelor's or Master's in a related field, or commensurate experience
• 5+ years in Computer Science, with a proven track record of successful projects.
• 5+ years of experience operating and deploying solutions using AWS Service including S3, EMR, SQS, SNS, Lambdas, Athena, Glue, Kinesis, and MSK.
• 5+ years of experience with one or more of the following programming languages: Python, Scala, or Java
• 5+ years of experience with SQL.
• 5+ years of experience with big data technologies such as Cassandra, Spark, Hadoop, Parquet, Redash, etc.
• Advanced proficiency in building data integrations using both API and file-based protocols.
• Advanced proficiency with test-driven development and unit testing.
• Experience with Git Version Control or similar
• Experience with CI/CD pipeline patterns and best practices
• Proficiency with alerting and monitoring tools like Grafana
• Demonstrated ability to learn new technologies and languages.
• Able to put together process documentation concisely and clearly.
• Excellent written and verbal communication skills.
• Able to work closely and effectively with peer developers and work on several active projects simultaneously, including leading small projects.
• Solid experience implementing high-availability, scalable cloud solutions
• Strong understanding of data structures and algorithms
• Solid knowledge of functional programming languages and techniques, and object-oriented programming languages and techniques
• Solid knowledge of concurrency and concurrent programming techniquess and distributed computing techniques
• Knowledge and understanding of operating with data in large scale, including Machine Learning and Data Science concepts