← back to jobs
> job detail
A
👽Other

Senior Data Engineer I

American Express · Gurugram, HR, India
// classified as
Other (Adjacent or hard to classify.)
posted
1d ago
location
Gurugram, HR, India
languages
python, scala, shell
tools
hadoop, hive, kafka
> stack
pythonscalashellsqlhadoophivekafkaspark
> education
ms
> description

Joining the Enterprise Marketing team, this role will be focused on the delivery of innovative solutions to satisfy the needs of our business. As an agile team we work closely with our business partners to understand what they require, and we strive to continuously improve as a team.
We pride ourselves on a culture of kindness and positivity, and a continuous focus on supporting colleague development to help you achieve your career goals. We lead with integrity, and we emphasize work/life balance for all our teammates.

  • As a part of our team, you will be developing innovative, high quality, and robust operational engineering capabilities.
  • Develop software in our technology stack, which is constantly evolving but currently includes Big data, Spark, Python, Scala, GCP, Adobe Suit ( like Customer Journey Analytics).
  • Work with Business partners and stakeholders to understand functional requirements, architecture dependencies, and business capability roadmaps.
  • Create technical solution designs to meet business requirements.
  • Define best practices to be followed by team.
  • Taking your place as a core member of an Agile team driving the latest development practices Identify and drive reengineering opportunities, and opportunities for adopting new technologies and methods.
  • Suggest and recommend solution architecture to resolve business problems.
  • Perform peer code review and participate in technical discussions with the team on the best solutions possible.


As part of our diverse tech team, you can architect, code and ship software that makes us an essential part of our customers' digital lives. Here, you can work alongside talented engineers in an open, supportive, inclusive environment where your voice is valued, and you make your own decisions on what tech to use to solve challenging problems. American Express offers a range of opportunities to work with the latest technologies and encourages you to back the broader engineering community through open source. And because we understand the importance of keeping your skills fresh and relevant, we give you dedicated time to invest in your professional development. Find your place in technology of #TeamAmex.

 

Minimum Qualifications:

  • BS or MS degree in computer science, computer engineering, or other technical discipline, or equivalent work experience.
  • 8+ years of hands-on software development experience with Big Data & Analytics solutions – Hadoop Hive, Spark, Scala, Hive, Python, shell scripting, GCP Cloud Big query, Big Table, Airflow.
  • Working knowledge of AI/ML concepts with the ability to apply them in building data-driven solutions and enabling intelligent decision-making
  • Proficiency in SQL and database systems, with experience in designing and optimizing data models for performance and scalability.
  • Design and development experience with Kafka, Real time ETL pipeline, API is desirable.
  • Experience in designing, developing, and optimizing data pipelines for large-scale data processing, transformation, and analysis using Big Data and GCP technologies
  • Certifications in cloud platform (GCP Professional Data Engineer) is a plus.
  • Understanding of distributed (multi-tiered) systems, data structures, algorithms & Design Patterns.
  • Strong Object-Oriented Programming skills and design patterns.
  • Experience with CICD pipelines, Automated test frameworks, and source code management tools (XLR, Jenkins, Git, Maven).
  • Good knowledge and experience with configuration management tools like GitHub
  • Ability to analyze complex data engineering problems, propose effective solutions, and implement them effectively.
  • Looks proactively beyond the obvious for continuous improvement opportunities.
  • Communicates effectively with product and cross functional team.
  • Willingness to learn new technologies and leverage them to their optimal potential.
  • Understanding various SDLC methodologies, familiarity with Agile & scrum ceremonies

 

Apply at American Express →