Data Engineer
Abu Dhabi
- Pay
- Pay not listed
- Work setting
On-site — work setting source
Work setup in the employer’s posting: onsite
From the employer’s posting- Employment
Full-time — employment source
Employment type Full-time
Employment type in the employer’s posting: Full-time
From the employer’s posting
What you’ll work on
Full postingRapidly collect, curate and preprocess datasets to researcher specifications
Build and maintain web crawling solutions, APIs and automated workflows
Refine and evaluate LLM outputs into structured datasets
Implement scalable data pipelines for processing, storage and distribution
Document collection methods, dataset characteristics and pipeline architecture
From the employer’s posting
Rapidly collect, curate, and preprocess datasets based on detailed specifications provided by NLP researchers
Develop and maintain efficient web crawling solutions, APIs, and automated workflows
Refine and evaluate outputs from Large Language Models (LLMs) to generate structured datasets
Implement scalable data pipelines, ensuring efficient data processing, storage, retrieval, and distribution to research teams.
Document data collection methodologies, dataset characteristics, and pipeline architecture clearly and effectively.
Education & alternatives
Academic Qualifications - Bachelor's degree in Computer Science, Data Science, Engineering, or a related technical field required - Master’s degree or equivalent experience in Computer Science, Data Engineering, or related technical fields preferred.
- Bachelor's degree in Computer Science, Data Science, Engineering, or a related technical field required - Master’s degree or equivalent experience in Computer Science, Data Engineering, or related technical fields preferred. Professional Experience - Required
Tools in this posting
- Python
- SQL
- AWS
- Kafka
- Kubernetes
- Spark
Source — Tool mentions in context
The Role As a Data Engineer specializing in Natural Language Processing (NLP) and large-scale data processing, you will quickly and effectively gather, curate, and prepare high-quality datasets to support cutting-edge NLP research. Your role will be instrumental in enabling researchers by delivering essential data through efficient and scalable engineering practices, including web crawling, LLM-generated content refinement, and robust data pipelines, primarily leveraging Python and related technologies. Key Responsibilities
Professional Experience - Required - Extensive experience in data engineering, data processing, and automation using Python. - Demonstrated proficiency in designing and deploying web crawling solutions, automated data extraction, and processing pipelines.
- Demonstrated proficiency in designing and deploying web crawling solutions, automated data extraction, and processing pipelines. - Strong understanding of data structures, algorithms, databases, SQL, and performance optimization. - Experience working with cloud infrastructure and distributed data processing frameworks (e.g., AWS, Spark, Kafka, Kubernetes).
- Strong understanding of data structures, algorithms, databases, SQL, and performance optimization. - Experience working with cloud infrastructure and distributed data processing frameworks (e.g., AWS, Spark, Kafka, Kubernetes). - Excellent problem-solving abilities, attention to detail, and the capability to rapidly address technical challenges.
About Ifm-Us
We are a dedicated research lab for building, understanding, using, and risk-managing foundation models.
In the employer’s words · Read in context
Posting record
Report an errorOpen 6 monthsWe first saw this posting 200 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
- Status in our records
- Live
- First seen by us
- Apr 15, 2026 · 200 days ago
- Recorded sightings
- 131
- Last seen by us
- Nov 1, 2026
- Employer says posted
- Jun 17, 2025
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Your next step
- Have your resume and examples of relevant work ready.
- Check the listed location, eligibility and core experience before starting.
- Ask the employer about the pay range before committing time to the process.
Complete your application on jobs.lever.co. The employer’s form will show what is required.
Already applied? Track this application
Job description
About the Institute of Foundation Models
We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.
As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers.
The Role
As a Data Engineer specializing in Natural Language Processing (NLP) and large-scale data processing, you will quickly and effectively gather, curate, and prepare high-quality datasets to support cutting-edge NLP research. Your role will be instrumental in enabling researchers by delivering essential data through efficient and scalable engineering practices, including web crawling, LLM-generated content refinement, and robust data pipelines, primarily leveraging Python and related technologies.
Key Responsibilities
- Rapidly collect, curate, and preprocess datasets based on detailed specifications provided by NLP researchers, delivering data within tight timelines (typically within 1-2 days).
- Develop and maintain efficient web crawling solutions, APIs, and automated workflows to continuously improve data collection processes.
- Refine and evaluate outputs from Large Language Models (LLMs) to generate structured datasets suitable for model training and benchmarking.
- Implement scalable data pipelines, ensuring efficient data processing, storage, retrieval, and distribution to research teams.
- Collaborate closely with researchers and engineers to ensure collected data meets specified quality and relevance criteria.
- Document data collection methodologies, dataset characteristics, and pipeline architecture clearly and effectively.
- Engage with peer teams and participate in technical reviews to uphold best practices and data quality standards.
- Represent MBZUAI at industry and research forums, showcasing technical capabilities in large-scale data processing and AI data infrastructure.
- Perform all other duties as reasonably directed by the line manager commensurate with these functional objectives.
Academic Qualifications
- Bachelor's degree in Computer Science, Data Science, Engineering, or a related technical field required
- Master’s degree or equivalent experience in Computer Science, Data Engineering, or related technical fields preferred.
Professional Experience - Required
- Extensive experience in data engineering, data processing, and automation using Python.
- Demonstrated proficiency in designing and deploying web crawling solutions, automated data extraction, and processing pipelines.
- Strong understanding of data structures, algorithms, databases, SQL, and performance optimization.
- Experience working with cloud infrastructure and distributed data processing frameworks (e.g., AWS, Spark, Kafka, Kubernetes).
- Excellent problem-solving abilities, attention to detail, and the capability to rapidly address technical challenges.
- Strong communication and collaboration skills with cross-functional teams.
Professional Experience - Preferred
- Proven track record of supporting NLP or AI research teams with rapid and reliable data delivery.
- Experience with refining outputs from large-scale AI models, such as LLM-generated data.
- Contributions to open-source projects, coding competitions, or high visibility in coding communities (e.g., GitHub, Stack Overflow).
- Familiarity with the latest advancements in NLP data processing and large language model technologies.
Employment type
Full-time
Source details
Source notes
Source excerptsSelected passages from the saved posting. Check the full description for conditions and exceptions.
- Pay
No pay amount identified in the saved description.
- Location & working pattern
Abu Dhabi
Working pattern and location restrictions need checking in the full posting.
- Work authorization
No clear work-authorization passage found. Eligibility is unconfirmed.
See how this role fits your experience
Add your resume to compare the role’s scope, tools and requirements with your experience.