AI/ML MLOps Engineer

Job Title: AI/ML MLOps Engineer – LLM Fine-Tuning & Deployment Experience: 5–8 Years Location: Hyderabad Employment Type: Full-Time, Hybrid We are looking for an experienced AI/ML MLOps Engineer with strong hands-on expertise in LLM fine-tuning, model deployment, AWS GPU infrastructure, and MLOps. The role involves fine-tuning and deploying self-hosted Large Language Models (LLMs), building training and evaluation pipelines, and implementing reliable production deployment and monitoring practices.The ideal candidate should have practical experience working across the complete ML lifecycle — data preparation, model fine-tuning, evaluation, deployment, monitoring, and continuous improvement. Key Responsibilities Fine-tune Large Language Models using Supervised Fine-Tuning (SFT) and Direct Preference Optimization (DPO). Develop and maintain training data pipelines, including data transformation, formatting, deduplication, filtering, and quality validation. Work extensively with the Hugging Face ecosystem, including Transformers, Datasets, and PEFT. Build and automate model evaluation and benchmarking frameworks to assess model quality and performance. Deploy and serve LLM models using AWS GPU/EC2 infrastructure and Amazon SageMaker. Optimize models for production through model quantization, inference optimization, and resource utilization. Build robust MLOps and ML CI/CD pipelines covering model training, evaluation, packaging, deployment, and monitoring. Implement A/B testing, Canary, and Shadow-mode deployments for safely introducing new model versions into production. Develop mechanisms for automated model promotion and rollback based on predefined performance and operational metrics. Implement production monitoring for model performance, latency, throughput, errors, GPU utilization, and resource consumption. Containerize ML workloads using Docker and deploy/manage them using Kubernetes/Amazon EKS. Collaborate with Data Scientists, ML Engineers, DevOps teams, and other stakeholders to build scalable and reliable AI/ML solutions. Requirements Strong programming experience in Python. Hands-on experience with LLM fine-tuning, particularly SFT and DPO. Strong knowledge of Hugging Face Transformers, Datasets, and PEFT. Experience working with AWS GPU/EC2 and SageMaker for ML workloads. Strong understanding of MLOps, ML CI/CD, and model lifecycle management. Experience with LLM model serving and production deployment. Experience building training data preparation and processing pipelines. Knowledge of model evaluation, benchmarking, and performance optimization. Hands-on experience with model quantization. Experience implementing A/B, Canary, and Shadow-mode deployments Benefits Comprehensive Medical Coverage: Health insurance of INR 7.0 Lakhs for you and your family (up to 6 members), ensuring complete peace of mind. Robust Protection Plans: Group Personal Accident Insurance and Group Term Life Insurance to safeguard you and your loved ones. Retirement Benefits: PF and Gratuity provided as per standard government regulations. Flexible Work Options: Enjoy hybrid work arrangements & flexible working hours Generous Leave Policy: 21 days of annual leave, in addition to 10 company-declared holidays. Employee Well-being Spaces: Access to a dedicated break-out area with round-the-clock refreshments for relaxation and rejuvenation.