Data Scientist / AI Models

Description

Job Description Data Scientist / AI Models Job Location: Madrid Location Flexibility: Primary Location Only Req Id: 11000 Posting Start Date: 8/7/26 **✔️What will be your responsibilities?** * Evaluate and compare LLMs (OpenAI, Anthropic, etc.) in terms of performance, latency, and costs. * Monitor AI model changes and deprecations and assess their impact on production environments. * Optimize prompting strategies based on the behavior and capabilities of each model. * Define and implement testing frameworks for GenAI solutions. * Execute regression testing, prompt testing, and output evaluation. * Design evaluation and monitoring pipelines for AI models. * Develop dashboards and visualizations for tracking and analyzing results. * Collaborate with IAOps/MLOps teams on observability, logging, and model governance. * Generate recommendations for model selection, cost optimization, and risk mitigation. * Participate in managing the AI model lifecycle and governance in production. * Work in coordination with local and international teams. **✔️What skills and experience do we require from you?** * **More than 2 years** of experience in similar roles. * University degree in Computer Engineering, Telecommunications, Mathematics, or other related STEM fields. * Solid experience with LLMs in production environments. * Experience in GenAI focused on auditing, evaluating, and monitoring. * Experience with AWS: Bedrock, SageMaker, Lambda, and CloudWatch. Knowledge of Prompt Engineering. * Experience with LLM evaluation frameworks such as RAGAS, DeepEval, or similar. * Experience in A/B testing and experimentation. Knowledge of AI solution observability and monitoring. * Understanding of AI governance and the AI model lifecycle. * Fluent level of Spanish and English. * Hybrid mode in Madrid. **\#Europe\_Priority** Relocation Supported: No Visa Sponsorship Approved: No