Senior Test Automation Engineer (Hybrid - Madrid)

Description

Summary: Seeking a Senior Test Automation Engineer to own and evolve test automation for an AI & MLOps platform powering RAG systems, LLM assistants, agentic workflows, and ML pipelines. Highlights: 1. Own and evolve test automation for AI & MLOps platform 2. Define automation architecture and build reusable frameworks 3. Create AI/ML-specific tests and manage regression suites 1 Opening Madrid ### **Role description** **We are still looking for the very Top Talent…and we would be delighted if you were to join our team!** More in details, UST is a multinational company based in North America, certified as a Top Employer and Great Place to Work company with over 35\.000 employees all over the world and presence in more than 35 countries. We are leaders on digital technology services, and we provide large\-scale technologic solutions to big companies. **What we look for?** We are looking for a **Senior Test Automation Engineer** to own and evolve the test automation solution for our AI \& MLOps platform powering RAG systems, LLM assistants, agentic workflows, and ML pipelines across the project of the client from the banking sector. High english level is required. **Availability to go to the client's offices in the centre of Madrid 3 days a week.** **Key Responsibilities:** * Define automation architecture aligned with the Bank’s Test Strategy/Policy * Build reusable frameworks/patterns for UI, API, data, BDD * Automate tests with Python (Playwright, pytest, requests, Behave/pytest\-bdd) * Create AI/ML\-specific tests (LLM evals, non\-determinism handling) * Implement contract tests (e.g., Pact) and integrate into GitLab CI/CD * Use Docker/Kubernetes for reproducible test environments * Manage regressions/smoke suites across DEV/INT/UAT/pre\-PROD * Reduce flakiness, report results, and ensure audit\-ready evidence \& traceability (Jira) **Mandatory requirements:** * 5–7\+ years in test automation, strong Python * Framework ownership (not only scripts) \+ CI/CD (GitLab preferred) * Playwright \+ pytest \+ API testing; BDD (Behave/pytest\-bdd) * Docker \+ basic Kubernetes; strong API/microservices understanding * Agile/SAFe experience; Jira \+ test management integration * English at least B2\+/C1 **Nice to have:** * AI/ML testing exposure (LLM/RAG/agents) * Regulated industry experience (banking preferred) * ISTQB Foundation; SAFe certs; German is a plus **¿What can we offer?** * 23 days of Annual Leave plus the 24th and 31st of December as discretionary days! * Numerous benefits (Heath Care Plan, Internet Connectivity, Life and Accident Insurances). * \`Retribución Flexible´ Program: (Meals, Kinder Garden, Transport, online English lessons, Heath Care Plan…) * Free access to several training platforms * Professional stability and career plans * UST also, compensates referrals from which you could benefit when you refer professionals. * The option to pick between 12 or 14 payments along the year. * Real Work Life Balance measures (flexibility, WFH or remote work policy, compacted hours during summertime…) * UST Club Platform discounts and gym Access discounts **If you would like to know more, do not hesitate to apply and we’ll get in touch to fill you in details. UST is waiting for you!** **In UST we are committed to equal opportunities in our selection processes and do not discriminate based on race, gender, disability, age, religion, sexual orientation or nationality. We have a special commitment to Disability \& Inclusion, so we are interested in hiring people with disability certificate.** **\#UST** ### **Skills** python,git testing,regulatory compliance,playwright, ### **About UST** UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future\-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.