Job Summary: We are seeking Agile-minded Data Engineers to transform Hadoop infrastructures into cutting-edge cloud environments, with a focus on continuous improvement and cross-functional teams. Key Highlights: 1. Transformation of Hadoop infrastructures to cutting-edge cloud environments 2. Participation in large-scale projects in the banking sector 3. Innovation with Gen AI and DevOps automation Data Engineer (Cloud Migration \& Big Data) We are looking for Data Engineers with solid technical expertise and an Agile mindset to join a large-scale project in the banking sector. You will participate in the transformation of Hadoop infrastructures toward cutting-edge cloud environments. **Required Profile:** We seek professionals with business acumen (preferably with experience in the banking sector), strong analytical capabilities, and a results-oriented approach. If you are passionate about continuous improvement and working in cross-functional teams, this is the right opportunity for you. **Role Details:** **Work Mode:** Hybrid (Madrid) — 1 day onsite / 4 days remote. **Key Requirement:** B2-level English (practical fluency for international environments). **Bonus:** Availability for occasional travel to Italy. **Your Key Challenges:** **Strategic Migration:** Migrate Hadoop infrastructure to Kubernetes Engine, COS, Spark, and Airflow as a Service. **Data Engineering:** Implement complex transformations and ensure data quality using Scala, SQL, and Spark. **DevOps Automation:** Configure CI/CD pipelines and advanced orchestration with Airflow. **Gen AI Innovation:** Design effective prompts to optimize the software development lifecycle (SDLC). **Required Technical Stack:** **Core:** Spark (Scala), Hadoop, HDFS, Apache Airflow. **Cloud Infrastructure:** Kubernetes, S3/COS, Parquet/ORC formats. **Databases:** Strong proficiency in SQL and NoSQL. **Tools:** CI/CD (GitLab, Jenkins), Shell Scripting, Oozie. **Valuable Additions:** Dremio, Elasticsearch, Kibana, Kafka (Streaming), and HashiCorp Vault. Spark, hadoop, apache, airflow, HDFS, kubernetes, SQL, noSQL, CI/CD, GitLab, Jenkins