Data Engineer Big Data (Spark / Scala / Python) – Madrid

Description

Job Summary: We are seeking a Big Data Data Engineer with strong analytical skills and a results-oriented mindset to develop, maintain, and evolve large-scale data processing solutions. Key Highlights: 1. Participation in high-impact technological projects. 2. Collaborative and dynamic work environment. 3. Professional stability and growth opportunities. **Location:** Madrid (hybrid model) **Experience:** 2 \- 3 years **Start Date:** Immediate **Work Model:** Hybrid, with availability to attend the client's offices when required. Who Are We? At IT Partner Spain, we are looking for a **Big Data Data Engineer** with 2 to 3 years of experience to join a long-term project within a high-level technological environment, contributing to the development, maintenance, and evolution of large-scale data processing solutions. We seek a candidate with analytical capabilities, a results-driven approach, and hands-on experience in Big Data environments and data pipeline development. Responsibilities: * Development and maintenance of data processing and transformation workflows. * Implementation of Big Data solutions using Spark and Scala. * Design and optimization of queries across various query engines and databases. * Automation of processes via scripting and continuous integration tools. * Participation in deployments and version management. * Monitoring and orchestration of batch jobs and processes. * Collaboration with cross-functional teams under agile methodologies. * Creation and maintenance of technical documentation. Requirements Mandatory: * **2 to 3 years of experience** in similar roles. * Experience developing with: * **Spark** * **Scala** * **Python** * **Bash Scripting** * Knowledge of databases and query engines: * Oracle * PostgreSQL * Hive * Impala * MongoDB * Starburst * Experience with version control tools: * Git Bash * GitHub * Experience with continuous integration: * Maven * Jenkins or equivalent tools * Urban Code * Knowledge of process orchestration: * Control\-M * Job as Code * Proficiency with collaborative tools: * Jira * Confluence * Residence in Madrid or surrounding areas. * Availability to attend the client's offices punctually. Desirable: * Experience with **Databricks**. * Knowledge of **Cloudera**. * Prior experience in data analytics projects or the financial sector. * Knowledge of **Java**. What We Offer: * Participation in high-impact technological projects. * Collaborative and dynamic work environment. * Professional stability and growth opportunities. * Hybrid work model. * Continuous training and professional development. * Competitive compensation based on experience and expertise. If you are passionate about data and eager to grow further within Big Data environments, we would love to meet you. Location (Hybrid)