Data Engineer, hybrid

Description

Job Summary: We are seeking Data Engineers to participate in the design and maintenance of pipelines, implementation of data ingestion, transformation, and loading processes, ensuring data quality and traceability. Key Highlights: 1. Participation in the design and maintenance of data pipelines. 2. Implementation of data ingestion, transformation, and loading processes. 3. Collaboration with data architects and BI and AI teams. Data Engineer At Arelance, we know that people are the most important asset within a company; therefore, we invest significant effort in identifying the best professionals for our clients and offering our candidates the best projects. We are currently seeking 2 Data Engineers with at least 2 years of professional experience to join an important project where you will perform tasks related to the design and maintenance of pipelines, implementation of data ingestion, transformation, and loading processes, ensuring data quality, consistency, and traceability. Additionally, you will collaborate with data architects and BI and AI teams, integrated into projects developed using agile methodology within the Defense sector in Barcelona. What are we looking for in you? * At least 2 years of experience as a Data Engineer. * Experience designing and maintaining robust, scalable data pipelines. * Experience with data ingestion, transformation, and loading (ETL) processes. * Knowledge of CI/CD pipeline deployments. * SQL databases and familiarity with NoSQL databases. * Proficiency in data-oriented programming languages such as Python, Scala, or Java. Experience with orchestration and data flow tools such as Airflow, NiFi, or Prefect. * University degree in Computer Engineering, Mathematics, Statistics, or related field; degrees specializing in databases or data analytics are highly valued. * English level B2\. * Big Data environment experience with technologies such as Spark, Hadoop, or Flink is desirable. * Familiarity with Data Lake and Data Warehouse architectures is desirable. * Knowledge of cloud data platforms such as Azure, AWS, or GCP is desirable. * Knowledge of Kafka, Docker, and Kubernetes is desirable. * Basic understanding of data governance and metadata is valuable. What do we offer in this position? * Permanent contract with Arelance. * Access to training. * Work modality: hybrid in Barcelona (60% remote). * Compensation package: based on experience and profile provided. If you are interested in this great opportunity, apply now! We want to meet you! Only candidates with valid work and residence permits in Spain will be considered. etl, ci/cd, sql, python, scala, java, airflow,