FULLREMOTE - Developer-Analyst (Big Data)

Description

* #### **Country:** Spain * #### **Province:** Community of Madrid * #### **Description:** At Capitole, we are expanding our team — and we want you to be part of it! We are seeking a Developer-Analyst (Big Data) to join a technology project where you will participate in the development, maintenance, and optimization of data processing solutions within a Client Contribution platform, working with Big Data technologies and Cloud environments. JOB RESPONSIBILITIES / FUNCTIONS: \- Design, develop, and maintain ETL and data transformation processes. \- Develop, implement, and optimize data pipelines using Apache Spark. \- Participate in data integration initiatives, ensuring platform quality, performance, and reliability. \- Analyze and resolve incidents related to data processing. \- Collaborate with functional and technical teams to analyze requirements and define efficient, scalable solutions. \- Work in Agile environments following best practices for continuous integration and DevOps. \- Actively contribute to the continuous improvement of Data Engineering solutions and processes. \- Explore the use of AI-assisted development tools to enhance automation and analytical processes. REQUIRED SKILLS: \- At least 3 years of experience in data-oriented development and programming. \- Experience with Apache Spark. \- Solid knowledge of SQL, including: \- ANSI SQL \- Hive SQL \- Spark SQL \- SQL in general \- Knowledge of Scala or equivalent experience with Python or Java. \- Experience working with Big Data environments such as: \- Azure Databricks \- Amazon EMR \- Cloudera \- Apache Hive \- Other Spark-based environments \- Experience working with DevOps tools and methodologies: \- Git \- GitHub \- Sonar \- Nexus \- Experience with reporting tools, especially Qlik Sense. \- Ability to analyze requirements and collaborate with the team in defining solutions. \- Teamwork capability. \- English level C1\. DESIRABLE REQUIREMENTS: \- Interest in or experience using AI-assisted development tools. \- Knowledge of AI-based automation and analytics. \- Experience in continuous improvement initiatives for Data Engineering processes. To help you get to know our entire family: \- Team-building events every two months. Don’t miss the summer party or the Christmas dinner! \- A football team sponsored by Capitole. \- Technology communities where you can share your knowledge and ideas with other teams. Sharing internal knowledge is essential!!! \- Last but not least — an outstanding team! Don’t know us yet? Discover us!! https://capitole\-consulting.com/ See what people say about us: https://www.glassdoor.es/Opiniones/Capitole\-Consulting\-Opiniones\-E2060890\.htm Feel free to send us your profile! The employee will adhere to information security policies: \- Will have access to confidential information related to Capitole and the project they work on. \- Must comply with security policies and internal policies of both the company and the client. \- Must sign an NDA.