Summary: Seeking a Python Developer with Databricks expertise for a critical project involving the migration of calculation logic into Databricks using Python, focusing on code adaptation, data processing, and security. Highlights: 1. Critical project migrating calculation logic to Databricks using Python 2. Focus on Python development, data processing, and cybersecurity principles 3. Collaborative role working with data engineers, analysts, and cloud architects * #### **Country:** España * #### **Province:** Comunidad de Madrid * #### **Description:** Capitole keeps growing and we want to do it with you! We are seeking a Python Developer with Databricks to work on a critical project involving the migration of calculation logic into Databricks using Python. This role requires expertise in Python development to adapt and extend existing Python code, experience with distributed data processing frameworks, knowledge of the Databricks environment, and close collaboration with a number of stakeholders. Experience in cybersecurity principles related to secure data handling and data protection in cloud environments is also needes. 1\. Code Adaptation and Development a) Refactor and adapt existing Python code to handle the new data schema and transformations. Part of the code is already available in Python, however it would need to be adjusted and/or extended (new data fields, new data sources…). b) Develop new modules to process, transform, and load data using PySpark or Python\-based frameworks. c) Implement data validation and error handling mechanisms. 2\. Databricks Platform Support (would be nice) a) Support in initial configuration of Databricks (including library installations and resource optimization). b) Integrate Databricks with cloud storage and data sources (on Azure and/or Databricks). c) Automation of Jobs in Databricks or Azure Data Factory. 3\. CI/CD, Testing and Quality Assurance a) Set up CI/CD pipelines for code and configuration deployment. b) Write and execute unit tests, integration tests, and performance tests for data pipelines. c) Debug and troubleshoot issues in a distributed environment. 4\. Data Security and Compliance a) Apply basic cybersecurity best practices to ensure secure data handling and protection within data pipelines and cloud environments. b) Collaborate with relevant teams to follow security and data governance guidelines when processing sensitive financial data. 5\. Collaboration and Documentation a) Work closely with data engineers, analysts, and cloud architects to ensure seamless integration and operation. b) Document code, workflows, and platform configurations for transparency and future reference. For this you will have: \- Budget of 1\.200€ in individual training for you to use it in whatever you want (technological events, books, trainings, certifications, etc.). \- Follow\-up with your team every month for continuous feedback. \- Teleworking. \- Flexible working hours to help you reconcile your professional / family life. \- Private medical insurance paid in full by Capitole. \- Flexible remuneration (restaurant tickets, transport and/or childcare). \- Andjoy (Gymforless). \- Discounts on major brands for employees (Club Capitole). Get to know the whole family: \- Team Buildings every two months \- don't miss the summer party or the Christmas dinner! \- Football team sponsored by Capitole. \- Technological communities for you to share your knowledge and ideas with the other teams, sharing internal knowledge is essential!!!! \- Last but not least, a TEAM! Don't you know us yet? Discover us!!! https://capitole\-consulting.com/ See what people are saying about us https://www.glassdoor.es/Opiniones/Capitole\-Consulting\-Opiniones\-E2060890\.html Don't hesitate to send us your profile, we are looking forward to meeting you! The employee will adhere to information security policies: \- Will have access to confidential information related to Capitole and the project they are working on. \- Must comply with the security policies and internal policies of the company and the client. \- Must sign an NDA.