Data Engineer

Description

Job Summary: We are seeking an experienced Data Engineer to design, develop, and maintain cloud-based data platforms and pipelines, focusing on robust and scalable solutions. Key Highlights: 1. Real opportunity for professional growth in Lakehouse architecture. 2. Enriching and collaborative work environment on meaningful projects. 3. Work with renowned clients across diverse industries. Business Insights is a custom software development company for enterprises. We are currently experiencing a growth phase and wish to bring onboard a **Data Engineer**. We believe in the importance of innovation and creativity when building high-quality, customized IT solutions for our clients. We are a diverse team of highly skilled and technology-passionate engineers who collaborate to solve complex challenges and continuously improve our capabilities. We would love for you to join our software development team, and we are confident your experience and skills will be a valuable asset to our company. We offer an enriching and collaborative work environment where you’ll have the opportunity to learn and grow as a software developer while working on interesting and impactful projects. Moreover, you’ll also have the opportunity to work with renowned clients across diverse industries—giving you broad exposure to software development and enhancing your ability to build innovative and effective solutions. **Context** At Business Insights, we are looking to hire a **Data Engineer** to help us develop, deploy, and maintain our cloud-based data platforms and pipelines—directly contributing to building robust and scalable solutions. While the role’s primary focus will be designing and maintaining ELT/ETL pipelines in Databricks, we offer a real opportunity for professional growth within a modern technical environment based on Lakehouse architecture. **What will your day-to-day look like?** * Design, development, and maintenance of cloud-based ELT/ETL pipelines. * Creation and optimization of jobs and workflows in Databricks. * Implementation of data models and medallion architecture. * Close collaboration with architects, data analysts, and data scientists. * Incident resolution, performance tuning, and continuous platform improvement. **What we’re looking for** * At least **4 years of experience** as a Data Engineer. * Proven experience building and maintaining cloud-based ELT/ETL pipelines. * Solid knowledge of **Azure**, especially: Azure Data Lake Storage and Azure Data Factory. * Experience with **Databricks**: Spark, Delta Lake, Unity Catalog, cluster and job optimization. * Knowledge of **medallion architecture**. * Strong **data modelling** skills. * Programming in **Python** (and/or PySpark) and excellent SQL proficiency. * Good understanding of software development best practices, version control, and CI/CD. * Nice-to-have: Scala, experience with other clouds (GCP/AWS), API-based ETLs, streaming, IaC, data governance. * Good English proficiency, attention to detail, quality mindset, and strong sense of ownership over pipelines. **What to expect when joining our team?** * Work in a stable, project-diverse environment that supports your professional growth. * Permanent contract. * Competitive salary. * Flexible working hours. * Hybrid model: 4 days remote, 1 day in-office in Barcelona. * And… enthusiasm to keep learning! **If this sounds good to you, apply to the job and let’s meet! Don’t wait any longer!**