Senior Data Engineer - EU

Description

Summary: Seeking a Senior Data Engineer to build scalable data pipelines, work with large datasets, and optimize data workflows in a cloud-based environment. Highlights: 1. Design, build, and maintain robust data pipelines (ETL/ELT) 2. Work with Databricks for large-scale data processing using Spark and Delta Lake 3. Collaborate with cross-functional teams to ensure efficient data processing At **TechBiz Global**, we are providing recruitment service to our TOP clients from our portfolio. We are currently looking for a Business Development Executive to join one of our **clients**' team. If you're looking for an exciting opportunity to grow in a innovative environment, this could be the perfect fit for you. We are looking for a skilled **Senior** **Data Engineer**. This role, you will be responsible for building scalable data pipelines, working with large datasets, and optimizing data workflows in a cloud\-based environment. You will collaborate closely with data and engineering teams to ensure efficient and reliable data processing. #### **Key Responsibilities** * Design, build, and maintain robust data pipelines (ETL/ELT) * Work with **Databricks** for large\-scale data processing using Spark and Delta Lake * Optimize data workflows, performance, and data storage solutions * Collaborate with cross\-functional teams including data analysts, engineers, and stakeholders * Ensure data quality, reliability, and scalability across systems * Contribute to continuous improvement of data architecture and processes * Strong experience with **Databricks** (Spark / Delta Lake) * Proficiency in **Python** for data processing * Strong knowledge of **SQL** * Hands\-on experience with ETL/ELT pipeline development * Experience with at least one cloud platform (**AWS, Azure, or GCP**) * Familiarity with **Git** and basic CI/CD practices ### **Nice to Have** * Experience with **dbt** * Knowledge of streaming technologies (e.g., Kafka or similar) * Experience with **Terraform** or Infrastructure as Code (IaC)