Deloitte SW Engineer - Senior Spark Developer Experience

Description

Job Summary: We are seeking a professional to design, develop, and optimize distributed data processing workflows using Apache Spark, implement data pipelines on AWS Glue/EMR, and collaborate on scalable solutions. Key Highlights: 1. Participate in the transformation of national and international organizations 2. Design, develop, and optimize data processing workflows with Apache Spark 3. Collaborate in defining scalable and high-performance solutions Can you envision yourself contributing to the transformation of leading national and international organizations? At Deloitte, we are committed to generating impact for society, our clients, and you. Responsibilities Design, develop, and optimize distributed data processing workflows with Apache Spark. Implement and maintain data pipelines on AWS Glue and/or Amazon EMR. Collaborate with data architects and analysts to define scalable and high-performance solutions. Analyze and interpret Spark-generated QueryPlans and use SparkUI to identify patterns, bottlenecks, and optimization opportunities. Ensure code quality, testing, and technical documentation. Identify performance and cost optimization opportunities in cloud environments. Requirements Solid experience with Apache Spark (PySpark or Scala). Advanced knowledge of AWS Glue and/or Amazon EMR. Ability to analyze and optimize Spark executions, including QueryPlan interpretation and SparkUI usage. Experience developing ETL/ELT workflows in distributed environments. Proficiency in Python and adherence to sound programming practices. Knowledge of complementary AWS services (S3, DynamoDB, Lambda, IAM, etc.). Experience working in agile and collaborative environments. Also Valued AWS certifications (Data Engineer or Solutions Architect, Associate or Professional level). Experience with microservices and event-driven architectures. Knowledge of pipeline orchestration tools (Step Functions, Airflow, or others). What Is It Like to Work at Deloitte? High-impact projects offering long-term growth and learning opportunities **Hybrid-flexible workday:** You’ll enjoy flexible working hours and a healthy balance between remote work and in-office or client-site teamwork **A positive atmosphere both inside and outside the office:** You’ll enjoy several team-building events per year, cultural and sports activities… and much more! **Holistic well-being:** Take care of yourself with our physical, mental, and financial health program… and with on-site medical staff in our offices! **Social impact:** You can participate in numerous national and international volunteering initiatives and pro-bono projects, dedicating your time and talent to those who need it most **Culture of feedback and continuous learning:** Grow within an inclusive environment where equal opportunity and your personalized training plan will drive your development. Can you already picture yourself at the Deloitte University in Paris? **Exclusive benefits as a Deloitte member:** Enjoy a wide catalog of benefits and a comprehensive flexible compensation plan **If this sounds appealing, here’s what to do next:** Apply to this position by clicking ‘Submit Application Now’ and completing your profile If you’re a strong match, our Talent team will contact you to learn more about you Start the process! We’ll guide you through each stage until your onboarding. Deloitte is a professional services firm firmly committed to equal opportunity. In this regard, the Firm accepts and processes applications from all sectors of society without discrimination based on sex, gender expression, race, religion or beliefs, ethnic or national origin, disability, illness or health condition, genetic predisposition to disease, age, citizenship, marital status, sexual orientation or gender identity, socioeconomic status, or any other personal or social condition or circumstance. **Location:** Barcelona **Position Type:** Experienced Professionals **Service Line:** T&T **Req Id:** 48689