Deloitte SW Engineer - Senior Spark Developer Experience

Description

Job Summary: We are seeking a professional to design, develop, and optimize distributed data processing and pipelines in cloud environments, collaborating on scalable solutions. Key Highlights: 1. Participate in the transformation of national and international organizations 2. High-impact projects with extensive scope and learning opportunities 3. Culture of feedback and continuous learning Can you envision yourself participating in the transformation of leading national and international organizations? At Deloitte, we are committed to generating impact on society, our clients, and you. Responsibilities Design, develop, and optimize distributed data processing workflows using Apache Spark. Implement and maintain data pipelines on AWS Glue and/or Amazon EMR. Collaborate with data architects and analysts to define scalable, high-performance solutions. Analyze and interpret Spark-generated QueryPlans and use SparkUI to identify patterns, bottlenecks, and optimization opportunities. Ensure code quality, testing, and technical documentation. Identify performance and cost optimization opportunities in cloud environments. Requirements Solid experience with Apache Spark (PySpark or Scala). Advanced knowledge of AWS Glue and/or Amazon EMR. Ability to analyze and optimize Spark executions, including QueryPlan interpretation and SparkUI usage. Experience developing ETL/ELT in distributed environments. Proficiency in Python and adherence to sound programming practices. Knowledge of complementary AWS services (S3, DynamoDB, Lambda, IAM, etc.). Experience working in agile and collaborative environments. Also Valued AWS certifications (Data Engineer or Solutions Architect, Associate or Professional level). Experience with microservices and event-driven architectures. Knowledge of pipeline orchestration tools (Step Functions, Airflow, or others). What Is It Like to Work at Deloitte? High-impact projects offering extensive career progression and learning opportunities **Hybrid-flexible workday:** Enjoy flexible working hours and a healthy balance between remote work and in-office collaboration—either at our offices or our clients’ locations **Positive atmosphere both inside and outside the office:** Enjoy several team-building events annually, cultural and sports activities… and much more! **Holistic wellbeing:** Take care of yourself through our physical, mental, and financial health program… and access on-site medical staff in our offices! **Social impact:** Join numerous national and international volunteer initiatives and pro-bono projects, dedicating your time and talent to those who need it most **Feedback culture and continuous learning:** Grow within an inclusive environment where equal opportunity and your personalized development plan will drive your growth. Can you already picture yourself at Deloitte University in Paris? **Exclusive benefits as a Deloitte member:** Access a wide catalog of benefits and a comprehensive flexible compensation plan **If this sounds appealing, here’s what to do next:** Apply to this role by clicking ‘Submit Application Now’ and completing your profile If your profile matches the role, our Talent team will contact you to learn more about you Start the process! We’ll guide you through each stage until your onboarding. Deloitte is a professional services firm firmly committed to equal opportunity. In this regard, the Firm accepts and processes applications from all sectors of society, without discrimination based on gender, gender expression, race, religion or beliefs, ethnic or national origin, disability, illness or health condition, genetic predisposition to disease, age, citizenship, marital status, sexual orientation or gender identity, socioeconomic status, or any other personal or social condition or circumstance. **Location:** Madrid **Position Type:** Experienced Professionals **Service Line:** T&T **Req Id:** 48690