Cloud Data Engineer Senior

Description

#### **Join the future of Paradigma!** We are looking for a **Senior Data Engineer** to participate in a Data-area project requiring experience in cloud-based data maintenance, optimization, integration, lifecycle management, and data quality. #### **What are we looking for?** We seek a Senior Data Engineer with experience in building data pipelines, and designing, developing, and optimizing complex cloud-based data solutions on AWS, Azure, and/or GCP.#### **Responsibilities** * **Design and implementation of data pipelines**: Create and structure processes for data ingestion, processing, and transformation. * **Data collection and storage**: Implement solutions for efficient capture and storage of data from diverse sources. * **Data cleaning and preprocessing**: Ensure data is clean and ready for analysis by applying cleaning and transformation techniques. * **Database optimization**: Tune databases to improve performance and scalability. * **Data integration**: Facilitate correct integration of data from disparate sources. * **Data systems maintenance**: Ensure continuous and efficient operation of data systems. * **Monitoring and tuning of data flows**: Monitor and adjust pipelines and data flows to maintain performance and reliability. * **Data quality**: Implement and maintain practices to ensure data accuracy, consistency, and reliability. * **Data lifecycle management**: Manage the data lifecycle from creation through eventual archiving and deletion. * **Orchestration of data pipelines**: Implement and manage workflow orchestration tools such as Apache Airflow, AWS Step Functions, or Google Cloud Composer to ensure pipeline automation and efficiency. * **Batch and/or streaming data ingestion**: Develop and implement batch and real-time data ingestion processes using tools such as Apache Kafka, Change Data Capture (CDC), and AWS Kinesis. #### **You must have experience in:** * Large-scale data projects as a Data Engineer * Cloud platforms * Python development * Apache Airflow * Kafka #### **Why Paradigma?** **Freedom with responsibility** We trust individuals to organize their work flexibly, promoting a healthy balance between personal and professional life—without losing sight of our goals and the impact of our work. You will have the option to work remotely or in a hybrid model. **A reference community** You will join an active, agile, and technology-driven community where knowledge sharing, learning from other experts, and contributing to industry best practices are central. **Support from day one** You will be assigned a Buddy who will assist with your onboarding, answer your questions, and help you feel part of Paradigma from the start. **Technical excellence as our hallmark** We are passionate about technology and committed to continuously developing our capabilities. Knowledge, quality, and constant improvement are embedded in our culture. We also support continuous learning and provide access to an annual training plan, official certifications, and dedicated learning spaces designed to accelerate your professional development. **Benefits** In addition to a close-knit and collaborative work environment, we offer 100% company-subsidized health insurance, flexible compensation via Edenred, 25 annual vacation days, and other benefits focused on employee wellbeing. Learn more about us here: **YouTube Paradigma Digital** **Our commitment to diversity and inclusion:** At Paradigma, equality is fundamental. We create an environment where everyone is welcome, regardless of gender, age, religion, sexual orientation, or any other condition. We actively work to ensure equal pay and equal opportunities. A disability certificate will be valued.#### **Who are we?** If you'd like to learn more about us, click the links below: Paradigma Digital Linkedin YouTube Our commitment to diversity and inclusion: *At Paradigma, equality is fundamental. We create an environment where everyone is welcome, regardless of gender, age, religion, sexual orientation, or any other condition. We actively work to ensure equal pay and equal opportunities.* *A disability certificate will be valued.*