
Data Engineer
emagine Polska
Status
Hexjobs Insights
Praca dla Data Engineera w Lisbonie, odpowiedzialność za architekturę i optymalizację pipeline'ów danych. Wymagana znajomość Spark, SQL, Python oraz doświadczenie w budowie ETL/ELT.
Schlüsselwörter
Introduction & Summary: We are seeking a Data Engineer who has experience building, optimizing, and maintaining data pipelines (ETL/ELT), as well as strong knowledge of technologies such as Spark, SQL, and Python. This role is fundamental to ensuring the reliability, security, and efficiency of data handling processes, with a focus on innovation and continuous system evolution.Main Responsibilities:The Data Engineer will be responsible for technical and data architecture;Building, optimizing, and maintaining data pipelines;Defining pipeline architecture and governance standards;Coordinating the technical deployment of pipelines;Ensuring technical execution, performance, and code reliability;Balancing technical and product vision, acting as a bridge between stakeholders;Implementing data tests and validations, handling errors and corrupted data;Automating and monitoring processes for continuous improvement;Evaluating and proposing new architectural approaches;Stimulating innovation and promoting new solutions.Key Requirements:Experience in building and maintaining data pipelines (ETL/ELT);Proficiency in Spark, SQL, and Python;Knowledge of Delta Lake and data architecture;Experience with Azure Fabric;Ability to implement tests and ensure data quality;Ability to define and follow security standards and access policies.Nice to Have:Experience with tools for data automation and monitoring.Knowledge of big data frameworks.Skills in data analysis and visualization.Experience in promoting Proof of Concepts (POCs) and the adoption of new technologies.Other Details: This is a hybrid working model job, long-term position.
Anmelden, um vollständige Details zu sehen
Erstellen Sie ein kostenloses Konto, um auf die vollständige Stellenbeschreibung zuzugreifen und sich zu bewerben.
| Veröffentlicht | vor 4 Tagen |
| Läuft ab | in etwa 2 Monaten |
| Art des Vertrags | B2B, Festanstellung |
Ähnliche Jobs, die für Sie von Interesse sein könnten
Basierend auf "Data Engineer"
Keine Angebote gefunden, versuchen Sie, Ihre Suchkriterien zu ändern.