Data Platform Engineer (AWS)

Data Platform Engineer (AWS)

emagine Polska

Remote

170 - 170 PLN / Stunde
B2B

Hexjobs Insights

Data Platform Engineer (AWS) needed to design cloud data lakehouse platforms. Requires 5+ years in data engineering, AWS experience. Fully remote, B2B, 170 PLN/h.

Schlüsselwörter

data engineering
cloud-based
data lakehouse
AWS
SQL
Python
stream processing
graph databases
Terraform
Airflow

Industry: automotiveRate: up to 170 pln/h net + VAT, B2BLocation: fully remoteWe are seeking an experienced Data Platform Engineer to design and implement a cloud-based data lakehouse platform ingesting engineering and security data, transforming it across medallion layers, and serving it to analytics dashboards and AI agents.Responsibilities:Design and build cloud-based data lakehouse architectures.Ingest and transform engineering and security data through multiple layers.Deliver production-grade data platforms to support analytics and AI functionality.Collaborate with data scientists and DevOps engineers to optimize data workflows.Explain technical trade-offs to non-technical stakeholders.Required Experience5+ years in data engineering2+ years building lakehouse architectures (Bronze/Silver/Gold or equivalent)Delivered production-grade data platformsExperience with graph databases (Neo4j, Amazon Neptune, TigerGraph)Hands-on with stream processing (Kafka, Flink, Spark Streaming, Kinesis)Core Technical SkillsCloud: AWS (S3/Blob, RDS/SQL DB, Managed Kafka, Serverless compute)SQL & Modeling: SQL, dimensional modeling, SCD2, normalization/denormalizationTransformations: dbt, Databricks SQL, Dataform, SQL/Python frameworksProgramming: Python, ScalaOrchestration: Airflow, Prefect, Dagster, Step Functions, Azure Data FactoryIaC: Terraform, CloudFormation, Pulumi, ARMNice to have:Search: OpenSearch, Elasticsearch, SolrGraph: Cypher, SPARQL, Gremlin, graph ETLData Quality: Great Expectations, dbt tests, custom validatorsReal-time: Flink, Spark Streaming, Lambda, Cloud FunctionsMonitoring: Grafana, Datadog, CloudWatch

Aufrufe: 8
Veröffentlichtvor 25 Tagen
Läuft abin etwa 2 Monaten
Art des VertragsB2B

Ähnliche Jobs, die für Sie von Interesse sein könnten

Basierend auf "Data Platform Engineer (AWS)"

Keine Angebote gefunden, versuchen Sie, Ihre Suchkriterien zu ändern.