Our client, an established company in the software industry, operates a modern, cloud-based data platform in an AWS environment. To strengthen the team, we are looking for an experienced Senior Data Platform Engineer who is passionate about managing, optimizing, and further developing complex big data architectures.



Your responsibilities: * Administration, monitoring, and optimization of a big data platform in the AWS Cloud * Management and maintenance of Cloudera On-Cloud PaaS services as well as AWS-native technologies such as Kafka, Flink, NiFi, Iceberg Tables, and DynamoDB * Deployment and automation of infrastructure in AWS using Terraform and ArgoCD * Execution of updates, upgrades, and incident management for all platform components * Advising data platform developers on selecting suitable services for business use cases * Taking over 3rd-level support, including monitoring, error analysis, and troubleshooting to ensure a highly available system (including 24/7 on-call duty) * Optimization of workloads, e.g.: ** Flink job memory management ** Impala and Trino query optimization * Evaluation and implementation of cloud-native services in accordance with the existing system architecture



Your profile: * Very good knowledge of Linux * Strong experience with Hadoop services such as HDFS, Zookeeper, Yarn, Impala, Spark, and Kafka * Experience with Terraform for infrastructure automation * Programming skills in Spark and Python * Practical experience with on-call duty and structured troubleshooting * Team-oriented working style and strong team spirit * Nice to have: ** Experience with Kubernetes ** Specific knowledge of Cloudera services such as HDFS, Zookeeper, Yarn, Impala, Hue, Spark, Kafka, Flink, Knox, Ranger RAZ, Streams Messaging Manager, NiFi, and Kudu ** Experience with rolling restarts in production environments



What you can look forward to: * Hybrid working model and flexible working hours * Individual training and development opportunities * Working with modern cloud and big data technologies * Meal allowance as well as free drinks and fruit * Health initiatives and company pension scheme * Team events and professional exchange in engineering communities * Good public transport connections and parking facilities * Support with any required relocation process



APPLY NOW

https://www.apsa.at/jobs/senior-data-platform-engineer-f-m-x/



Job ID 3560

Ansprechpartner/In Stefan Hilgner

E-Mail [email protected]

Telefon + 43 1 934 66 86 685





apsa all people shall advance

Neubaugasse 43/4, 1070 Vienna