Crush your SAP career goals.
Get the guidance, resources, and connections you need to secure your next role
Data Platform Operations Engineer - Databricks/Airflow
Stellenausschreibung
- England, United Kingdom Ort
- Negotiable Gehalt
- Data & Analytics Technologie
- Freiberuflich Art
- Remote Arbeitsplatz
Role:Data Platform Operations Engineer - Databricks/Airflow
Location :Remote EU
Duration: 6 months +
Start :ASAP
RESPONSIBILITIES / TASKS:
As a Data Engineer in Data Platform, you will be supporting 1000+ stakeholders focusing on data transformation and pipeline orchestration technologies. By constantly challenging the status quo, you will ensure stakeholder teams to deliver high-performance data processing solutions that are efficient and remain reliable at scale
Where your experience is needed:
* Automation of support activities (e.g cluster creations, configuration changes)
* Improving documentation to address user inquiries
* Prioritizing customer queries and escalating serious technical issues to 2nd level
* Operational Excellence
* Stakeholder support through chat and support tickets
* Troubleshooting user issues related to Databricks (Spark) / Airflow and suggesting optimizations for long running or resource intensive jobs
* Guiding users on best practices of Databricks and Airflow cluster management
* Consult and help our diverse teams to develop, implement and maintain sustainable, high-performance, growth-ready data-processing and data integration systems
* Having documentation focus to improve user journey
SKILLSET - Technical:
Mandatory:
* Basic understanding of distributed data processing frameworks like Apache Spark
* Understanding of relational database management systems
* Hands-on experience with Databricks
* Hands-on experience with Apache Airflow/Amazon Managed Workflows for Apache Airflow
* Hands-on experience with Python combined with SQL knowledge
* Hands-on experience in cloud technologies (AWS services like S3, EC2, IAM, Cloudformation)
* Hands-on experience in container/orchestration tools (Kubernetes, Docker, Podman)
* Engineering craftsmanship with an experience in software development processes focusing on testing, continuous integration/continuous delivery (CI/CD), monitoring and writing documentation
Nice to have:
* Knowledge on AWS Step Functions, Cloudwatch, Lambda
Must have skills:
* Amazon Web Services
* Apache Airflow
* Databricks
* Python
Reference
CR/111482_1699958283
You might also like…
Related Jobs
Registrieren Sie sich bei RED Global.
Registrieren
Wenn Sie sich bei RED Global registrieren, erhalten Sie personalisierte Benachrichtigungen zu Jobangeboten, bekommen sofortigen Zugang zu hunderten neuen SAP- und IT-Vakanzen und können sich schnell und einfach bewerben. Registrieren Sie sich noch heute und nutzen Sie die Vorteile, die RED Global für seine Kunden bereithält.
