Hadoop / Spark Administrator
Absa
n/a - n/a
R450–480 per hour
Johannesburg, City of Johannesburg Metropolitan Municipality
Contract
Scripting
Security
Spark Administration
Linux
Starburst/Trino
Role
Overview Seeking an experienced Spark Administrator with strong Linux and Starburst/Trino skills to support large-scale data platforms in a regulated banking environment. Requires 5+ years of hands-on experience in big data infrastructure and system operations.
Key Responsibilities
• Install, configure, and maintain Apache Spark clusters.
• Monitor cluster performance and troubleshoot Spark jobs.
• Administer Linux servers and automate tasks using scripts (Bash/Python).
• Manage and optimize Starburst/Trino clusters and connectors.
• Ensure platform security, access control, and compliance with banking standards.
• Support data engineering and analytics teams with performance tuning.
• Maintain high availability for critical banking data pipelines.
Required Skills
• 5+ years in Spark administration and big data platforms.
• Strong Linux system administration (RHEL preferred).
• Hands-on Starburst/Trino experience.
• Knowledge of Hadoop ecosystem (HDFS, Hive, Ranger).
• Scripting abilities (Bash, Python).
• Understanding of authentication, networking, and security.
Preferred
• Cloud experience (AWS/Azure/GCP).
• Familiarity with banking data workflows and governance
Apply
Share