Big Data Infrastructure Engineer - Linux & Cloudera

Descrição do cargo

We are looking for an experienced Linux Red Hat System Engineer to join a team responsible for the operation, support, and continuous improvement of a critical Cloudera/Hadoop infrastructure. This role offers the opportunity to work in a complex enterprise environment, combining Linux administration, automation, big data operations, and infrastructure engineering.

Location: Lisbon (Hybrid, 2 days/week onsite)

The Role

As part of the Infrastructure Operations team, you will be responsible for ensuring the availability, performance, security, and stability of Cloudera/Hadoop production environments. You will work closely with platform, data, network, storage, backup, security, and Wintel teams, supporting business-critical services and driving operational excellence through automation.

Key Responsibilities

- Operate, monitor, and support Cloudera/Hadoop-based production environments.

- Provide L3 support, troubleshooting, and performance tuning for Big Data platforms.

- Automate operational tasks using Python and Ansible, including monitoring, alerting, deployments, and configuration management.

- Ensure HDFS data integrity, replication, and capacity management.

- Develop and maintain monitoring and alerting solutions for platform services and infrastructure health.

- Apply patches, upgrades, and configuration changes to maintain security and platform stability.

- Manage Kerberos authentication, Ranger/Sentry authorizations, and TLS encryption.

- Collaborate with platform and data teams to onboard new workloads and optimize resource utilization.

- Work closely with stakeholders to deliver custom infrastructure requirements and improvements.

- Maintain technical documentation and contribute to knowledge-sharing initiatives.

Technical Skills

Mandatory

- Red Hat Linux System Administration and Operations

- Cloudera/Hadoop Infrastructure

- Python

- Ansible

- Linux Server Monitoring and Diagnostics (CPU, Memory, Storage)

- JVM and Middleware Troubleshooting

- HDFS Administration and Capacity Management

- Storage Management (SAN, NAS, RAID)

- Incident Management and Root Cause Analysis

Nice to Have

- Cloudera or other Big Data certifications

- Kafka

- NiFi

- Flume

- ITIL processes for Incident and Change Management

What We're Looking For

- Bachelor's Degree in Computer Science or equivalent.

- Minimum 5 years of experience in a similar role.

- Experience supporting mission-critical production environments.

- Strong troubleshooting and problem-solving skills.

- Ability to diagnose and resolve complex issues in Big Data ecosystems.

- Strong communication and stakeholder management skills.

- English level B2-C1.

#J-18808-Ljbffr