python developer for big data

Описание: Inetum is a European leader in digital services, helping businesses, public sector entities, and society achieve digital transformation, performance, and innovation. The company operates across 19 countries and generated sales of 2.5 billion euros in 2023.

Задачи

- Analyze and refactor existing code primarily developed by data engineers

- Establish and maintain modular and clean development standards

- Conduct code reviews and provide feedback to improve code quality and development practices

- Write and execute unit, integration, performance, and regression tests

- Ensure migration and compatibility with recent versions of Python 3 while managing existing code

- Apply SOLID principles of object-oriented design

- Work with Cloudera tools and environments to manage and optimize data

- Apply distributed computing principles to optimize data processing and computation

- Collaborate with data engineering teams to understand and improve existing data pipelines

- Implement Continuous Integration using Jenkins, Jenkins files/Groovy, and SonarQube

- Develop, deploy, and manage containerized applications using Docker

- Apply deployment strategies using Virtuozzo Containers and Docker

- Manage Jira API integrations for task and project management

- Manage artifacts using Nexus Repository

- Troubleshoot issues and optimize performance

- Manage packages using PyPI and pip

- Automate feeds for DEV, SIM, and UAT environments

- Work in an Agile methodology, participating in daily stand-ups, sprint planning, and retrospectives

Требования

- 3+ Years of experience in Python development

- Strong understanding of object-oriented and modular programming principles

- Good knowledge of Python 3 and challenges associated with migrating from older versions

- Deep understanding of SOLID principles of object-oriented design

- Expertise in code refactoring and improving code quality

- Proficiency in unit, integration, performance, and regression testing

- Experience with distributed computing principles and optimizing data processing, such as Spark

- Understanding of data modelling and creating data structures on Hadoop

- Ability to work independently and take initiative to solve technical problems

- Excellent communication skills for collaboration with technical and non-technical teams

- Nice to have: experience with big data environments, particularly Cloudera

Условия

Office location: Lisbon, Portugal.

#J-18808-Ljbffr