python developer for big data

Описание: Inetum is a European leader in digital services, helping businesses, public sector entities, and society achieve digital transformation, performance, and innovation. The company operates across 19 countries and generated sales of 2.5 billion euros in 2023.

Задачи

Analyze and refactor existing code primarily developed by data engineers

Establish and maintain modular and clean development standards

Conduct code reviews and provide feedback to improve code quality and development practices

Write and execute unit, integration, performance, and regression tests

Ensure migration and compatibility with recent versions of Python 3 while managing existing code

Apply SOLID principles of object-oriented design

Work with Cloudera tools and environments to manage and optimize data

Apply distributed computing principles to optimize data processing and computation

Collaborate with data engineering teams to understand and improve existing data pipelines

Implement Continuous Integration using Jenkins, Jenkins files/Groovy, and SonarQube

Develop, deploy, and manage containerized applications using Docker

Apply deployment strategies using Virtuozzo Containers and Docker

Manage Jira API integrations for task and project management

Manage artifacts using Nexus Repository

Troubleshoot issues and optimize performance

Manage packages using PyPI and pip

Automate feeds for DEV, SIM, and UAT environments

Work in an Agile methodology, participating in daily stand-ups, sprint planning, and retrospectives

Требования

3+ Years of experience in Python development

Strong understanding of object-oriented and modular programming principles

Good knowledge of Python 3 and challenges associated with migrating from older versions

Deep understanding of SOLID principles of object-oriented design

Expertise in code refactoring and improving code quality

Proficiency in unit, integration, performance, and regression testing

Experience with distributed computing principles and optimizing data processing, such as Spark

Understanding of data modelling and creating data structures on Hadoop

Ability to work independently and take initiative to solve technical problems

Excellent communication skills for collaboration with technical and non-technical teams

Nice to have: experience with big data environments, particularly Cloudera

Условия

Office location: Lisbon, Portugal.

#J-18808-Ljbffr