Senior GCP & Python Data Engineer – Cloud Data Platform

Empower data-driven transformation — architect scalable cloud solutions that redefine financial services!

Lisbon-based opportunity with hybrid work model.

As a Senior GCP & Python Data Engineer, you will be working for our client, a major player within the financial sector supporting innovative data platform initiatives. The role involves designing and maintaining advanced cloud data pipelines, integrating AI/ML models, and collaborating in an agile environment to deliver cutting-edge data solutions that foster smarter decision-making and operational excellence.

Your main responsibilities:

- Design, build, and optimize end-to-end batch and streaming data pipelines (ELT/ETL) on GCP to handle large, diverse data sources.

- Develop scalable data models and schemas (star, snowflake, data lake, data warehouse) utilizing BigQuery, Cloud Storage, Dataflow, and DataProc.

- Write robust Python code for data transformations, automation, and quality checks, ensuring high-performance processing.

- Collaborate on deploying and operationalizing AI/ML models and integrating feature stores within cloud pipelines.

- Implement orchestration, scheduling, and workflow automation using Cloud Composer (Airflow) and Control-M.

- Embed testing, validation, and monitoring practices to maintain data quality, security, and compliance (GDPR, IAM, encryption).

- Contribute to technical documentation, data dictionaries, and runbooks in both French and English.

- Participate actively in agile ceremonies, code reviews, and cross-team collaboration with data engineers, scientists, analysts, and stakeholders.

You're ideal for this role if you have:

- Minimum 5 years of experience in data engineering or related fields.

- Strong hands-on experience with GCP services: BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, Cloud Composer.

- Proficiency in Python development, including design patterns, performance tuning, and testing.

- Deep knowledge of SQL and data modeling (relational and NoSQL).

- Excellent command of French (C1 minimum) and fluency in English.

- Experience with data governance, security, and privacy frameworks within cloud environments.

It is a strong plus if you have:

- GCP Professional Data Engineer certification.

- Experience deploying and monitoring AI/ML models using Vertex AI.

- Knowledge of enterprise orchestration tools such as Control-M.

- Familiarity with Spark/Databricks, Kafka streaming, and BI tools like Looker or Tableau.

- Experience in regulated financial or banking environments.

Language Required for the role:

- French (C1 minimum preferred)

- Fluent English

Eligibility for the role:

- Only candidates with an existing legal right to work in Europe will be considered for this role.

#MAKEYourCareerBETTER

Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.

Poderá encontrar o anúncio original publicado em: https://www.itjobs.pt/oferta/516464/senior-gcp-python-data-engineer-cloud-data-platform