Data Engineer

We are looking for a Data Engineer who's eager to embark on an exciting new opportunity!

We connect IT professionals with projects that match their skills, professional experience, and goals, then we offer a career progression program, delivered by in-house specialists - our People Experience Partners - to guide them through our journey with us.

The Challenge:

- Lead the transition of our current data workloads to Apache Iceberg, building and refining our core lakehouse infrastructure from the ground up.

- Engineer and deploy highly reliable batch and real-time streaming data pipelines using Spark and Flink.

- Work hand-in-hand with Backend Engineering to seamlessly integrate APIs and establish reliable, formal data contracts.

- Help design and implement a comprehensive data lineage and governance strategy using DataHub.

What you bring to the table:

- 3+ years of experience in Data Engineering;

- Strong, proven coding skills in Python and PySpark.

- Practical, hands-on experience with modern data lake formats like Iceberg, Hudi, or Delta Lake.

- A deep understanding of Apache Kafka and event-driven architecture.

- A proven track record of constructing and managing large-scale data pipelines.

- Advanced SQL capabilities paired with a solid foundation in data modeling techniques.

- Experience utilizing modern workflow schedulers such as Airflow, Dagster, or equivalent tools.

Do you meet most of the position requirements? Then grab this opportunity and apply now!

✨ What we offer

- A project that matches your skills and ambitions, as well as your preferences for working policies and culture.

- A competitive salary with awesome benefits and opportunities to leverage your knowledge and network to earn additional income.

- An empowering and respectful work culture enriched with social and learning events.

- A People Experience Partner specially assigned to you - your go-to career guide, responsible for supporting your growth, facilitating training, and ensuring your work-life balance at KWAN.

“At KWAN, they make sure that I feel comfortable with the client I’m working for and that what I’m doing aligns with my career aspirations.” - Luis Caldeira, DevOps @ KWAN

#J-18808-Ljbffr