Data Engineer - Lisboa

Data Engineer
Lisboa
Lisboa, Lisboa, Portugal

Inetum is a European leader in digital services. Inetum’s team of 28, 000 consultants and specialists strive every day to make a digital impact for businesses, public sector entities and society. Inetum’s solutions aim at contributing to its clients’ performance and innovation as well as the common good.

Present in 19 countries with a dense network of sites, Inetum partners with major software publishers to meet the challenges of digital transformation with proximity and flexibility.

Driven by its ambition for growth and scale, Inetum generated sales of 2. 5 billion euros in 2023

Responsibilities:

Distributed Data Processing: Develop and optimize distributed data pipelines using Apache Spark, ensuring efficient processing of large datasets
Caching & Computation Optimization: Implement advanced caching techniques and optimize distributed computation workflows to improve data retrieval times and resource utilization
Partition Key Join Optimization: Optimize partition keys joins to speed up query processing and enhance overall system performance in distributed environments
SQL Query Optimization: Optimize SQL queries for better performance and scalability, particularly in
- scale, distributed database systems
Cloudera Ecosystem: If applicable, leverage the Cloudera platform to manage and scale data workflows in big data ecosystems, ensuring reliability and efficiency.

Qualifications:

Expertise in Apache Spark and distributed computation techniques
Experience with advanced SQL optimization and caching strategies
Knowledge of the Cloudera ecosystem is a valuable asset for managing big data platforms
Ability to work independently and take initiative to solve technical problems.
Excellent communication skills to effectively collaborate with technical and
- technical teams.