Senior Data Engineer (Kafka Expert) Lisboa

Senior Data Engineer (Kafka Expert)
Lisboa
Lisboa, Lisboa, Portugal

Marionete

Marionete is an independently minded, entrepreneurial technology consultancy helping clients exploit tomorrow’s technology to find unexpected solutions to today’s business problems.

For more information visit us: www.marionete. co. uk

SKILLS

Must-Have Requirements

• Minimum of 5 years in Data Engineering.
• Speaks fluent English (written and verbal) for effective collaboration with stakeholders.
• Proven ability to communicate complex technical concepts to both technical and
  - technical audiences.
• Capable of providing technical guidance and mentoring to junior team members.
• Experience working in cross-functional teams, including data scientists, analysts, and Dev
  Ops engineers.
• Ability to influence and establish best practices in data engineering processes.
• Self-motivated with a growth mindset and an eagerness to stay updated on emerging technologies.

Apache Kafka Expertise:

Proven experience designing, developing, and managing Kafka-based data pipelines.

Good understanding of Kafka Streams, Connect, or the Confluent Kafka platform.

Data Engineering Skills:

Hands-on experience with ETL tools and data ingestion processes.

1. Strong SQL skills, with the ability to write optimized and scalable queries.
2. Or, Proficiency in at least one programming language (Python, Java, Scala, or. NET).

CI/CD:

Experience using CI/CD pipelines for development and deployment of data pipelines.

Proficiency in Git-based workflows and tools like Jenkins, Azure Dev
Ops, or Git
Lab CI/CD.

Nice-to-Have Skills

Azure Ecosystem:

• Knowledge of Azure services like Azure Data Factory, Azure Data Lake, or Azure Synapse.
• Understanding of Azure’s security and identity management practices (e. g. , IAM, RBAC).

Snowflake Data Warehouse Experience:

• Designing and optimizing Snowflake schemas for efficient querying.
• Implementing ETL/ELT pipelines to load and transform data in Snowflake.

Big Data Processing Frameworks:

• Familiarity with Apache Spark, Hadoop, or other distributed data processing frameworks.

Data Governance and Compliance:

• Understanding of data governance principles, security policies, and compliance standards (e. g. , GDPR, HIPAA).

Benefits

• Competitive compensation
• Permanent position
• Benefits package, including health insurance and mental health support
• Financial support for ongoing training
• There is a relaxed dress code at the Marionete offices
• An abundance of career paths and opportunities in which to advance
• A flexible and hybrid work environment
• Interview process: 3 interviews

Application

Marionete believes in providing equal employment opportunities to everyone. We do not practice and will not tolerate discrimination based on race, skin color, ethnicity, national origin, gender, sexual orientation, marital status, maternity, religion, age, disability, gender identity, results of genetic testing, or service in the military.

By applying to Marionete vacancies, you agree that your data and CV remain secure and confidential with your application. Marionete is a company in compliance with General Data Protection Regulation (GDPR).