Data Engineer (AWS)
We are seeking five skilled Data Engineers with expertise in
- native data pipeline development within AWS environments and Snowflake. We are looking for medior, senior, and lead profiles who will play a crucial role in designing and implementing
- performance data solutions that support our business objectives.
You will join our partner Scrum team of one of our products as part of the development team, collaborating with data analysts and internal teams to ensure the successful delivery and maintenance of the product in line with the sprint backlog.
Key Responsibilities
- Data Pipeline Development:
- Design and implement
- based data pipelines to transform raw data from various sources (e. g. , APIs, FTP, SFTP) into structured formats.
- Architect and deploy
- performance (batch and streaming) data pipelines with robust monitoring and alerting systems for data analysts and business users.
Data Management:
- Assemble and manage large, complex datasets that meet both functional and
- functional business requirements.
- Support data governance initiatives by cataloging and describing metadata.
- Implement functional and
- functional tests on data to ensure accuracy and reliability.
Data Modeling and Analysis:
- Perform data modeling and design appropriate database objects (views, tables, procedures, scripts).
- Analyze and optimize queries for performance and scalability.
- Collaboration and Production Support:
- Participate in troubleshooting, monitoring, and user support activities.
- Work closely with
- functional teams to gather requirements and implement solutions.
Continuous Improvement:
- Follow established architecture guidelines and continuously work on improving the scalability and performance of data products.
- Stay updated with the latest industry trends and technologies to enhance data engineering practices.
Qualifications & Skills
Mandatory Skills:
- University degree in Engineering, Computer Science, or a related discipline.
- Proven experience in data pipelining and related technologies on AWS (S3, ECS, Lambda, RDS, SNS/SQS, IAM, Cloud
Watch).
- Extensive experience with analytical database programming (SQL) and unstructured data/graph databases.
- Strong proficiency in writing complex SQL queries; knowledge of DBT core is a plus.
- Proficient in Python and
- related libraries (e. g. , Pandas, Boto3).
- Solid understanding of data platform architecture and data governance principles.
Preferred Skills (Nice to Have):
- Deep expertise in Snowflake development is a strong asset.
- Experience with CI/CD practices.
- Proficiency in orchestration tools (e. g. , Step Function, Airflow, Prefect).
- Experience with version control tools such as Git
Hub or Git
Lab.
- Familiarity with data visualization tools (e. g. , Tableau) is a plus.
- Knowledge of Infrastructure as Code (e. g. , Cloud
Formation, Terraform).
- AWS certification (e. g. , Solution Architect or equivalent) is preferred.
- Snowflake certification (e. g. , Snow
Pro Core) is preferred.
Soft Skills & Work Ethic
- Agile mindset: collaboration, mentorship, intellectual humility, and a strong desire to learn.
- Proven ability to deliver against deadlines with strong analytical and
- solving skills.
- Detail-oriented with a focus on quality and performance.
- Ability to work effectively in an Agile environment using tools like Jira.
- Excellent communication skills.
- Fluent in English; Portuguese and/or French is a plus.
- Team player with a proactive approach to challenges and continuous improvement.
- A
- rounded personality with a good sense of humor—we don’t compromise on these!
Why Join Us?
- Work on
- edge data solutions in a dynamic, collaborative environment.
- Be part of a team that values innovation, continuous learning, and professional growth.
- Competitive compensation and benefits package.
If you're passionate about data engineering and ready to take on exciting challenges, apply now and be a part of our growing team!
-
Informações detalhadas sobre a oferta de emprego
Empresa: Taleo Consulting Localização: Lisboa
Lisboa, Lisboa, PortugalPublicado: 19. 3. 2025
Vaga de emprego atual
Seja o primeiro a candidar-se à vaga de emprego oferecida!