Data Engineer Lisboa

Data Engineer
Lisboa
Lisboa, Portugal

On a daily basis, we assume commitments and present solutions to our stakeholders in order to create a structure of human values, based on professionalism, honesty and rigor.

With a management based on Human Centered Design, we take care of our professionals with consistent career plans, but flexible with their needs and expectations of evolution. Our management team guarantees an empathetic and present leadership that will provide superior technological engagement and delivery to our clients' projects and products.

Role

1. Design and implement scalable data pipelines using AWS services such as Glue, Lambda, Step Functions, and Kinesis.
2. Develop and optimize ETL workflows to process large datasets efficiently.
3. Build and maintain data lakes and data warehouses using S3, Redshift, Athena, and Lake Formation.
4. Ensure data integrity, governance, and security through proper IAM policies, encryption, and compliance frameworks.
5. Work with structured and unstructured data to enable analytics, AI/ML, and business intelligence use cases.
6. Optimize SQL and No
   SQL databases (Redshift, Dynamo
   DB, RDS, Open
   Search) for performance and cost efficiency.
7. Automate infrastructure deployment using Infrastructure as Code (Ia
   C) tools like Terraform or AWS Cloud
   Formation.
8. Implement
   - time and batch data processing using AWS Glue.
9. Collaborate with Data Scientists, AI/ML Engineers, and Dev
   Ops teams to support
   - driven applications.
10. Monitor and troubleshoot data pipelines with Cloud
    Watch, Datadog, or ELK Stack.

We are looking for

1. Strong experience as a Data Engineer with expertise in AWS cloud environments.
2. Proficiency in Python, SQL, and Spark for data processing and transformation.
3. Hands-on experience with AWS Glue, Redshift, Athena, EMR, S3, and Lambda.
4. Experience with ETL orchestration tools (Step Functions, Airflow, Prefect, Dagster).
5. Familiarity with containerization (Docker, Kubernetes, ECS) and CI/CD pipelines.
6. Understanding of data security, IAM policies, and encryption best practices.

What you can discover with us?

• Be part of a tech
  - up.
• Different scopes of project in different sectors.
• Structure of fairness and equity salary (Consultant Profile).