Data Platform Engineer (GCP, Data DevOps, Databricks)
Fixed Term Employment | Geek
Soft Consulting | Portugal
Posted On 18. 12. 2024
Job Information
Technology
Work Experience 5+ years
State/Province Viseu
City Ferreiros De Tendais
4690-236
Job Description
- Help design, build and continuously improve the clients online platform.
- Research, suggest and implement new technology solutions following best practices/standards.
- Take responsibility for the resiliency and availability of different products.
- Be a productive member of the team.
Requirements
- As a Cloud Data Engineer, you will work with modern data engineering and cloud technologies to design and implement scalable, secure, and governed infrastructure solutions.
- Designing and implementing data pipelines using Py
Spark and maintaining data governance. - Leveraging GCP services like Pub/Sub, Dataflow, and Databricks to build robust data solutions.
- Managing Kubernetes environments for scalable application deployment.
- Using Terraform for Ia
C to ensure reproducibility and security in infrastructure management. - Collaborating with
- functional teams to maintain seamless CI/CD processes and hybrid cloud setups. - This role requires a mix of cloud engineering expertise, programming skills, and a deep understanding of data systems.
- Strong understanding and
- on experience with GCP cloud computing, networking, and infrastructure. - Proficiency in planning, designing, and implementing secure,
- governed GCP infrastructures. - Experience with Google Cloud tools: Pub/Sub, Dataflow, Databricks, and Cloud Storage.
- Proficiency in Python, Py
Spark, and SQL. - Experience in designing and implementing data pipelines with Py
Spark. - Strong skills in maintaining data quality and governance.
- Hands-on experience with Infrastructure as Code (Ia
C) using Terraform. - Experience with CI/CD pipelines for data engineering workflows.
- Advanced knowledge of container orchestration and Kubernetes implementation.
Additional Information
- A challenging, innovative environment.
- Opportunities for learning where needed.
Seja o primeiro a candidar-se à vaga de emprego oferecida!
-
Porque procurar um emprego no Vagas.pt?
Todos os dias oferecemos novas vagas de emprego. Pode escolher entre uma vasta gama de empregos: O nosso objectivo é oferecer a escolha mais vasta possível Receba novas ofertas por e-mail Ser o primeiro a responder a novas ofertas de emprego Todas as ofertas de emprego num só lugar (de empregadores, agências e outros portais de emprego) Todos os serviços para quem procura emprego são gratuitos Vamos ajudá-lo a encontrar um novo emprego