GCP Data Engineer
Job Summary
We are seeking a skilled Data Engineer to join our team for an exciting project with our retail client. The candidate will possess strong expertise in Google Cloud Platform (GCP), SQL, and Python. A comprehensive understanding of ETL processes within cloud environments is essential for this role.
Responsibilities
- Design and implement data pipelines
- Optimize SQL queries
- Develop and maintain ETL processes
- Collaborate with cross-functional teams
Required Skills
- Google Cloud Platform (GCP)
- SQL and Python
- DBT and Terraform
- ETL process management
Job Details
Main Responsibilities:
- Designing and implementing robust data pipelines.
- Utilizing cloud services for efficient data processing and storage.
- Collaborating with cross-functional teams to gather requirements.
- Optimizing SQL queries for performance and scalability.
- Developing and maintaining ETL processes with industry-standard tools.
- Ensuring data integrity and security standards are met.
- Documenting technical specifications and workflows.
Key Requirements:
- Proficiency in GCP services (BigQuery, Cloud Run, Cloud Functions, etc.).
- Strong SQL skills.
- Expertise in Python programming.
- Experience with DBT and Terraform.
- Familiarity with at least one business intelligence (BI) tool.
- Basic understanding of Azure.
- Experience with Informatica or other ETL tools.