Senior Platform Engineer
Job Summary
The Senior Platform Engineer is responsible for designing, building, and operating scalable data platform capabilities within Microsoft Fabric. This role focuses on optimizing environments, managing data pipelines across the Medallion architecture, and enforcing infrastructure-as-code principles. The position requires strong expertise in Azure technologies, Python, and CI/CD implementation to deliver high-quality data solutions.
Responsibilities
- Design and manage scalable data pipelines using Microsoft Fabric and Azure
- Develop and deploy ETL/ELT workflows using Python, PySpark, and SQL
- Implement infrastructure-as-code and CI/CD for data platform artifacts
- Ensure data governance, security, and quality compliance
- Mentor junior engineers and promote technical best practices
Required Skills
- 5+ years of Data Engineering experience
- Expertise in Azure Data Factory, Synapse, and ADLS
- Advanced proficiency in Python, PySpark, and SQL
- Strong knowledge of Medallion architecture and DevOps/CI/CD
- Experience with Data Governance and Security
Job Details
Responsibilities:
- Participate in the design, development, and implementation of scalable data engineering solutions across the Medallion architecture (Bronze, Silver, Gold).
- Design and maintain efficient data pipelines and integration processes using Microsoft Fabric, Azure Data Factory and ADLS / Onelake.
- Develop, test, and deploy SQL, PySpark and pure-python ETL/ELT workflows ensuring data quality, consistency, and performance.
- Collaborate with data architects, data scientists, analysts, and business stakeholders to define data requirements and deliver high-quality solutions aligned with governance and modeling standards.
- Monitor, troubleshoot, and optimize data pipelines and architectures for scalability, reliability, and efficiency.
- Ensure compliance with data governance, security, and regulatory standards throughout the data lifecycle.
- Maintain clear technical documentation and promote reusable frameworks, automation, and best practices.
- Mentor junior engineers and foster a culture of technical excellence, collaboration, and continuous improvement.
Requirements:
- 5+ years of professional experience in data engineering with proven expertise in Azure technologies.
- Strong track record in designing, implementing, and managing complex data pipelines, ETL/ELT processes, and integration solutions.
- Advanced knowledge of data modeling, dimensional design, and data warehousing using SQL, NoSQL, and columnar databases.
- Hands-on experience with Azure Data Factory, Synapse, and Azure Data Lake Storage.
- Proficiency in Python and PySpark for scalable data processing.
- Expert-level SQL skills for complex transformations, optimization, and performance tuning.
- Familiarity with Agile and DevOps methodologies, including CI/CD implementation.
- Strong understanding of data governance, security best practices (RBAC, encryption, GDPR).
- Proficiency in English is essential.
Benefits:
- Direct contract (contrato sem termo).
- Health and life insurance.
- Meal allowance of 10,2 €/work day.
- Annual bonus up to 8%.
- Transportation allowance of 40€ / month.
- Pension plan.
- Hybrid work model (3 days on-site; 2 days remote / week).