Senior Data Engineer

  • Vendor / Contractor
  • Full time
  • Hybrid (Johannesburg, South Africa)

Senior Data Engineer

Company: PYGIO
Engagement: Contract
Duration: 5 months
Project: Data Platform & Reporting Transformation
Location: Remote

About the Role

PYGIO is looking for a Senior Data Engineer to join a data transformation project focused on building a future-state data platform and delivering a scalable MVP.

This is a highly technical role focused on modern cloud-based data engineering, data platform architecture, scalable pipelines and automation.

You will be responsible for designing and implementing the foundations of a modern data environment, while working closely with business, analytics and technical stakeholders to turn requirements into scalable, reusable solutions.

Key Responsibilities

  • Design and build the future-state data platform MVP.

  • Develop scalable data pipelines and transformation processes.

  • Implement automated data ingestion and integration patterns.

  • Design and maintain reusable data models.

  • Establish data engineering standards, patterns and best practices.

  • Implement automated testing, monitoring and data quality controls.

  • Support the migration from legacy reporting processes to the target architecture.

  • Build scalable and maintainable data solutions using modern cloud technologies.

  • Collaborate with business and analytics stakeholders to understand requirements and translate them into technical solutions.

  • Establish engineering foundations that can support future phases of the data platform.

  • Contribute to DataOps and CI/CD practices for analytics engineering.

  • Support the development of the Power BI reporting layer required for the MVP.

  • Maintain appropriate metadata and documentation across the data environment.

  • Transfer knowledge and best practices to client-side data and technical teams.

Required Skills & Experience

Must-have:

  • Strong commercial experience in Data Engineering.

  • Hands-on experience with Snowflake.

  • Strong experience with dbt.

  • Experience with AWS cloud services.

  • Experience with Fivetran or similar automated data ingestion/integration platforms.

  • Advanced SQL skills.

  • Strong knowledge of data modelling and modern data warehouse architecture.

  • Experience designing and implementing scalable data pipelines.

  • Experience with automated data quality, testing and validation.

  • Experience with CI/CD for Analytics Engineering.

  • Understanding and practical experience with DataOps practices.

  • Experience with metadata management.

  • Experience with Power BI and modern reporting environments.

  • Strong understanding of data platform scalability, automation and maintainability.

Key Deliverables

During the engagement, you will be responsible for delivering:

  • A future-state data platform MVP.

  • Snowflake-based data models and data pipelines.

  • Automated data ingestion and transformation processes.

  • Automated testing and data quality controls.

  • Monitoring and operational controls for data pipelines.

  • Reusable data engineering standards and patterns.

  • A Power BI reporting layer supporting MVP requirements.

  • Foundational architecture that can be extended in future phases.

  • Documentation and knowledge transfer to the client's technical team.

How You'll Work

You will work closely with both business and technical stakeholders in a highly delivery-focused environment.

The role requires an outcome-oriented mindset — focusing on delivering scalable, reliable solutions rather than simply completing individual activities.

You will also be expected to:

  • Take ownership of technical deliverables.

  • Communicate progress and potential risks clearly.

  • Collaborate effectively with analytics, engineering and business teams.

  • Transfer knowledge and contribute to the client's long-term technical capability.

  • Design solutions with future scalability and reusability in mind.

Success in the Role

Success will be reflected through:

  • Increased automation and reduced manual effort.

  • Reliable and scalable data pipelines.

  • Improved data quality and accuracy.

  • Successful delivery of the future-state MVP.

  • Reusable data models, engineering standards and patterns.

  • A solid architectural foundation for future platform development.

  • Readiness to expand the solution beyond the initial MVP.

Engagement Details

  • Contract duration: 5 months

  • Work model: Remote

  • Role type: Senior-level individual contributor

  • Focus: Cloud Data Engineering / Snowflake / dbt / AWS / Data Platform

|
|
Powered by Factorial
Build my own jobs page