Data Engineer
| Job Type | Permanent |
| Area | Western Cape, South AfricaCape Town, South Africa |
| Sector | IT - Data |
| Salary | R500 000 – R600 000 Per Annum |
| Start Date | Approximately 2 months |
| Job Ref | VR/26144 |
- Description
Are you a Data Engineer based in Cape Town looking for your next adventure? Look no further!
This position is with a leader in the investment industry and will be onsite in the Southern Suburbs of Cape Town. As the Data Engineer, you will be responsible for the team database architecture, data flow and data processes. A candidate with strong programming skills in Python and SQL are essential, alongside having experience managing and analysing large amounts of data.
Responsibilities:
- Design and develop scalable data pipelines and ETL (Extract, Transform, Load) processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.
- Implementing data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing and analysis
- Collaborating with quantitative and analysts to understand their data requirements and provide them with the necessary infrastructure and tools for data exploration, analysis, and visualization
- Ensuring data quality and consistency by implementing data validation, cleaning, and transformation procedures.
- Monitoring and maintaining the performance, availability, and security of data systems, including database servers, data warehouses, and data processing frameworks
- Troubleshooting and resolving data-related issues and performance bottlenecks in collaboration with the investment teams
- Evaluating and integrating new data technologies, tools, and frameworks to improve data infrastructure and processing capabilities
- Documenting data pipelines, workflows, and technical specifications to facilitate knowledge sharing and maintain system
- Keeping up-to-date with industry trends, best practices, and emerging technologies in the field of data engineering.
Requirements:
- At least 3 years of experience in database management, data analysis
- Previous experience producing ETL processes at scale
- Skilled in Python and SQL
- Prior experience setting up and running containerised (e.g. Docker) data applications is highly beneficial
- Post Graduate degree in any of the following: Computer Science, Information Systems, Mathematics, Statistics, Business Science, Actuarial
Apply today!