Data Engineer
This job does not exist anymore.
Try running a new search or browse our vacancies.
Or fill in the form below to receive job alerts.
| Job Type | Contract |
| Area | Johannesburg, South AfricaGauteng, South Africa |
| Sector | IT - DevelopmentIT - Data |
| Salary | R500 – R700 Per Hour |
| Start Date | Approximately 1 month |
| Job Ref | VR/25918 |
- Description
Swan iT is searching for a Data Engineer to join a finance client on a 12-month contract.
Responsibilities:
- Data Pipeline Development:
- Design, build, and maintain scalable data pipelines using Ab Initio.
- Develop ETL processes to extract, transform, and load data from various sources.
- Data Integration and Management
- Integrate data from multiple sources to create a unified data environment.
- Ensure data quality and consistency across different systems.
- Performance Optimization
- Monitor and optimize the performance of data pipelines and ETL processes.
- Implement best practices for data storage and retrieval.
- Collaboration and Communication
- Work closely with data scientists, analysts, and other stakeholders to understand data needs and requirements.
- Collaborate with cross-functional teams to ensure seamless data integration.
- Troubleshooting and Support
- Identify and resolve data-related issues and discrepancies.
- Provide support for data-related queries and requests.
Requirements:
- Bachelor’s or Master’s degree (Computer Science, Engineering, Information Technology, or related.)
- Minimum of 5 years of experience in data engineering and ETL development.
- Proficiency in SQL and other database technologies.
- Experience with big data technologies such as Hadoop, Spark, and Hive.
- Experience with Ab Initio is beneficial but not required
- Familiarity with Data Modelling in Ab Initio will be beneficial
Apply today for more information.
- Data Pipeline Development: