IM Practitioner: Data Engineering

Job Req ID

7044

Closing Date

31 January 2025

OME

CML: Information Management

Location

Sandton

Purpose of Job

The IM Analyst Data Engineering is responsible for ingestion of data from multiple sources by applying data extraction, transforming and load techniques. The responsibilities also include analysis, modeling and orchestration. The role i aimed at enabling the organizations with data to derive valuable business insights to improve decision-making and enables reporting and analysis. The individual will collaborate with data analysts and data platform team to design and build data engineering solutions for business enablement. Identify, source and make available key data required in the Analytics Ecosystem platform. Develop and implement an automated data orchestration through DeveOps processes to ensure reliable and readily available data. Create and publish data objects to enable development or data products and business views required for business intelligence and analytics. participate in embedding best practices within the organisation in terms of integration of a decision support database and the related software programs used to collect, cleanse, transform, and store data from a variety of operational and external sources.

Key Accountabilities

Data modelling, integration and products

Maintain and adapt Enterprise Data Schema Analyse Metadata and develop database structures Analyse and develop data solutions using standard development toolsDevelop new procedures and standards Appraise current Data Problems and devise solutions to resolve Lead various value adding architectural projects to improve the business value of Data through Data Analysis

Data Acquisition

Utilise techniques such as classification, regression, market basket, clustering to build and examine complex data models Review the model and algorithm used for anomaly detection Examine the deployment options and deploy the data models and test results Build and examine complex data models Coach others on data acquisition tools and techniques

Data Orchestration

Conduct continuous ETL impact analysis and to provide guidance in tuning and optimization of ETL jobs Ensure Data Conformance and Data Lineage Coach others on data orchestration Support teams when they have challenges with extracting, transforming or loading data

Data Security Standards

Explain the fundamentals of data security. Describe the organization’s expectations for data security, data privacy, and confidentiality.

Formal Education

University Bachelor's Degree

Min Experience

Typically, 3 Years Relevant Experience

Certification

Microsoft data engineering on Microsoft Azure

Tools and Technology Skillsets

Azure Data Engineering - ETL and automation of testing (Azure Data Factory,

Theobald SSIS and Logic Apps)

Data Architecture

Data Modelling and Design (eg. SAP PowerDesigner)

Data Warehousing (eg. Synapse SQL)

Azure Power Platform Engineering (Power BI)

Integration with PowerApps or K2 or SharePoint Online or SQL

DevOps

Agile

Required Personal and Professional Skills