Data Engineer

The Data Engineer drives the development and maintenance of a Data Architecture that will be leveraged to consolidate data across systems and produce Data analytics.

Data Engineer

Data Management and Application Support

Guardian Group

JOB OBJECTIVE:

The Data Engineer drives the development and maintenance of a Data Architecture that will be leveraged to consolidate data across systems and produce Data analytics. He/ she is also responsible for expanding and optimizing the Group’s data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. This involves maintenance, improvement, cleaning, and manipulation of data in the business’s master data repository. He/ she also directs the changes, interfaces, user access controls, and operations for systems that house and impact Data Integrity. Additionally, the position will support the software developers and data scientists on data initiatives to ensure optimal data delivery architecture is consistent throughout ongoing projects and data operations.

MAJOR RESPONSIBILITIES:

1.   Data Management:
•   Maintain data architecture standards across all the business’s strategic databases.
•   Create and maintain optimal data pipeline architecture.
•   Assemble large, complex data sets that meet functional/non-functional business requirements
•   Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
•   Create relevant KPIs and Metrics for performance of operations.
•   Evaluate business processes, anticipating requirements, uncovering areas for improvement, and developing and implementing solutions.
•   Lead ongoing reviews of business processes and develop optimization strategies.
•   Keep abreast with the latest process and IT advancements to automate and modernize systems.
•   Perform ad-hoc analyses of data stored in the business’s databases and writes SQL scripts, stored procedures, functions, and views.
•   Identify and tag critical data sources (CDRs), data classification and security around the downstream usage of this data:
•   Data definition
•   Production
•   Usage 
•   Retention
•   Archiving
•   Disposal

2.   Maintenance of the Group Data Architecture and corresponding data standards:
•   Define and maintain a Target State Data Architecture and roadmap.
•   Govern the changes to the Data Architecture.
•   Vet and recommend requested changes and exceptions to Data Architecture to the Design Authority. 
•   Research and develop standard that support the Data Architecture. 
•   Establish a cadre of tools, systems, and vendors that can support the Data Architecture.

3.   Conduct Data integrity reviews on systems and downstream data consumption:
•   Analyse data errors to determine and address their root cause. 
•   Review systems changes, and projects implemented to ensure that they used appropriate Data sharing      and protection mechanisms. 
•   Implement and oversee systems and controls to Review and validate changes to sensitive and private    data.
•   Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.

4.   Provide solutions for Analytics, BI Reports, and Data sharing for projects:
•   Leverage existing controlled and common services for Exec/BI reports, analytics/machine learning. 
•   Review requirements, Enterprise Architecture, and constraints and develop feasible solutions/ options.
•   Develop new universal and standardized Interfaces and web services where necessary.
•   Design and implement Governance and control mechanisms and triggers to ensure solution integrity. 
•   Operationalize and handover to BU / Support staff.

5.   Set up and Govern trusted unified Data repositories and sources: 
•   Design and establish Master Data repositories where necessary
•   Implement and monitor the procedures, systems, and controls that are necessary to ensure these    systems remain current and accurate 
•   Oversee the creation of View, portals, Links, and Dashboards to the common repositories
•   Maintain a proper inventory of the sources and uses of the data in the common repository

6.   To perform any other job-related duties as assigned by the Manager.

EDUCATION:

•   5 CXC/ CSEC passes including Mathematics and English Language.
•   2 A’ Level/ CAPE passes.
•   First Degree in Information Technology, Computer Science or related field from a recognized tertiary educational institution

KNOWLEDGE AND EXPERIENCE:

•   A minimum of 5 years’ experience in a Data Operations or similar role.
•   Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
•   Experience building and optimizing data pipelines, architectures and data sets.
•   Experience with data preparation methods, including data profiling, data quality, data transformation
•   Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
•   Experience working with large and complex data sets as well as experience analyzing volumes of data
•   Experience working in internet technologies e.g. SaaS, IaaS and PaaS
•   Core member of at least two IT analytics projects.
•   Knowledge of Data Architecture, Data Science and Data Analytics

PERSONALITY:

The Data Engineer must be a logical, methodical and highly self- motivated individual. He/ she must be able to communicate effectively with internal and external stakeholders and colleagues. Emotional intelligence and Critical Thinking skills must be inherent. The incumbent must be able to plan effectively and remain calm in situations of uncertainty