Big Data Specialist

Job Summary

The Big Data Specialist operates, maintains, and protects the institutional Climate Data Management System while uncovering valuable trends and patterns within complex weather datasets. This role ensures secure data storage, executes system backups, and satisfies internal and external data requisitions. The specialist works collaboratively with data quality, database management, and IT teams to implement data mining enhancements, reporting directly to the Data Observations, Quality Control and Processing Division Manager.

Qualification

Candidates must hold an accredited degree in one of the following fields and meet the corresponding experience requirements:

• Bachelor's Degree in Data Science, Mathematical Sciences, Big Data, Machine Learning and Artificial Intelligence, or Computer Systems.
• Master's Degree in Data Sciences, Mathematical Sciences, Mathematical Science, Big Data, Machine Learning and Artificial Intelligence, or Computer Systems.

N.B. Regardless of degree level, candidates must possess a professional/technical certificate OR at least one (1) year of relevant working experience in cluster computing resources, climate database management systems, climate modeling, Linux/Unix servers, and Python programming languages.

Experience

• For Bachelor's Degree holders: Minimum of 3 years of relevant experience.
• For Master's Degree holders: Minimum of 1 year of relevant experience.
  • Exception: 0 years of relevant experience is required if the candidate holds a Master's Degree in Mathematical Sciences.

Core Duties and Responsibilities

Data Operations & Infrastructure Management:

• Gather, accumulate, clean, and organize all weather and climate data from various national sources into an acceptable database format.
• Register data reports in appropriate logbooks and digital templates following QMS and WMO guidelines.
• Ensure adequate database storage, systematic station report archiving, and secure accessibility.
• Create new data definitions for new databases and document all architectural alterations made to existing systems.
• Write targeted SQL queries to ensure precise database extraction by station names, data types, and periods.
• Monitor the performance of the data mining system and resolve any emerging operational bugs.

Analytics & Business Intelligence:

• Process and analyze complex datasets using statistical techniques, graphs, charts, and tables to extract valuable insights.
• Track, identify, and interpret long-term trends and correlational patterns in complex data sets.
• Present data findings clearly in official reports to aid executive decision-making and day-to-day business operations.
• Identify new data sources, evaluate reporting periods, and innovate new methodologies to upgrade data mining and analysis architectures.

Team Collaboration & Requisitions:

• Fulfill internal and external data requests completely and efficiently.
• Coordinate closely with management to prioritize institutional information and business needs.
• Collaborate with the Data Quality Specialist to develop innovative, customized analytical tools.
• Maintain tight cross-functional alignment with both the Data Management team and IT team to hit institutional targets.

Skills & Competencies

Technical & Professional Competencies:

• Ability to operate a large-scale meteorological data handling system.
• Expertise in running scripts, utilizing programming languages, and manipulating cluster computers.
• Solid grasp of data servers, dataset skills, and data management systems.
• Strong knowledge of quality control methods, meteorological observation techniques, and standard programming environments.
• Capacity to deliver weather and climate data processing guidance based on international criteria (including WMO guidelines, QMS ISO 9001:2015, and regional/national standard operating procedures).
• Professional fluency in Kinyarwanda, English, and/or French (multilingual proficiency is an added advantage).

Behavioural & Psychometric Profiles:

• Integrity, accountability, professionalism, and inclusiveness.
• Client/citizen focus, teamwork, and commitment to continuous learning.
• Digital literacy, resource management, performance management, and results orientation.
• Advanced critical thinking, problem-solving, and decision-making skills.

Core Psychometric Testing Domains:

• Problem solving (Competence / Skills)
• Decision making (Competence / Skills)
• Analytical skills (Competence / Skills)
• Processing speed (Behavior and attitude)
• Attention and concentration (Behavior and attitude)
• Coordination (Behavior and attitude)
• Language Assessment: Conducted in English.

Examination Structure & Timeline

The institutional selection procedure dictates that shortlisted candidates must successfully complete a multi-tiered evaluation process:

• Psychometric Test (Administered in English)
• Written Examination
• Oral Interview

Skills Required:

• Computer / Software / It / Data