6.1 Introduction

6.1.1 Background

This chapter provides general guidance for the management of performance/proficiency data within an AQP. Background information and principles for collecting, entering, reporting, and analyzing performance data are addressed in a publication titled “Data Management Guide”. This reference document was developed by the Data Management Focus Group AQP Subcommittee, which is sponsored by the Air Transport Association (ATA). The “Data Management Guide” is available from Transport Canada.

1. Regulatory Requirement
    
   In AQP, the air operator is required to collect and analyze performance information on its flight crewmembers, instructors and evaluators. The data collection, analysis and reporting processes employed by the air operator must be acceptable to Transport Canada. This data will enable the air operator and Transport Canada to determine whether the form and content of training and evaluation activities are satisfactorily accomplishing the overall objectives of the curriculum. Good data management practices are necessary to determine whether an AQP is meeting its objectives. 
    
2. Validation
    
   The principal goal of the AQP is true proficiency-based training and qualification. Performance Objectives are systematically developed and maintained, then continuously validated through the collection and evaluation of empirical performance data.  Data collection and analysis (data management) is, therefore, an integral part of AQP.

6.1.2 Definitions

Data management can be classified into two broad categories:

1. Individual Qualification Records; and 
    
2. Performance/Proficiency Data.

These broad categories are described below:

1. Individual Qualification Records
    
   These are identifiable, detailed records that are maintained on each individual flight crewmember, instructor and evaluator who is qualifying or has qualified under an AQP. These records show how and when the individual satisfied the requirements of the curriculum required for their assigned duty position. They may also include demographic and work history information, as well as completion information on the modules and lessons. Air operators may maintain a manual record keeping system, or a computerized record keeping system.  The record keeping process in AQP does not differ from traditional record keeping requirements. 
    
2. Performance/Proficiency Data
    
   In addition to the traditional record keeping requirements described above, AQP also requires the establishment of a separate PPDB. Performance/proficiency data records are de-identified and are maintained separately from the normal qualification records.
   
   This de-identified information represents the results of an individual’s ability to successfully demonstrate the performance objectives of each curriculum. This information is captured during validation and evaluation gates as a flight crewmember progresses through an AQP curriculum. This data is obtained from each flight crewmember’s performance and is stored in a collective form in the PPDB. 
   
   This data is used to analyze training programs and/or groups of participants, not for tracking individual accomplishment. Successful collection and analysis of this data will allow the air operator to identify and correct problems, validate AQP curricula, and identify developing trends.