The integrating authority is responsible for managing the end-to-end process of the data integration project. This includes the evaluation and project completion phase.
To assist with quality evaluation and to maximise the learnings from the project for future research projects involving data integration, all documentation generated throughout the project needs to be finalised. For more information on the importance of documentation and quality evaluation see data quality.
Project completion
A project is considered complete once the approved purpose of the project is met, the related datasets destroyed, or if retained, the reasons for and necessity of retention documented and a review process set up, for example, if the project is ongoing, or the integrated dataset is required to support a family of projects [1. Data integration projects using the same source datasets, for similar purposes, with the same integrating authority, are referred to as a family of projects. ] . If such retention was not part of the initial approval process, re-approval of the decision to retain should be obtained from all data custodians.
Archiving of statistically integrated data sets should be restricted to confidentialised datasets. See High Level Principle 6 – Preserving privacy and confidentiality.
It is the responsibility of the integrating authority to ensure the above tasks are completed. In accordance with the High Level Principles (particularly Principle 6) and the supporting governance arrangements, the integrating authority is responsible for the management of the integrated datasets throughout their lifecycle. This includes initiating and managing the regular review of the project if it is ongoing or the integrated dataset is otherwise retained.
For more information on secure data storage, please refer to the data security section, in particular information and communication technology security.
For more information on the project delivery phase see:
- Extract and transfer data
- Preparing for linking
- Linking and merging of data
- Access to integrated data
- Analysis of integrated data
- Evaluation and project completion