The Ship Research Institute Research and Development Evaluation Manua

1. Basic Principles

To ensure the transparency and impartiality of evaluation, we have set up an Evaluation Committee consisting of external experts who are not directly involved in the research tasks subject to evaluation. The evaluation results of the Evaluation Committee will in principle be disclosed to the public, with all due consideration to the protection of personal information, the acquisition of intellectual property rights, and so on.


2. Purpose of Evaluation

The purpose of this evaluation, as stated in the Basic Guidelines, will be (1) to implement research and development more efficiently and effectively, and (2) to disclose the state of research and development to the public. Specifically, those implementing the evaluation (the evaluators) and those receiving the evaluation (the evaluated) will mutually inform each other through exchanges of opinions, while opinions from new points of view will also be incorporated from the outside. In this way, the significance and directions of research and development will be reviewed, resulting in more efficient and effective research and development. Also, to address the fact that research and development have become increasingly sophisticated and specialized and their meaning and content more difficult for the public to understand, research and development will be evaluated in a rigorously constructed evaluation process, and their content thus made clearer for the public.


3. Evaluators

The Committee will consist of external experts, selected in line with the following principles.

(1) Persons of learning or experience who are well-versed in the field subject to evaluation
(2) Researchers of other governmental research organizations, etc.
(3) Experts and specialists from manufacturers and others in the field subject to evaluation


4. Method of Evaluation

The evaluation work will be implemented in a committee format. At meetings of the committee, personnel in charge of research and development will explain the tasks subject to evaluation to the committee members, and will answer their questions. On the basis of this, the committee members will give their opinions on specific research evaluation forms, which will then be submitted at a later date.


5. Types of Evaluation and Implementation Timing

Evaluation will be divided into the three types of pre-evaluation, mid-evaluation, and post-evaluation. Each will be implemented at the times shown in the chart below.

Type of Evaluation Implementation Timing
Pre-evaluation Research tasks to be newly implemented by this Institute will be evaluated before a budget request is made
Mid-evaluation Research tasks implemented by this Institute that have an R&D period of at least 5 years will be evaluated during the 3rd year
Post-evaluation Research tasks implemented by this Institute will be evaluated in the fiscal year following completion of the research and development


6. Evaluation Topics

Evaluation topics have been decided in line with the Ministry of Transport Evaluation Guidelines.

The various evaluation topics will be evaluated as to whether the purpose, significance, plan content, and other details suitably reflect social circumstances or technical trends (mainly topics related to the design and management of tasks), whether the significance or prospects for practical application are suitable (topics related to results), and so on.

Evaluation Types and Evaluation Topics

Evaluation Types Evaluation Topics
Pre-evaluation 1. Means, significance, etc., of R&D
2. Necessity of research plan
3. Compatibility with higher-level plans, etc.
4. Suitability of R&D plans
Mid-evaluation 1. State of progress of R&D
2. Verification of results (including secondary results)
3. Changes in external conditions affecting the R&D
4. Verification of R&D plans (including plans after evaluation)
5. Verification of pre-evaluation
Post-evaluation 1. Verification of R&D process
2. Verification of results (including secondary results)
3. Changes in external conditions affecting the R&D
4. Verification of R&D plans (including plans after evaluation)
5. Verification of pre-(mid-)evaluation



[ BACK ][ NMRI HOME ]
Contact:Research Planning Division(info@nmri.go.jp)