Research Evaluation Report Form
Yes No N/A ?/X
Is there a statement of the problem of a qualitative topic of study?
Does the problem of topic indicate a particular focus of study?
Is the problem “researchable,” that is, can it be investigated through
the collection and analysis of data?
Is the background information on the problem presented? Yes
Is the educational significance of the problem discussed? Yes
Does the quantitative problem statement indicate the variables of
interest and the specific relationship between those variables that were
When necessary, are variables directly or operationally defined? Yes
Does the researcher have the knowledge and skill to carry out the
Review of the Literature Yes
Is the review comprehensive
Is the review well organized? Does it logically flow in such a way that
the references least related to the problem are discussed first and the
most related references are discussed last? Does it educate the reader
about the problem or topic?
Is the review more than a series of abstracts or annotations? That is,
have the references been analyzed and critiqued and the results of the
RESEARCH EVALUATION 3
various studies compared and contrasted?
Are most of the sources primaries; i.e., are there only a few or no
Have the references been critically analyzed and the results of various
studies compared and contrasted (i.e., is the review more than a series
of abstracts or annotations)?
Are all cited references relevant to the problem under investigation? Is
the relevance of each reference explained?
Does the review conclude with a summary and interpretation of the
literature and its implications for the problem under study?
Do the implications form an empirical or theoretical rationale for the
hypotheses that follow?
Are references cited completely and accurately? Yes
Are specific research questions listed or specific hypotheses stated? Yes
Is each hypothesis testable? N/A
Does each hypothesis state an expected relation or difference? N/A
If necessary, are variables directly or operationally defined? N/A
Are the size and major characteristics of the population described? Yes
Are the accessible and target populations described? Yes
If a sample was selected, is the method of selecting the sample clearly
RESEARCH EVALUATION 4
Does the method of sample selection suggest any limitations or biases
in the sample? For example, was stratified sampling used to obtain
Are the size and major characteristics of the sample described? Yes
If the study was quantitative, does the sample size meet the suggested
guidelines for the minimum sample size appropriate for the method of
Do instruments and their administration meet guidelines for protecting
participants? Were needed permissions obtained?
Are the instruments appropriate for measuring the intended variables?
Was the correct type of instrument used for data collection (e.g., was a
norm referenced instrument used when a criterion-referenced one was
Is the rationale given for the selection of the instruments (or
Are the purpose, content, validity, and reliability of each instrument
described? If appropriate, are subtest reliabilities given?
Is evidence presented to indicate that the instruments are appropriate
for the intended sample? For example, is the reading level of an
instrument suitable for sample participants?
If an instrument was developed specifically for the study, are
administration, scoring or tabulating, and interpretation procedures
RESEARCH EVALUATION 5
Does the researcher have the needed skills or experience to construct
or administer an instrument?
Design and Procedure
Are the design and procedures appropriate for examining the research
question or testing the hypothesis of the study?
Are the procedures described in sufficient detail to permit replication
by another researcher?
Do procedures relate to one another logically? Yes
Were instruments and procedures applied correctly? Yes
If a pilot study was conducted, are its execution and results described?
Is the effect on the subsequent study explained?
Are control procedures described? N/A
Does the researcher discuss or account for any potentially confounding
variables that he or she was unable to control?
Are appropriate descriptive statistics presented? Yes
Are the tests of significance appropriate, given the hypotheses of and
design of the study?
If parametric tests were used, is there evidence that the researcher
avoided violating the required assumptions for parametric tests?
Was the probability level at which the tests of significance were
evaluated specified in advance of data analyses? Was every hypothesis
RESEARCH EVALUATION 6
Are the tests of significance interpreted using the appropriate degrees
Was the inductive logic used to produce results in a qualitative study
Are the results clearly described? Yes
Are the tables and figures (if any) well organized and easy to
Are the data in each table and figure described in the text of the
Discussion (Conclusions and Recommendations)
Is each result discussed in terms of the original hypothesis or topic to
which it relates?
Is each result discussed in terms of its agreement or disagreement with
previous results obtained by other researchers in other studies?
Are generalizations consistent with the results? Yes
Are theoretical and practical implications of the findings discussed? Yes
Are the possible effects of uncontrolled variables on the results
Are recommendations for future action made? Yes
Are the suggestions for future action based on practical significance or
on statistical significance only (i.e., has the author avoided confusing
practical and statistical significance)?
RESEARCH EVALUATION 7
Abstract or Summary
Is the problem stated? Yes
Are the number and type of participants and instruments described? Yes
Is the design identified? Yes
Are procedures described? Yes
Are the major results and conclusions stated? Yes
Type-Specific Evaluation Criteria
Are the characteristics or experiences that differentiate the groups (i.e.,
the grouping variable) clearly described?
Were any control procedures applied to equate the groups on
Are causal relations discussed with due caution? N/A
Are plausible alternative hypotheses discussed? ?/X
Strengths of the Report
This report is very significant in answering the research questions which it was out to solve. The
problem is clearly stated and the report follows through to ensure that all the objectives are met.
As a result of the strict procedures followed in the process, erroneous conclusions are eliminated
effectively. Control has been properly exerted by the use of sampling and effective data analysis.
The findings in this study can be generalized to the population about which the information is
required. This is strength of this report.
RESEARCH EVALUATION 8
Samples of individuals are well represented in this study research and the structural factors
which are determinant of how inequalities are produced are well analyzed. The QUANT
estimates have been outlined together with the magnitude of the distribution impacts. QUANT
estimates of costs and benefits of interventions. This report can be used to analyze comparable
findings on the same subject.
Weaknesses of the Report
The sensitive aspects of the study have not been brought out competently enough. Many
groupings such as sex workers and ethnic minorities cannot be reached very easily through the
report. The self-reported information such as those which are obtained from the questionnaires
may be inaccurate or incomplete. There are no contextual factors which are necessary for the
interpretation of the result as well as to explain the variations in behaviors between one group to
The administration of the questionnaires created an unnatural situation which could easily
alienate respondents. The research method is quite rigid as the instruments for use could not be
adjusted when the research had kicked off. The errors in hypothesis tested could easily result
misimpressions of program quality or influential factors. The selection procedure had a little
problem which could easily result into erroneous findings.
RESEARCH EVALUATION 9
Cochran-Smith, Marilyn, and Kenneth M. Zeichner, eds. Studying teacher education: The report
of the AERA panel on research and teacher education. Routledge, 2009.