Hagopian, L. P., Fisher, W. W., Thompson, R. H., Owen-DeSchryver, J., Iwata, B. A., & Wacker, D. P. (1997).
Toward the development of structured criteria for interpretation of functional analysis data.
Journal of Applied Behavior Analysis,
30, 313-326.
Using functional analysis results to prescribe treatments is the
preferred method for developing behavioral interventions. Little
is known, however, about the reliability and validity of visual
inspection for the interpretation of functional analysis data.
The purpose of this investigation was to dev elop a set of
structured criteria for visual inspection of multielement
functional analyses that, when applied correctly, would increase
interrater agreement and agreement with interpretations reached
by expert consensus. In Study 1, 3 predoctoral interns
interpreted functional analysis graphs, and interrater agreement
was low (M = .46). In Study 2, 64 functional analysis
graphs were interpreted by a panel of experts, and then a set of
structured criteria were developed that yielded interpretive
results similar to those of the panel (exact agreement = .94). In
Study 3, the 3 predoctoral interns from Study 1 were trained to
use the structured criteria, and the mean interrater agreement
coefficient increased to .81. The results suggest that (a) the
interpretation of functional analysis data may be less reliable
than is generally assumed, (b) decision-making rules used by
experts in the interpretation of functional analysis data can be
operationalized, and (c) individuals can be trained to apply
these rules accurately to increase interrater agreement.
Potential uses of the criteria are discussed.
DESCRIPTORS: assessment, functional analysis, visual inspection,
interrater agreement