Unobtrusive Measures &
Official Statistics
Crim 320-023
Bryan Kinney
November 19, 2002
Unobtrusive Measures:
n
A definition:
n
“Unobtrusive measures are nonreactive methods of
gathering data; that is, means of obtaining information in which subjects are
not aware of being studied” (Hagan, 2003: 234)
n
An immediate problem:
n
Clandestine research and ethical treatment of
research subjects/participants
n
A quantitative emphasis for our (320) purposes
Major Types of Unobtrusive
Measures
n
Physical trace evidence
n
Archival, existing data & autobiographies
n
Simple observation
n
Disguised observation
n
Simulation
Physical Trace Evidence
n
Deposits (selective)
n
Artifacts left behind
n
Accretion measures
n
Signs of use, wear ‘n’ tear
n
Other “indirect” indicators of human activity
n
Hypodermic needles & drug use indicators
Archival & Existing Data
n
Archival data sources:
n
Looks to existing data
n
Memoirs, diaries, historical documents
n
Official statistics and records (UCR, CAD, etc.)
n
Examples of Unobtrusive techniques
n
Content analysis
n
Media/communication analysis; analysis of texts/documents
n
Secondary analysis
n
Reanalysis of data originally collected for some other purpose (e.g.,
Police calls for service)
Observation
n
In quantitative observational strategies
n
Researcher is typically non-participatory
n
Ode to “distanced”, “objective” observation
n
Simple observation
n
Naturalistic or experimentalist design;
researcher presence conspicuous but not interactive
n
Disguised (surreptitious) observation
n
Also naturalistic or experimentalist design; yet
now researcher actively disguises or attempts to ‘blend in’ to the research
context; “clandestine” observation
n
Humphreys’ “tea room” (1970)
Simulation Studies
n
Field observations tend to be “messy” and
difficult to effect “controls” for various variable effects
n
Simulation studies can help avoid these
difficulties
n
“simulation is a situation or game that attempts to mimic, or imitate,
key features of reality” (Hagan, 2003: 265)
n
Stanley Milgram, Obediance to authority
(1974)
n
Haney, Banks & Zimbardo’s mock prison
General Advantages to
Unobtrusive Techniques
n
Unobtrusive data collection reduces/avoids
reactivity
n
Observations are thought to be more ‘natural’
& thus reliable
n
Avoid over-reliance on attitudinal (self report)
data (social desirability bias)
n
Much archival data already exists (cost/time
effective)
n
Physical evidence collection provides a measure
of anonymity; can be inconspicuous
n
Archival/trace evidence allows study over time
n
May be only way to capture historical social
artifacts
Disadvantages to Unobtrusive
Techniques
n
Ethics, privacy, anonymity, confidentiality
n
Surreptitious studies by definition do not ask
for permission to include research subjects
n
W/o permission, even greater pains needed to
ensure unintended identification of subjects cannot happen
n Impact
of potential exposure of identities can be even more damaging (embarrassing;
dangerous; legal) than other research strategies
n
Representativeness of subjects
n
May be an atypical study group & not
generalizable to a wider population
n
Potential observational bias
n
C.p. selective deposit
n
Researchers and confederates both prone to this
n
Try to have data triangulation
n
Avoid relying on any data type as only source
n
Perhaps archival/unobtrusive data more so than
others
Examples of Unobtrusive
Research
n
We’ll look at two examples of research in
action, both using official data (gasp!)
n
First, we’ll suffer through some of my work on
calls for police service and proximity to licensed premises
n
Second, Rob will talk about research in
process—problems working with data, organisation and general research advice
n Hopefully,
this exposure will help you think about how to organise and survive your own
research project in this class