OToPS/Measures/Attribution Questionnaire

Lead section

edit

The Attribution Questionnaire (AQ) is a self-report questionnaire that assesses public stigma toward people with mental illnesses, specifically one's sense of attribution, emotional reaction, and discriminatory responses. The AQ begins with a paragraph-long hypothetical vignette about Harry, a person with schizophrenia. There are different versions of the Harry vignette that can be used to test different forms of attribution. The measure follows with 27 items rated from 1 (not at all) to 9 (very much) assessing stigma towards Harry, creating 9 subscales that capture how one perceives and how one would respond to a specific person with mental illness.[1] Although the questionnaire itself is not specifically meant for one age group, the items inquire about complex emotions and hypothetical actions and thus may be most appropriate for older adolescents and adults. The AQ was developed in 2003 by Dr. Patrick Corrigan and colleagues based in Illinois and has been further developed into smaller tests such as the Attribution Questionnaire-9 (AQ-9), the revised Attribution Questionnaire (r-AQ), and the children's Attribution Questionnaire (AQ-8-C) for ages 10-18, in which youths are presented both a simplified version of the vignette and simpler test items.

Click here for instructions for lead section

The lead section gives a quick summary of what the assessment is. Here are some pointers (please do not use bullet points when writing article):

  1. Make sure to include a link to the "anchor citation"
  2. What population is it intended for? What do the items measure?
  3. How long does it take to administer?
  4. What has been its impact on the clinical world in general?
  5. Who uses it? Clinicians? Researchers? What settings?
  6. Using the Edit Source function, remove collapse top and collapse bottom curly wurlys to show content.

Psychometrics

edit

Steps for evaluating reliability and validity

edit
Click here for instructions
  1. Evaluate the instrument by referring to the rubrics for evaluating reliability and validity (both external Wikiversity pages). For easy reference, open these pages in separate tabs.
    1. Reliability rubric
    2. Validity rubric
  2. Refer to the relevant instrument rubric table. This is the table that you will be editing. Do not confuse this with the external pages on reliability and validity.
    1. Instrument rubric table: Reliability
    2. Instrument rubric table: Validity
  3. Depending on whether instrument was adequate, good, excellent, or too good:
    1. Insert your rating.
    2. Add the evidence from journal articles that support your evaluation.
    3. Provide citations.
  4. Refer to the heading for the instrument rubric table ("Rubric for evaluating norms and reliability for the XXX ... indicates new construct or category")
    1. Make sure that you change the name of the instrument accordingly.
  5. Using the Edit Source function, remove collapse top and collapse bottom curly wurlys to show content.

Reliability

edit
Click here for instrument reliability table

Reliability

edit

Reliability refers to whether the scores are reproducible. Unless otherwise specified, the reliability scores and values come from studies done with a United States population sample. Here is the rubric for evaluating the reliability of scores on a measure for the purpose of evidence based assessment.


Evaluation for norms and reliability for the Attribution Questionnaire (table from Youngstrom et al., extending Hunsley & Mash, 2008; *indicates new construct or category)
Criterion Rating (adequate, good, excellent, too good*) Explanation with references
Norms Adequate Norms for each of the 9 subscales have been reported in a variety of studies conducted with college students and adolescents for the AQ-27 and the r-AQ over the course of several years.[1][2][3]
Internal consistency (Cronbach’s alpha, split half, etc.) Adequate In summary, results for the AQ-27 and its smaller counterparts have been mixed.

The original study testing the AQ in its original form had alpha values of 0.70 and higher for the 6 original subscales.[1]

In a 2008 factor analysis study of the AQ-27 that supported the notion of 6 factors, the 6 alphas were fair to strong, ranging from 0.60 to 0.93.[2]

A 2012 factor analysis study of the r-AQ found a single factor containing 5 items with factor loadings of 0.50 to 0.70, different from the original conceptualization of 9 separate factors.[3]

Inter-rater reliability n/a The AQ and its other versions are all self-report measures.
Test-retest reliability (stability) One study found values of 0.50 and higher for the AQ-27 over a week retest period.[4]

Intraclass correlations for the subscales were good over a week test-retest period, ranging from 0.74 to 0.90.[2]

Repeatability TBD No formally published studies testing repeatability.

Validity

edit
Click here for instrument validity table

Validity

edit

Validity describes the evidence that an assessment tool measures what it was supposed to measure. There are many different ways of checking validity. For screening measures, diagnostic accuracy and discriminative validity are probably the most useful ways of looking at validity. Unless otherwise specified, the validity scores and values come from studies done with a United States population sample. Here is a rubric for describing validity of test scores in the context of evidence-based assessment.

Evaluation of validity and utility for the Attribution Questionnaire (table from Youngstrom et al., unpublished, extended from Hunsley & Mash, 2008; *indicates new construct or category)
Criterion Rating (adequate, good, excellent, too good*) Explanation with references
Content validity Excellent The AQ-27 contains items relating to the perceived responsibility of the person with mental illness, the emotional reactions (eg: anger, pity) directed at that person, and discriminatory beliefs (segregation, coercion), suggesting a wide range of stigma features.
Construct validity (e.g., predictive, concurrent, convergent, and discriminant validity) Good A 2004 study of the AQ-27 found strong correlations between the coercion and segregation subscales and a measure inquiring about allocating services and mandating treatment to people with mental illness.[4]

A 2008 factor analysis of the AQ-27 yielded 6 factors when the AQ was administered to college students, with strong factor loadings of 0.50 and higher. The same study found moderate correlations of 0.40 and higher were found between a few AQ subscales and other reliable stigma measures (eg: the Social Distance Scale, the Dangerousness Scale, and the Affect Scale).[2]

Validity generalization TBD Studies using the AQ-27 have shown good reliability, but not enough studies have analyzed its validity, much less the validity of the multiple versions.
Treatment sensitivity n/a
Clinical utility TBD The current literature has shown that the AQ is used in a community setting and has yet to be implemented in a clinical sample.

Development and history

edit

People may exhibit public stigma towards others with mental health issues through stereotypes, prejudice, and discrimination. Despite psychological research and statistical trends that suggest such prejudices may be invalid, public surveys have suggested people still possess ingrained beliefs about people with mental illness. The attribution theory posits that someone's behavior, such as a mental illness, may be perceived by others as a personal characteristic or something that they brought on themselves. Inferences about a mental illness lead to inferences about a person, and this attribution can lead to emotional reactions such as anger and pity towards that individual. Negative thoughts about people with mental illness may also influence discriminatory behavior such as refusal to help. Research supporting the attribution theory shows that internal attributions lead to more negative emotions and discriminatory responses. The original study by Corrigan, Markowitz, Watson, Rowan, and Kubiak validating the AQ explored the composition of public stigma: attribution, emotional reactions, and discriminatory thoughts. Their research thus revealed areas of interest where public stigma can be addressed and reduced.[1]

In the original study in 2003, tested using a sample of students in community college, the researchers created the Attribution Questionnaire (AQ) that references prior theory on attribution, resulting emotional responses, and resulting discriminatory behavior. The original study manipulated the hypothetical vignette's level of dangerousness, specifying the man's non-violent nature to one group and a violent nature to another group. The questionnaire contained 21 items grouped into 6 subscales that theoretically aligned with prior research: personal responsibility, pity, anger, fear, helping/avoiding behavior, and coercion/segregation.[1] By the following year, Corrigan used a different version of the AQ, now containing 27 items and 9 subscales. Dangerousness was included as a new subscale instead of being manipulated, and coercion, segregation, avoidance, and helping behavior were split into four separate subscales.[4] The AQ-27 is the current version of the questionnaire.

The subscales of the AQ-27 and descriptions are listed below:

  • Blame: perception that a person's mental illness is controllable and their own responsibility
  • Anger: towards the person with mental illness
  • Pity: towards the person with mental illness
  • Help: extent to which people are willing to support people with mental illness through interpersonal or economic means
  • Dangerousness: perception of people with mental illnesses as a threat to themselves, to others, or to the society
  • Fear: towards the person with mental illness
  • Avoidance: active evasion of people with mental illness
  • Segregation: support for treating people with mental illnesses in isolation away from the community, usually in institutions
  • Coercion: support for mandatory treatment for people with mental illnesses

Versions

edit

The AQ-9

edit

A shorter version of the AQ-27, called the AQ-9, was created by Corrigan and colleagues in 2003. This version contains 9 items, each representing one of the 9 subscales existing in the longer version. These items were chosen for the shorter form for their strong factor loadings from the AQ-27.[5]

The r-AQ

edit

The revised Attribution Questionnaire (r-AQ) was created by Watson and colleagues using the AQ-9 as a basis and adjusting the measure for an adolescent audience. This version contains the same number of items as the AQ-9, but the items have been verbally adjusted along with the subject of the vignette to describe a younger person with mental illness.[5]

Impact

edit

As of now, there is not a widespread use of the Attribution Questionnaire. Current studies analyzing its use are limited, and a gold standard on combating mental health stigma has yet to be established. As stigma becomes increasingly researched, the AQ may be a springboard to reach more audiences and clarify which factors make up stigma. The AQ could be applied to a clinical setting, but such implementation has not been planned or brought into practice. Moreover, validity studies need to be conducted to analyze how the child and adolescent versions of the AQ may map onto the adult AQ-27 and if this measure could be used longitudinally.

Use in other populations

edit

The Attribution Questionnaire is not a commonly used measure and thus has not been translated into various languages. Currently, an Italian version of the measure exists.[6]

Limitations

edit

As the AQ is presented as a self-report, the pressure of social desirability may encourage subjects to endorse less of the items they think would be discriminatory towards those with mental illness. Furthermore, as the AQ is not normally built into a behavioral observation, the scores on this self-report questionnaire may not align with actual behavior. The AQ has only been validated in college volunteer students and adolescent students in research settings. More research is needed with the general public to see if the AQ could be used to assess stigma in other samples. Lastly, the components of mental stigma have yet to be fully revealed. Other components may not be well represented; others may be undeservedly so. The various existing studies have suggested the latter, with fewer factors being endorsed than the original 9.

OToPS Usage History

edit
Details
Date Added

(when was measure added to OTOPS Survey?

<Date>
Date Deleted

(when was measure dropped from OTOPS survey?)

<active/deleted>, <date>
Qualtrics scoring Variable name of internally scored variable:

XXX

Notes on internal scoring:

- Is it piped?

- Is it POMP-ed?

- Any transformations needed to make it comparable to published benchmarks?

Content expert Name: Jane Doe, Ph.D.

Institution/Country: University of Wikiversity / Canada

Email: Type email out

Contacted: Y/N

Following page: Y/N

Scoring instructions and syntax

edit

We routinely include scoring syntax in three major languages: R, SPSS, and SAS. All variable names are the same across all three (so we follow naming conventions that would work in any of them -- note that R is case sensitive), and all match the CSV shell that we provide as well as the Qualtrics export.

Hand scoring and general instructions

edit

<Information about hand scoring and general instructions go here>

CSV shell

edit

Because we are sharing the scoring syntax, we also want to share a shell data file that you could use in your own research. If you use this file, or make sure that your own file uses the same variable names, then the scoring code we provide should do the basic scoring for you. When different research projects and groups use the same variable names and syntax, it makes it easier to share the data and work together on integrative data analyses or "mega" analyses (which are different and better than meta-analysis in that they are combining the raw data, versus working with summary descriptive statistics).

Note that our CSV includes several demographic variables, which follow current conventions in most developmental and clinical psychology journals. You may want to modify them, depending on where you are working. Also pay attention to the possibility of "deductive identification" -- if we ask personal information in enough detail, then it may be possible to figure out the identity of a participant based on a combination of variables.

<Paste Link to CSV Shell here>

Syntax/code

edit
Click here for R code

R code goes here

Click here for SPSS code

* Stigma scoring. * Done freehand with Di-Poo; no article in front of us. * Let's see how close we get to the real scoring! ;-). desc /var aq01 to aq27. compute aq07r = 10-aq07. compute aq08r = 10-aq08. compute aq26r = 10-aq26. compute aq16r = 10-aq16. compute aq20r = 10-aq20. compute aq21r = 10-aq21. * Note that Corrigan does *not* reverse these -- they form the Pity scale. compute aq09r = 10-aq09. compute aq22r = 10-aq22. compute aq27r = 10-aq27. reliability /var aq01 to aq06 aq07r aq08r aq09 aq10 to aq15 aq16r aq17 to aq19 aq20r aq21r aq22 aq23 to aq25 aq26r aq27 /sum total. * Not positive about scoring of #11; #5 shows craptacular corrected item-total. * Weird. Not reversing the Pity items makes the alpha worse, and low CITC (-.28!). compute aqtotaldi = (mean.24(aq01 to aq06, aq07r, aq08r, aq09r, aq10 to aq15, aq16r, aq17 to aq19, aq20r to aq22r, aq23 to aq25, aq26r, aq27r)-1)/8. compute aqtotal = (mean.24(aq01 to aq06, aq07r, aq08r, aq09, aq10 to aq15, aq16r, aq17 to aq19, aq20r, aq21r, aq22 to aq25, aq26r, aq27)-1)/8. compute aqblame = (mean(aq10, aq11, aq23)-1)/8. compute aqanger = (mean(aq01, aq04, aq12)-1)/8. compute aqpity = (mean(aq09, aq22, aq27)-1)/8. compute aqhelp = (mean(aq08r, aq20r, aq21r)-1)/8. compute aqdanger = (mean(aq02, aq13, aq18)-1)/8. compute aqfear= (mean(aq03, aq19, aq24)-1)/8. compute aqavoidance = (mean(aq07r, aq16r, aq26r)-1)/8. compute aqsegregation = (mean(aq06, aq15, aq17)-1)/8. compute aqcoercion = (mean(aq05, aq14, aq25)-1)/8. var labels aqtotaldi 'Diane scoring of AQ total (reverses Pity items, along with the 6 Corrigan flips)' /aqtotal 'Total Stigma -- Attitudes Questionnaire'. corr /var aqblame aqanger aqpity aqhelp aqdanger aqfear aqavoidance aqsegregation aqcoercion. * Blame = AQ10+ AQ11 +AQ23 * Anger = AQ1 + AQ4 + AQ12 * Pity = AQ9 + AQ22 + AQ27 * Help = AQ8 + AQ20 + AQ21 (Reverse score all three questions) * Dangerousness = AQ2 + AQ13 + AQ18 * Fear = AQ3 + AQ19 + AQ24 * Avoidance = AQ7 + AQ16 + AQ26 (Reverse score all three questions) * Segregation = AQ6 + AQ15 + AQ17 * Coercion = AQ5 + AQ14 + AQ25.

Click here for SAS code

SAS code goes here

See also

edit
edit

References

edit
Click here for references
  1. 1.0 1.1 1.2 1.3 1.4 Corrigan, Patrick; Markowitz, Fred E.; Watson, Amy; Rowan, David; Kubiak, Mary Ann (2003). "An Attribution Model of Public Discrimination Towards Persons with Mental Illness". Journal of Health and Social Behavior 44 (2): 162–179. doi:10.2307/1519806. http://www.jstor.org/stable/1519806. 
  2. 2.0 2.1 2.2 2.3 Brown, Seth A.. "Factors and measurement of mental illness stigma: A psychometric examination of the Attribution Questionnaire.". Psychiatric Rehabilitation Journal 32 (2): 89–94. doi:10.2975/32.2.2008.89.94. http://doi.apa.org/getdoi.cfm?doi=10.2975/32.2.2008.89.94. 
  3. 3.0 3.1 Pinto, Melissa D.; Hickman, Ronald; Logsdon, M. Cynthia; Burant, Christopher (2012-04-01). "Psychometric Evaluation of the Revised Attribution Questionnaire (r-AQ) to Measure Mental Illness Stigma in Adolescents". Journal of Nursing Measurement 20 (1): 47–58. doi:10.1891/1061-3749.20.1.47. http://www.ingentaconnect.com/content/springer/nmeas/2012/00000020/00000001/art00004. 
  4. 4.0 4.1 4.2 Corrigan, Patrick W.; Watson, Amy C.; Warpinski, Amy C.; Gracia, Gabriela (2004-08-01). "Stigmatizing Attitudes About Mental Illness and Allocation of Resources to Mental Health Services". Community Mental Health Journal 40 (4): 297–307. doi:10.1023/b:comh.0000035226.19939.76. ISSN 0010-3853. https://link.springer.com/article/10.1023/B:COMH.0000035226.19939.76. 
  5. 5.0 5.1 Watson, Amy C.; Otey, Emeline; Westbrook, Anne L.; Gardner, April L.; Lamb, Theodore A.; Corrigan, Patrick W.; Fenton, Wayne S. (2004-01-01). "Changing Middle Schoolers' Attitudes About Mental Illness Through Education". Schizophrenia Bulletin 30 (3): 563–572. doi:10.1093/oxfordjournals.schbul.a007100. ISSN 0586-7614. https://academic.oup.com/schizophreniabulletin/article/30/3/563/1933089/Changing-Middle-Schoolers-Attitudes-About-Mental. 
  6. Pingani, Luca; Forghieri, Matilde; Ferrari, Silvia; Ben-Zeev, Dror; Artoni, Paolo; Mazzi, Fausto; Palmieri, Gaspare; Rigatelli, Marco et al. (2012-06-01). "Stigma and discrimination toward mental illness: translation and validation of the Italian version of the attribution questionnaire-27 (AQ-27-I)". Social Psychiatry and Psychiatric Epidemiology 47 (6): 993–999. doi:10.1007/s00127-011-0407-3. ISSN 0933-7954. https://link.springer.com/article/10.1007/s00127-011-0407-3.