Helping Give Away Psychological Science/OSF Guide for Assessment Center

Getting Started:

1. Make an OSF account
   • Get the group leader to add you as a contributor to these two projects: Helping Give Away Psychological Science & Assessment Center
2. Make a Zotero Account
   • Get the team leader to share the HGAPS Group Library with you on Zotero
   • Download Zotero desktop app and browser extension
3. Click here to see a template OSF component.

Step 1: Getting to Right Project

Navigate to OtoPS (Open Teaching of Psychological Science) /Measure component within OSF

Step 2: Creating a Component for the Assessment

Once you've confirmed that the assessment you're working with does not have a previously created component, click the "Add Component" button shown in the image above to create a new one.

Step 2a: Add and Name the Component

• Search the assessment center project to see if there is already a component created for the assessment in question
• If not, then create a component for the assessment.
  • Click “Add Component” on the right side of the screen under the Components section
  • Name the component ‘Full Measure Name (Measure Acronym)’. For example: Child Mania Rating Scale (CMRS)
    • If you want all contributors to have access to this component, select "Add contributors from [Component]"
  • Click "Create"

Step 2b: Rename the files before uploading them on OSF

The Child Mania Rating Scale will be used as an explicative example.

• Measure: ACRONYM_Version_Language_ShortForm

ACRONYM: Use abbreviation of the first letters (in capital form) of each word of the measure name.

Version: Caregiver; Clinician; Parent; Relative (other than parent); Self-report; Teacher.

Language: If there are different versions of the measure in the same language (e.g., Mexican vs Cuban Spanish) specify the type after the word Language and the symbol “-” (see the example below).

ShortForm: add the term “ShortForm”only in case of a shortened version of the measure. If the measure is full length, omit specifying this.

Examples: CMRS_Teacher_English

CMRS_Teacher_English_ShortForm

CMRS_Caregiver_English

CMRS_Teacher_Spanish

CMRS_Teacher_Spanish-Mexican

• Anchor article: ACRONYM_Version_AnchorArticle

Examples: CMRS_Caregiver_AnchorArticle CMRS_Caregiver&Teacher_AnchorArticle

• Validation article in a different language:  ACRONYM_Version_Validation_Language

Examples: CMRS_Caregiver_Validation_Spanish

CMRS_Teacher_Validation_Spanish-Mexican

CMRS_Teacher_Validation_Spanish-Cuban

• For other types of articles, specify the specific topic in the third spot of the file name:  ACRONYM_Version_?????_Language

Examples: CMRS_Caregiver_PsychometricProprieties_Spanish CMRS_Teacher_DevelopingShortForm_English

Step 2c: Add Tags

Once the component has been created, on the bottom right-hand side of the page you will see a box labeled ‘Tags’. Here, create tags specific to the measure. These include:

• The informant (e.g., ‘Self Report’, ‘Teacher Report’).
• The acronym for the measure (e.g., ‘BDI’).
• If the measure is in the Assessment Center, add the tag ‘AC’.
• A tag for each of the versions present (e.g., ‘Short Form’, ‘Work’, ‘Updated’).
• A tag for each language present (e.g., ‘English’, ‘Spanish’, ‘Korean’).

Step 3: Adding Information to the Component Wiki

Add information about the measure to the wiki of the newly created component according to the questions outlined in the template (also listed below).

Step 3a: Description of the Measure:

• Is it in the HGAPS Assessment Center?
  • If so which battery or batteries?
  • Is there a stand-alone version?
  • Is it in the process of being added to Qualtrics?
  • Which versions are in the Assessment Center? If it is a stand-alone measure or in an assessment battery then provide the link to the assessment center measure.
• Is it free?
  • Is it free to use or open access?
  • Do we have permission to use it?
• Who is it for?
  • What Age/developmental stage?
  • What Demographic? (in-patient, out-patient)
  • Is it for the client, associate of the client or clinician, etc.?
• What is it for?
  • What is it assessing/measuring?
    • Does it measure opinions, feelings, thoughts, behaviors, family history, health, habits?
  • Is it a screener, symptom tracker, scale, survey, clinical, collect background information, progress measure meant to be given periodically to check progression in therapy?
  • What type of diagnosis?
  • What are the constructs and/or subcategories it is measuring?
  • Is this a measure meant to be given at the initial interview?
• How long
  • Does it take 20 minutes on average to complete?
  • How many questions in total?
  • How many questions per section or construct/category?
• Measurement concerning time
  • Is it for behavior/feelings/thoughts over the past week, month, three months, year, lifetime?
  • Is it asking for how they are feeling at that exact moment so their current state?
  • Is it asking how that person is in general like their character traits, usual demeanor/temperament?
• How many versions?
  • How many versions of the measure are there?
  • Is there an original, a revised (revised by who), is there a short version or extended version that added additional questions/sub construct added?
  • Is there a self-report, parent-report, clinician-report, teacher-report, etc.?
  • What languages does it come in?
• When?
  • When was it first made and published?
  • When was it updated?
• Summary of Scoring
  • How is it scored?
  • Are there subscores and which questions do they draw from?
  • What is the max total score?
  • What do the scores tell you or mean?

Step 4: Creating Components Within the Measure Component

Within the measure component that was just created, create the five sub-components with the detailed wiki outlined below along with adding the appropriate files/subcomponents if they are required for one of the five subcomponents below:

Step 4a: Anchor Article(s)

• Add the article that describes the making of the original measure, later versions including validation of different language versions.
• Add the pdfs if any that we are required to cite as a condition of permission of use.
• Specify which article is for what in the wiki like so...
• Anchor Article for Original: citation or name of PDF.
• Article(s) required to Cite: citations and name of PDFs.

Step 4b: Supplemental/Supporting Articles:

This component should not host Anchor Articles or Permissions of Use Articles but articles that fall under the following types:

• Articles about validity, reliability, psychometrics, the measure being.
• Use/validation process with certain demographics using the measure like ages/developmental stage, in-patient, out-patient, race, SES, countries, bi-lingual, etc. or in translations of different languages.
• Articles comparing the measure and its performance and diagnostic capabilities/prediction abilities to other measures or other versions of that measure (comparing the performance of the revised version to the original version).

Step 4c: Permissions of Use/Conditions

• Is it free?

• Is it only allowed to be used if the author permits you?
  • Is there an online request process? What is the email of the person to contact to ask for permission from?
  • Is it only allowed to be used for research and if so does that exclude commercial research?
  • Include a copy of emails, printed screen of stated permission of use as a pdf in this component. Alternatively, provide a link of where it states the conditions of use for the measure inside this Wiki and then add a document or excerpt that describes the conditions of use or permission in this component.

• What are the conditions laid out by the author for using this measure?
• Do we need to cite them inside the qualities? If so, is there a specified way they want us to cite/give credit to the owner/author of the measure.
  • For instance, is there a watermark or caption we need to put somewhere like: "Copyrighted by the APA, Author Name, Year."
• Did they provide you with the citation they want you to include?
• Do we just need to cite it if we write a paper about or using the measure?
• Are the conditions of use to share the data with the owner/author or to send published papers of the study that it was used in or send a link of the Qualtrics to them for approval or just for them to have?

Step 4d: Original Version of Measure

• By original I mean the first version of the measure, not the revised, not extended, not the short version but the measure that is referenced in the anchor article.
• Specify if this is the version used in the Assessment Center here in the description.
• This component should have the following:
  • PDF or Word Document of Scoring: how it is scored, sub scoring, which questions it uses, the value for each answer choice, and what each score means.
  • A manual of the measure if it exists and open access. Sometimes the author will send it to you.
  • PDF AND Word Document version of the measure which includes the instructions, questions, and answers.
  • If a text/notepad (.txt) version of the measure exists or has been made by someone to upload into Qualtrics so it builds the questions for them then it should also be inside this component.
  • All parts of the English version of the measure should go directly into this component. If the measure comes in another language and you have all its materials:
    • Make a component for other languages if you have it inside this component and just label it as Spanish Version, Arabic Version, Albanian Version, etc.
    • Inside those versions just put the PDF and Word Document of the actual measure in that language and any other testing materials in that language. Also, put a different report version if it exists and you have it in that language. For example, self-report original Spanish version pdf, teacher-report, etc.
  • If there are long-form and short-form options for the measure, create another component inside of the language component (if there are multiple languages) for those forms.
    • For example, under the ‘original version’, there could be an ‘English version’ and ‘Spanish version’, and under those subcomponents, you would create the components ‘long-form’ and ‘short-form’.

Step 4e: Revised Version of the Measure

• This component could be called, for example, CMRS_Teacher_English_ShortForm

What to put in this Component’s Wiki:

• Everything that you put in the Original Measure Component Wiki you should put here but specifically for the Revised Version.
• Specifically, state key differences from the original: what was omitted or added, changes in scoring, subscores, or constructs that were taken out or new ones added changes in names of constructs, etc.
• If this version is in the Assessment Center then say that here and specify where/which batteries. You can even add the links that go directly to it!
• If there is a different author for this version of the measure then state that here and provide the citation for that measure and the anchor article for the making of this version of the measure.
• This component should have the same type of files as the Original Version component!

Once you've accessed the Measures component of the Assessment Center project, click on the component you want to upload files to. Circled above is an example of a component you may select.

Step 5: Upload all Files

• Download all of the files assembled, then upload them to OSF in their respective components.
• Go to the measure component, and then go to the specific component to which you want to upload the file.
  • Example: Supplemental/Supporting Articles.
• To upload go to the relevant component within the measures and select "OSF Storage (United States)" on the left hand side and then you will see the upload button.
• Manuals and scoring documents should be uploaded into the same components as the original version of the measure (and if applicable, the English version).

Once you've opened the desired component, select "OSF Storage" on the left side of the screen as shown in blue and circled with red in the image above. Once you've done that, the Upload button, circled in red, will show up and you can select it to upload your files.

Step 6: Zotero

Step 6a: Zotero Setup

• If you do not already have Zotero, download Zotero.
  • If you use Google Chrome, it would also be very useful to get the Zotero Chrome extension.
  • This will make citing pages a lot easier as well as setting up a desktop version. Zotero browser extensions are useful as they automatically sense content you access online and allow you to save information to Zotero easily.
  • If you use a browser other than Google Chrome, such as Firefox or Safari, there is also an option to download Zotero browser-specific extension. Upon accessing the download page, Zotero should sense your default browser and give you the option to download the extension specific to your computer.

Step 6b: Where and What

• On Zotero, go to the Assessment Center Folder under the HGAPS library.
  • Navigate to the measure’s respective subgroup (e.g. sleep, affective disorders, substance abuse, eating disorders).
• Once there, create a subfolder for the specific measure.
  • Name the folder ‘Name of Measure (Measure abbreviation)”.
  • For example, “Beck Depression Inventory (BDI)”. Then, in the newly created folder, create two subfolders: Anchor Publication and Supplemental/Supporting Articles.

Step 6c: Add Zotero to OSF

• In OSF, navigate to the measure component.
• Once there, click on the ‘Add-ons’ tab near the top right-hand side of the page.
• In the ‘Select Add-ons’ box, scroll down until you find the Zotero add-on and enable it.
  • Zotero should show up in a separate box at the bottom of the page.
• On the right of the Zotero add-on, click ‘connect account’.
  • The add-on should then connect to your Zotero account.
• Finally, select the HGAPS library and respective Zotero folder within the Add-on.
• The Zotero citations should now show up as a separate box near the bottom of that measure’s main component.

If you do not have the Zotero browser extension, enter the DOI or article information in the box in the upper left hand corner as shown above.

Step 6d: Cite the anchor publication(s) and supporting articles in Zotero

• First, open the article on your browser.
• If you have the chrome extension, click the Zotero icon in the top right-hand corner of the browser and Zotero should automatically cite the page.
  • The extension will let you select which folder you want the article in.
  • Check Zotero to make sure it ended up in the right folder, if not, you can change its location by dragging the citation to the correct folder.
• If you don’t have the chrome extension, you can also create citations manually.
  • Navigate to the correct folder in Zotero, then click the green plus on the upper left-hand side of the page.
  • Select the type of media, then record the correct information in the citation.
  • Alternatively, you can simply enter the DOI if your source has one (see picture below).
    • Zotero should then cite the source automatically, however, you should look over the citation and correct/add information when necessary.