{"id":65,"date":"2024-03-26T14:16:01","date_gmt":"2024-03-26T14:16:01","guid":{"rendered":"https:\/\/routledgelearning.com\/evaluatingresearch\/?post_type=content&#038;p=65"},"modified":"2024-03-26T15:43:22","modified_gmt":"2024-03-26T15:43:22","slug":"chapter-8-evaluating-measures","status":"publish","type":"content","link":"https:\/\/routledgelearning.com\/evaluatingresearch\/student-resources\/chapter-8-evaluating-measures\/","title":{"rendered":"Chapter 8 &#8211; Evaluating Measures"},"content":{"rendered":"\n\n<section id=\"section-block--block_376e15b90da6dc3763bae51218292a65\" class=\"section-block\" style=\"background-color:#e0dbcf; padding-top:var(--wp--preset--spacing--60);padding-bottom:var(--wp--preset--spacing--60);\" class=\"align wp-block-acf-block-json-section has-background\">\n    <div class=\"container-fluid\">\n        <div class=\"acf-innerblocks-container\">\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:66.66%\"><div class=\"aioseo-breadcrumbs\"><span class=\"aioseo-breadcrumb\">\n\tHome\n<\/span><\/div>\n\n<h1 class=\"wp-block-post-title\" id=\"anchor-1-chapter-8-evaluating-measures\">Chapter 8 &#8211; Evaluating Measures<\/h1>\n\n\n<p>Besides decisions about how to select the sample, researchers\u2019 decisions about how to measure key variables in their study are some of the most influential for the study results. When it comes to accurately measuring complex concepts common in the social sciences (such characteristics or traits as well-being, achievement, impulsivity, self-doubt, etc.), there are many important considerations. The evaluation questions and examples in this chapter can help you make preliminary assessments of researchers\u2019 measurement procedures by learning more about some of the tricky matters that contribute to the validity of measures. Most of the chapter content applies to both qualitative and quantitative (as well as mixed methods) studies, where measurement can include surveys, interviews, observations, tests, and so on. This chapter is organized into three main sections: (1) Details of the Measures, (2) Efforts to Reduce Biases, and (3) Reliability and Validity of the Measures. It covers a range of issues\u2014from assessing the accuracy of data gathered on sensitive topics to considering interrater reliability and internal consistency, from using data triangulation for accurate measurement to distinctions between face and empirical validity. The end-of-chapter exercises help reinforce key takeaways.<\/p>\n<\/div>\n<\/div>\n\n<\/div>\n    <\/div>\n<\/section>\n\n\n\n<section id=\"section-block--block_c1aecdc1a409ae662f2d35984b21169f\" class=\"section-block has-background has-white-background-color\" style=\"padding-top:var(--wp--preset--spacing--50);padding-bottom:var(--wp--preset--spacing--50);\" class=\"align wp-block-acf-block-json-section has-background has-white-background-color\">\n    <div class=\"container-fluid\">\n        <div class=\"acf-innerblocks-container\">\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:66.66%\">\n<h2 class=\"wp-block-heading\" id=\"anchor-2-multiple-choice-questions\">Multiple Choice Questions<\/h2>\n\n\n<script>\n                            if (window.qmn_quiz_data === undefined) {\n                                    window.qmn_quiz_data = new Object();\n                            }\n                    <\/script><script>window.qmn_quiz_data[\"8\"] = {\"quiz_id\":\"8\",\"quiz_name\":\"Chapter 8\",\"disable_answer\":\"0\",\"ajax_show_correct\":\"0\",\"progress_bar\":\"0\",\"contact_info_location\":\"0\",\"qpages\":{\"2\":{\"id\":\"2\",\"quizID\":\"8\",\"pagekey\":\"QEKEZGzS\",\"hide_prevbtn\":\"0\"}},\"skip_validation_time_expire\":\"0\",\"timer_limit_val\":\"0\",\"disable_scroll_next_previous_click\":\"0\",\"disable_scroll_on_result\":0,\"disable_first_page\":\"1\",\"enable_result_after_timer_end\":\"0\",\"enable_quick_result_mc\":\"0\",\"end_quiz_if_wrong\":\"0\",\"form_disable_autofill\":\"0\",\"disable_mathjax\":\"0\",\"enable_quick_correct_answer_info\":\"0\",\"quick_result_correct_answer_text\":\"Correct! You have selected correct answer.\",\"quick_result_wrong_answer_text\":\"Wrong! You have selected wrong answer.\",\"quiz_processing_message\":\"\",\"quiz_limit_choice\":\"Limit of choice is reached.\",\"not_allow_after_expired_time\":0,\"scheduled_time_end\":false,\"prevent_reload\":0,\"limit_email_based_submission\":0,\"total_user_tries\":\"0\",\"is_logged_in\":false,\"pagination\":{\"amount\":\"1\",\"section_comments\":\"1\",\"total_questions\":12,\"previous_text\":\"Previous\",\"next_text\":\"Next\",\"start_quiz_survey_text\":\"Start Quiz\",\"submit_quiz_text\":\"Submit\"},\"error_messages\":{\"email_error_text\":\"Not a valid e-mail address!\",\"number_error_text\":\"This field must be a number!\",\"incorrect_error_text\":\"The entered text is not correct!\",\"empty_error_text\":\"Please complete all required fields!\",\"contact_field_required_error_text\":\"Please complete all required fields!\",\"url_error_text\":\"The entered URL is not valid!\",\"minlength_error_text\":\"Required atleast %minlength% characters.\",\"maxlength_error_text\":\"Maximum %maxlength% characters allowed.\",\"recaptcha_error_text\":\"ReCaptcha is missing\",\"phone_error_text\":\"Phone number is invalid\"},\"question_list\":{\"83\":{\"question_id\":\"83\",\"quiz_id\":\"8\",\"question_name\":\"\",\"answer_array\":\"a:4:{i:0;a:3:{i:0;s:93:\\\"An article that includes a full text of a test or questionnaire is unlikely to get published.\\\";i:1;d:0;i:2;i:0;}i:1;a:3:{i:0;s:116:\\\"If a test or questionnaire is copyrighted, researchers may be prohibited from including its items into their report.\\\";i:1;d:0;i:2;i:1;}i:2;a:3:{i:0;s:102:\\\"It is not important for a research report to provide specific items or questions from a questionnaire.\\\";i:1;d:0;i:2;i:0;}i:3;a:3:{i:0;s:98:\\\"Qualitative researchers do not need to provide information about the settings of their interviews.\\\";i:1;d:0;i:2;i:0;}}\",\"answer_one\":\"\",\"answer_one_points\":\"0\",\"answer_two\":\"\",\"answer_two_points\":\"0\",\"answer_three\":\"\",\"answer_three_points\":\"0\",\"answer_four\":\"\",\"answer_four_points\":\"0\",\"answer_five\":\"\",\"answer_five_points\":\"0\",\"answer_six\":\"\",\"answer_six_points\":\"0\",\"correct_answer\":\"0\",\"question_answer_info\":\"\",\"comments\":\"1\",\"hints\":\"\",\"question_order\":\"1\",\"question_type\":\"0\",\"question_type_new\":\"0\",\"question_settings\":\"a:14:{s:8:\\\"required\\\";i:0;s:12:\\\"answerEditor\\\";s:4:\\\"text\\\";s:14:\\\"question_title\\\";s:67:\\\"Which one of the following statements about measurement is correct?\\\";s:14:\\\"featureImageID\\\";s:0:\\\"\\\";s:15:\\\"featureImageSrc\\\";s:0:\\\"\\\";s:11:\\\"matchAnswer\\\";s:6:\\\"random\\\";s:14:\\\"case_sensitive\\\";s:0:\\\"\\\";s:16:\\\"image_size-width\\\";s:0:\\\"\\\";s:17:\\\"image_size-height\\\";s:0:\\\"\\\";s:8:\\\"autofill\\\";s:0:\\\"\\\";s:10:\\\"limit_text\\\";s:1:\\\"0\\\";s:23:\\\"limit_multiple_response\\\";s:1:\\\"0\\\";s:17:\\\"file_upload_limit\\\";s:1:\\\"0\\\";s:16:\\\"file_upload_type\\\";s:0:\\\"\\\";}\",\"category\":\"\",\"linked_question\":\"\",\"deleted\":\"0\",\"deleted_question_bank\":\"0\",\"answers\":[[\"An article that includes a full text of a test or questionnaire is unlikely to get published.\",0,0],[\"If a test or questionnaire is copyrighted, researchers may be prohibited from including its items into their report.\",0,1],[\"It is not important for a research report to provide specific items or questions from a questionnaire.\",0,0],[\"Qualitative researchers do not need to provide information about the settings of their interviews.\",0,0]]},\"84\":{\"question_id\":\"84\",\"quiz_id\":\"8\",\"question_name\":\"\",\"answer_array\":\"a:4:{i:0;a:3:{i:0;s:78:\\\"Triangulation is rarely used for measuring straightforward variables like age.\\\";i:1;d:0;i:2;i:0;}i:1;a:3:{i:0;s:75:\\\"Triangulation can be used both in qualitative and in quantitative research.\\\";i:1;d:0;i:2;i:0;}i:2;a:3:{i:0;s:84:\\\"Triangulation involves using several sources of information about the same variable.\\\";i:1;d:0;i:2;i:0;}i:3;a:3:{i:0;s:87:\\\"Triangulation involves the use of a questionnaire that has three-choice answer options.\\\";i:1;d:0;i:2;i:1;}}\",\"answer_one\":\"\",\"answer_one_points\":\"0\",\"answer_two\":\"\",\"answer_two_points\":\"0\",\"answer_three\":\"\",\"answer_three_points\":\"0\",\"answer_four\":\"\",\"answer_four_points\":\"0\",\"answer_five\":\"\",\"answer_five_points\":\"0\",\"answer_six\":\"\",\"answer_six_points\":\"0\",\"correct_answer\":\"0\",\"question_answer_info\":\"\",\"comments\":\"1\",\"hints\":\"\",\"question_order\":\"1\",\"question_type\":\"0\",\"question_type_new\":\"0\",\"question_settings\":\"a:14:{s:8:\\\"required\\\";i:0;s:12:\\\"answerEditor\\\";s:4:\\\"text\\\";s:14:\\\"question_title\\\";s:69:\\\"All of following statements correctly apply to triangulation, EXCEPT:\\\";s:14:\\\"featureImageID\\\";s:0:\\\"\\\";s:15:\\\"featureImageSrc\\\";s:0:\\\"\\\";s:11:\\\"matchAnswer\\\";s:6:\\\"random\\\";s:14:\\\"case_sensitive\\\";s:0:\\\"\\\";s:16:\\\"image_size-width\\\";s:0:\\\"\\\";s:17:\\\"image_size-height\\\";s:0:\\\"\\\";s:8:\\\"autofill\\\";s:0:\\\"\\\";s:10:\\\"limit_text\\\";s:1:\\\"0\\\";s:23:\\\"limit_multiple_response\\\";s:1:\\\"0\\\";s:17:\\\"file_upload_limit\\\";s:1:\\\"0\\\";s:16:\\\"file_upload_type\\\";s:0:\\\"\\\";}\",\"category\":\"\",\"linked_question\":\"\",\"deleted\":\"0\",\"deleted_question_bank\":\"0\",\"answers\":[[\"Triangulation is rarely used for measuring straightforward variables like age.\",0,0],[\"Triangulation can be used both in qualitative and in quantitative research.\",0,0],[\"Triangulation involves using several sources of information about the same variable.\",0,0],[\"Triangulation involves the use of a questionnaire that has three-choice answer options.\",0,1]]},\"85\":{\"question_id\":\"85\",\"quiz_id\":\"8\",\"question_name\":\"\",\"answer_array\":\"a:4:{i:0;a:3:{i:0;s:19:\\\"Level of education.\\\";i:1;d:0;i:2;i:0;}i:1;a:3:{i:0;s:18:\\\"Diet restrictions.\\\";i:1;d:0;i:2;i:0;}i:2;a:3:{i:0;s:14:\\\"Substance use.\\\";i:1;d:0;i:2;i:1;}i:3;a:3:{i:0;s:16:\\\"Vacation habits.\\\";i:1;d:0;i:2;i:0;}}\",\"answer_one\":\"\",\"answer_one_points\":\"0\",\"answer_two\":\"\",\"answer_two_points\":\"0\",\"answer_three\":\"\",\"answer_three_points\":\"0\",\"answer_four\":\"\",\"answer_four_points\":\"0\",\"answer_five\":\"\",\"answer_five_points\":\"0\",\"answer_six\":\"\",\"answer_six_points\":\"0\",\"correct_answer\":\"0\",\"question_answer_info\":\"\",\"comments\":\"1\",\"hints\":\"\",\"question_order\":\"1\",\"question_type\":\"0\",\"question_type_new\":\"0\",\"question_settings\":\"a:14:{s:8:\\\"required\\\";i:0;s:12:\\\"answerEditor\\\";s:4:\\\"text\\\";s:14:\\\"question_title\\\";s:201:\\\"Sometimes, survey questions concern sensitive matters that can make people uncomfortable. Which of the following topics is likely to be the most problematic one in terms of the truthfulness of answers?\\\";s:14:\\\"featureImageID\\\";s:0:\\\"\\\";s:15:\\\"featureImageSrc\\\";s:0:\\\"\\\";s:11:\\\"matchAnswer\\\";s:6:\\\"random\\\";s:14:\\\"case_sensitive\\\";s:0:\\\"\\\";s:16:\\\"image_size-width\\\";s:0:\\\"\\\";s:17:\\\"image_size-height\\\";s:0:\\\"\\\";s:8:\\\"autofill\\\";s:0:\\\"\\\";s:10:\\\"limit_text\\\";s:1:\\\"0\\\";s:23:\\\"limit_multiple_response\\\";s:1:\\\"0\\\";s:17:\\\"file_upload_limit\\\";s:1:\\\"0\\\";s:16:\\\"file_upload_type\\\";s:0:\\\"\\\";}\",\"category\":\"\",\"linked_question\":\"\",\"deleted\":\"0\",\"deleted_question_bank\":\"0\",\"answers\":[[\"Level of education.\",0,0],[\"Diet restrictions.\",0,0],[\"Substance use.\",0,1],[\"Vacation habits.\",0,0]]},\"86\":{\"question_id\":\"86\",\"quiz_id\":\"8\",\"question_name\":\"\",\"answer_array\":\"a:4:{i:0;a:3:{i:0;s:64:\\\"Observing participants who do not know they are part of a study.\\\";i:1;d:0;i:2;i:1;}i:1;a:3:{i:0;s:66:\\\"Observing participants by making it a routine part of the setting.\\\";i:1;d:0;i:2;i:0;}i:2;a:3:{i:0;s:83:\\\"Letting participants fill out the survey questionnaire anonymously and untraceably.\\\";i:1;d:0;i:2;i:0;}i:3;a:3:{i:0;s:110:\\\"On sensitive topics, asking participants what they think their peers do before asking what they themselves do.\\\";i:1;d:0;i:2;i:0;}}\",\"answer_one\":\"\",\"answer_one_points\":\"0\",\"answer_two\":\"\",\"answer_two_points\":\"0\",\"answer_three\":\"\",\"answer_three_points\":\"0\",\"answer_four\":\"\",\"answer_four_points\":\"0\",\"answer_five\":\"\",\"answer_five_points\":\"0\",\"answer_six\":\"\",\"answer_six_points\":\"0\",\"correct_answer\":\"0\",\"question_answer_info\":\"\",\"comments\":\"1\",\"hints\":\"\",\"question_order\":\"1\",\"question_type\":\"0\",\"question_type_new\":\"0\",\"question_settings\":\"a:14:{s:8:\\\"required\\\";i:0;s:12:\\\"answerEditor\\\";s:4:\\\"text\\\";s:14:\\\"question_title\\\";s:129:\\\"All of the following strategies can be ethically used by researchers to ensure their observations and measures are valid, EXCEPT:\\\";s:14:\\\"featureImageID\\\";s:0:\\\"\\\";s:15:\\\"featureImageSrc\\\";s:0:\\\"\\\";s:11:\\\"matchAnswer\\\";s:6:\\\"random\\\";s:14:\\\"case_sensitive\\\";s:0:\\\"\\\";s:16:\\\"image_size-width\\\";s:0:\\\"\\\";s:17:\\\"image_size-height\\\";s:0:\\\"\\\";s:8:\\\"autofill\\\";s:0:\\\"\\\";s:10:\\\"limit_text\\\";s:1:\\\"0\\\";s:23:\\\"limit_multiple_response\\\";s:1:\\\"0\\\";s:17:\\\"file_upload_limit\\\";s:1:\\\"0\\\";s:16:\\\"file_upload_type\\\";s:0:\\\"\\\";}\",\"category\":\"\",\"linked_question\":\"\",\"deleted\":\"0\",\"deleted_question_bank\":\"0\",\"answers\":[[\"Observing participants who do not know they are part of a study.\",0,1],[\"Observing participants by making it a routine part of the setting.\",0,0],[\"Letting participants fill out the survey questionnaire anonymously and untraceably.\",0,0],[\"On sensitive topics, asking participants what they think their peers do before asking what they themselves do.\",0,0]]},\"87\":{\"question_id\":\"87\",\"quiz_id\":\"8\",\"question_name\":\"\",\"answer_array\":\"a:4:{i:0;a:3:{i:0;s:47:\\\"Have several observers rate the same behaviors.\\\";i:1;d:0;i:2;i:1;}i:1;a:3:{i:0;s:69:\\\"Have unsuspecting study participants rate each other after the study.\\\";i:1;d:0;i:2;i:0;}i:2;a:3:{i:0;s:55:\\\"Ask everybody present how they interpret the situation.\\\";i:1;d:0;i:2;i:0;}i:3;a:3:{i:0;s:52:\\\"Ask the participant to rate his or her own behavior.\\\";i:1;d:0;i:2;i:0;}}\",\"answer_one\":\"\",\"answer_one_points\":\"0\",\"answer_two\":\"\",\"answer_two_points\":\"0\",\"answer_three\":\"\",\"answer_three_points\":\"0\",\"answer_four\":\"\",\"answer_four_points\":\"0\",\"answer_five\":\"\",\"answer_five_points\":\"0\",\"answer_six\":\"\",\"answer_six_points\":\"0\",\"correct_answer\":\"0\",\"question_answer_info\":\"\",\"comments\":\"1\",\"hints\":\"\",\"question_order\":\"1\",\"question_type\":\"0\",\"question_type_new\":\"0\",\"question_settings\":\"a:14:{s:8:\\\"required\\\";i:0;s:12:\\\"answerEditor\\\";s:4:\\\"text\\\";s:14:\\\"question_title\\\";s:81:\\\"What is the most valid way to reduce the subjectivity of observations in a study?\\\";s:14:\\\"featureImageID\\\";s:0:\\\"\\\";s:15:\\\"featureImageSrc\\\";s:0:\\\"\\\";s:11:\\\"matchAnswer\\\";s:6:\\\"random\\\";s:14:\\\"case_sensitive\\\";s:0:\\\"\\\";s:16:\\\"image_size-width\\\";s:0:\\\"\\\";s:17:\\\"image_size-height\\\";s:0:\\\"\\\";s:8:\\\"autofill\\\";s:0:\\\"\\\";s:10:\\\"limit_text\\\";s:1:\\\"0\\\";s:23:\\\"limit_multiple_response\\\";s:1:\\\"0\\\";s:17:\\\"file_upload_limit\\\";s:1:\\\"0\\\";s:16:\\\"file_upload_type\\\";s:0:\\\"\\\";}\",\"category\":\"\",\"linked_question\":\"\",\"deleted\":\"0\",\"deleted_question_bank\":\"0\",\"answers\":[[\"Have several observers rate the same behaviors.\",0,1],[\"Have unsuspecting study participants rate each other after the study.\",0,0],[\"Ask everybody present how they interpret the situation.\",0,0],[\"Ask the participant to rate his or her own behavior.\",0,0]]},\"88\":{\"question_id\":\"88\",\"quiz_id\":\"8\",\"question_name\":\"\",\"answer_array\":\"a:4:{i:0;a:3:{i:0;s:59:\\\"Interrater reliability is the same as internal consistency.\\\";i:1;d:0;i:2;i:0;}i:1;a:3:{i:0;s:57:\\\"Interrater reliability is the same as temporal stability.\\\";i:1;d:0;i:2;i:0;}i:2;a:3:{i:0;s:66:\\\"Interrater reliability is calculated as a correlation coefficient.\\\";i:1;d:0;i:2;i:1;}i:3;a:3:{i:0;s:84:\\\"Interrater reliability refers to the correlation between two split-halves of a test.\\\";i:1;d:0;i:2;i:0;}}\",\"answer_one\":\"\",\"answer_one_points\":\"0\",\"answer_two\":\"\",\"answer_two_points\":\"0\",\"answer_three\":\"\",\"answer_three_points\":\"0\",\"answer_four\":\"\",\"answer_four_points\":\"0\",\"answer_five\":\"\",\"answer_five_points\":\"0\",\"answer_six\":\"\",\"answer_six_points\":\"0\",\"correct_answer\":\"0\",\"question_answer_info\":\"\",\"comments\":\"1\",\"hints\":\"\",\"question_order\":\"1\",\"question_type\":\"0\",\"question_type_new\":\"0\",\"question_settings\":\"a:14:{s:8:\\\"required\\\";i:0;s:12:\\\"answerEditor\\\";s:4:\\\"text\\\";s:14:\\\"question_title\\\";s:78:\\\"Which one of the following statements about interrater reliability is correct?\\\";s:14:\\\"featureImageID\\\";s:0:\\\"\\\";s:15:\\\"featureImageSrc\\\";s:0:\\\"\\\";s:11:\\\"matchAnswer\\\";s:6:\\\"random\\\";s:14:\\\"case_sensitive\\\";s:0:\\\"\\\";s:16:\\\"image_size-width\\\";s:0:\\\"\\\";s:17:\\\"image_size-height\\\";s:0:\\\"\\\";s:8:\\\"autofill\\\";s:0:\\\"\\\";s:10:\\\"limit_text\\\";s:1:\\\"0\\\";s:23:\\\"limit_multiple_response\\\";s:1:\\\"0\\\";s:17:\\\"file_upload_limit\\\";s:1:\\\"0\\\";s:16:\\\"file_upload_type\\\";s:0:\\\"\\\";}\",\"category\":\"\",\"linked_question\":\"\",\"deleted\":\"0\",\"deleted_question_bank\":\"0\",\"answers\":[[\"Interrater reliability is the same as internal consistency.\",0,0],[\"Interrater reliability is the same as temporal stability.\",0,0],[\"Interrater reliability is calculated as a correlation coefficient.\",0,1],[\"Interrater reliability refers to the correlation between two split-halves of a test.\",0,0]]},\"89\":{\"question_id\":\"89\",\"quiz_id\":\"8\",\"question_name\":\"\",\"answer_array\":\"a:4:{i:0;a:3:{i:0;s:45:\\\"When two raters cannot agree on a test grade.\\\";i:1;d:0;i:2;i:0;}i:1;a:3:{i:0;s:54:\\\"When the coding of observations involves subjectivity.\\\";i:1;d:0;i:2;i:1;}i:2;a:3:{i:0;s:37:\\\"When aggressive behavior is measured.\\\";i:1;d:0;i:2;i:0;}i:3;a:3:{i:0;s:48:\\\"When test scores vary widely among participants.\\\";i:1;d:0;i:2;i:0;}}\",\"answer_one\":\"\",\"answer_one_points\":\"0\",\"answer_two\":\"\",\"answer_two_points\":\"0\",\"answer_three\":\"\",\"answer_three_points\":\"0\",\"answer_four\":\"\",\"answer_four_points\":\"0\",\"answer_five\":\"\",\"answer_five_points\":\"0\",\"answer_six\":\"\",\"answer_six_points\":\"0\",\"correct_answer\":\"0\",\"question_answer_info\":\"\",\"comments\":\"1\",\"hints\":\"\",\"question_order\":\"1\",\"question_type\":\"0\",\"question_type_new\":\"0\",\"question_settings\":\"a:14:{s:8:\\\"required\\\";i:0;s:12:\\\"answerEditor\\\";s:4:\\\"text\\\";s:14:\\\"question_title\\\";s:61:\\\"When do researchers need to calculate interrater reliability?\\\";s:14:\\\"featureImageID\\\";s:0:\\\"\\\";s:15:\\\"featureImageSrc\\\";s:0:\\\"\\\";s:11:\\\"matchAnswer\\\";s:6:\\\"random\\\";s:14:\\\"case_sensitive\\\";s:0:\\\"\\\";s:16:\\\"image_size-width\\\";s:0:\\\"\\\";s:17:\\\"image_size-height\\\";s:0:\\\"\\\";s:8:\\\"autofill\\\";s:0:\\\"\\\";s:10:\\\"limit_text\\\";s:1:\\\"0\\\";s:23:\\\"limit_multiple_response\\\";s:1:\\\"0\\\";s:17:\\\"file_upload_limit\\\";s:1:\\\"0\\\";s:16:\\\"file_upload_type\\\";s:0:\\\"\\\";}\",\"category\":\"\",\"linked_question\":\"\",\"deleted\":\"0\",\"deleted_question_bank\":\"0\",\"answers\":[[\"When two raters cannot agree on a test grade.\",0,0],[\"When the coding of observations involves subjectivity.\",0,1],[\"When aggressive behavior is measured.\",0,0],[\"When test scores vary widely among participants.\",0,0]]},\"90\":{\"question_id\":\"90\",\"quiz_id\":\"8\",\"question_name\":\"\",\"answer_array\":\"a:4:{i:0;a:3:{i:0;s:79:\\\"Internal consistency is measured using a coefficient called Cronbach\\u2019s alpha.\\\";i:1;d:0;i:2;i:0;}i:1;a:3:{i:0;s:78:\\\"Internal consistency is calculated to ensure all items measure the same trait.\\\";i:1;d:0;i:2;i:0;}i:2;a:3:{i:0;s:85:\\\"Internal consistency can only be calculated among items measured in numerical scores.\\\";i:1;d:0;i:2;i:0;}i:3;a:3:{i:0;s:84:\\\"Internal consistency is especially important for comparing qualitative observations.\\\";i:1;d:0;i:2;i:1;}}\",\"answer_one\":\"\",\"answer_one_points\":\"0\",\"answer_two\":\"\",\"answer_two_points\":\"0\",\"answer_three\":\"\",\"answer_three_points\":\"0\",\"answer_four\":\"\",\"answer_four_points\":\"0\",\"answer_five\":\"\",\"answer_five_points\":\"0\",\"answer_six\":\"\",\"answer_six_points\":\"0\",\"correct_answer\":\"0\",\"question_answer_info\":\"\",\"comments\":\"1\",\"hints\":\"\",\"question_order\":\"1\",\"question_type\":\"0\",\"question_type_new\":\"0\",\"question_settings\":\"a:14:{s:8:\\\"required\\\";i:0;s:12:\\\"answerEditor\\\";s:4:\\\"text\\\";s:14:\\\"question_title\\\";s:79:\\\"All of the following statements about internal consistency are correct, EXCEPT:\\\";s:14:\\\"featureImageID\\\";s:0:\\\"\\\";s:15:\\\"featureImageSrc\\\";s:0:\\\"\\\";s:11:\\\"matchAnswer\\\";s:6:\\\"random\\\";s:14:\\\"case_sensitive\\\";s:0:\\\"\\\";s:16:\\\"image_size-width\\\";s:0:\\\"\\\";s:17:\\\"image_size-height\\\";s:0:\\\"\\\";s:8:\\\"autofill\\\";s:0:\\\"\\\";s:10:\\\"limit_text\\\";s:1:\\\"0\\\";s:23:\\\"limit_multiple_response\\\";s:1:\\\"0\\\";s:17:\\\"file_upload_limit\\\";s:1:\\\"0\\\";s:16:\\\"file_upload_type\\\";s:0:\\\"\\\";}\",\"category\":\"\",\"linked_question\":\"\",\"deleted\":\"0\",\"deleted_question_bank\":\"0\",\"answers\":[[\"Internal consistency is measured using a coefficient called Cronbach\\u2019s alpha.\",0,0],[\"Internal consistency is calculated to ensure all items measure the same trait.\",0,0],[\"Internal consistency can only be calculated among items measured in numerical scores.\",0,0],[\"Internal consistency is especially important for comparing qualitative observations.\",0,1]]},\"91\":{\"question_id\":\"91\",\"quiz_id\":\"8\",\"question_name\":\"\",\"answer_array\":\"a:4:{i:0;a:3:{i:0;s:69:\\\"Empirical validity is rarely discussed in detail in research reports.\\\";i:1;d:0;i:2;i:1;}i:1;a:3:{i:0;s:81:\\\"Empirical validity ensures that the measure can be used in open-ended interviews.\\\";i:1;d:0;i:2;i:0;}i:2;a:3:{i:0;s:68:\\\"Empirical validity can only be established through content validity.\\\";i:1;d:0;i:2;i:0;}i:3;a:3:{i:0;s:79:\\\"Empirical validity is best calculated through a pilot administration of a test.\\\";i:1;d:0;i:2;i:0;}}\",\"answer_one\":\"\",\"answer_one_points\":\"0\",\"answer_two\":\"\",\"answer_two_points\":\"0\",\"answer_three\":\"\",\"answer_three_points\":\"0\",\"answer_four\":\"\",\"answer_four_points\":\"0\",\"answer_five\":\"\",\"answer_five_points\":\"0\",\"answer_six\":\"\",\"answer_six_points\":\"0\",\"correct_answer\":\"0\",\"question_answer_info\":\"\",\"comments\":\"1\",\"hints\":\"\",\"question_order\":\"1\",\"question_type\":\"0\",\"question_type_new\":\"0\",\"question_settings\":\"a:14:{s:8:\\\"required\\\";i:0;s:12:\\\"answerEditor\\\";s:4:\\\"text\\\";s:14:\\\"question_title\\\";s:74:\\\"Which one of the following statements about empirical validity is CORRECT?\\\";s:14:\\\"featureImageID\\\";s:0:\\\"\\\";s:15:\\\"featureImageSrc\\\";s:0:\\\"\\\";s:11:\\\"matchAnswer\\\";s:6:\\\"random\\\";s:14:\\\"case_sensitive\\\";s:0:\\\"\\\";s:16:\\\"image_size-width\\\";s:0:\\\"\\\";s:17:\\\"image_size-height\\\";s:0:\\\"\\\";s:8:\\\"autofill\\\";s:0:\\\"\\\";s:10:\\\"limit_text\\\";s:1:\\\"0\\\";s:23:\\\"limit_multiple_response\\\";s:1:\\\"0\\\";s:17:\\\"file_upload_limit\\\";s:1:\\\"0\\\";s:16:\\\"file_upload_type\\\";s:0:\\\"\\\";}\",\"category\":\"\",\"linked_question\":\"\",\"deleted\":\"0\",\"deleted_question_bank\":\"0\",\"answers\":[[\"Empirical validity is rarely discussed in detail in research reports.\",0,1],[\"Empirical validity ensures that the measure can be used in open-ended interviews.\",0,0],[\"Empirical validity can only be established through content validity.\",0,0],[\"Empirical validity is best calculated through a pilot administration of a test.\",0,0]]},\"92\":{\"question_id\":\"92\",\"quiz_id\":\"8\",\"question_name\":\"\",\"answer_array\":\"a:0:{}\",\"answer_one\":\"\",\"answer_one_points\":\"0\",\"answer_two\":\"\",\"answer_two_points\":\"0\",\"answer_three\":\"\",\"answer_three_points\":\"0\",\"answer_four\":\"\",\"answer_four_points\":\"0\",\"answer_five\":\"\",\"answer_five_points\":\"0\",\"answer_six\":\"\",\"answer_six_points\":\"0\",\"correct_answer\":\"0\",\"question_answer_info\":\"\",\"comments\":\"1\",\"hints\":\"\",\"question_order\":\"1\",\"question_type\":\"0\",\"question_type_new\":\"0\",\"question_settings\":\"a:3:{s:8:\\\"required\\\";i:1;s:12:\\\"answerEditor\\\";s:4:\\\"text\\\";s:14:\\\"question_title\\\";s:0:\\\"\\\";}\",\"category\":\"\",\"linked_question\":\"\",\"deleted\":\"0\",\"deleted_question_bank\":\"0\",\"answers\":[]},\"93\":{\"question_id\":\"93\",\"quiz_id\":\"8\",\"question_name\":\"\",\"answer_array\":\"a:4:{i:0;a:3:{i:0;s:83:\\\"If a questionnaire measures a homogenous trait, it should be internally consistent.\\\";i:1;d:0;i:2;i:0;}i:1;a:3:{i:0;s:89:\\\"Temporal stability is important for measures of traits that do not change much over time.\\\";i:1;d:0;i:2;i:0;}i:2;a:3:{i:0;s:73:\\\"Empirical validity of a measure is more objective than its face validity.\\\";i:1;d:0;i:2;i:0;}i:3;a:3:{i:0;s:80:\\\"Empirical validity is more suitable for qualitative measures such as interviews.\\\";i:1;d:0;i:2;i:1;}}\",\"answer_one\":\"\",\"answer_one_points\":\"0\",\"answer_two\":\"\",\"answer_two_points\":\"0\",\"answer_three\":\"\",\"answer_three_points\":\"0\",\"answer_four\":\"\",\"answer_four_points\":\"0\",\"answer_five\":\"\",\"answer_five_points\":\"0\",\"answer_six\":\"\",\"answer_six_points\":\"0\",\"correct_answer\":\"0\",\"question_answer_info\":\"\",\"comments\":\"1\",\"hints\":\"\",\"question_order\":\"1\",\"question_type\":\"0\",\"question_type_new\":\"0\",\"question_settings\":\"a:14:{s:8:\\\"required\\\";i:0;s:12:\\\"answerEditor\\\";s:4:\\\"text\\\";s:14:\\\"question_title\\\";s:98:\\\"Which one of the following statements about the validity and reliability of measures is INCORRECT?\\\";s:14:\\\"featureImageID\\\";s:0:\\\"\\\";s:15:\\\"featureImageSrc\\\";s:0:\\\"\\\";s:11:\\\"matchAnswer\\\";s:6:\\\"random\\\";s:14:\\\"case_sensitive\\\";s:0:\\\"\\\";s:16:\\\"image_size-width\\\";s:0:\\\"\\\";s:17:\\\"image_size-height\\\";s:0:\\\"\\\";s:8:\\\"autofill\\\";s:0:\\\"\\\";s:10:\\\"limit_text\\\";s:1:\\\"0\\\";s:23:\\\"limit_multiple_response\\\";s:1:\\\"0\\\";s:17:\\\"file_upload_limit\\\";s:1:\\\"0\\\";s:16:\\\"file_upload_type\\\";s:0:\\\"\\\";}\",\"category\":\"\",\"linked_question\":\"\",\"deleted\":\"0\",\"deleted_question_bank\":\"0\",\"answers\":[[\"If a questionnaire measures a homogenous trait, it should be internally consistent.\",0,0],[\"Temporal stability is important for measures of traits that do not change much over time.\",0,0],[\"Empirical validity of a measure is more objective than its face validity.\",0,0],[\"Empirical validity is more suitable for qualitative measures such as interviews.\",0,1]]},\"94\":{\"question_id\":\"94\",\"quiz_id\":\"8\",\"question_name\":\"\",\"answer_array\":\"a:4:{i:0;a:3:{i:0;s:70:\\\"It ensures that the measures used in the study are valid and reliable.\\\";i:1;d:0;i:2;i:0;}i:1;a:3:{i:0;s:74:\\\"It helps the readers understand how much the study results can be trusted.\\\";i:1;d:0;i:2;i:1;}i:2;a:3:{i:0;s:85:\\\"Research reports are written for non-specialists who do not know much about research.\\\";i:1;d:0;i:2;i:0;}i:3;a:3:{i:0;s:93:\\\"Journal editors are more likely to publish an article with a detailed discussion of measures.\\\";i:1;d:0;i:2;i:0;}}\",\"answer_one\":\"\",\"answer_one_points\":\"0\",\"answer_two\":\"\",\"answer_two_points\":\"0\",\"answer_three\":\"\",\"answer_three_points\":\"0\",\"answer_four\":\"\",\"answer_four_points\":\"0\",\"answer_five\":\"\",\"answer_five_points\":\"0\",\"answer_six\":\"\",\"answer_six_points\":\"0\",\"correct_answer\":\"0\",\"question_answer_info\":\"\",\"comments\":\"1\",\"hints\":\"\",\"question_order\":\"1\",\"question_type\":\"0\",\"question_type_new\":\"0\",\"question_settings\":\"a:14:{s:8:\\\"required\\\";i:0;s:12:\\\"answerEditor\\\";s:4:\\\"text\\\";s:14:\\\"question_title\\\";s:106:\\\"What is the main reason for researchers to discuss the limitations of their measures in a research report?\\\";s:14:\\\"featureImageID\\\";s:0:\\\"\\\";s:15:\\\"featureImageSrc\\\";s:0:\\\"\\\";s:11:\\\"matchAnswer\\\";s:6:\\\"random\\\";s:14:\\\"case_sensitive\\\";s:0:\\\"\\\";s:16:\\\"image_size-width\\\";s:0:\\\"\\\";s:17:\\\"image_size-height\\\";s:0:\\\"\\\";s:8:\\\"autofill\\\";s:0:\\\"\\\";s:10:\\\"limit_text\\\";s:1:\\\"0\\\";s:23:\\\"limit_multiple_response\\\";s:1:\\\"0\\\";s:17:\\\"file_upload_limit\\\";s:1:\\\"0\\\";s:16:\\\"file_upload_type\\\";s:0:\\\"\\\";}\",\"category\":\"\",\"linked_question\":\"\",\"deleted\":\"0\",\"deleted_question_bank\":\"0\",\"answers\":[[\"It ensures that the measures used in the study are valid and reliable.\",0,0],[\"It helps the readers understand how much the study results can be trusted.\",0,1],[\"Research reports are written for non-specialists who do not know much about research.\",0,0],[\"Journal editors are more likely to publish an article with a detailed discussion of measures.\",0,0]]}},\"first_page\":false,\"questions_settings\":[]}\n                    <\/script>\t\t<div class='qsm-quiz-container qsm-quiz-container-8 qmn_quiz_container mlw_qmn_quiz qsm_auto_pagination_enabled quiz_theme_default  '>\n\t\t\t\t\t\t\t\t<form name=\"quizForm8\" id=\"quizForm8\" action=\"\/evaluatingresearch\/wp-json\/wp\/v2\/content\/65\" method=\"POST\" class=\"qsm-quiz-form qmn_quiz_form mlw_quiz_form\" novalidate enctype=\"multipart\/form-data\">\n\t\t\t\t<input type=\"hidden\" name=\"qsm_hidden_questions\" id=\"qsm_hidden_questions\" value=\"\">\n\t\t\t\t<input type=\"hidden\" name=\"qsm_nonce\" id=\"qsm_nonce_8\" value=\"acb253bb67\">\n\t\t\t\t<input type=\"hidden\" name=\"qsm_unique_key\" id=\"qsm_unique_key_8\" value=\"69eba9532f8e2\">\n\t\t\t\t<div id=\"mlw_error_message\" class=\"qsm-error-message qmn_error_message_section\"><\/div>\n\t\t\t\t<span id=\"mlw_top_of_quiz\"><\/span>\n\t\t\t\t\t\t\t\t\t<div class=\"qsm-auto-page-row qsm-question-page qsm-apc-1\" data-apid=\"1\" data-qpid=\"1\" style=\"display: none;\">\n\t\t\t\t\t\t\t\t<div class=\"quiz_section qsm-question-wrapper question-type-0  question-section-id-83 slide0 \">\n\t\t\t\t\t\t\t\t\t\t<span class='mlw_qmn_question_number'>1.&nbsp;<\/span>\n\t\t\t\t\t\t\t\t<div class='mlw_qmn_new_question'>Which one of the following statements about measurement is correct? <\/div>\n\t\t\t<div class='mlw_qmn_question  qsm_remove_bold' >\n\t\t<p><\/p>\n\t<\/div>\n\t\t<fieldset>\n\t\t<legend><\/legend>\n\t<div class='qmn_radio_answers mlwRequiredRadio'>\n\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question83-1 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question83\" id=\"question83_1\" value=\"0\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question83_1\">\n\t\t\t\t\tAn article that includes a full text of a test or questionnaire is unlikely to get published.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question83-2 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question83\" id=\"question83_2\" value=\"1\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question83_2\">\n\t\t\t\t\tIf a test or questionnaire is copyrighted, researchers may be prohibited from including its items into their report.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question83-3 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question83\" id=\"question83_3\" value=\"2\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question83_3\">\n\t\t\t\t\tIt is not important for a research report to provide specific items or questions from a questionnaire.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question83-4 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question83\" id=\"question83_4\" value=\"3\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question83_4\">\n\t\t\t\t\tQualitative researchers do not need to provide information about the settings of their interviews.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t \t\t\t<label style=\"display: none !important;\" for=\"question83_none\">None<\/label>\n\t\t\t<input type=\"radio\" style=\"display: none;\" name=\"question83\" id=\"question83_none\" checked=\"checked\" value=\"\" \/>\n\t\t\t\t<\/div>\n\t<\/fieldset>\n\t<input type=\"hidden\" name=\"answer_limit_keys_83\" value=\"\" \/>\n\t\t\t\t<\/div><!-- .quiz_section -->\n\t\t\t\t\t\t\t\t<\/div><!-- .qsm-auto-page-row -->\n\t\t\t\t\t\t\t\t\t\t<div class=\"qsm-auto-page-row qsm-question-page qsm-apc-2\" data-apid=\"2\" data-qpid=\"2\" style=\"display: none;\">\n\t\t\t\t\t\t\t\t<div class=\"quiz_section qsm-question-wrapper question-type-0  question-section-id-84 slide1 \">\n\t\t\t\t\t\t\t\t\t\t<span class='mlw_qmn_question_number'>2.&nbsp;<\/span>\n\t\t\t\t\t\t\t\t<div class='mlw_qmn_new_question'>All of following statements correctly apply to triangulation, EXCEPT: <\/div>\n\t\t\t<div class='mlw_qmn_question  qsm_remove_bold' >\n\t\t<p><\/p>\n\t<\/div>\n\t\t<fieldset>\n\t\t<legend><\/legend>\n\t<div class='qmn_radio_answers mlwRequiredRadio'>\n\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question84-1 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question84\" id=\"question84_1\" value=\"0\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question84_1\">\n\t\t\t\t\tTriangulation is rarely used for measuring straightforward variables like age.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question84-2 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question84\" id=\"question84_2\" value=\"1\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question84_2\">\n\t\t\t\t\tTriangulation can be used both in qualitative and in quantitative research.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question84-3 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question84\" id=\"question84_3\" value=\"2\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question84_3\">\n\t\t\t\t\tTriangulation involves using several sources of information about the same variable.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question84-4 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question84\" id=\"question84_4\" value=\"3\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question84_4\">\n\t\t\t\t\tTriangulation involves the use of a questionnaire that has three-choice answer options.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t \t\t\t<label style=\"display: none !important;\" for=\"question84_none\">None<\/label>\n\t\t\t<input type=\"radio\" style=\"display: none;\" name=\"question84\" id=\"question84_none\" checked=\"checked\" value=\"\" \/>\n\t\t\t\t<\/div>\n\t<\/fieldset>\n\t<input type=\"hidden\" name=\"answer_limit_keys_84\" value=\"\" \/>\n\t\t\t\t<\/div><!-- .quiz_section -->\n\t\t\t\t\t\t\t\t<\/div><!-- .qsm-auto-page-row -->\n\t\t\t\t\t\t\t\t\t\t<div class=\"qsm-auto-page-row qsm-question-page qsm-apc-3\" data-apid=\"3\" data-qpid=\"3\" style=\"display: none;\">\n\t\t\t\t\t\t\t\t<div class=\"quiz_section qsm-question-wrapper question-type-0  question-section-id-85 slide2 \">\n\t\t\t\t\t\t\t\t\t\t<span class='mlw_qmn_question_number'>3.&nbsp;<\/span>\n\t\t\t\t\t\t\t\t<div class='mlw_qmn_new_question'>Sometimes, survey questions concern sensitive matters that can make people uncomfortable. Which of the following topics is likely to be the most problematic one in terms of the truthfulness of answers? <\/div>\n\t\t\t<div class='mlw_qmn_question  qsm_remove_bold' >\n\t\t<p><\/p>\n\t<\/div>\n\t\t<fieldset>\n\t\t<legend><\/legend>\n\t<div class='qmn_radio_answers mlwRequiredRadio'>\n\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question85-1 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question85\" id=\"question85_1\" value=\"0\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question85_1\">\n\t\t\t\t\tLevel of education.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question85-2 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question85\" id=\"question85_2\" value=\"1\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question85_2\">\n\t\t\t\t\tDiet restrictions.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question85-3 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question85\" id=\"question85_3\" value=\"2\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question85_3\">\n\t\t\t\t\tSubstance use.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question85-4 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question85\" id=\"question85_4\" value=\"3\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question85_4\">\n\t\t\t\t\tVacation habits.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t \t\t\t<label style=\"display: none !important;\" for=\"question85_none\">None<\/label>\n\t\t\t<input type=\"radio\" style=\"display: none;\" name=\"question85\" id=\"question85_none\" checked=\"checked\" value=\"\" \/>\n\t\t\t\t<\/div>\n\t<\/fieldset>\n\t<input type=\"hidden\" name=\"answer_limit_keys_85\" value=\"\" \/>\n\t\t\t\t<\/div><!-- .quiz_section -->\n\t\t\t\t\t\t\t\t<\/div><!-- .qsm-auto-page-row -->\n\t\t\t\t\t\t\t\t\t\t<div class=\"qsm-auto-page-row qsm-question-page qsm-apc-4\" data-apid=\"4\" data-qpid=\"4\" style=\"display: none;\">\n\t\t\t\t\t\t\t\t<div class=\"quiz_section qsm-question-wrapper question-type-0  question-section-id-86 slide3 \">\n\t\t\t\t\t\t\t\t\t\t<span class='mlw_qmn_question_number'>4.&nbsp;<\/span>\n\t\t\t\t\t\t\t\t<div class='mlw_qmn_new_question'>All of the following strategies can be ethically used by researchers to ensure their observations and measures are valid, EXCEPT: <\/div>\n\t\t\t<div class='mlw_qmn_question  qsm_remove_bold' >\n\t\t<p><\/p>\n\t<\/div>\n\t\t<fieldset>\n\t\t<legend><\/legend>\n\t<div class='qmn_radio_answers mlwRequiredRadio'>\n\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question86-1 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question86\" id=\"question86_1\" value=\"0\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question86_1\">\n\t\t\t\t\tObserving participants who do not know they are part of a study.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question86-2 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question86\" id=\"question86_2\" value=\"1\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question86_2\">\n\t\t\t\t\tObserving participants by making it a routine part of the setting.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question86-3 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question86\" id=\"question86_3\" value=\"2\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question86_3\">\n\t\t\t\t\tLetting participants fill out the survey questionnaire anonymously and untraceably.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question86-4 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question86\" id=\"question86_4\" value=\"3\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question86_4\">\n\t\t\t\t\tOn sensitive topics, asking participants what they think their peers do before asking what they themselves do.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t \t\t\t<label style=\"display: none !important;\" for=\"question86_none\">None<\/label>\n\t\t\t<input type=\"radio\" style=\"display: none;\" name=\"question86\" id=\"question86_none\" checked=\"checked\" value=\"\" \/>\n\t\t\t\t<\/div>\n\t<\/fieldset>\n\t<input type=\"hidden\" name=\"answer_limit_keys_86\" value=\"\" \/>\n\t\t\t\t<\/div><!-- .quiz_section -->\n\t\t\t\t\t\t\t\t<\/div><!-- .qsm-auto-page-row -->\n\t\t\t\t\t\t\t\t\t\t<div class=\"qsm-auto-page-row qsm-question-page qsm-apc-5\" data-apid=\"5\" data-qpid=\"5\" style=\"display: none;\">\n\t\t\t\t\t\t\t\t<div class=\"quiz_section qsm-question-wrapper question-type-0  question-section-id-87 slide4 \">\n\t\t\t\t\t\t\t\t\t\t<span class='mlw_qmn_question_number'>5.&nbsp;<\/span>\n\t\t\t\t\t\t\t\t<div class='mlw_qmn_new_question'>What is the most valid way to reduce the subjectivity of observations in a study? <\/div>\n\t\t\t<div class='mlw_qmn_question  qsm_remove_bold' >\n\t\t<p><\/p>\n\t<\/div>\n\t\t<fieldset>\n\t\t<legend><\/legend>\n\t<div class='qmn_radio_answers mlwRequiredRadio'>\n\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question87-1 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question87\" id=\"question87_1\" value=\"0\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question87_1\">\n\t\t\t\t\tHave several observers rate the same behaviors.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question87-2 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question87\" id=\"question87_2\" value=\"1\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question87_2\">\n\t\t\t\t\tHave unsuspecting study participants rate each other after the study.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question87-3 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question87\" id=\"question87_3\" value=\"2\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question87_3\">\n\t\t\t\t\tAsk everybody present how they interpret the situation.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question87-4 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question87\" id=\"question87_4\" value=\"3\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question87_4\">\n\t\t\t\t\tAsk the participant to rate his or her own behavior.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t \t\t\t<label style=\"display: none !important;\" for=\"question87_none\">None<\/label>\n\t\t\t<input type=\"radio\" style=\"display: none;\" name=\"question87\" id=\"question87_none\" checked=\"checked\" value=\"\" \/>\n\t\t\t\t<\/div>\n\t<\/fieldset>\n\t<input type=\"hidden\" name=\"answer_limit_keys_87\" value=\"\" \/>\n\t\t\t\t<\/div><!-- .quiz_section -->\n\t\t\t\t\t\t\t\t<\/div><!-- .qsm-auto-page-row -->\n\t\t\t\t\t\t\t\t\t\t<div class=\"qsm-auto-page-row qsm-question-page qsm-apc-6\" data-apid=\"6\" data-qpid=\"6\" style=\"display: none;\">\n\t\t\t\t\t\t\t\t<div class=\"quiz_section qsm-question-wrapper question-type-0  question-section-id-88 slide5 \">\n\t\t\t\t\t\t\t\t\t\t<span class='mlw_qmn_question_number'>6.&nbsp;<\/span>\n\t\t\t\t\t\t\t\t<div class='mlw_qmn_new_question'>Which one of the following statements about interrater reliability is correct? <\/div>\n\t\t\t<div class='mlw_qmn_question  qsm_remove_bold' >\n\t\t<p><\/p>\n\t<\/div>\n\t\t<fieldset>\n\t\t<legend><\/legend>\n\t<div class='qmn_radio_answers mlwRequiredRadio'>\n\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question88-1 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question88\" id=\"question88_1\" value=\"0\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question88_1\">\n\t\t\t\t\tInterrater reliability is the same as internal consistency.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question88-2 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question88\" id=\"question88_2\" value=\"1\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question88_2\">\n\t\t\t\t\tInterrater reliability is the same as temporal stability.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question88-3 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question88\" id=\"question88_3\" value=\"2\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question88_3\">\n\t\t\t\t\tInterrater reliability is calculated as a correlation coefficient.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question88-4 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question88\" id=\"question88_4\" value=\"3\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question88_4\">\n\t\t\t\t\tInterrater reliability refers to the correlation between two split-halves of a test.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t \t\t\t<label style=\"display: none !important;\" for=\"question88_none\">None<\/label>\n\t\t\t<input type=\"radio\" style=\"display: none;\" name=\"question88\" id=\"question88_none\" checked=\"checked\" value=\"\" \/>\n\t\t\t\t<\/div>\n\t<\/fieldset>\n\t<input type=\"hidden\" name=\"answer_limit_keys_88\" value=\"\" \/>\n\t\t\t\t<\/div><!-- .quiz_section -->\n\t\t\t\t\t\t\t\t<\/div><!-- .qsm-auto-page-row -->\n\t\t\t\t\t\t\t\t\t\t<div class=\"qsm-auto-page-row qsm-question-page qsm-apc-7\" data-apid=\"7\" data-qpid=\"7\" style=\"display: none;\">\n\t\t\t\t\t\t\t\t<div class=\"quiz_section qsm-question-wrapper question-type-0  question-section-id-89 slide6 \">\n\t\t\t\t\t\t\t\t\t\t<span class='mlw_qmn_question_number'>7.&nbsp;<\/span>\n\t\t\t\t\t\t\t\t<div class='mlw_qmn_new_question'>When do researchers need to calculate interrater reliability? <\/div>\n\t\t\t<div class='mlw_qmn_question  qsm_remove_bold' >\n\t\t<p><\/p>\n\t<\/div>\n\t\t<fieldset>\n\t\t<legend><\/legend>\n\t<div class='qmn_radio_answers mlwRequiredRadio'>\n\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question89-1 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question89\" id=\"question89_1\" value=\"0\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question89_1\">\n\t\t\t\t\tWhen two raters cannot agree on a test grade.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question89-2 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question89\" id=\"question89_2\" value=\"1\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question89_2\">\n\t\t\t\t\tWhen the coding of observations involves subjectivity.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question89-3 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question89\" id=\"question89_3\" value=\"2\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question89_3\">\n\t\t\t\t\tWhen aggressive behavior is measured.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question89-4 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question89\" id=\"question89_4\" value=\"3\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question89_4\">\n\t\t\t\t\tWhen test scores vary widely among participants.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t \t\t\t<label style=\"display: none !important;\" for=\"question89_none\">None<\/label>\n\t\t\t<input type=\"radio\" style=\"display: none;\" name=\"question89\" id=\"question89_none\" checked=\"checked\" value=\"\" \/>\n\t\t\t\t<\/div>\n\t<\/fieldset>\n\t<input type=\"hidden\" name=\"answer_limit_keys_89\" value=\"\" \/>\n\t\t\t\t<\/div><!-- .quiz_section -->\n\t\t\t\t\t\t\t\t<\/div><!-- .qsm-auto-page-row -->\n\t\t\t\t\t\t\t\t\t\t<div class=\"qsm-auto-page-row qsm-question-page qsm-apc-8\" data-apid=\"8\" data-qpid=\"8\" style=\"display: none;\">\n\t\t\t\t\t\t\t\t<div class=\"quiz_section qsm-question-wrapper question-type-0  question-section-id-90 slide7 \">\n\t\t\t\t\t\t\t\t\t\t<span class='mlw_qmn_question_number'>8.&nbsp;<\/span>\n\t\t\t\t\t\t\t\t<div class='mlw_qmn_new_question'>All of the following statements about internal consistency are correct, EXCEPT: <\/div>\n\t\t\t<div class='mlw_qmn_question  qsm_remove_bold' >\n\t\t<p><\/p>\n\t<\/div>\n\t\t<fieldset>\n\t\t<legend><\/legend>\n\t<div class='qmn_radio_answers mlwRequiredRadio'>\n\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question90-1 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question90\" id=\"question90_1\" value=\"0\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question90_1\">\n\t\t\t\t\tInternal consistency is measured using a coefficient called Cronbach\u2019s alpha.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question90-2 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question90\" id=\"question90_2\" value=\"1\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question90_2\">\n\t\t\t\t\tInternal consistency is calculated to ensure all items measure the same trait.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question90-3 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question90\" id=\"question90_3\" value=\"2\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question90_3\">\n\t\t\t\t\tInternal consistency can only be calculated among items measured in numerical scores.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question90-4 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question90\" id=\"question90_4\" value=\"3\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question90_4\">\n\t\t\t\t\tInternal consistency is especially important for comparing qualitative observations.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t \t\t\t<label style=\"display: none !important;\" for=\"question90_none\">None<\/label>\n\t\t\t<input type=\"radio\" style=\"display: none;\" name=\"question90\" id=\"question90_none\" checked=\"checked\" value=\"\" \/>\n\t\t\t\t<\/div>\n\t<\/fieldset>\n\t<input type=\"hidden\" name=\"answer_limit_keys_90\" value=\"\" \/>\n\t\t\t\t<\/div><!-- .quiz_section -->\n\t\t\t\t\t\t\t\t<\/div><!-- .qsm-auto-page-row -->\n\t\t\t\t\t\t\t\t\t\t<div class=\"qsm-auto-page-row qsm-question-page qsm-apc-9\" data-apid=\"9\" data-qpid=\"9\" style=\"display: none;\">\n\t\t\t\t\t\t\t\t<div class=\"quiz_section qsm-question-wrapper question-type-0  question-section-id-91 slide8 \">\n\t\t\t\t\t\t\t\t\t\t<span class='mlw_qmn_question_number'>9.&nbsp;<\/span>\n\t\t\t\t\t\t\t\t<div class='mlw_qmn_new_question'>Which one of the following statements about empirical validity is CORRECT? <\/div>\n\t\t\t<div class='mlw_qmn_question  qsm_remove_bold' >\n\t\t<p><\/p>\n\t<\/div>\n\t\t<fieldset>\n\t\t<legend><\/legend>\n\t<div class='qmn_radio_answers mlwRequiredRadio'>\n\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question91-1 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question91\" id=\"question91_1\" value=\"0\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question91_1\">\n\t\t\t\t\tEmpirical validity is rarely discussed in detail in research reports.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question91-2 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question91\" id=\"question91_2\" value=\"1\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question91_2\">\n\t\t\t\t\tEmpirical validity ensures that the measure can be used in open-ended interviews.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question91-3 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question91\" id=\"question91_3\" value=\"2\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question91_3\">\n\t\t\t\t\tEmpirical validity can only be established through content validity.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question91-4 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question91\" id=\"question91_4\" value=\"3\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question91_4\">\n\t\t\t\t\tEmpirical validity is best calculated through a pilot administration of a test.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t \t\t\t<label style=\"display: none !important;\" for=\"question91_none\">None<\/label>\n\t\t\t<input type=\"radio\" style=\"display: none;\" name=\"question91\" id=\"question91_none\" checked=\"checked\" value=\"\" \/>\n\t\t\t\t<\/div>\n\t<\/fieldset>\n\t<input type=\"hidden\" name=\"answer_limit_keys_91\" value=\"\" \/>\n\t\t\t\t<\/div><!-- .quiz_section -->\n\t\t\t\t\t\t\t\t<\/div><!-- .qsm-auto-page-row -->\n\t\t\t\t\t\t\t\t\t\t<div class=\"qsm-auto-page-row qsm-question-page qsm-apc-10\" data-apid=\"10\" data-qpid=\"10\" style=\"display: none;\">\n\t\t\t\t\t\t\t\t<div class=\"quiz_section qsm-question-wrapper question-type-0  question-section-id-92 slide9 \">\n\t\t\t\t\t\t\t\t\t\t<span class='mlw_qmn_question_number'>10.&nbsp;<\/span>\n\t\t\t\t\t\t\t<div class='mlw_qmn_question ' >\n\t\t<p><\/p>\n\t<\/div>\n\t\t<fieldset>\n\t\t<legend><\/legend>\n\t<div class='qmn_radio_answers '>\n\t\t \t\t\t<label style=\"display: none !important;\" for=\"question92_none\">None<\/label>\n\t\t\t<input type=\"radio\" style=\"display: none;\" name=\"question92\" id=\"question92_none\" checked=\"checked\" value=\"\" \/>\n\t\t\t\t<\/div>\n\t<\/fieldset>\n\t<input type=\"hidden\" name=\"answer_limit_keys_92\" value=\"\" \/>\n\t\t\t\t<\/div><!-- .quiz_section -->\n\t\t\t\t\t\t\t\t<\/div><!-- .qsm-auto-page-row -->\n\t\t\t\t\t\t\t\t\t\t<div class=\"qsm-auto-page-row qsm-question-page qsm-apc-11\" data-apid=\"11\" data-qpid=\"11\" style=\"display: none;\">\n\t\t\t\t\t\t\t\t<div class=\"quiz_section qsm-question-wrapper question-type-0  question-section-id-93 slide10 \">\n\t\t\t\t\t\t\t\t\t\t<span class='mlw_qmn_question_number'>11.&nbsp;<\/span>\n\t\t\t\t\t\t\t\t<div class='mlw_qmn_new_question'>Which one of the following statements about the validity and reliability of measures is INCORRECT? <\/div>\n\t\t\t<div class='mlw_qmn_question  qsm_remove_bold' >\n\t\t<p><\/p>\n\t<\/div>\n\t\t<fieldset>\n\t\t<legend><\/legend>\n\t<div class='qmn_radio_answers mlwRequiredRadio'>\n\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question93-1 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question93\" id=\"question93_1\" value=\"0\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question93_1\">\n\t\t\t\t\tIf a questionnaire measures a homogenous trait, it should be internally consistent.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question93-2 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question93\" id=\"question93_2\" value=\"1\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question93_2\">\n\t\t\t\t\tTemporal stability is important for measures of traits that do not change much over time.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question93-3 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question93\" id=\"question93_3\" value=\"2\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question93_3\">\n\t\t\t\t\tEmpirical validity of a measure is more objective than its face validity.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question93-4 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question93\" id=\"question93_4\" value=\"3\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question93_4\">\n\t\t\t\t\tEmpirical validity is more suitable for qualitative measures such as interviews.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t \t\t\t<label style=\"display: none !important;\" for=\"question93_none\">None<\/label>\n\t\t\t<input type=\"radio\" style=\"display: none;\" name=\"question93\" id=\"question93_none\" checked=\"checked\" value=\"\" \/>\n\t\t\t\t<\/div>\n\t<\/fieldset>\n\t<input type=\"hidden\" name=\"answer_limit_keys_93\" value=\"\" \/>\n\t\t\t\t<\/div><!-- .quiz_section -->\n\t\t\t\t\t\t\t\t<\/div><!-- .qsm-auto-page-row -->\n\t\t\t\t\t\t\t\t\t\t<div class=\"qsm-auto-page-row qsm-question-page qsm-apc-12\" data-apid=\"12\" data-qpid=\"12\" style=\"display: none;\">\n\t\t\t\t\t\t\t\t<div class=\"quiz_section qsm-question-wrapper question-type-0  question-section-id-94 slide11 \">\n\t\t\t\t\t\t\t\t\t\t<span class='mlw_qmn_question_number'>12.&nbsp;<\/span>\n\t\t\t\t\t\t\t\t<div class='mlw_qmn_new_question'>What is the main reason for researchers to discuss the limitations of their measures in a research report? <\/div>\n\t\t\t<div class='mlw_qmn_question  qsm_remove_bold' >\n\t\t<p><\/p>\n\t<\/div>\n\t\t<fieldset>\n\t\t<legend><\/legend>\n\t<div class='qmn_radio_answers mlwRequiredRadio'>\n\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question94-1 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question94\" id=\"question94_1\" value=\"0\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question94_1\">\n\t\t\t\t\tIt ensures that the measures used in the study are valid and reliable.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question94-2 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question94\" id=\"question94_2\" value=\"1\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question94_2\">\n\t\t\t\t\tIt helps the readers understand how much the study results can be trusted.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question94-3 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question94\" id=\"question94_3\" value=\"2\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question94_3\">\n\t\t\t\t\tResearch reports are written for non-specialists who do not know much about research.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"qmn_mc_answer_wrap  mrq_checkbox_class\" id=\"question94-4 \">\n\t\t\t\t\t\t\t\t\t\t\t<input type='radio' class='qmn_quiz_radio qmn-multiple-choice-input ' name=\"question94\" id=\"question94_4\" value=\"3\" \/>\n\t\t\t\t\t<label class=\"qsm-input-label\" for=\"question94_4\">\n\t\t\t\t\tJournal editors are more likely to publish an article with a detailed discussion of measures.\t\t\t\t\t<\/label>\n\t\t\t\t\t \t\t\t\t<\/div>\n\t\t\t\t\t \t\t\t<label style=\"display: none !important;\" for=\"question94_none\">None<\/label>\n\t\t\t<input type=\"radio\" style=\"display: none;\" name=\"question94\" id=\"question94_none\" checked=\"checked\" value=\"\" \/>\n\t\t\t\t<\/div>\n\t<\/fieldset>\n\t<input type=\"hidden\" name=\"answer_limit_keys_94\" value=\"\" \/>\n\t\t\t\t<\/div><!-- .quiz_section -->\n\t\t\t\t\t\t\t\t<\/div><!-- .qsm-auto-page-row -->\n\t\t\t\t\t\t\t<input type=\"hidden\" name=\"qmn_question_list\" value=\"83Q84Q85Q86Q87Q88Q89Q90Q91Q92Q93Q94Q\" \/>\n\t\t\t\t\t<div class=\"qsm-auto-page-row quiz_section quiz_end empty_quiz_end qsm-d-none\" >\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<div id=\"mlw_error_message_bottom\" class=\"qsm-error-message qmn_error_message_section\"><\/div>\n\t\t\t\t\t<input type=\"hidden\" name=\"qmn_all_questions_count\" id=\"qmn_all_questions_count\" value=\"12\" \/>\n\t\t\t\t\t<input type=\"hidden\" name=\"total_questions\" id=\"total_questions\" value=\"12\" \/>\n\t\t\t\t\t<input type=\"hidden\" name=\"timer\" id=\"timer\" value=\"0\" \/>\n\t\t\t\t\t<input type=\"hidden\" name=\"timer_ms\" id=\"timer_ms\" value=\"0\"\/>\n\t\t\t\t\t<input type=\"hidden\" class=\"qmn_quiz_id\" name=\"qmn_quiz_id\" id=\"qmn_quiz_id\" value=\"8\" \/>\n\t\t\t\t\t<input type='hidden' name='complete_quiz' value='confirmation' \/>\n\t\t\t\t\t\t\t\t\t<\/form>\n\t\t\t\t\t\t<\/div>\n\t\t<div style=\"display: none;\" class=\"qsm-popup qsm-popup-slide\" id=\"modal-4\" aria-hidden=\"false\"><div class=\"qsm-popup__overlay\" tabindex=\"-1\" data-micromodal-close=\"\"><div class=\"qsm-popup__container qmn_quiz_container\" role=\"dialog\" aria-modal=\"true\"><div class=\"qsm-popup__content\"><img decoding=\"async\" src=\"https:\/\/routledgelearning.com\/evaluatingresearch\/wp-content\/plugins\/quiz-master-next\/assets\/clock.png\" alt=\"clock.png\"\/><p class=\"qsm-time-up-text\"> Time&#8217;s up<\/p><\/div><footer class=\"qsm-popup__footer\"><button class=\"qsm-popup-secondary-button qmn_btn\" data-micromodal-close=\"\" aria-label=\"Close this dialog window\" onclick=\"location.reload();\">Cancel<\/button><\/footer><\/div><\/div><\/div>\n\n\n<h2 class=\"wp-block-heading\" id=\"anchor-1-online-resources\" id=\"anchor-3-online-resources\">Online Resources<\/h2>\n\n\n\n<p>Triangulation in research:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.scribbr.com\/methodology\/triangulation\/\">https:\/\/www.scribbr.com\/methodology\/triangulation\/<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/youtu.be\/sBchy35JqaQ\">https:\/\/youtu.be\/sBchy35JqaQ<\/a><\/li>\n<\/ul>\n\n\n\n<p>4 types of reliability in research:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.scribbr.com\/methodology\/types-of-reliability\/\">https:\/\/www.scribbr.com\/methodology\/types-of-reliability\/<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/youtu.be\/uOhDHZ1nu3U\">https:\/\/youtu.be\/uOhDHZ1nu3U<\/a><\/li>\n<\/ul>\n\n\n\n<p>Validity of tests and measures:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.scribbr.com\/methodology\/types-of-validity\/\">https:\/\/www.scribbr.com\/methodology\/types-of-validity\/<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/youtu.be\/NKUt5h3ObeY\">https:\/\/youtu.be\/NKUt5h3ObeY<\/a><\/li>\n<\/ul>\n\n\n\n<p>Hawthorne effect (changing behavior when observed): Myth or reality?<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/youtu.be\/fei2WVqEykM\">https:\/\/youtu.be\/fei2WVqEykM<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.scientificamerican.com\/absolutely-maybe\/the-hawthorne-effect-an-old-scientistse28099-tale-lingering-e2809cin-the-gunsmoke-of-academic-sniperse2809d\/\">https:\/\/blogs.scientificamerican.com\/absolutely-maybe\/the-hawthorne-effect-an-old-scientistse28099-tale-lingering-e2809cin-the-gunsmoke-of-academic-sniperse2809d\/<\/a><\/li>\n<\/ul>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:33.33%\"><\/div>\n<\/div>\n\n<\/div>\n    <\/div>\n<\/section>","protected":false},"featured_media":0,"parent":46,"template":"single-full-width.php","meta":{"_acf_changed":false},"class_list":["post-65","content","type-content","status-publish","hentry"],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/routledgelearning.com\/evaluatingresearch\/wp-json\/wp\/v2\/content\/65","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/routledgelearning.com\/evaluatingresearch\/wp-json\/wp\/v2\/content"}],"about":[{"href":"https:\/\/routledgelearning.com\/evaluatingresearch\/wp-json\/wp\/v2\/types\/content"}],"up":[{"embeddable":true,"href":"https:\/\/routledgelearning.com\/evaluatingresearch\/wp-json\/wp\/v2\/content\/46"}],"wp:attachment":[{"href":"https:\/\/routledgelearning.com\/evaluatingresearch\/wp-json\/wp\/v2\/media?parent=65"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}