Psychology 601 Research Proposal Grading Rubric Content Poor Adequate Good 5 I. Title Page (5%) Missing information (e.g., running header, page number, institution), poor layout on the page, mistakes in spelling or format, title that doesn t describe project. All the information is present and properly formatted. 5 II. Abstract (5%) General opening with no specific details of the proposed study. 35 III. Introduction (35%) A. Statement of the Problem (5%) B. Literature Review (20%) Vague and/or general introduction that has little connection to the proposed research. Each paragraph summarizes the results of one study without evaluation, integration or synthesis. 1. Theory (5%) No recognizable theory is included in the literature review. Describes the variables under study and the method to be used. Begins with the research question and includes some specific references. Relevant literature that covers the empirical evidence and theory needed to support the hypothesis is described. The theory is present but not integrated well with the empirical literature. All the information is present and properly formatted. The title is descriptive and the running header is a good summary. Concisely presents the problem, hypothesis, sample, method and a clear causal prediction for the study. Opening paragraphs describe previous research and theory that leads to a clear thesis statement. Prior empirical research and theory are integrated, evaluated and synthesized to show a clear path between the thesis statement and the hypotheses. The correct theory is applied to connect and extend the empirical literature to the proposed hypothesis. 1
2. Empiricism (5%) Only general conclusions are presented that appear to come from the abstract. 3. Evaluation (5%) No evaluation of previous work is presented. 4. Integration (5%) Each article is presented separately and no connections are made between different sources. C. Hypothesis (5%) Missing or vague statements of the relationships between variables. D. References (5%) Textbooks and other general sources are cited at the end of the paragraphs. Most paragraphs have only one source cited. Direct quotes are presented without page numbers. The relevant empirical results are presented in an organized way. The evaluation of some of the research is present. The theory serves as a connecting and organizing mechanism for the different sources. A specific research question where the cause and effect are clear. Each paragraph includes citations for sources as the ideas are presented. The key facts from empirical studies are presented, evaluated and compared so that the hypothesis and method section are clearly supported by the past research. The evaluation of the prior research methods and results leads to improvements in terms of the hypotheses and/or methods proposed. The introduction is organized by ideas that lead from the thesis statement to the hypothesis with each source described only as it relates to each topic and the other sources related to that topic. A specific statement of the expected outcomes of the cause on the effect. Recent and classic sources are appropriately cited throughout. 2
25 IV. Method (35%) A. Design (5%) An unlabeled figure is presented without description. B. Participants/Subjects (5%) C. Measures and Apparatus (5%) Too general without describing participant characteristics or incentives. Incomplete or vague descriptions of instruments, questionnaires, etc. D. Procedure (10%) Disorganized and incomplete description of what will be done in the experiment or manipulating the dependent variable while measuring the independent variable. 5 E. Planned Statistical Analysis (5%) Incorrect or incomplete statistics for the given hypothesis. Figure is labeled and described in the text. Gives the number and type of participants. Describes all the measures and/or apparatus and provides references where appropriate. Orderly description of what will occur in the experiment, making clear what the different treatment manipulations are. Planned statistics for the major hypothesis. The paragraph described the design and the well-labeled figure that includes projected sample sizes and results. The figure caption also described the design, using APA style. Describes the participant characteristics, the number of participants and any incentives for participation. Describes each instrument or measure used with example items, units of measurement, reliability and validity, citing sources and including full materials in appendix. Organized presentation of the processes used to collect data, beginning with informed consent through the manipulation check and debriefing, referring to but not repeating the information in the materials and apparatus section. Method of assignment to treatment condition and the differences between the conditions are clearly described. Specific planned descriptive and inferential statistics for each major hypothesis. 3
5 F. Predicted Results Figure(s) (5%) Poorly labeled graph in SPSS standard format. 5 V. References (5%) Incomplete list, or the sources don t match the reference list. 5 VI. Business Proposal (5%) Vague, brief or incomplete budget, timeline and/or vita. 10 VII. Format (10%) A. Spacing Inconsistent spacing. B. Margins Inconsistent margins. C. References Does not follow APA style. APA style figure with major predicted results well-labeled. All the sources in the paper are in the reference list in the correct order. Budget, timeline fit the proposal. Vita is complete. Double-space throughout. 1 inch margins all around. Only misses APA style one or two times. D. Pagination No page numbers. Most pages numbered properly. E. Headings Headings not all there, and formatted inconsistently. VIII. Writing (Lose points for each error) A. Grammar More than 10 grammatical errors At least three levels of headings, formatted correctly. APA style figures for each major hypothesis with clear labels and good figure captions describing the predictions. All the references are cited and in the list correctly and they include the key sources for this proposal. The timeline and budget clearly support the proposed project. The vita shows that the PI is qualified to undertake the project. Double-space throughout. 1 inch margins all around. Perfect APA style. All pages numbered with APA style. Three or more levels of headings, formatted correctly, that help the reader see the organization of the paper. -5 points -3 points -1 point Fewer than 10 grammatical errors and it s clear that the paper has been proofread Almost no grammatical errors B. Spelling Did not spellcheck Few spelling errors Almost no spelling errors 100 Total 4
APA Reference Format Things to Check 1. All sources are cited; including page numbers for direct quotes. 2. All sources are cited with APA style including Author (not just the first author) Year Page number for direct quotes 3. Proper punctuation. 4. Single and multiple sources are cited in the right place in the text. 5. Reference list starts on a new page. 6. Reference heading is proper as a main heading in APA style. 7. References are in alphabetical order. 8. References are double spaced. 9. References paragraphs have a hanging indent (not tabbed). 10. All the authors are listed by last name and initials. 11. Year of publication is in parentheses. 12. Reference information is in the APA order appropriate for the type of source. 13. Italics are used for titles of journals, books, and volume numbers. 14. In titles of articles, books or book chapters only first words, proper nouns and words following a colon are capitalized. 15. All major words or Journal Titles are capitalized. 16. Multiple articles by the same author(s) are organized by publication date. 17. Access date is given for electronic sources. 18. Check spelling, especially of author names, in both citations and reference list. Other APA Format Checklist 1. Entire page is double-spaced. 2. Title Page has a Running Head in the upper right hand corner. 3. Title Page has a page number in the upper right hand corner. 4. The full Running Head is on the title page. 5. The title is centered. 6. The title has proper use of Capitalization. 7. The author s full name is centered below the title. 8. The author s affiliation is centered below his or her name. 9. The title is centered at the top of the Introduction and acts as the heading for that section. 10. All the pages include the running head and page number in the upper right hand corner. 11. Margins are one inch all around on all pages. 12. All paragraphs except the abstract are indented. 5
13. Continue double spacing between sections. 14. Center all Level 1 headings. 15. No fancy font for headings or elsewhere. 16. Flush left, italicize Side headings. 17. Italicize statistical terms. 18. Double-space between sections. Research Design Issues to Remember 1. Specify whether the design is between subjects or repeated measures. 2. If it s between subjects describe random assignment to treatment conditions. 3. If it s repeated measures describe counterbalancing the order of the treatments. 4. Remember to describe the control condition. 5. Make sure that the design fits the hypothesis. 6. Describe all the measures (dependent variables) that you will use even if you have included them in an appendix. 7. Have someone else read the procedure to be sure you haven t left things out. 6