mimics the peer-review process, with the instructor playing the role
of the reviewer and editor.
A single pre-test and two sets of post-tests (see Table 3 for test questions) were used to evaluate student learning. Students were tested
before the exercise, one week after submitting the assignment
(Post-test 1), and again during finals week at the end of the simester
(Post-test 2). Knowledge-based questions addressed student knowledge associated with the three objectives of this study (fromatting,
peer review, and scientitific literacy). This cohort was also asked
questions related to their confidence in understanding the same
three areas (see Table 4). Individual identifiers were removed from
each evaluative tool prior to examination of the data.
Repeated measures ANOVAs for each of the six sets of questions (three knowledge-based and three confidence-level) were
conducted, comparing the means of each of the three groups:
Pre-test, Post-test 1, and Post-test 2. Only students who completed all the tests (all three knowledge questions and/or all three
confidence questions) were were included in the statistical analysis. For significant outcomes, Tukey’s post-means comparisons
were subsequently conducted to identify which pairings were significantly different.
Table 2. Questions posed to compare the three
types of articles collected.
What is the title of the article?
What year was the article published?
Who is the publisher (or the name of the journal)?
Who are the authors?
What organizations are the authors affiliated with?
Did the authors conduct the research that they are
presenting in the article?
Do the authors reference the information they are
What types of references are listed? (Are they Internet
sources, magazines, or peer-reviewed journals?)
Is this article reviewed by an expert in their field?
Is the language intended for professionals in the field?
What is the scientific credibility of this article? Rank from 1
(lowest) to 3 (highest).
Would this article be cited in a scientific paper?
Table 3. Knowledge-based questions by study objectives.
Formatting (1) Recently, Gartner, with multiple co-authors, wrote a paper about cottonmouth snake
scavenging behaviors at island rookeries. Which of the following is THE correct citation?
Answer: Multiple references were given, though only one met ALL the criteria.
(2) What does “15(7):7-14” mean?
Answer is choice of: Volume (total no. of pages): pages | Volume (issue): pages |
Day (hour): minutes | Year (month): days | None of those listed.
(3) Which of the following is the correct format for an in-text citation?
Answer: Various permutations of author, date, title source are given, but only ONE is in
the correct order.
Peer Review (1) Which of the following would you find ONLY in a primary article?
Answer is choice of: in-text citation, evidence of peer review, reference to other people’s
work, list of contribution authors, and affiliation of author.
(2) What is an example of an appropriate peer reviewer for an article on cottonmouth
Answer is choice of: lawyer, medical professional, academic, typist, or ALL.
Scientific Literacy (1) In any given Wikipedia article, you can find the author(s) and their affiliations?
Answer: Yes or No.
(2) In terms of literature review, what does “source” mean in an article?
Answer is choice of: name of journal, name of publisher, affiliation of author, name of
editor, or another word for ketchup.
(3) Which of the following is NOT an example of a secondary journal?
Answer is choice of: Discovery Magazine, National Geographic, Nature, All or None.