Apparatus, Peer Review & Self Evaluation
March 1, 2007
Two activities have been integral to learning in this freshman writing course: peer reviews and self evaluations. Each serves to enhance learning. In particular, they facilitate conversations and help students engage actively in their own learning.
Early during the semester, I introduce and use accepted disciplinary language to prompt and facilitate discussions. I do this in part through the prompts I give to students for these activities. Later during the semester, students prompt discussions and almost every student participates, and they participate using a vocabulary and increasing understanding of rhetoric and writing.
Early during the semester we focus on substantive issues such as audience, purpose, and content and we revisit those throughout the semester. By giving these prompts during each unit, students come to demonstrate increased confidence and facility with their rhetorical skills. Moreover, these tools are designed to help writers stay in conversation with their work and each other and to help students to gain a better understanding of criteria against which people will assess their writing.
Peer Review Prompt
While I have used a variety of peer review prompts throughout the years, mostly synthesized from a variety of sources (with a nod to Illinois State University and their extensive course and TA development materials), for this assignment we relied heavily upon adaptations of review prompts in their textbook, Everything's an Argument (Lunsford, Ruszkiewicz, & Walters, 2007). These prompts connect directly to the units and reflect values of the discipline. I adapt these prompts based on my additional unit goals. The reviews for the substantive peer reviews of the Facebook paper are adapted as such:
Audience:
- Who are the readers? Does the writer target a general audience or a more specific one? Is the targeted audience the appropriate choice? What in the text leads you to your answer?
- Will readers understand the piece? How might readers respond to the piece as a whole or to specific parts? Will they read the whole piece? Where might they stop? Why? Will readers seriously consider the case? How might readers feel or what might they think while reading or after reading the piece? Will readers seriously consider the case? Will they agree? Identify specific places in the text that lead you to your answers.
- What in the writing shows that the writer clearly keeps readers in mind? What specific changes in the piece might help the writer tailor more specifically to the audience?
- What changes must the writer make to better communicate with the audience? What other changes could be made to help the writing better communicate with the audience?
Purpose:
- Where is the writing headed? Identify how can you tell from the writing. What is the thesis? Identify how and where the writing may need to have greater focus and direction.
- Where does the writing stay on track? Where does the writing go into new directions? How do you know?
- Is the writer trying to do too much? How so? Too little? How so? What needs to be changed to be more focused, developed, or to stay on track?
- Does the author seem to care about this topic or writing? How can you tell?
Effect:
- Given the purpose and thesis, what explanations, support, rationales, or connections would you expect to see in the piece? Why?
- Identify the main point of the piece. Identify the supporting claims of the piece. Is each claim or point clear?
- Identify where the writer supports the thesis and sub claims. Identify where the writer provides warrants or explanations for the claims. How does the writer qualify the argument, anticipate rebuttals, and provide backing?
- Identify any confusing parts and explain what was confusing. Where was there no explanation? Where was something missing? Was a sentence ambiguous or otherwise unclear? Was a wrong word used?
- Do you or the audience have different opinions? What needs to be changed in order to address different opinions in the piece?
- Identify any places where the writer said too much or explained too much about the subject or specific claims. Where was there information the audience did not need to have explained? How do you know that it was over explained? Where were there redundancies? What points were tangential? Explain your responses.
- Identify places where the writer did not explain enough. Was some information included (perhaps as claims) but not explained in enough detail (such as with support and warrants)? What should be changed, added, explained, supported, rationalized, and connected more fully?
In addition to discussions and peer reviews, which are external interactions, students also focus on internalizing what they've learned. Aside from informal reflections, students evaluate themselves after each paper using two prompts: the self-evaluation prompt below and the departmental grading standards (available in the earlier note (Course Description, Objectives, & Standards). After responding to the following prompt, students highlight, underline, or otherwise mark the level at which they think they meet each criterion as listed on the grading standards sheet. Then, about two-thirds of the way into the semester, students assess each other's papers according to the standards. Aside from helping students learn from each other, this approach also demonstrates if and how students understand and can apply the standards. By the end of the semester, students evaluate the writing of their peers in similar ways.
Complete the following about the paper you are about to turn in.
- Check the following. I have:
- Included all related assignments, drafts, and peer reviews in addition to my revised paper.
- Arranged my materials with the oldest on the bottom and the newest on the top.
- Stapled multiple pages of any one assignment together.
- Clipped or otherwise bound all unit materials together (i.e., with a binder clip, in a folder, in an envelope).
- Revised my paper in substantive ways.
- Proofread and edited my final paper.
- Used at least three sources, one of which is from our textbook.
- Looked up how to and have, therefore, properly documented all of my sources:
- In text.
- In my works cited or bibliography.
- Identify the following for your paper:
- Audience: Specific ways in which your claims, supports, and warrants are tailored for your audience.
- Purpose: Specific ways in which your claims, supports, and warrants are tailored for your purpose.
- Effect: Specific ways in which your claims, supports, and warrants are tailored for your effect.
- Situation: Specific ways in which your claims, supports, and warrants are tailored for your imagined or invoked writing situation.
- Explain how you would revise your paper if you had one more week to do so (be realistic about how much time you could spend on it during that time).
- Identify the following in your paper (you may write, underline, highlight, or otherwise clearly mark these directly on your paper):
- Thesis
- Your main claims that support your thesis
- Evidence for each main claim
- Explanations or warrants for each bit of evidence
- Explanations for how each bit of evidence and its warrants work toward supporting your thesis
- Potential rebuttals to your main claims
- Your responses to those rebuttals
March 1, 2007
*Organize class sessions around activities that require participation (share homework in a round robin, have students write in response to the assignments they read, and then ask the whole group to discuss what they wrote).
March 1, 2007
*Examine from their lives examples of constructed knowledge and ask students to explain why that is the case. One might use the idea of grading writing, which introduces rubrics, outcomes, and the sense that evaluating essays is not as subjective as students may have believed. Students can see learning as holistic and as based within a community of people who have negotiated what items belong there and what they mean.
March 16, 2007
The learning opportunities you describe as embedded within the assignment focus on writing. What about the content of Facebook, technology, or identity that together you describe as the impetus for the assignment? Seems these would be the more engaging topics for students.
March 25, 2007
I can see why you would ask that question. I agree, Jonathan. I aim to do both. Because this is a service course, a course called "college writing," we spend a lot of time on writing itself. Facebook and technology are also important conversations within which I hope students engage, but other topics are important as well: sustainability, the purpose of education, class, gender, and race, and a very long list to which we could each add items.
December 2, 2009
The self-evaluation prompt helps explain why students seemed able to structure arguments but commented little about social networking in cultural contexts. The self-evaluation prompt indicates that structure is important because it specifically asks about argument (identify specific ways in which your "claims, supports, and warrants are tailored for your" audience, purpose, effect, or situation); the absence of specific questions about identity, particularly cultural identity, sends a message about its importance level.
December 9, 2009
Yes, I need to reconsider the assignment expectations and prompt if I want students to focus more on content.
June 12, 2010
For the record, students hate having to mark on their hard copy papers before turning them in for a grade.
The Facebook Papers Unit Prompt
February 28, 2007
Here is the paper prompt for the Facebook paper unit.
The Facebook Papers Unit
The day before a new unit begins, students can find the unit schedule and prompt in the learning management system. As is evident from the following prompt, this unit emphasizes making observations, collecting data, examining data, and then making claims, supports, and warrants about that data. The unit topic and discussions emphasize identity in social networking sites, particularly individual identity but with some consideration of cultural identity.
The Facebook Papers: Technology, Culture, and Identity
Date | Topic | In-Class | Due |
M 3/6 | Technology, persona, culture | Go over paper 3 assignment, conduct sample observations and analyses; Pre-survey; Assign peers | PEER REVIEWS Provide feedback to 3 of your peers’ papers (those posted above yours on the TRACS forum—if you are on the top, go to the bottom) following the guidelines given. Post your responses to the TRACS Forum by selecting “reply to message.” You will be able to see everyone’s papers plus everyone’s responses. Each review will count as a separate homework grade (in other words, this assignment counts as three grades). Be ready to discuss your responses in class. |
M 3/11 - W 3/13 | Spring Break | ||
M 3/17 | Observations, categorizing data | Wrap up paper 2; Read papers, Respond to arguments, Model peer responses; Documentation styles (Be sure to bring your SF book to class.) | READ Assigned peer Facebook, MySpace, or blog site HOMEWORK Keep a notebook of your observations of the peer site to whom you have been assigned. Identify what you see in the status updates, photos, in posts, in comments, and in other ways. Keep these observations over time. In other words, look at each day rather than all at once, or you will miss information. Do look back in time a bit, though, to see what you can identify. Be sure to document your observations: when did you see them, at what site, and at what part of the site? Be as specific as possible. We should be able to trace each observation you make, including time. Due Paper 2 |
W 3/19 | Arguments of definition (formal, operational, example); definitional claims, reasons, warrants, matching definitions and claims, design and visuals | Discuss readings, prepare for papers (questions in EaA pages 236-239) | READ EaA: Chapter 8 HOMEWORK Alone or with up to two other people, complete one of the following from “Respond” on pages 240-241: #1, #2, or #3 |
M 3/24 | Elements of argument, elements of definitions, peer reviews | Begin peer reviews; Look at evidence and look for fallacies | PAPER Typed paper draft “The Facebook Papers: Technology, Culture, Identity” posted to the appropriate TRACS forum. TBA: Visit to the library OR review of claims, evidence, and fallacies. |
W 3/26 | Revising | Ways to improve arguments of definition; Discussion of papers | READ EaA: pages 237-239; Your peers’ papers PEER REVIEWS Provide feedback to 3 of your peers’ papers (those posted above yours on the TRACS forum—if you are on the top, go to the bottom) following the guidelines given. Post your responses to the TRACS Forum by selecting “reply to message.” Note: You will be able to see everyone’s papers plus everyone’s responses. Each review will count as a separate homework grade. |
M 3/31 | Arguments of facts | Self evaluations; Wrap up paper 3; Introduce paper 4 | PAPER Turn in your final paper, hard copy and on TRACS. For the hard copy, your most recent version should be on top and the oldest on the bottom. Your peer reviews and other versions should be in between. Staple each version together separately and then use a paperclip or binder clip to hole them all together. For the electronic copy in TRACS, post it as a reply to the appropriate forum. |
Paper 3
During this unit, we examine technology, culture, and identity by analyzing Facebook, MySpace, and other such sites and through your own research. You will write a definitional argument that captures the persona of your peer and does so in part to argue about the use of such technologies in your culture. You will analyze an assigned web space of another person in this class.
Your main goal is to individually write a 900-1500 word definitional argument analyzing the persona or ethos of the person based only on their presence in that forum and connections from it. In other words, if we knew nothing about this person other than what appears in this space, how might you characterize this person? In concluding, use what you know or what you have researched about such spaces and college students’ uses of them in order to speculate about how this person’s persona or use of the space compares with others or about technology generally.
In terms of writing and communicating, this unit assumes that you can summarize and synthesize as well as use a clear thesis and topic sentences, as covered in 1310. This unit also builds upon the first unit about audience, purpose, effect, situation (as in the rhetorical situation), claims, supports, warrants, ethos, pathos, and logos. It builds upon the previous unit’s addition of qualifiers, rebuttals, backing, evaluating evidence, and documenting sources. It adds elements of definitional argument and fallacies.
Your paper must include and properly cite at least three different sources, at least one of which must be the site you are examining.
Because the sites can change at any moment, each time you go to the site, you need to write down the date and time that you visited it and what you saw. You will need to include this along with other regular citation information in your works cited page.
While it is not required, you might consider using at least one visual.
Ways to go About Your Analysis
As you begin, identify and list items you need to consider. If you are looking at Facebook, for example, you will consider photos, notes, wall posts, status messages, friends, away messages, the profile photo, group memberships, and so on. You should define this person based on the whole of what you can see, although you may find that some parts stand out and, thus, you choose to focus on these. You must first have the bigger picture to know what really stands out.
Answers to the following questions will help you write up your analysis. For any claims that you make, readers will expect support.
- Observe and describe in detail the scene. What do you see? Describe photographs. Quote messages. Who are this person’s friends? What connections do they have? What is posted? What has this person posted to other walls? To what groups does this person belong? Others? Be objective as possible (without introducing any cultural bias or personal interpretation).
- Identify patterns. What trends do you notice? In photographs? In comments? In groups? Other? How does the person seem to want to be seen? By friends? Family? Others?
- Speculate about what the patterns reveal. About relationships? About power, friendships, or other characteristics? About how this person uses the electronic space you are examining? About the role this electronic space plays in this person’s relationships and life? About the person’s personal and professional lives? What values does this person hold?
- How do the patterns fit? How would you characterize the person’s persona or ethos? What do you think this person’s persona or ethos represents culturally? Do you find "ethnic," "class,” "national," or other similar significances?
- How reliable or valid are your arguments? In what areas of your analysis are you most/least confident? Could others come to different conclusions by looking at the same information? How might the person being analyzed respond to your analysis? What additional information would need to make more accurate and thorough analyses?
Writing
Although you completed your analysis first and then came to your own picture of this person’s persona or ethos, your written definition begins by making a claim about the persona or ethos, as this was the purpose for your analysis. See pages 236-239 for more information. Successful papers meet the tasks outlined here, address their prompts, and address the criteria outlined in the grading standards in your syllabus. Put the number of words in your paper in your heading.
Turning It In
To receive credit for your paper, you must turn in your final paper and at least one draft. You should also include peer reviews (that you made and that others gave you).
Due
March 31, 2:00 pm.
March 1, 2007
*write a 900-1500 word definitional argument.
At the time students receive the prompt, most are unfamiliar with the term "definitional argument"
April 4, 2008
When I first designed the course, I intended to explicitly cover qualifiers, backing, and rebuttals but it turned out to be too much. When I gave the assignment this time, I removed that sentence from the prompt and began to cover the concepts more indirectly.
March 23, 2010
After teaching this unit twice, students were not addressing how technology relates to cultural identity as much as I had hoped. This makes some sense because programmatically the course focuses on developing essays as essays. Also, for many students, this is the first time they write essays based on primary observations. As a result, we spent time talking about themselves within these overlapping communities that sometimes have very different goals. So, while we did not talk about culture in the way I had planned, we did talk about the cultures of communities. Expecting deeper discussions specifically about technology seemed premature given our own rhetorical situation, which is something to consider in redesigning the assignments or course.
March 23, 2010
The Facebook Paper seemed to help students learn to collect data and structure arguments--skills that could be valuable earlier in a course. Therefore, two changes were made to the course: The Facebook Paper was assigned earlier. Next, a technology-focused paper was added.
My initial impression of this new structure was that while students did learn how to analyze data and structure arguments earlier during the semester by completing the Facebook Paper earlier during the term, they were less prepared to put their analyses and arguments into contexts of conversations about culture, communication, or writing.
March 28, 2010
The third time you taught this unit, you assigned a second technology paper in the course. Did students address cultural identity there?
March 29, 2010
They wrote about how texting interferes with relationships or how it is rude to text with someone else while you are hanging out. They wrote about how multiplayer online video games are addicting. One student argued that while such games seem addicting, and can be for some people, there are actually benefits to playing. He dug deep into the databases to find scholarly sources before forming his opinions (he intended to write against gaming). He pointed out that players are interacting with real people and often form offline relationships with some of them. Some investigated the relationship between gaming and violence. Many of them wrote about privacy. Several wrote to parents of high school students about the benefits of Facebook and MySpace, often in order to demonstrate that these spaces could be safe. Some students wrote to high school students to demonstrate how to practice safe online networking.
March 30, 2010
If you used the Facebook assignment again, would you put it second or third? Would you assign the second technology paper?
April 1, 2010
Hmm. Good question. I was going to wait a year before making that decision.
The short answer in this moment is that I would use the Facebook assignment as the third paper. From a learning perspective, it doesn't matter if they learned the structure of argument earlier if it was more difficult to envision their paper as part of a conversation.
I'm torn about using the second technology paper along with the Facebook paper. For one, I use different topics in order to appeal to more students and expose them to a wider variety of rhetorical situations, thus providing a greater range of experiences and opportunities to develop rhetorical agility. It has been my experience that some students disengage if they are not invested in the topic. If they are not invested in technology, that could be two rather than just one reason to lose interest.
Context for The Facebook Papers Unit
February 28, 2007
Before looking at the paper prompt and unit schedule, it may be useful to understand where The Facebook Papers unit fits within the course. This section of College Writing asks students to examine the formation of cultural and individual identities.
The Facebook assignment is one of five papers in this first-year writing course. Of the four remaining papers, one is a diagnostic in-class essay about how the student understands college writing, one focuses on what shapes our national identity, one focuses on what shapes cultural identities, and one is a self portrait of the author as an individual and citizen five to ten years into the future as informed by our discussions and experiences through the semester. The units about individual and national or cultural identity begin with readings in the textbook and The Sixties: Years that Shaped a Generation from PBS (http://www.pbs.org/opb/thesixties/index.html). The self-portrait can be developed in a variety of media (video, paper, paint, as examples). During the semester, students develop a portfolio that includes revisions of three of the four main essays, a document that identifies and explains their changes (using a word processor's track changes with comments would suffice), and they write reflective introductions. For the final exam, students once again write an in-class essay about their understanding of college writing.
During each unit, students engage in collaborative learning as they talk and write with each other and with me about college writing (the course title) and the unit topics. In general, at the beginning of a unit, students complete homework assignments that are then shared with the class through some form of class activity, such as small group responses to colleagues' essays. Students next share paper drafts then peers provide quick written feedback. Students also take three drafts home and respond in writing to open-ended questions from an assignment prompt. These peer reviews are graded. After the conversations, students revise their papers in ways that reflect their new understandings. At the end, students revise again for their portfolios in order to showcase their best work.
Writing, Culture, & Technology
October 13, 2006
I wanted to immerse in the writing spaces of Facebook before I ever saw it. After talking with Evelyn, I wanted to connect—identify—with others through the site and I wanted to connect—conceptualize—social networking within the history of print and cultural change. I understand relationships among history and print as neither deterministic nor stochastic but instead as reciprocal or what Bolter and Grusin came to explain as remediated. I wanted to observe the remediation of both the technology and the students themselves.
As scholars in the field know, the community of computers & writing has valued the important historical analyses of print technologies and culture, recognized often through the works of Marshall McLuhan (1964), Elizabeth Eisenstein (1979), Eric Havelock (1982), Walter Ong (1982), and later Jay David Bolter (1991). Christina Haas (1996) portrayed these histories as deterministic in that they presented stories in which technology inevitably changed communication or cultural experiences.
In the second edition of Writing Space, Bolter (2010) responded that technology does not have agency and, therefore, cannot determine the course of culture but that material realities do shape "human practices" and, consequently, cultural choices (p. 19). He emphasized that "material properties" do "impose limitations" (p. 20) that compete with culture—the competitive process of remediation. Remediation as a process is, according to Bolter and Richard Grusin (1999), "the formal logic by which new media refashion prior media forms" (p. 273). Any instance of mediated communication depends upon at least parts of things before it. In terms of its properties, Facebook calls upon photo albums, physical walls on which people write graffiti, email (in the messages), and face-to-face discussions or discussion boards.
David Blakesley (2001) criticized responses such as those from Haas (1996) as well as Bolter and Grusin (1999) as technologically deterministic, but Blakesley found interest and value in their discussion of the remediated self that emerges when we digitize ourselves. This Facebook Paper assignment is situated within a semester-long focus on how convergences of forces influence us. I want to explore ethos with students and find and create opportunities and exigences for acquiring and enacting rhetorical agency within re/mediated culture and selves.
October 16, 2006
In that same review, Blakesley (2001) points to another reason it is important to incorporate mediated communications into writing classes. At a practical level, people write more and in more spaces: "The proliferation of writing across a range of readily available media means that writers now need to know how to see, read, and write more than ever" (Writing and remediation section, para. 5).
October 16, 2006
Many scholarly works are emerging about social networking. Naomi Baron's Always On: Language in an Online and Mobile World (2008) investigates language use and change in and as influenced especially by mobile technologies. Despite public concern, she found that such technologies do not "negatively" influence student language use over all but they do increase attention to audience and relationships.
November 5, 2006
I want to call upon us to make more conscious choices, and challenge us to act as agents in the symbolic development and use of mediated communications. In a somewhat confrontational pedagogy kind-of-a-way (Strickland, 1990), I want to confront students' notions of media and communication. This approach creates cognitive dissonance from which we can examine beliefs and then come to reconstruct or remediate them. I want them to interrogate convergences of forces and raise awareness about how they as individuals and citizens might play a role. I hope they can come to better identify and influence possible and probable outcomes and how those manifest.
November 5, 2006
In this, I hope to move students to participate in a productive rhetoric in the sense that these interrogations--this way of "knowing rhetorically"--becomes a way of producing or "creating actuality" (Scott, 1976, p. 261), although Scott might argue that this is not the work of rhetoric alone.
November 6, 2006
Within this vision of grandeur, for this project I will have one assignment within one first-year writing course that asks students to produce and evaluate mediated communications in social networking sites and also to reflect, evaluate, write, and rewrite about them. I hope that this becomes more than cataloging features and that students recognize and more consciously write their mediated selves. Even if we meet the larger goals only partially, the assignment still asks students to engage in scholarly inquiry and to write an essay with the traditional features of a thesis, topic sentences, and developments of claims as they support the thesis. Students will still practice writing for a selected audience, purpose, effect, and situation. They also experience, as Blakesley says, writing more and writing in more places.
January 8, 2010
YouTube (2009), which unfortunately I did not write, examined participatory culture, which authors Jean Burgess and Joshua Green described as "core business" (p. 6) because "cultural, social, and economic values are collectively produced by users _en masse_" (p. 5). Social-networking sites are important places for receiving and producing communications, connections, and values. For writing faculty, this means rhetorical agency and communicative acts become increasingly important. My hope is that this becomes more visible to students as they examine their identities in their social networking spaces.
January 10, 2010
Burgess and Green (2009) became concerned with defining media literacy. In their example of YouTube, literacy would include being able to create and consume video content, understanding how it "works as a set of technologies and as a social network" (p. 72), and it would include questioning mediated spaces by examining "how this system is shaped," who has access, and why it matters that those with access have access (p. 72).
January 10, 2010
The proliferation of writing within a participatory culture presents opportunities to re-examine writing assignments and courses, particularly in terms of how mediated communications reciprocally relate to rhetorical situations, invention, writers, audiences, purposes, delivery, and outcomes.