Upload
jason-leath
View
218
Download
0
Embed Size (px)
Citation preview
7/30/2019 Cycle 8: Video Feedback for First Draft Writing
1/7
Cycle 8 Video Feedback for First Draft Writing:
22 Respondents
ACTION TAKEN: The students were asked to write an artist statement for their
photography portfolios. Screencasting was used to provide feedback for the rough
drafts of their artist statements in conjunction with Adobe Illustrator to mark thegrammatical errors. Since this was a rough draft, no rubric was used to assess the
quality writing.
RESEARCH QUESTION: How will video feedback without a rubric and showing
corrections, apply to written work andaffect student-learning outcomes, as evaluated
by the students?PREDICTED OUTCOME: This method should work better for first-drafts because
the feedback provided will be more relevant when students can still correct their
work. I was concerned that writing corrections on the paper would be distracting
and that the students would feel uncomfortable pausing the videos to make the
necessary changes. My challenges in the previous cycle of placing feedback on the
schools server made me concerned about continued challenges in this area, but the
file sizes left few options.
EVIDENCE USED TO EVALUATE THE ACTION: The evidence used to evaluate
the actions in this cycle was a survey with the following questions:
1. How useful was the video in providing feedback on your writing?
2. What was the worst part of video feedback?
3. What aspects of video feedback are different than what you would receive
from written feedback?4. Were the written notes on your artist statement helpful or distracting when
presented in a video with a voiceover?
5. Would having a rubric or another type of scoring tool be helpful in
understanding how you performed?
6. Did you find video feedback helpful in any way that you did not mention
earlier? (Please describe in detail.)
7. Will having this opportunity to provide your opinion affect your learning in
photography?
EVALUATION: The first question of this cycle asked how useful video feedback was
to writing (Figure 8.1.) The responses to the question were not as positive as inprevious cycles. 46% of the students responded positively, with 23% providing the
highest rating. 32% of the students believed that video feedback provided the same
level of effectiveness as written feedback. For the first time, it was indicated that
video feedback was less useful than written feedback, with 22% of the students
indicating that screencasting was detrimental to their learning. It was my belief that
when this question is looked at in context with question 2 (Figure 8.2) issue will be
that the video did not present static corrections, and the students were unable to
7/30/2019 Cycle 8: Video Feedback for First Draft Writing
2/7
make the changes without pausing the video. Thus far, they have displayed an
inability to work in this method and I hope that this second exposure will increase
their likelihood of pausing the video while working.
Figure 8.1. How Useful was Video Feedback on your Writing?
The second question (Figure 8.2) asked students to identify the worst part of video
feedback. The majority (59%) said that that there was no worst part. The next
highest response was 18% of the students indicating that this method made itdifficult to look back upon their work. Students may not have thought of, or liked
the method of pausing the video to look at the suggested corrections. This could be
corrected by presenting the paper with the corrections on it as well as the video
feedback. The inability to access the feedback at home was also mentioned again in
this cycle (8%.) File sizes continue to be a challenge because students do not
download the video before leaving for home. A new delivery method could be
created if screencasting continues to be used.
23%
23%
32%
18%
4%
How Useful was Video Feedback on Writing
Much more useful
More useful
The Same
Less Useful
Much Less Useful
7/30/2019 Cycle 8: Video Feedback for First Draft Writing
3/7
Figure 8.2. What was the Worst Part of Video Feedback?
The next question asked what the differences between video and written feedback
were (Figure 8.3.) The most common answers suggested that the information was
clearer in video (32%.) The next highest category contained 23% of the responses,
and suggested that this form of feedback was more personal than a written version.
Both the clarity of information and personal nature of the responses are the primary
reasons why video feedback shows promise, suggesting that its benefits apply to
both written work and the larger sample size. Along with none at 9%, otheranswers included a variety of personal views that either did not directly answer the
question or were only mentioned by one respondent.
59%
4%
18%
5%
9%
5%
What was the Worst Part of Video Feedback?
No Worst Part
Speech Mistakes
Difficult to Look Back on
Work
Could not Ask Questions
Could not get at Home
Went to Quickly
7/30/2019 Cycle 8: Video Feedback for First Draft Writing
4/7
Figure 8.3. What aspects of video feedback are different than what you would receive
from written feedback?
The students were asked if they found the written notes helpful while listening to
the voiceover. The large majority of 82% found that the notes were in fact helpful.
This suggested that my concerns about the hand written notes being a distraction
when paired with a voiceover were unfounded, since the students responded that
they benefited from the notes.
The next question asked if including a scoring tool would be helpful in their
understanding of how they performed (Figure 8.4) and 68% of the students
indicated that they would find this helpful. These responses are somewhat
surprising considering that this was a first draft of a paper. It was my belief that
they would not be interested in a scoring metric because this was not their final
product. Rather, it appears that they want to know how well they performed on this
paper regardless of their need to make changes. The rubric may help clarify how
the severity of my feedback or if they should restructure larger sections of their
papers, both of which would suggest a motivation for these responses.
32%
23%9%
4%
4%
5%
5%
18%
What Were the Differences Between Video and
Written Feedback?
Clarity
Personal
None
Better
Went To Quickly
Cannot Ask for
Clarification
You Only Need to Listen
N/A
7/30/2019 Cycle 8: Video Feedback for First Draft Writing
5/7
Figure 8.4. Would having a rubric or another type of scoring tool be helpful in
understanding how you performed?
Question six gave the students an opportunity to provide any other feedback that
they did not have a chance to mention earlier. One response stated that video being
colorful and visual is more helpful than voices alone, and another response
suggested that video feedback was not that helpful, the remainder of the responses
indicated that they had nothing else to add.
The final question was in regards to the action research process. It asked the
students if having an opportunity to voice their opinions would be beneficial to their
learning. Surprisingly 50% of the respondents did not think that this would help
their experience learning photography. I changed the wording of this question from
the previous cycle because it might have been too leading, and these results may
have existed because the question was not as clearly stated. Since there is no way of
knowing which students have responded in each cycle, it may be that this group of
respondents did not feel a chance for feedback would be as beneficial as the
previous group. Finally it may be that they did not feel as though providing
feedback for this assignment was beneficial.REFLECTION: When asked how useful video feedback was for written responses
varied a great deal (Figure 8.1.) 46% of the responses were positive and 32% were
neutral, but for the first time I received negative response (22%.) This cycle of
feedback on written work was different than the last cycle, and some of the changes
that were made in this cycle may have resulted in negative responses. First, this
cycle was used for a rough draft of a paper, which meant the students needed to use
the feedback to make changes. A number of the students did not follow directions
68%
27%
5%
Would a Scoring Tool be Helpful in
Understanding Performance?
Helpful
Not
Helpful
7/30/2019 Cycle 8: Video Feedback for First Draft Writing
6/7
correctly and needed to rework large sections of their writing. My critical feedback
may be part of the reason they did not prefer the use of screencasting. Of the 33
students who turn in their artist statements for proofreading only 22 responded to
the survey questions. Out of the original 33 students there were 6 (18%) who did
not follow directions or wrote an artist statement that needed many corrections.
This aligns with the 22% who did not respond positively to screencasting. Howeversince the questions were anonymous there is no way of knowing which students
answered the questions. This makes these results untestable and this was only an
attempt to look at possible testing biases as a cause for both the positive and
negative responses.
A second possibility for the negative results is that for the first time I made
markings on the written work that the students needed to incorporate into their
final drafts. I did not however provide them with a non-video copy of my markings
because I wanted to test if they would adapt to pausing the video and then make
corrections. In looking at these results along with the questions what was the
worst part (Figure 8.2) and what were the main differences (Figure 8.3) itappears that only some of the students struggled while working from a guiding
video. This could be due to the students level of experience with previous
screencasts as feedback, or their level of comfort with a computer.
When asked about the worst part of video feedback the results were varied. The
majority response indicated there was no worst part (Figure 8.2.) The next highest
response was the challenge of being unable to look back on their work. This
challenge has appeared in previous cycles and continues to a problem. Photography
is the only class that requires students to use the schools servers to store and
retrieve work. This being the case, students are unsure to downloading work from
the server and working with it at home. Due to the file size of the videos, this is the
only option available to give students the feedback and it may continue to present a
challenge moving forward.
In the suggested differences between written and video feedback, the 32% of the
respondents indicated that the information was more clearly presented in video
form and 23% stated that it was a more personal approach. This continues to
reinforce the reasons I believe video feedback is preferable to written feedback.
These findings have been consistent throughout my research and they are
encouraging signs that video feedback may be an improved method of assessment
for students. This must be balanced with the extra time and complications that it
takes for educators to learn this method, but I believe that there is a strong potential
for this system. Once a level of comfort is obtained with the programs, the process
does not take much longer than other methods of feedback, yet the benefits of a
personal approach, clarity, control of sequencing and the modeling art-oriented
speech, are much grater than the extra efforts needed to create the feedback.
The written notes on the students papers were found to be helpful. I was
concerned that it would be too much to ask the students to follow my voice and read
through the comments. However, it may be that because I was discussing the
7/30/2019 Cycle 8: Video Feedback for First Draft Writing
7/7
comments on their paper the redundancy allowed for a clearer message. It appears
that the corrections were greatly preferred and should be continued.
There was an overwhelming response that having a quantifying assessment tool
would be beneficial on a rough draft (Figure 8.4.) I had not included a scoring
metric in this cycle for two reasons: first, one was used on the last writing cycle and
I wanted to test this cycle without a rubric, and secondly, I did not think that
providing a grade would be necessary for a rough draft. It may be that middle
school English and Social Studies teachers provide rubrics to students rough drafts
and so they are used to having that grade as a way of marking their progress. This
could help to explain the students interest in a rubric for the rough draft.
When asked if providing an opinion would benefit their learning, 50% of the
students indicated that it would make no difference. This was surprising because in
the previous cycle 74% of the students indicated that they would benefit from this
opportunity to share their views. I purposefully changed the wording of this
question because I found it too leading in the previous cycle, however I now wonder
if now this question was too vague and the students didnt understand the meaning.
It may also be the I provided much more negative feedback in this cycle that the
students then had to incorporate into their work and that may have directly affected
their feelings towards this process.
Average length of recording 1:42