Electronic Grading of Paper Assessments

MAA Session on Mathematics and Technology

San Diego, CaliforniaJanuary 8, 2013

Matthew Leingangleingang@nyu.edu

twitter: @mleingang

Hi

The Story

The Story

The Characters

The Characters

The Characters

The Characters

The Characters

The Characters

The Characters

Scanning

My Hero: The Fujitsu ScanSnap

My Hero: The Fujitsu ScanSnap

My Hero: The Fujitsu ScanSnap

My Hero: The Fujitsu ScanSnap

Other possibilities

Other possibilities

Doxie

Other possibilities

DoxieAdobe Acrobat Pro

+ any TWAIN-compliant scanner

Forms

LaTeX Packages

LaTeX Packages

• in TeX-Live

• well-maintained

• lightly documented

hyperref.sty

LaTeX Packages

• in TeX-Live

• well-maintained

• lightly documented

• not in TeX-Live (acrotex.net)

• not actively maintained

• richly documented

• more formatting features

hyperref.sty eforms.sty

LaTeX Packages

• in TeX-Live

• well-maintained

• lightly documented

• not in TeX-Live (acrotex.net)

• not actively maintained

• richly documented

• more formatting features

hyperref.sty eforms.sty

TikZ for placement

Checkboxes

\documentclass{article}\usepackage{tikz}\usepackage[pdftex]{eforms}\begin{document}Correct? \checkBox{myCheck}{10bp}{10bp}{On}\end{document}

Checkboxes

\documentclass{article}\usepackage{tikz}\usepackage[pdftex]{eforms}\begin{document}Correct? \checkBox{myCheck}{10bp}{10bp}{On}\end{document}

Correct? ☐

Radio Buttons

\documentclass{article}\usepackage{tikz}\usepackage[pdftex]{eforms}\begin{document}Correct? Yes \radioButton{MC1}{10bp}{10bp}{No}No \radioButton{MC1}{10bp}{10bp}{Yes}

\end{document}

Radio Buttons

\documentclass{article}\usepackage{tikz}\usepackage[pdftex]{eforms}\begin{document}Correct? Yes \radioButton{MC1}{10bp}{10bp}{No}No \radioButton{MC1}{10bp}{10bp}{Yes}

\end{document}

Correct? ◯ No ◯ Yes

Pull-down lists\documentclass{article}\usepackage{tikz}\usepackage[pdftex]{eforms}\begin{document}\begin{tikzpicture}[remember picture,overlay] \node at ([xshift=0.5in,yshift=2.25in]current page.south west) {\parbox{1.5cm}{\comboBox[\textColor{1 0 0 }\Ff\FfEdit]{}{1.5cm}{1.0cm}{(0)(1)(2)(3)}}};\end{tikzpicture}

Pull-down lists\documentclass{article}\usepackage{tikz}\usepackage[pdftex]{eforms}\begin{document}\begin{tikzpicture}[remember picture,overlay] \node at ([xshift=0.5in,yshift=2.25in]current page.south west) {\parbox{1.5cm}{\comboBox[\textColor{1 0 0 }\Ff\FfEdit]{}{1.5cm}{1.0cm}{(0)(1)(2)(3)}}};\end{tikzpicture}

• Pull-down list

Pull-down lists\documentclass{article}\usepackage{tikz}\usepackage[pdftex]{eforms}\begin{document}\begin{tikzpicture}[remember picture,overlay] \node at ([xshift=0.5in,yshift=2.25in]current page.south west) {\parbox{1.5cm}{\comboBox[\textColor{1 0 0 }\Ff\FfEdit]{}{1.5cm}{1.0cm}{(0)(1)(2)(3)}}};\end{tikzpicture}

• Pull-down list

• half-inch from left edge, 2.25 inch frrom bottom edge

Pull-down lists\documentclass{article}\usepackage{tikz}\usepackage[pdftex]{eforms}\begin{document}\begin{tikzpicture}[remember picture,overlay] \node at ([xshift=0.5in,yshift=2.25in]current page.south west) {\parbox{1.5cm}{\comboBox[\textColor{1 0 0 }\Ff\FfEdit]{}{1.5cm}{1.0cm}{(0)(1)(2)(3)}}};\end{tikzpicture}

• Pull-down list

• half-inch from left edge, 2.25 inch frrom bottom edge

• 0, 1, 2, 3 or “write-in” other score

Pull-down lists w/ keys

% ...\comboBox[\textColor{1 0 0 }]{Username}{2in}{1.0cm}{[(Gagner, Liza)(lg271)] [(Hennen, Guy)(gh46)] [(Lach, Gary)(gl923)] [(Osbourn, Julio)(jo77)]%... }

Pull-down lists w/ keys

% ...\comboBox[\textColor{1 0 0 }]{Username}{2in}{1.0cm}{[(Gagner, Liza)(lg271)] [(Hennen, Guy)(gh46)] [(Lach, Gary)(gl923)] [(Osbourn, Julio)(jo77)]%... }

• Pull-down list

Pull-down lists w/ keys

% ...\comboBox[\textColor{1 0 0 }]{Username}{2in}{1.0cm}{[(Gagner, Liza)(lg271)] [(Hennen, Guy)(gh46)] [(Lach, Gary)(gl923)] [(Osbourn, Julio)(jo77)]%... }

• Pull-down list

• keys are usernames of each student

Pull-down lists w/ keys

% ...\comboBox[\textColor{1 0 0 }]{Username}{2in}{1.0cm}{[(Gagner, Liza)(lg271)] [(Hennen, Guy)(gh46)] [(Lach, Gary)(gl923)] [(Osbourn, Julio)(jo77)]%... }

• Pull-down list

• keys are usernames of each student

• pull down menu and pick a name

Stamping form over documents

$ for file in `ls *_0??.pdf`; do \> pdftk form.pdf multibackground $file output `basename $file .pdf`_form.pdf; \> done

• pdftk is an open-source pdf utility that works on the command line.

• The pdftk invocation makes the test file a background for the form and creates a new file

• The for loop in the bash shell cycles over all pdfs sequentially numbered

Other methods for stamping

\documentclass{article}\usepackage{tikz}\usepackage[pdftex]{eforms}\begin{document}\begin{tikzpicture}[remember picture,overlay]\node at (current page.center) {\includegraphics[page=1]{scanned_quiz}};% ... form stuff ...\end{tikzpicture}\clearpage%...

• Use TikZ to include the scanned page and form elements

• Do this once per page

• scriptable

• Can also do a watermark in Acrobat

Grading

Desktop Apps for PDF Annotation

Desktop Apps for PDF Annotation

Adobe Acrobat Pro

($$, Mac/Win)

Desktop Apps for PDF Annotation

Adobe Acrobat Pro

($$, Mac/Win)

Preview(Free, Mac)

Desktop Apps for PDF Annotation

Adobe Acrobat Pro

($$, Mac/Win)

Preview(Free, Mac)

PDF-XChange (Free, Win)

Tablet Apps for PDF Annotation

Tablet Apps for PDF Annotation

GoodReader($5, iPhone/iPad)

Tablet Apps for PDF Annotation

GoodReader($5, iPhone/iPad)

PDFExpert($10, iPad)

Tablet Apps for PDF Annotation

GoodReader($5, iPhone/iPad)

PDFExpert($10, iPad)

RepliGo Reader($3, Android)

Screenshots

Data Extraction

Data Extraction• Adobe Acrobat

Tools > Forms > More Form Options > Manage Form Data > Merge Files into Spreadsheet

Data Extraction• Adobe Acrobat

Tools > Forms > More Form Options > Manage Form Data > Merge Files into Spreadsheet

• pdftk$ pdftk graded_quiz.pdf dump_data_fieldsthen parse (like Mail headers) to CSV

Data Extraction• Adobe Acrobat

Tools > Forms > More Form Options > Manage Form Data > Merge Files into Spreadsheet

• pdftk$ pdftk graded_quiz.pdf dump_data_fieldsthen parse (like Mail headers) to CSV

• PDF-XChange can export XFDFthen parse to CSV

Reporting

Reporting

Email

Reporting

Email Share with Dropbox or Google Drive

Reporting

Email Share with Dropbox or Google Drive

Keep a copy!!

Summary

SummaryPro

Summary

• Free data granularity

• Free document integrity

• Portability

Pro

Summary

• Free data granularity

• Free document integrity

• Portability

• Can adopt in pieces

Pro

Summary

• Free data granularity

• Free document integrity

• Portability

• Can adopt in pieces

Pro Con

Summary

• Free data granularity

• Free document integrity

• Portability

• Can adopt in pieces

• Not a huge time saver

• Learning curve

Pro Con

Summary

• Free data granularity

• Free document integrity

• Portability

• Can adopt in pieces

• Not a huge time saver

• Learning curve

• risk of dissemination

Pro Con

The Future: 2D Codes

• Can be used to encode any data

• Identify the file

• Identify the student

• 21st-century Scantron?

Matthew Leingangleingang@nyu.edu

twitter: @mleingang

Thank You

Image Credits• Adam E. Moreira

• Veronica Belmont

• Wayne & Wax

• Gratuit