Online Portfolio Assessment
for
Technical Writing Programs

Cyclic Assessment of Online Portfolios

The cycle of assessment is simple: we teach, students create an online portfolio with links to their assignments, and, after the semester is over we get together and score a random sampling of the portfolios. We then use that data to search for patterns in our teaching to improve the program; we institute change; we teach; we assess.

Creating the Online Portfolio

Students create a simple web interface with links to their documents and upload the site to the university servers, which are open to the internet. Most of the instructors did not have any experience in creating websites or online portfolios. However, most students need minimal instruction; they could be taught enough basic HTML in one class session or they can break into groups and teach each other. No special programs are required to do this work; they need only a connection to the internet and university server space.At the end of the semester, each instructor submits a list of URLs. The figure below is an example of the basic online portfolio required in our technical communication service course.

Scoring the Online Portfolio

During the reading at the end of the semester, we first have a calibration session in which we individually score and then discuss a range of sample portfolios taken from that semester. After the calibration session, each instructor scores portfolios individually.

Analyzing the Data

After the assessment, the program coordinator compiles and analyzes the data using Excel or SPSS. The results from the data are distributed to the instructors and form the basis for a meeting at the beginning of the following semester in which we discuss changes, methods and goals. Thus, online portfolios have allowed us to have a sustainable method of monitoring and updating the course.