Learning Systems Design and Development Competencies

Demonstration of Competency: Flash Interactive Animation Project

Evaluation Purpose

The purpose of the evaluation was to assess the usability and effectiveness of a Flash Web site in meeting its goal to educate users on horse hoof care.

Evaluation Method

The evaluation focused on the usability, content, visual design, animation quality and overall impression of an educational site on horse hoof care developed in Flash.

Using the first version of the site, I conducted usability testing in a face-to-face setting. I chose users who lacked knowledge on the subject matter so I could better assess their reactions and how much they learned from the site.

During user observations, I asked users to complete two tasks on the Web site. I also invited them to explore the site in general.

I then asked users to fill out a brief written survey about their experience using the site. The survey had questions with five-level item answers as well as open-ended text response areas.

At the conclusion of the testing, I conducted interviews with them about their impressions and experiences with the site.

Evaluation Results

Observation notes, survey item answers and text responses, and notes from the interviews were compiled. Usability testing results showed that a key element of the hoof pick movie clip and the hoof pick quiz, the direction of how to move the pick, was confusing to users. These animations were reworked for the final version so users could understand the correct technique.

Navigation issues became apparent especially during the observations and interview portions of the usability testing. Numerous changes were made for the final version. For example, boxes were added around animations on the hoof care page so the separation between animations was visually more distinct.

Usability testing demonstrated that the goal to educate users on the topic was met.

The report on the usability testing (PDF) showed the usability testing results in detail and the proposed changes. The site then went through another iteration.

• Final Site

Follow Up

Since finishing this class, I shared the Flash site with subject matter experts such as veterinarians, riding instructors and horse owners. I received positive feedback. They told me that they share my site with their contacts. I plan to keep the site active so it is available as a learning resource for the local riding community.

Additional Artifacts

Other artifacts which include an evaluation process are the Needs Assessment Report, discussed in the conducting needs assessment competency section and the Computer Supported Collaborative Work Sakai Desktop Widget, discussed in the designing learning environments competency section.