s519 logo S519 Evaluation of Information Systems


Home | About | Course Readings | Syllabus | Handouts | Assignment


Upon completion of this course, you should be able to:


Required Textbook:

Salkind, N.J. (2007). Statistics for people who (think they) hate statistics. The Excel edition. [Kent-Cooper room (KCR); Call number: HA29 .S2365 2007]

Davidson, E. J. (2005). Evaluation methodology basics: The nuts and bolts of sound evaluation . Thousands Oaks, CA: Sage. [KCR; Call number: H62 .D254 2005]

You can also find most of the articles on the E-reserves system. Some articles are physically on reserve in the SLIS library due to copyright issues. E-reserve URL: http://ereserves.indiana.edu/coursepage.asp?cid=416

Course Schedule and Readings by Week:



Project Due and Presentation


Week 1.

  • Introduction
  • Overview of syllabus
  • Learning from failures


ISWorld site
Hayes et al

Week 2.

  • What is evaluation?


Davidson Ch 1-5

Week 3.

No Class – Martin Luther King Jr. Day


Salkind Ch 1, 1a, 1b

Week 4.

  • Defining system/service objectives
  • Establishing evaluation criteria
  • Validity &reliability


DeLone &McLean x 2
Davidson Ch 6
Salkind (3rd ed.) Ch 6

Week 5.

  • Reporting of evaluation
  • Social statistics
    • Hypothesis testing
    • Significantly significant
  • Measurement memo to be discussed
  • Team formation


Davidson Ch 10 [skim]
Salkinds Ch 6, 7, 8
Babbie Ch 16

Week 6.

  • System/software quality;
  • Information quality

Measurement memo on system quality or information quality due

Strong et al
Stvilia et al
Chae et al

Week 7.

  • Usability/performance
  • Attitudes/satisfaction
  • User experience

Measurement memo on usability/performance; attitudes/satisfaction due

Rosenbaum et al

Nevo &Wade
Ong &Lai

Week 8.

  • Implementation/use
  • Web analytics

Measurement memo on adoption/implementation/use due

Legris et al
Prisk &Brooks
Norguet et al.

Week 9.

  • User effectiveness/productivity
  • Organizational performance/productivity

Measurement memo on net effects due

Devaraj &Kohli
Kohli &Sherer

Week 10.

No Class—Spring Break



Week 11

  • Understanding survey research
  • Service quality
  • What to expect for usability testing next week
  • Preview of data analysis techniques


Bobbie, Ch 9
UCLA report

Week 12.

  • Qualitative methodology
  • Usability testing of the instruments

Research design proposal and measurement instrument due (3/26)

Kaplan et al
Kelly et al.

Week 13.

  • Introduction to data analysis
  • Data collection
  • Graphical representation

Research design proposal and measurement instrument due

Salkind Ch 2, 3, 4, &5

Week 14

  • More on data analysis


Salkind, Ch 9, 10, &11
Davidson Ch 7

Week 15

  • Practical considerations in evaluation
  • Politics of evaluation

Data analysis due

Fitzpatrick et al
Davidson Ch 10

Week 16.

  • Oral Presentations



April 25, 2008

Final Project due at 5pm



Back to Top

Course Deliverables and Grading:

Readings will typically be assigned for each class period, and the latest information about readings will be listed in the on the class website. Please come prepared. Class discussions are important, and I expect all students to participate. Your grade will be based on two individual, four group assignments, and participation:

The class will be conducted in a participative manner, with members of the class having significant control over the specific content of each class session.

SLIS Grading Policy

To receive a passing grade in this course, you must turn in all of the assignments and the term project and complete all the presentations. You cannot pass this course without doing all of the assigned work (which includes the final presentation), however, turning in all of the work is not a guarantee that you will pass the course.

To earn a B in this course your work must consistently demonstrate and/or include:

Your work must also meet all of the requirements of the assignment. To earn a higher grade you must surpass the criteria and expectations for a B; to do so your work should consistently demonstrate and include:

Your work should also demonstrate the ability to see the relationship between coursework and the larger issues which evaluation of information systems encounter.


Course Policies:

On honor and collaboration:

Course assignments are designed to help you build a professional portfolio and gain practical experiences. You will be provided with some class time to discuss projects, but you are expected to spend outside of class time each week to practice your skills, work on assignments, and complete readings. You are encouraged to help each other throughout this course. However, the individual assignment you submit must be your own. Any students who submit work completed by someone else will receive a 0 score for that assignment, and may receive an F for the course.

On due dates:

Unless otherwise noted, due dates are at the beginning of the class time on the due date. If you come to the class late and submit an assignment after the class begins, it will be considered as a late submission. Due times for non-class days are 5 PM. Unexcused late work is likely to be penalized. Assignments that are over 6 days late will not be accepted unless arrangements have been made with me. If you have unexpected events and need to submit the assignments late, please contact me beforehand.

On attendance:

I expect you to attend all class meetings. If you cannot attend class, you must notify the instructor in advance (preferably more than 24 hours prior to the class). Attendance will factor into your final grade. Unexcused absences will not be tolerated; numerous absences are frowned upon, and if you foresee yourself missing multiple classes, be sure to see the instructor the first day after class. Make-up work may be negotiated only in cases of documented, excused absences. If you do not come to the class on time, it will affect the participation grade.

On cell phones:

Please turn off your cell phone before each class starts.

On interactions with the instructor:

I will be around during office hours. If office hours do not work for your schedule, you can make appointments. At other times, whenever my door is open, please feel free to knock and enter.

Academic Dishonesty:

There is extensive documentation and discussion of the issue of academic dishonesty here in the Indiana University "Code of Student Rights, Responsibilities and Conduct." Of particular relevance is the section on plagiarism.

Indiana University and the School of Library and Information Science policies on academic dishonesty will be followed. Students found to be engaging in plagiarism, cheating, and other types of dishonesty will receive an F for the course. As a rule of thumb, when in doubt, cite the source!


Back to Top


The instructor reserves the right to change, omit, or append the Course Syllabus whenever she deems it appropriate to do so.

Home | About | Course Readings | Syllabus | Handouts | Assignment

Copyright 2007, Noriko Hara

URL: https://ella.slis.indiana.edu/~nhara/teaching/sp08/s519/syl.html

Contact Noriko at nhara [at] indiana.edu