URS 6806: Research Methods and Evaluation Techniques
[Section R3A, Number: 56449]
SUMMER 2005

Schools of Social Work, Policy and Management
College of Health and Urban Affairs
Florida International University
Instructor: Ganapati, Sukumar 
Office: PCA 363B, University Park Campus
Telephone: (305) 348-6275
Office hours: Tuesday 2.00-3.30 pm
Email: ganapati@fiu.edu
Class hours: Thursday, 5.30-9.30 pm
Location SP Clark Building
Click below for appropriate links:

Last updated: 1 July, 2005


 
 

RECENT ANNOUNCEMENTS

Scope of TEST 3 The scope of Test 3 will be Chapter 14 (Regression Analysis) and Performance Evaluation.
July 1, 2005 Click here for instructions on Homework 3 (due July 14, 2005).
Scope of TEST 2 (23 June, 2005) Click here for the practice exercise I promised in class. This is for your practice only with Excel; it will not be graded.

The scope of Test 2 will be Sampling (Ch. 5), Primary Data Collection (Ch 6, 7), Data Analysis (Ch 10, 11). In Ch. 10, ignore Factor Analysis. In Ch 11, ignore InterQuratile Range and Exploratory Data Analysis.

3 June, 2005 Click here for handout on Homework 2
Scope of TEST 1 (to be held on 2 June) The scope for Test 1 to be held on 2 June is Chapters 2 through 4. The test will comprise 2 parts. Part A will consist of 4-5 multiple choice, True False, Yes/No type questions; Part B will consist of 5-6 short answer questions that will require answers of about a paragraph length. After the test, we will have a discussion of your homework papers, where you will talk about the papers you are reviewing informally. Please do not forget to bring the hard copy of your homework and the original article.
12 May 2005 Click here for handout on Homework 1

OUTLINE OF LECTURES PRESENTED IN CLASS

Lecture Notes 6 Performance Evaluation
Lecture Notes 5 Bivariate Analysis
Lecture Notes 4 Data Analysis
Summary Research Design Summary
Lecture Notes 3 Primary data collection
Lecture notes 2 Measurement
Lecture notes 1 Designs for Description and Explanation
COURSE SYLLABUS
Catalog Description

Theories and concepts of research and evaluation. Specific focus given to action components of the research process: design and formulation, strategies and methodological tools for conducting research. Discussion of the role of research in administrative decisions and in testing ways to implement public policy. A review of contemporary critiques on research design.

According to the FIU catalog, URS 6155 (Quantitative Methods and Analysis) is a prerequisite for taking this course. However, please note that this is not a statistics course. The emphasis is on general methods of research.

Course Objectives

The main objective of the course is to expose you to the different research methods, program evaluation, and performance measurement techniques. I will give special emphasis to significance of research and evaluation in specific administrative, program, and policy contexts.  

Educational Learning Outcome

Upon completion of the course, you should be able to:

  • Identify and use different research methods suitable to the purpose
  • Identify and implement different program evaluation and performance measurement techniques
  • Write a defensible research proposal
  • Assess research designs in research and program evaluation reports
Course Design

I have structured the course in three sections. The sections and the topics within each section are arranged such that there is a natural linkage from one to the next. The first section will focus on the Research Agenda and Design. In this section, we will discuss the ways of setting up the research agenda and an appropriate research design to support the agenda. The second section will focus on Research Analysis and Interpretation. Here, I will introduce the formal statistical procedures of analysis and testing the statistical significance. Although both these sections focus more formally on research methods, I will demonstrate how these concepts are applicable to program evaluation and performance measurement. The third section will formally deal with the central concepts of Program Evaluation and Performance Measurement. I will use specific examples from local, federal, and international agencies to illustrate these concepts.

As the course will progressively evolve from one section to the next, the classes form a chain link. Missing a class could mean that you will miss a crucial link in the evolution. Hence, I strongly advocate class attendance and participation.

To take full advantage of the course, I advise you to do the assigned readings before the class. I could assign specific readings to certain students and call them up at random.

Course Requirements

There will be three tests to evaluate your performance in the course, each of which will be held at the conclusion of a section. Each test will have an in-class component and a homework component. The in-class component will consist of questions that will test students’ understanding of the materials covered in the corresponding section. The questions will be both descriptive and analytical in scope. The homework component will consist of an analytical write-up of a substantive issue that relates to the corresponding section. I will give separate handouts explaining the scope and expectations of each homework assignment. You should be prepared to make an informal presentation about each homework assignment in class. I am unlikely to entertain requests for make-up exams or assignments unless it is warranted due to compelling unforeseen circumstances..

Exercise schedule and weightage

First Test 2 June, 2005 30 points
Second Test 23 June, 2005 30 points
Third Test 14 July, 2005 30 points
Class attendance & participation   10 points
Total   100 points
Required Text

The following textbook is required for the course:

O’Sullivan, Elizabeth, Gary R. Rassel, and Maureen Berner.  2003 (4th edition). Research Methods for Public Administrators. New York: Addison Wesley Longman, Inc.

However, please note that students will be required to do periodic readings from other sources assigned from time to time. Materials from the following websites will be used in the course:

William Trocim’s Research Methods Knowledge Base:  http://www.socialresearchmethods.net/kb/

W. K. Kellog Foundation’s Evaluation Toolkit: http://www.wkkf.org/Programming/Resources.aspx?CID=281

Class Schedule
Section 1: Research Agenda and Design
12 May, 2005 Introduction: Setting the Research Agenda
      Introduction to basic concepts of research methods
      Introduction to performance measurement and program evaluation
      Review of fundamental statistical concepts
Readings: O’Sullivan et al. Chapters 1 and 2.
19 May, 2005 From Research Agenda to Research Design:
      Selecting inputs, outputs, outcomes
      Choosing and measuring variables
      Reliability and Validity
      Sampling techniques
Readings: O’Sullivan et al. Chapters 3, 4, and 5.
26 May, 2005 Implementing Research Design:
      Primary and secondary data collection
      Ethics of Human Research Subjects
Readings: O’Sullivan et al. Chapters 6, 7, 8.
 
2 June, 2005 Review and Test
      In class test
      Student discussion of homework assignments
      Introduction to Analysis and Interpretation
Section 2: Research Analysis and Interpretation
9 June, 2005 Analyzing Research Results:
      Univariate analysis
      Standardized indicators
Readings: O’Sullivan et al. Chapters 9, 10, 11.
16 June, 2005 Interpreting Research Results:
      Statistical significance tests
      Regression
      Qualitative assessments
Readings: O’Sullivan et al. Chapters 12,13,14.
23 June, 2005 Review and Test
      In class test
      Student discussion of homework assignments
Review of Program Evaluation and Performance Measurement
Section 3: Program Evaluation and Performance Measurement
30 June, 2005 Program Evaluation Techniques
      Formative Program Evaluation
      Summative Program Evaluation
      Cost-benefit analysis vs cost-effective analysis
Readings: As assigned
7 July 2005 Performance Measurement
     Efficiency measures
     Outcome measures
     Productivity measures
Readings: As assigned
14 July, 2005 Final class test and student discussion