The goal for the Session Long Project is to develop a hypothetical plan to evaluate a program. In each module, you will revise and add various components to the paper. The components are outlined below:
SLP 1: Program Overview
SLP 2: Purpose and Goals of the Evaluation
SLP 3: Data Collection and Instrumentation
SLP 4: Data Analysis
SLP 5: Distribution of Findings
*Note: You will not conduct the evaluation, but merely plan for one.
Read:
Chapter 7: Phase 3 – Obtaining Information to Answer Evaluation Questions (87-110) in:
Jason, M. H. (2008).
Evaluating programs to increase student achievement. SAGE Publications, Inc. doi: 10.4135/9781412990264
Use the reading to compose a 2- to 3-page paper with the following components:
1. Data Collection Methods
2. What type of data collection methods will you utilize? Qualitative or quantitative? Outline in detail the process.
a. Instruments – What type of data will be collected? surveys? interviews? Other? Explain the various types of data.
3. Participants-Who will participate in the program evaluation? What are their roles in the organization? Will you include everyone in the organization? Explain.
4. Resources-What other resources will you use as part of the data collection?
5. Ethical Considerations-What are ethical issues associated with you as the leader collecting and analyzing the data? Be sure to acknowledge any bias.
SLP Assignment Expectations
Your paper will be assessed on the following criteria:
Assignment-driven criteria: Demonstrates mastery covering all key elements of the assignment in a substantive way.
Critical thinking/Application to professional practice: Demonstrates mastery conceptualizing the problem and viewpoints. Assumptions of experts are analyzed, synthesized, and evaluated thoroughly. Conclusions are logically presented and applied to professional practice.
Scholarly writing: Demonstrates mastery and proficiency in scholarly written communication to an appropriately specialized audience.
Quality of references and organization: Demonstrates mastery using relevant and quality sources and uses appropriate, relevant, and compelling content to support ideas, and convey understanding of the topic and shape the work.
Citing sources: Demonstrates mastery using in-text citations or sources and properly uses APA format including a full reference list.
Timeliness/Professionalism: Demonstrates excellence in taking responsibility for learning, adhering to the course requirement policies and expectations. Assignment submitted on time or collaborated with professor for an approved extension on due date.
This is what the Professor gave us to help
The chapter generally covers four major areas:
1. Choosing Data Collection Methods
You decide how information will be gathered. The chapter explains two main approaches:
• Quantitative methods – numbers and measurable results
o Surveys with rating scales
o Test scores
o Performance metrics
o Statistical data
•
• Qualitative methods – descriptive insights and experiences
o Interviews
o Observations
o Focus groups
o Open-ended responses
Most evaluations use a mixed-method approach (both types).
2. Selecting Instruments
“Instruments” means the tools used to collect data, such as:
• Surveys or questionnaires
• Interview protocols
• Observation checklists
• Document analysis (reports, records, policies)
The chapter emphasizes that instruments must be:
• Reliable – produce consistent results
• Valid – actually measure what they claim to measure.
3. Identifying Participants
You must determine:
• Who will provide the data
• Whether you include all members of the organization or just a sample
Examples might include:
• Program participants
• Leaders or administrators
• Staff members
• Stakeholders
4. Ensuring Data Quality
The chapter stresses:
• Avoiding bias
• Collecting accurate data
• Using multiple sources (triangulation)
Triangulation means using several data sources to confirm findings.