Objective 5:
Youth in high risk environments will participate in community based programs resulting
in opportunities for the youth to increase internal and external assets.
Evaluation Strategies
A variety of strategies can be used to document inputs, outputs, and outcomes
of programs. Appropriate tools include surveys including surveys, interviews,
expert observations and periodic parent/mentor/teacher assessment. Existing
data such as school records and 4-H project books, as well as personal project
journals or goal-setting/achieving records can be used. The following is prepared
as suggestive of evaluation approaches. The variety of target audiences, purposes,
and settings as well as the requirements of funding agencies recommends matching
objectives and tools to each project rather than using a ‘one-size-fits-all’
approach.”
A. Measures of Progress
1. Increased internal assets (personal capacities that promote healthy development,
interaction, and adaptation from youth into adulthood)
NUMBER demonstrating gains ________
Outcomes and Evaluation Tools
· Project Mastery (completion of objectives, demonstration)
· Commitment to Learning (ex: homework, projects)
· Positive Values (ex: Character Counts: Trustworthiness, Respect,
Responsibility, Fairness, Caring, Citizenship)
· Social Competencies (ex: Penn State Life Skills assessment)*
· Decision-making
· Communication
· Goal setting
· Problem Solving
· Resistance—role play/observation
· Conflict Resolution—here we need another instrument
*Note: The Penn State Life Skills survey seems to be a measure of progress (e.g.,
short-term outcome), but repeated indications that youth “often”
or “always” use skills or other evidence (e.g., demonstrating skills
in completing projects, leading clubs, etc.) of applying skills might qualify
as impact (e.g., long-term outcome) especially if it represented a change in
behavior or competence level.
· Positive Identity
· Self-efficacy—scale
· Sense of Purpose statement
2. Increased external assets (program and environmental conditions that support
positive development)
NUMBER demonstrating gains ________
Outcomes and Evaluation Tools
(based on Program Features of Eccles & Gootman, 2002)
· Physical and Psychological Safety (school, community climate)
· Safe & Healthy Environment Checklist
· Healthy Habits Checklist
· Structured Environment (boundaries and limitations)
· Survey on Program Rules
· High Expectations for behavior, achievement
· Supportive Relationships
· Feedback on staff, volunteers
· Opportunities to Belong
· Inclusion
· Teamwork
· Positive Social Norms
· Character Counts indicators for the program
· Support for Efficacy and Mattering
· Shared governance of program
· Youth-adult partnership
· Community service learning
· Opportunities for Skill Building
· Project Mastery opportunities
· Life Skills training
· Integration with Family, School, Community
· Evidence of Linkages
· Family, Teacher feedback on youth participation in the program
3. Increased knowledge of alternatives to negative risk
taking behavior.
NUMBER demonstrating knowledge ________
Outcomes and Evaluation Tools
· Knowledge of alternatives (survey, role play)
B. Impact Indicators
(As noted above, extended evidence of knowledge, attitude, skill, or aspiration
change or evidence of applying short-term gains for significant behavior change
constitutes impact)
1. Increased life skills.
NUMBER demonstrating ________
Objectives and Evaluation Tools: see above and identify evidence of sustained
knowledge, application of knowledge and skills to specific circumstances, or
evidence of benefits of youth activity such as positive mentor-mentee relationships.
2. Improved academic performance.
NUMBER demonstrating ________
Outcomes and Evaluation Tools: see above and identify evidence of sustained
good grades, improved EOGs, teacher/mentor reports; increasing difficulty of
courses (or persistence in school); decreased behavioral referrals.
3. Increased community service.
NUMBER demonstrating ________
Outcomes and Evaluation Tools: see above and track sustained engagement, increased
involvement or leadership, improved relationships, effects.
4. Reduced negative risk taking behaviors.
NUMBER demonstrating ________
Outcomes and Evaluation Tools: see above and track risk survey (sustained),
pledge/monitoring, counselor/mentor feedback.
5. Reduced judicial involvement.
NUMBER demonstrating ________
Outcomes and Evaluation Tools: court records, court counselor observations.