Course Catalog  |  Chapter Directory

NEXT

Module D > Indicators 

 

Indicators 

 

To make an outcome measurable, ask the question: “What change in your participants’ behavior, attitudes, skills, knowledge, status or condition would indicate success?” That change is an indicator of your outcome. You can have more than one indicator per outcome.

You’ll ensure your indicator is measurable by writing it in the following form:

The # and % of (participants) who (demonstrate what specified change?) 

Why start with participants? : To show that you’re observing a member of the target audience for change.

Why # and %? : To let you decide what level of impact counts as success:  everyone? Half? 80%  (We’ll talk about setting “targets” for success later in this module.)

How specific a change? : Make sure you use a verb that can be observed. Give enough specifics (how many or under what conditions or in what timeframe) that scoring doesn’t depend on guesswork or interpretation.  

Example:
Outcome: Student Bird Watchers know about birds in their area.
Indicator: The # and % of Student Bird Watchers who can identify at least five local birds on a field trip.

Coach

Watch out for fuzzy verbs (“know, do, feel, act, think”) and try to replace them with observable or measurable verbs: 
changes in knowledge: lists, describes, compares, teaches, gives examples, identifies
changes in attitudes: answers a survey, reports, chooses
changes in behavior: builds, joins, pays for, votes, devotes effort to
changes in skills: builds, can prepare, qualifies, demonstrates, passes exam

 

Writing effective indicators

Indicators should be measurable and specific enough so that all can agree whether the behavior has occurred. 

As you develop an indicator, be sure it meets the following criteria:

Meaningful: Does it capture the essence of the outcome so that it can represent the outcome?
In the Riverton Memoirs example, outcome: participants become more skillful writers.  Is it enough that improvement is assessed by the participating writers? Their instructor? An outside evaluator?

Timely: Is it likely to occur within the designed timeframe or often enough to be useful?
The West Dakota case tests whether their health database affects residents’ health decisions by survey of randomly chosen residents six months after the last training services of the grant occur (with budget included in the grant). Check these examples by clicking the Case tab at the top of the screen.

Manageable: Is evaluation workable and cost-effective in terms of effort and budget?
An Oregon Zoo measures whether minority interns demonstrate presentation and teamwork skills using indicators which use attendance records, activity logs, and observations by project staff.

Acceptable: Will key stakeholders accept this indicator as a description of what the outcome looks like when it happens?
A Central Florida Memory program involves stakeholders in libraries and historical groups, 4th-grade teachers, and developers in business and government. The outcomes focus on changes in the librarians, 4th-grade classes and business/government users.  

It’s time for you to look at an example in some detail. 

Library example: Indicators of outcomes for the Riverton program

The Riverton Memoirs Program provides support for adults writing autobiographical essays, with a moderator directing bi-monthly meetings for peer review and discussions with authors.

The first program outcome is: Participants show improvement in their writing. Which of the following statements are good indicators for the success of this outcome?

Possible Indicators of Success

Proposal 1: Funding for the second year of the program increases.

Proposal 2: 85% of workshop participants have two revised essays judged better than their original drafts in an independent blind testing

Proposal 3: 60% of participants sign up for a writing workshop within three months of the end of the Memoirs program.

Proposal 4: 90% of participants who signed up for the workshop attend 80% of the sessions and produce work included in the published anthology of participants’ work.

 

Answer

 

 

Dig Deeper

For more in-depth information about the Riverton program, click on Cases and choose Riverton Library Memoirs.


 

NEXT



创建自: JacmanChin408 points . 最后修改: 星期日 22 of 5月, 2011 00:45:44 MDT 作者 JacmanChin408 points .
原始文件位于 https://evergreeneducation.org/wikipub/tiki-index.php?page=Module%20D%20Indicators