TIES Program Evaluation

Evaluation of the TIES program is carried out by Steve Rider, PhD, of Pacific Research & Evaluation, an independent organization.

Evaluation Goals

  1. To provide useful information to project staff for program development purposes.
  2. To measure the impact of the TIES program on teachers and students.

Evaluation Methods

The program’s evaluation design consists of collecting process data to assist project staff in making program adjustments, as well as collecting longitudinal data on various outcome measures for teachers and students. The following table lists the evaluation measures.

Type of Measure Target Group Data Collected
Process Teacher Satisfaction with TIES summer program.
Outcome Teacher and Student Knowledge of regulations related to, and purposes of, the use of humans and animals in research.
Attitudes regarding use of humans and animals in research.
Self-efficacy regarding talking with students and colleagues about the use of humans and animals in research.
Student Interest in science and scientific careers.

 

Data Collection Instruments

The instruments used in this evaluation allow for collection of both quantitative and qualitative data.  Data collection efforts include:

Teacher Focus Groups
A focus group is conducted with teachers at the end of each week of the TIES summer research experience. Questions focus on their perceptions of the strengths and weaknesses of the 3-week summer experience.

Teacher Pre- and Post-surveys
Pre- and Post-surveys of teachers at the beginning and end of the TIES summer research experience.  Survey items assess:

  • Knowledge of regulations related to, and the purposes of, the use of humans and animals in research
  • Attitudes regarding the use of humans and animals in research
  • Trust in various sources of information about research
  • Self-efficacy regarding talking with students and colleagues about the use of humans and animals in research

Student Pre- and Post-surveys:
Pre- and post-surveys of students at the beginning and end of the school year.  Survey items assess:

  • Knowledge of regulations related to, and the purposes of, the use of humans and animals in research
  • Attitudes regarding the use of humans and animals in research
  • Trust in various sources of information about research
  • Interest in science and scientific careers
Key Research Findings
  • Teachers reported significant increases in knowledge between the beginning and end of the TIES summer research experience on all items in years one and two.

 

image

 

  • Teachers’ trust in newspapers and PETA as sources of information decreased by the end of the summer research experience in years one and two.
  • Teachers were more comfortable talking about research with colleagues and students by the end of the summer research experience in years one and two.

 100% of teachers surveyed would recommend the TIES Program to other teachers.

TIES is a “once in a lifetime experience”.

“I thought it was the best professional development I have had as a teacher.”

“I feel lucky to be involved in such an engaging program.”

TIES staff are: “just stellar”, “approachable”, “organized”, and “responsive”.

- Comments made by TIES 1st and 2nd year summer program participants in focus groups

Contact Us:

Pacific Research & Evaluation
3507 SW Corbett Avenue
Portland, Oregon 97239
Phone: 503-595-3970

Email:
steve@pacific-research.org