Title/Name
Description (+ What's Included) Purpose
Deadline For
Submitting
Who Initiates The
Data Request?
Data Collection
Source
Point Person
Responsible for
Submitting the
Data
Required for DOE
Reporting?
1
Excel template for
sampling (cohort
selection)
List of all deposited students eligible for
RAM selection - All names are omitted
from list. Deidentified numbers are used
instead.
For random sampling into RAM
program treatment and control
groups
As soon as available -
Late Spring/Summer
KWE sends request
then partners submit
pool for KWE to
sample
Institutional Records
(Treatment and
Control)
Yes
2
Entering Baseline
Admissions Scores
Baseline data (HS GPA, SAT or ACT Scores,
etc.) of new matriculated Treatment and
Control RAM students
Analysis of student population
- within each institution and
across each MAC partner
Late September
(depending on
Institution's Census
Date)
KWE sends request
then partners submit
deidentified data to
KWE
Institutional Records
(Treatment and
Control)
Yes
3
Annual Student
Academic
Performance
Template
A template asking for all student grades,
GPA, credits earned for the 12 month period
Sept through August; Yr 1 to Yr 2 retention
data for each entering cohort; plus
graduation data as of August each year
Assess annual relative performance
of treatment and control students
in each cohort
By Sept 15 (for data
on performance
during preceding 12-
mo peiod, Yr 1 to Yr
2 retention data,
plus graduation data
as of August)
KWE sends request
and a template then
partners submit
promptly
Institutional Records
(Treatment and
Control)
Yes
4
Entering Student
Attitudinal Survey
This is an anonymous online survey
collecting pre-college/RAM program
psychological data from first semester, first-
year students on their college adjustment,
sense of belonging, campus involvement,
abilities and persistence in college, and
aspirations.
Assess all first-semester treatment
and control students on
psychological variables at beginning
of college
For each new entering
cohort: Submit by
September 30 of each
year
Partners administer
through links provided
by Erica at FSC - Erica
sends de-identified
data to KWE
Online survey of all
entering students
from both the
treatment and control
groups
Yes
5
Key Interventions
Survey
Online Survey assessing the major 4
required treatment
components/interventions, including:
(1) First Year Experience Course
(2) Counseling and Roadmap
(3) Collaborative Learning
Workshops
(4) Research Placement
Assess uniform implementation of 4
interventions across partners such
as when/timing of implementation
and #/% of students participating.
By January 15 each
year
KWE sends request
then partners
complete the survey
Project Administration Yes
6
Culminating Student
Program Evaluation
Surveys (formerly
Focus Groups)
Online survey sent to all RAM
treatment scholars upon completion
of research placement (e.g., the final
intervention)
Assess student feedback about
the overall RAM program
experience to support modification,
if needed
Varies - Ideally
administered within 1
month after each
student completes the
Treatment #4
Research Experience
Partners administer
through links provided
by Erica at FSC - Erica
sends de-identified
data to KWE
Online survey of
students from the
treatment group
Yes
7
Faculty/Staff
Interview or Survey
Faculty/Staff are given the option of a
phone interview with Gabbi or Kate and/or
an online survey, both of which ask the
exact same questions about faculty
experience in the RAM program
Solicit feedback from faculty/staff
who are central to the program for
assessment and modification
purposes
By February 15 of Yr 1
cohort (Feb 2017) & Yr
3 cohort (Feb 2019)
KWE sends request
for faculty contact
information and
administers the
survey or conducts
interviews
KWE phone interviews
or online survey
Yes
8
Graduating Student
Attitudinal Survey
This is an anonymous online survey
collecting post-college/RAM program
psychological data from students on their
college adjustment, sense of belonging,
campus involvement, abilities and
persistence in college, and aspirations.
Assess treatment and control
students’ on psychological variables
at end of college in order to
compare levels of change from
Entering Student Attitudinal Survey
By April 15 (for each
cohort starting in their
senior year)
Partners administer
through links provided
by Erica at FSC - Erica
sends de-identified
data to KWE
Online survey of
students from both
the treatment and
control groups
Yes
9
(Optional)
Attendance Records
for Special Events
Number of participants at special RAM
program events (e.g., Welcome,
workshops, speakers, social gatherings,
civic engagement, etc.)
Monitor engagement with
intervention/
implementation fidelity
June 1 each year Any partners who
collect this data can
submit it to KWE to
supplement our
findings
Program
documentation
No
FITW - EVALUATION PROTOCOLS
