Assessment Process
What happens as a part of the Engagement & Well-Being Survey?
- In Spring and Summer 2024, we will develop the survey and submit our IRB proposal.
- In September-October 2024, we will administer the campus-wide survey.
- Behind the scenes, our consultant, Rankin Climate, will also be analyzing our institutional policies and procedures.
- In November-December 2024, we will conduct data analysis and begin to develop the report.
- Results will be presented in March 2025, and those will be the start of our Action Planning so that the lessons we learn throughout the process can be acted upon.
How are the questions developed?
- Rankin Climate, our consultant, developed a repository of tested questions from administering climate assessments at more than 300 institutions across the nation. Rankin Climate also administered the 2017 Campus Climate Assessment at Kent State that led to many positive initiatives. To assist in contextualizing the survey for Kent State, and to capitalize on the many assessment efforts already undertaken, the CSWG was formed. The committee is responsible for developing the survey questions. The team will review selected survey questions from the 2017 survey and the consultant’s 2024 tested collection.
Why do some demographic questions contain a very large number of response options?
- It is important in staff engagement and well-being research for survey participants to “see” themselves in response choices to prevent “othering” an individual or an individual’s characteristics. Some researchers maintain that assigning someone to the status of “other” is a form of marginalization and should be minimized, particularly in campus climate research which has an intended purpose of inclusiveness. Along these lines, survey respondents will see a long list of possible choices for many demographic questions. However, it is reasonably impossible to include every possible choice to every question, but the goal is to reduce the number of respondents who must choose “other.”
Why is this a population survey and not a sample survey?
- The survey will be administered to all staff at Kent State. Climate exists in micro-climates, so creating opportunities to maximize participation is important as well as maximizing opportunities to reach minority populations. Along these lines, the consultant has recommended not using random sampling as we may “miss” particular populations where numbers are very small (e.g., Native American staff). Since one goal of the project is inclusiveness and allowing invisible “voices” to be heard, this sampling technique is not used. In addition, randomized stratified sampling is not used because we do not have population data on most identities. For example, Kent State collects population data on gender identity and racial identity, but not on disability status or sexual identity. A sample approach could miss many groups.
What is the response rate goal?
- The target participation in the survey is all students, faculty, and staff at Kent State. Every response matters and is valuable in providing the most beneficial feedback and results.
What will be included in the final summary reports?
- The consultant, Rankin Climate, will provide a key findings summary of the most salient findings from the results. The report will provide high-level summaries of the findings and will identify themes found in the data. Generalizations for populations are limited to those groups or subgroups with response rates of at least 30%.
What will be done with data from the results?
- The purpose of conducting the survey is to assess the campus climate for learning, working, and living at Kent State and to identify successes and opportunities for improvement.
- The findings will serve as a guide when creating the action plan that accounts for the identified opportunities for improvement.
- Although the committee believes the survey process itself is informative, we have sought and received commitment from the senior leaders that data will be used to plan for an improved staff environment at Kent State.
What is the Institutional Review Board (IRB) process for this study?
- Submitting the survey to the university's Institutional Review Board (IRB) is an important step of the campus climate study project. There are several benefits to going through this process, even if the survey is considered to be "exempt" or "not human subjects research." Firstly, it provides some assurance to potential participants that their responses to the survey will remain confidential. People who have participated in social science research may recognize and expect that the process has been reviewed by IRB. They may feel more comfortable sharing their confidential information and personal stories. Secondly, going through an IRB review provides some protections to the Principal Investigators (PIs) who will be entrusted with analyzing and managing the data, including both Rankin Climate and the institutional PIs. The expectation is that the data will not be shared with others, as designated in the data security plan. Lastly, an IRB review provides some cache to the study in the eyes of those who conduct research professionally, such as faculty members and scientists. These individuals understand what an IRB review requires and the protections for the data to which research professionals commit.
- The primary investigator from Kent State for the IRB process is Dr. Linnea Stafford at Kent State. An IRB application will be submitted for the project. Once the project is approved, the survey will be administered.