OSP Research Design & Data Analysis Lab

Join us for our monthly October Book Club meeting as we learn together and discuss chapters 9-12 from: Qualitative research in practice: Examples for discussion and analysis. Participants are encouraged to read the selected chapters prior to the meeting but prior reading is not required. If you missed a previous meeting, do not hesitate to still join. All are welcome! Access to the book is free through the UT Tyler 

Library:
E-Book

10/16/25

REGISTER NOW

Validity, Reliability, and the Science of Measurement

Building on the foundations, this session introduces core measurement concepts—validity, reliability, and fairness—in accessible terms. We will explore how these concepts apply in both traditional contexts (exams, standardized tests) and non-traditional ones (program evaluations, research surveys). Faculty will learn to identify threats to measurement quality and strategies for mitigating them.

Key Takeaways:

• Definitions and practical applications of key psychometric concepts
• Tools for identifying common sources of error in measurement
• Understanding trade-offs in assessment design

10/22/25

Join us for our monthly Fall Book Club meeting as we learn together and discuss chapters 13-16 from: Qualitative research in practice: Examples for discussion and analysis. Participants are encouraged to read the selected chapters prior to the meeting but prior reading is not required. If you missed a previous meeting, do not hesitate to still join. All are welcome! Access to the book is free through the UT Tyler

Library:
E-Book

11/6/25

REGISTER NOW

Item Writing Mastery: From Multiple-Choice to Open-Ended Excellence

This session focuses on the art and science of item construction. We will cover writing high-quality multiple-choice, Likert-scale, and open-ended items that measure intended constructs without unintended difficulty or bias. Real-world examples will illustrate how subtle wording choices influence responses.

Key Takeaways:

• Principles for writing clear, fair, and discriminating items
• Avoiding common pitfalls such as double-barreled questions and cueing
• Best practices for crafting items in both academic and research settings

11/19/25

Join us for our monthly Fall Book Club meeting as we learn together and discuss chapters 17-18 from: Qualitative research in practice: Examples for discussion and analysis. Participants are encouraged to read the selected chapters prior to the meeting but prior reading is not required. If you missed a previous meeting, do not hesitate to still join. All are welcome! Access to the book is free through the UT Tyler

Library:
E-Book

12/4/25

REGISTER NOW

Beyond the Basics: Introduction to Advanced Psychometrics

This session introduces more sophisticated techniques for evaluating assessments, including item analysis, item difficulty and discrimination indices, and the basics of factor analysis. We will discuss when and why these methods matter, and how they can be applied even in small-scale faculty projects.

Key Takeaways:

• How to interpret item statistics to improve tests and surveys
• Understanding the logic behind exploratory and confirmatory factor analysis
• Identifying when advanced methods add value in applied settings

2/25/26

Language Matters: Neurolinguistic and Cognitive Considerations in Assessment

This session explores how the brain processes test and survey items, focusing on language comprehension, cognitive load, and cultural-linguistic factors. We will discuss neurolinguistic principles for item clarity, how reading level impacts performance, and strategies for designing assessments that are cognitively accessible without reducing rigor.

Key Takeaways:

• Understanding how language processing affects measurement accuracy
• Practical tools for analyzing and improving item clarity
• Strategies for reducing unintended cognitive barriers for diverse populations

3/25/26

Applying Theory to Non-Traditional Assessment and Research Applications

In our closing session, we will expand beyond the classroom to explore assessment in research, community programs, and professional training. Participants will learn how to adapt psychometric principles to non-traditional formats, including performance-based assessments, reflective surveys, and technology-enhanced tools. We will also discuss integrating qualitative elements for mixed-methods approaches.

Key Takeaways:

• Applying psychometric thinking to novel contexts
• Designing assessments for experiential learning and program evaluation
• Combining quantitative and qualitative approaches for richer insights

4/25/26