I’ve been absent from the blog for some time. I had a death in my family and assorted deadlines pushed blogging down the priority list for a while. But now it’s time to resume blogging. Look for new posts soon!
Time flies…or what’s been going on at The Measurement Group
I really didn’t mean for this much time to go by since my last blog entry in May. My colleagues and I at The Measurement Group have been busy with a number of interesting projects. For example:
We recently completed a five-year evaluation of the Los Angeles Integrated Add Us In Consortium, led by the Integrated Recovery Network. This project was funded by the US Department of Labor, Office of Disability Employment Policy (ODEP) to expand employment opportunities for people with disabilities. The Los Angeles Consortium created and implemented a successful model for helping people with primarily mental health disabilities to gain “soft skills,” connect with employers, and gain and maintain jobs that match their abilities and interests. Across the five-year project period, the Los Angeles Consortium helped its clients — many of whom are homeless and dealing with mental illness — in successfully obtaining 193 jobs! It was an incredibly rewarding experience to work with this group and help them document and share their outcomes.
Since earlier this year, we have been working with Arizona First Things First on the evaluation of an online developmental screening program they have implemented in three regions. We’ve interviewed a number of stakeholders to understand issues that they encounter in providing developmental screening to families with young children (0-5 years). In particular, we’ve been learning about the successes and challenges they’ve had in using an online screening tool. We continue to gather and share information with our colleagues on this project to help inform their future developmental screening strategies.
These are just a few highlights of the work we’ve been doing in recent months. In addition, life got busy with high school graduations, family trips, and transitions with my son starting college. So, blogging took a back seat for a while. But with lots of news to share, I will be returning to active blogging soon…if not now, then I’ll make an early new year’s resolution?
Some of my professional influences in evaluation
An evaluation blog that I follow, aea365.org, had a recent post by Liz Zadnik about her professional influences and inspirations in evaluation. Reading Liz’s post got me thinking about some of my own influences over the years.
First of all, I am grateful for the mentorship of George J. Huba, PhD – my partner at The Measurement Group for 23 years. Back in the day, George started TMG from his kitchen table. Shortly after securing our first contract, I joined him in this exciting venture. Even though we both had professional training and experience in social science research methods (he much more than I), we learned a lot over the years about translating that into doing evaluation in the real world with programs that serve vulnerable populations. I learned from George’s ability to take results from complex analyses and turn them into straightforward, bottom-line recommendations for health, mental health, and social service professionals. George’s high standards set a bar for my work that I continue to strive for. Now a “retired evaluator,” George is currently a social media force to be reckoned with, blogging at www.hubaisms.com and tweeting prolifically as @DrHubaEvaluator.
My list of professional influences would not be complete without Vivian B. Brown, PhD. Dr. Brown, an accomplished community psychologist and founder of Prototypes (retired), was an early adopter of program evaluation, back when very few community treatment program administrators really understood the value of collecting data to demonstrate their outcomes. I have many fond memories of meetings with Vivian and George where we would brainstorm about evaluation questions, ways to disseminate our findings to the field, or how to use the information from our evaluation work to improve services for the women and children in Prototypes’ outreach, prevention, and treatment programs. One of the most important things I take from my work with Dr. Brown is to always be cognizant of the burden of collecting data from program participants, especially with respect to asking sensitive questions and the context in which they are asked.
Before I became an evaluator, I was trained as a research psychologist. So what made me want to do that in the first place? Jonathan M. Cheek, PhD was my undergraduate advisor at Wellesley College. There was something about doing research with him that sparked my interest. It struck me as something that certainly wouldn’t be boring. I have always appreciated the opportunities I had early in my career as an undergraduate to conduct and publish psychological research in several articles and book chapters. And although my work in personality research was a long time ago, it’s been exciting to see a renewed interest in the study of traits (for example, Susan Cain’s excellent book “Quiet”). My background in individual and group differences has certainly influenced my approach to evaluation — realizing that it’s not only whether a program is effective, but for whom and in what circumstances.
There are many more influencers and inspirations than I can acknowledge in this blog post. So, I’d like to think of this as the start of an occasional series and I look forward to giving a shout out to the rest of you in the future.
Welcome to The Measurement Group Blog
Welcome to The Measurement Group blog! I’m Dr. Lisa Melchior, and I’d like to introduce you to the work we do and our approach to program evaluation.
I’ve worked in the field of program evaluation and applied social research for more than 25 years. I’m a licensed research psychologist specializing in the evaluation of health, mental health and social services. I enjoy using my professional training and expertise to help improve services, outcomes and quality of life for people who often fall through the cracks of our health and social service systems. I’ve published articles and presented to audiences about issues related to the evaluation of community-based services such as substance abuse prevention and treatment, mental health services, integrated and culturally specific models of care, wraparound services, and child abuse prevention. My work has focused on services for at-risk and vulnerable populations, including women, children and families, youth, older adults, recent immigrants, and people with disabilities — including those that stem from behavioral health conditions. In addition to my primary focus on program evaluation, I have expertise in screening and assessment tools and techniques used in various health, mental health, and social service settings.
At The Measurement Group, my colleagues and I provide evidence for stakeholders that their programs produce measurable, meaningful results. We work with our clients to design and implement useful, realistic and user-friendly evaluation studies that simultaneously maximize reliability, validity and utility while minimizing burden. Since 1988, we have evaluated more than 400 health and social service programs in 38 states and 39 major metropolitan areas. We work with programs that range from small community-based start-ups to large multi-site federally funded initiatives.
For more information, please visit us at www.TheMeasurementGroup.com, like us on Facebook, and find us on Google+. Follow me on Twitter for news about healthcare and social services research and evaluation and connect with me on LinkedIn.