We can lead you in creating and conducting multi-method designs.
Philliber often uses mixed-methods to provide the best possible evaluations. Our staff is highly skilled in tailoring our evaluation methodologies and tools to meet the particular needs of the sites where we are working and programs we are evaluating. This combination of strategies provides a more in-depth description of the programs, their implementations, and the impact they have.
A few select recent or key multi-method evaluations include:
Career Connections, Fairfield County’s Community Foundation
The Career Connections Program was a scholarship and coaching program for opportunity youth at Norwalk Community College in Norwalk, CT. The program was designed to connect young adults to short-term certificate programs that would help them enter high-demand jobs in the local healthcare sector. The evaluation was both an implementation and outcomes evaluation that incorporated a Philliber-designed data collection and dashboard system to monitor outcomes of the program, as well as stakeholder interviews.
Engaging the Electorate: A Program in Elections Coverage and Multimedia for Cambodian Journalists, International Center for Journalists
For International Center for Journalists, Philliber conducted a process and outcome evaluation of the Engaging the Electorate: A Program Focusing on Elections Coverage and Multimedia Reporting for Cambodian Journalists Project, which aimed to develop political reporting skills for Cambodian journalists through digital and multimedia reporting. Funding was provided by the U.S. Embassy in Phnom Penh.
Girls Inc. of New York City
Girls Inc. of New York City is a multi-program empowerment program for low-income girls of color in New York City. The evaluation (2013-present) includes programs at middle and high school sites that offer both high-dose and sampler programming, as well as programs with specialized curricula such as Generation Giga Girls, a data analytics program for high school girls that focuses on social justice, and Teen Leadership Circles, a peer education program that trains girls to facilitate their own Girls Inc. clubs. The evaluation includes site-based and annual reports on pre to post program changes in social-emotional competencies, academic and college outcomes, risk-taking behavior, and program satisfaction. For this work, Philliber has designed survey instruments, trained data collectors, conducted focus groups with students and program staff, and gathered national and NYC comparison data.
Iowa and Colorado Initiatives to Reduce Unintended Pregnancies
The Iowa and Colorado Initiatives to Reduce Unintended Pregnancies funded by a private donor, was designed to increase access to family planning services and reduce unintended pregnancies in Iowa and Colorado. Philliber, along with the University of California San Francisco, monitored activities of over sixty agencies and collected data in both states to evaluate the progress and effectiveness of these Initiatives and, ultimately, to see if there was a decrease in unintended pregnancy after these Initiatives ended.
JusticeCorps, The Judicial Council of California
Philliber has had several contracts with the California Judicial Council since 2009 to evaluate the JusticeCorps program. This program trains college students to assist self-represented litigants at legal self-help centers in three regions of the state (Bay Area, Los Angeles, and San Diego). In the first evaluation contract, six sites documented their program delivery, client satisfaction, and best practices. The final report recommended how to improve the program model by incorporating best practices statewide. Philliber conducted a follow-up evaluation to document how well the programs incorporated these best practices. More recently, Philliber assessed the performance measurement system which resulted in piloting of a better system of tracking performance measures and measures of beneficiary outcomes. Currently, Philliber is conducting a quasi-experimental study at courts in each region to determine whether self-represented litigants served by the JusticeCorps program file more accurately completed court documents than self-represented litigants who have received no assistance.
Maine Family Planning, Anonymous funder and the Family Planning Association of Maine
The Maine Family Planning project documented the implementation of primary care services in a family planning clinic in rural Maine and subsequent changes in patient and clinic-level variables as the clinic moved toward certification as a patient-centered medical home. The evaluation was a quasi-experimental design using two family planning clinics with no primary care that served as comparisons to family planning clinics with primary care. The research drew on both quantitative and qualitative data from a patient surveys, staff and administrator interviews, and clinic financial reports, as well as extensive gleaning of clinical and billing data directly from the electronic medical record system. A related case study on the process of transforming a family planning clinic into a level three patient centered medical home was completed in summer 2016.
Shakespeare in American Communities, Juvenile Offenders Programs, National Endowment for the Arts/Arts Midwest
Arts Midwest asked Philliber to evaluate its Shakespeare in American Communities Juvenile Offender Programs in six cities. The programs use theatre to improve the behavior of youth in the juvenile justice system. Philliber designed and conducted the evaluation of the six programs. Evaluation design included key informant interviews, focus groups and site observations to identify best practices.
Veterans Legal Corps, Equal Justice Works
For Equal Justice Works, Philliber is evaluating the AmeriCorps funded Veterans Legal Corps program that utilizes fellows and law students to provide legal services to help low-income and homeless veterans to overcome barriers to employment, housing, benefits and other critical needs. This is a multi-method evaluation that employs focus groups, surveys and site visits). Philliber also conducted a survey of five cohorts of alumni that served in the VLC program.