Philliber follows a well-established set of steps when developing a new evaluation. These steps are:
Step 1: Discovery
This phase, at the outset of the project, involves meeting with our program partners and establishing communication preferences. Communication is crucial for any project and establishing systems and preferences for this early on will establish strong teamwork and help the whole project run smoothly. We will work with you to establish the best ways of collecting data as needed. We will immerse ourselves into thoroughly understanding your organization and its programs and needs. The information gleaned will inform subsequent decisions on the final evaluation protocols and procedures to be used.
Step 2: Design
Taking the information we have acquired during the phase of Discovery, Philliber will design and develop the evaluation. This phase ideally results in a logic model of the program, finalizes the evaluation plan, and establishes the preliminary analysis plan. During this process, a final evaluation model will be decided upon. We will refine the timeline for data collection and analysis and revise existing instruments or develop new ones. We will also determine what, if any, institutional review (i.e., IRB approval) is required.
Step 3: Implementation
During implementation, all data will be obtained, cleaned, and analyzed. Updates will be given regularly throughout the process. We do not believe it is useful to wait until the end of an evaluation to report what has been learned. Evaluations are tools that are meant to inform staff and stakeholders so that they can provide better programs and services. Frequent reporting also provides opportunities to adjust evaluations to produce more useful data. We expect to develop a protocol that will provide the most frequent feedback that is useful to staff and stakeholders.
Step 4: Analysis
The analysis stage will be different for each project. However, all data will be analyzed by our in-house Masters level Data Analysts.
Step 5: Reporting
Reporting will occur for the overall project based on your wishes. This may include both implementation and outcome data, a critical analysis of essential elements of program success, barriers to implementation, and recommendations to overcoming barriers. Both internal user-friendly reports and publishable articles can be produced. Our studies are often published in peer-reviewed journals and presented at national conferences. As Philliber is a private organization, we are not required to publish results, as some university-affiliated groups may be. Therefore, while it is preferable to publish, all possible publishing opportunities will be approved by you prior to their pursuit.