Diabetes - "Flu and Pneumococcal Shot Campaign" |
|
Disclaimer The flu example is derived from the "Life Preserver" campaign. Portions were modified and fictionalized in part to conform to the planning process set forth in CDCynergy 3.0. This example originally appeared in CDCynergy Diabetes Edition. |
|
|
|
Step 1.1 Write a problem statement. |
|
The Advisory Committee on Immunization Practices (ACIP) and Centers for Disease Control and Prevention (CDC) recommend that persons with diabetes obtain a pneumococcal and annual flu shot. However, according to the state-based 1997 Behavioral Risk Factor Surveillance System (BRFSS), only slightly more than half (52.1 percent) of those diagnosed with diabetes reported getting a flu shot, and 33.2 percent had ever been immunized against pneumonia. Diabetes affects approximately 16 million persons in the United States. It is currently the seventh leading cause of death and the leading cause of blindness and non-traumatic lower extremity amputations. Persons with diabetes are also more vulnerable to common, seasonal health risks. Epidemiological research by the (CDC) shows that persons with diabetes are at greater risk both of getting and of dying with the flu and/or pneumonia. Each year 10,000 to 30,000 persons with diabetes die from flu or pneumonia complications. |
|
Step 1.2 Assess the problem's relevance to your program. |
|
The Centers for Disease Control and Prevention (CDC)/Division of Diabetes Translation's (DDT) mission is to eliminate the preventable burden of diabetes through leadership, research, programs, and policies that translate science into public health practice. One way to accomplish this goal is through coordinated media strategies and through the funding of Diabetes Control Programs (DCPs) in health departments throughout the United States, the District of Columbia, Puerto Rico, the U.S. Virgin Islands, and six island-based programs in the Pacific Basin. Addressing and highlighting the need for persons with diabetes to get a pneumococcal and an annual flu shot through a national campaign as well as local campaigns (carried out by the DCPs) fits well with the mission and strategy of the Division. Tackling this problem is consistent with the focus on preventive health care practices included in Healthy People 2000 and Healthy People 2010. |
|
Step 1.3 Explore who should be on the planning team and how team members will interact. |
|
In an effort to represent various perspectives and bring the campaign to the state level, the following organizations served on the planning team:
Formative focus groups acknowledged that both persons with diabetes and health professionals were not aware of the risk for flu/pneumonia mortality with diabetes, therefore it was necessary to build partnerships with a variety of organizations related to diabetes care. The CDC provided funding for the campaign, and the DDT, NIP, and DCPs combined information gathered from previous campaigns and best practices used to encourage persons to obtain flu shots. The diversity of the planning team allowed for an effective campaign to build awareness about this problem to increase the number of persons with diabetes who receive flu/pneumococcal immunizations. |
|
Step 1.4 Examine and/or conduct necessary research to describe the problem. |
|
A situation analysis showed that a great deal had already been done to raise awareness regarding specific risks associated with diabetes, such as the need for foot and eye care, by the federal government and organizations like the American Diabetes Association (ADA). No group, however, had focused specifically on the fact that persons with diabetes are more vulnerable to common, seasonal health risks. CDC's national epidemiological research showed that persons with diabetes are at greater risk both of getting and of dying from the flu and pneumonia. Each year 10,000 to 30,000 persons with diabetes die with flu or pneumonia complications. Data in the CDC's Morbidity and Mortality Weekly Report (October 1999) revealed that immunization behaviors varied according to ethnicity, age, gender, and geographic location for persons with diabetes. Non-Hispanic whites were more likely to report receiving pneumococcal vaccine and flu shots than non-Hispanic blacks and Hispanics. As age increased, reports of vaccination also significantly increased, likely due to successful flu campaigns to get persons over the age of 65 vaccinated. Overall, Health Styles research revealed that only 40 percent of persons with diabetes get an annual flu shot, leaving a large at-risk population for whom pneumococcal and annual flu shots would be a simple, safe, and inexpensive preventive measure. |
|
Step 1.5 Determine and describe distinct subgroups affected by the problem. |
|
The data clearly indicated a need for a national program that would target persons with diabetes and the health professionals treating them, and a need to work through DCPs to implement the campaign at state levels. The following were identified as being subgroups affected by this problem:
|
|
Step 1.6 Write a problem statement for each subgroup you plan to consider further. |
|
|
|
Step 1.7 Gather information necessary to describe each subproblem defined in new problem statement. |
|
|
|
Step 1.8 Assess factors and variables that can affect the project's direction. |
|
|
|
Step 2.1 List the direct and indirect causes of each subproblem that may require intervention(s). |
|
Persons with diabetes do not obtain pneumococcal and annual flu shots for various reasons including:
|
|
Step 2.2 Prioritize and select subproblems that need intervention(s). |
|
After careful consideration, the subproblems were prioritized as follows:
|
|
Step 2.3 Write goals for each subproblem. |
|
On the basis of the subproblems this campaign chose to address, the planning team decided on the following goals:
|
|
Step 2.4 Examine relevant theories and best practices for potential intervention(s). |
|
After examining various theories and "best" practices of diabetes interventions, the following models and strategies were considered. Health Communication/Education
Health Policy/Enforcement
Health Engineering
Health-Related Community Services
|
|
Step 2.5 Consider SWOT and ethics of intervention options. |
|
Health Communication/Education: Strengths
Weaknesses
Opportunities
Threats
What ethical considerations were considered for this strategy?
What aspects were strengthened within the program staff to carry out this activity?
Summarize the needs of the intervention:
Health Policy/Enforcement: Strengths
Weaknesses
Opportunities
Ethical considerations
Health Engineering: Strengths
Weaknesses
Opportunities
Threats
Ethical Considerations
Health-Related Community Services: Strengths
Weaknesses
Opportunities
Threats
Ethical Considerations
After reviewing the SWOT of the four intervention frameworks, Health Communication/Education strategies were chosen as the first set of interventions for the Flu Campaign. Health Engineering Strategies are also very important and serve as another component of the overall effort to increase the percentage of persons with diabetes who receive a pneumococcal and annual flu shot. Further development of these latter interventions, however, will not be covered here. |
|
Step 2.6 For each subproblem, select the intervention(s) you plan to use. |
|
A logic model was developed by the planning team members to show the subproblems, their causal factors, the intervention chosen for each subproblem, and the result that was desired. Various types of logic models exist. For this campaign, a logic model in the form of a table was chosen because it is easily readable and understandable. To read more about Logic Models, refer to the tutorial text for this step. |
|
Step 2.7 Explore additional resources and new partners. |
|
Additional resources were available because campaign partners included the CDC (DDT, NIP), State health departments, and other large organizations that had access to resources, expertise, patients and media outlets. New partners included:
Additionally, the DCPs were responsible for working with local managed care organizations, retailers and other intermediaries, state immunization program directors, and public health information officers to disseminate the campaign message. Other partners relayed the campaign's messages to patients, provided education as necessary, and stressed the importance of obtaining pneumococcal and annual flu shots. DCPs were encouraged to cultivate local partnerships to broaden the campaign. Some of these local partners included: Faith Community. Faith-based community leaders have significant influence over portions of the target group. The DCPs were encouraged to partner with the members of this community to stress the importance of flu and pneumococcal vaccines for persons with diabetes in their congregation. This approach could be particularly effective with minority populations. Grocery stores and pharmacies. Since shopping for essentials is a regular occurrence, reminders and flyers were distributed to many grocery stores. Partnerships were developed so that flyers and brochures regarding the need for pneumococcal and annual flu shots would be placed in prescription bags, because persons with diabetes frequently visit their local pharmacy for diabetes medication and supplies. In addition, pharmacists were encouraged to speak to their customers with diabetes about the importance of obtaining a flu and pneumococcal shot. Businesses displayed educational posters as yet an additional reminder. Partnerships with these establishments were explored on both local and national levels. Physicians' offices
and health departments. Because patients with diabetes seek medical
attention and advice from physicians and other health care providers,
planning team members chose to involve physicians' offices and health
departments. Consumer information brochures and posters for waiting rooms
were distributed. |
|
Step 2.8 Acquire funding and solidify partnerships. |
|
The primary funding source for this campaign was CDC. DCPs were encouraged to devote state funding to the effort and solicit "in kind" or donated funds from organizations with similar missions. Communication between staff and partners was an essential part of this campaign. External and internal communication, as well as the sharing of baseline data occurred among partners and participating agencies and organizations. Internal communication was used to discuss the progress of the campaign, elicit feedback, and generate ideas on events that were occurring. External communication was used to update stakeholders on the progress of the campaign and to ensure their needs were being met. New partners were invited to assist in strategy and implementation development, and existing partners and staff indicated what they could contribute and how their participation would benefit the stakeholders and the campaign. |
|
|
|
Step 3.1 For each subproblem, determine if intervention is dominant or supportive. |
|
Initially, communication proved to be the dominant intervention for almost all of the subproblems addressed in Phase 2. Communication was required to raise awareness, educate persons about the adverse effects of pneumonia and the flu for persons with diabetes, adapt cultural and ethnic beliefs into beneficial health practices, motivate persons with diabetes to obtain pneumococcal and annual flu shots, and educate physicians and providers on the importance of recommending pneumococcal and flu shots to their patients with diabetes. |
|
Step 3.2 Determine whether potential audiences contain any subgroups (audience segments). |
|
The planning team did not feel that sufficient resources were available to segment the target audiences any further. Because the campaign was centered on creating awareness, it was decided that the messages could be properly delivered within the existing groups:
|
|
Step 3.3 Finalize intended audiences. |
|
Planning team members intended to reach all of the target audiences previously mentioned. CDC was responsible for launching the campaign at the national level, and it relied on DCP partners to localize the campaign. |
|
Step 3.4 Write communication goals for each audience segment. |
|
The communication goals for selected audiences were:
|
|
Step 3.5 Examine and decide on communication-relevant theories and models. |
|
After careful consideration of the numerous communication-relevant theories and models, the Health Belief Model was chosen as the basis for this campaign. For many years, the Health Belief model has been used to describe health behavior change and maintenance and has been employed as a framework for health interventions. The concepts that compose this model are perceived susceptibility and severity of disease impact, perceived benefits and barriers, cues to action, and self-efficacy. This campaign chose to focus on the perceived susceptibility to and severity of problems that persons with diabetes could incur by not obtaining flu and pneumococcal shots; the perceived benefits of and barriers to obtaining these shots; and the self efficacy, or perceived ability, of persons with diabetes to get their pneumococcal and annual flu shots. To read more about the Health Belief Model, see the resource entitled "Change Theories" in the tutorial text of this step. In addition to the Health Belief Model, social marketing was used during this campaign. Social marketing is the application of commercial marketing technologies to the analysis, planning, execution, and evaluation of programs designed to influence the voluntary behavior of target audiences to improve their personal welfare and that of their society. |
|
Step 3.6 Undertake formative research. |
|
The Behavioral Risk Factor Surveillance System (BRFSS) was used to gather necessary information on the target audiences. To view a report with this information, see CDC website (http://www.cdc.gov/mmwr/preview/mmwrhtml/mm4842a3.htm). On behalf of the CDC, Prospect Associates conducted separate focus groups with persons with diabetes, physicians, and diabetes educators. These sessions produced information on the knowledge, attitudes, and behaviors among persons with diabetes and among health professionals about the necessity of flu and pneumococcal shots for persons with diabetes. Prospect also explored barriers to immunizations and looked to establish communication strategies and messages to overcome these existing barriers. To view the full report, see "Focus Group Report" (DB_Flu_Focus_Group_Report.pdf). Additionally, an extensive literature search and review was conducted to gather information on target audiences, best practices, intervention methods, and communication strategies that would be most applicable to this campaign. |
|
Step 3.7 Write profiles for each audience segment. |
|
Persons with diabetes, aged 25 - 54:
African Americans with diabetes:
Latino/Hispanic Americans:
In addition to primary target audiences, planning team members identified secondary audiences. These included: Family members and/or friends of persons with diabetes: Family members and/or friends of persons with diabetes would most likely encourage loved ones to obtain flu and pneumococcal shots, prompting action on the primary target audiences' part. The distribution and display of informational posters, flyers and brochures at grocery stores, local pharmacies, area malls and movie theatres was intended to assist in raising awareness among this group. Physicians/Health Care Providers: These persons were chosen as a secondary target audience because they offer and prescribe health care and oftentimes carry credibility. To garner this group's support, campaign planners reminded physicians and health care providers of the importance of flu and pneumococcal shots for their patients with diabetes. Planning team members also communicated to this group that one of the strongest motivators for adult vaccination was a recommendation by the health care provider. Informational flyers and kits were distributed to various offices and places that provide health care. |
|
Step 3.8 Rewrite goals as measurable communication objectives. |
|
The communication goals helped to establish the objectives of the campaign:
Note: It was the intent of the campaign to contribute to this goal, though it was not expected that this communication component of the campaign alone could accomplish this objective. See Steps 2.5 and 2.6 for the non-communication interventions that would contribute to this goal. |
|
Step 3.9 Write creative briefs. |
|
Primary Target Audiences:
Objectives
Obstacles
Key Promises
Support Statements/Reasons Why
Media Various print materials were developed, such as "frequently asked questions" flyers, informational brochures (to be distributed a points were people get flu shots, diabetes care and other community information venues), and posters. Informational flyers and kits were distributed to various offices and places that provide health care. A print public service announcement (PSA), media kit, and community kit were produced. Radio and television PSAs were also created. These materials were developed in both English and Spanish. Activities
Tone Key messages had to motivate target audiences and initiate action. Planning team members believed that using tones of concern, hope, and empowerment were the way to do this. Additionally, an optimistic, warm, and positive tone was seen as the best way to present culturally sensitive, diverse, motivating and attention-getting (without being fear based) messages. Creative Considerations To reach both the primary and secondary target audiences, materials had to take different approaches at relaying key messages. Additionally, the radio and television spots were designed to address diverse populations; thus, cultural sensitivity had to be considered and incorporated into the key messages. Materials were developed in Spanish and English and the PSAs were tagged with local contact information for their audiences. These were distributed nationally by CDC and locally by DCP personnel prior to flu season. View the creative brief developed by Prospect Associates (DB_Flu_Shot_Creative_Brief.pdf). |
|
Step 3.10 Confirm plans with stakeholders. |
|
The planning team held a meeting with stakeholders, partners, and involved staff to discuss the status of the campaign thus far. The creative brief was distributed to everyone present, and ideas and feedback were solicited. The planning team members wanted to confirm the stakeholders' support and commitment to the campaign. Preliminary timelines were set and necessary resources, including time and personnel, were reviewed. During this planning stage, training sessions necessary for the implementation of the campaign were planned and program materials were distributed to the media. It was decided that the CDC would be the primary funding source for this campaign. Another meeting was scheduled and responsibilities were assigned to the various attendees. The necessity of evaluation was stressed, and information regarding the stakeholders' desired outcomes was revealed. |
|
|
|
Step 4.1 Draft timetable, budget, and plan for developing and testing communication mix. |
|
The campaign initially received funding in November 1996, which totaled $700,000 and was used to conduct formative research, concept testing, creative development, and pre-testing of communication materials. This money was also used to build local DCP's capacity to implement an awareness-raising campaign targeted at persons with diabetes through trainings for DCP staff, media materials and other strategies. Before the national campaign rollout, the campaign was piloted and extensively evaluated in Florida, Texas, Montana, and California. These DCPs teamed with their counterparts from the NIP to conduct the program in each pilot state. The training began in mid-June of 1997, and the first year campaign launch was set for September of 1997. While the local DCPs were gaining the necessary skills to implement and distribute a consistent message across all states/territories, message concepts were being created and tested. In subsequent years, because of the success of the pilot, the campaign was launched nationally in September/October 1998, 1999, and 2000. Various campaign enhancements were developed and implemented during these years. To reach members of both the primary and secondary target audiences, materials were distributed and displayed in many different settings including grocery stores, pharmacies, local malls, movie theatres, physicians' offices, health departments, churches and other religious organizations. The planning team decided that it would be best to implement activities at different levels, creating a call for action targeted to the wider community. These activities were later implemented at interpersonal, small group, organizational, community and mass media levels. All print materials, such as brochures and flyers, are described in more detail in Step 4.8 and can be viewed by visiting the CDC website (http://www.cdc.gov/diabetes/pubs/index.htm). Video and audio PSAs can also be viewed at http://www.cdc.gov/diabetes/projects/psas.htm. For campaign timeline: DB_Flu_Timeline.pdf. |
|
Step 4.2 Develop and test creative concepts. |
|
Using a creative platform that could cover multiple risks and prevention steps in future campaigns, the overarching theme of "Diabetes. One Disease. Many Risks." was developed, with the tagline "With Diabetes, Prevention is Control." It underscored that diabetes is a disease that can be controlled with some simple, preventive measures. Several creative concepts were tested with persons with diabetes of various ethnicities and locales to ensure effectiveness across a wide audience. The final concept used the visual metaphor of a life preserver to communicate the significance of a flu shot for persons with diabetes. |
|
Step 4.3 Develop and pretest messages. |
|
Based on feedback collected from the target audiences, materials that incorporated their thoughts and ideas were created. The key messages selected were "Flu shots can be a life preserver for people with diabetes" and "With diabetes, prevention is control." This represents a social marketing approach because it is target audience-driven and because it produced messages that selected audiences will listen to, and may lead them to take appropriate action. The target audience felt that the life-preserver metaphor best expressed their own empowerment to do something simple to help control their diabetes. |
|
Step 4.4 Pretest and select settings. |
|
The planning team selected various settings in which to expose the primary and secondary target audiences to key messages. Careful consideration, extensive formative research and focus group testing selected grocery stores and pharmacies, local malls and theatres, churches and other religious organizations, community centers and local YMCAs, and physicians' offices and health departments. Displaying materials and distributing information in all of the aforementioned settings allowed the key messages to reach the primary and secondary audiences both directly and indirectly. |
|
Step 4.5 Select, integrate, and test channel-specific communication activities. |
|
After selecting the settings for material dissemination, the planning committee choose communication activities. Activities would be conducted at different levels (i.e. interpersonal, small group, organizational, community and mass media) in an attempt to involve the community in addition to persons with diabetes. It was important to the planning team members not to place sole responsibility for obtaining pneumococcal and annual flu shots on persons with diabetes, but to take a more ecological approach and involve and place responsibility on the wider community as well. Activities were performed at different levels:
In addition to the media activities, campaign planners created materials to remind physicians and health care providers of the importance of flu and pneumococcal shots for their patients with diabetes and that one of the strongest motivators for adult vaccination was a recommendation by the health care provider. |
|
Step 4.6 Identify and/or develop, pretest, and select materials. |
|
Several creative concepts were tested with persons with diabetes to ensure effectiveness. The final concept used the visual metaphor of a life preserver to communicate the significance of a flu shot to persons with diabetes. Materials included press kits outlining the connection between diabetes and the flu, pre-printed newspaper stories in English and Spanish; a news release sent over the newswire, television, radio and print PSAs; consumer and health care provider materials (i.e. brochures, provider reminder postcards, patient reminder letters, and posters); and DCP implementation kits containing tips on developing story angles and sample press releases. All campaign materials were placed on CD-ROM for states to use and adapt to their needs. |
|
Step 4.7 Decide on roles and responsibilities of staff and partners. |
|
CDC took on the role of implementing this campaign at the national level by creating audience-tested materials, providing training and technical assistance to DCPs, and conducting the national media campaign overlay. DCPs agreed to localize the campaign by distributing and pitching materials locally to key markets, engaging their partners in the effort, coordinating health systems interventions, and evaluating results of their efforts. Some DCPs modified materials for the specific audiences in their state. |
|
Step 4.8 Produce materials for dissemination. |
|
Materials were created in English and Spanish for four campaign components used at national and local levels:
These materials can be viewed on CDC website http://www.cdc.gov/diabetes/pubs/index.htm and http://www.cdc.gov/diabetes/projects/psas.htm. DCPs received a requested quantity of consumer posters and brochures for distribution. They received a sample quantity of all other materials and a CD-ROM with Quark or PageMaker files of the other materials that they could take to a printer to produce quantities for distribution. English public service advertising materials were distributed and tracked (through Nielsen) by Goodwill Communications, with monthly reports sent to the contractor, Prospect Associates. Spanish materials were distributed and tracked by a Prospect partner agency, Bienestar LCG. To generate news stories in print media about the need for persons with diabetes to receive annual flu shots and pneumococcal vaccines, a special media outreach was conducted:
A national news release about the need for at-risk populations to obtain flu shots was developed and sent out by the Department of Health and Human Services. Health systems interventions were developed and encouraged including the incorporation of annual flu shots for persons with diabetes into health systems delivery. This was done by encouraging the inclusion of vaccination of persons with diabetes in guidelines/standards of care. Some DCPs and their partners created other materials using the campaign information, while adapting it to their needs. |
|
Step 4.9 Finalize and briefly summarize the communication plan. |
|
The audiences selected
for intervention included the persons with diabetes aged 25 - 54, African
Americans and Latino/Hispanic Americans with diabetes, family members
and friends of persons with diabetes, and physicians and health care providers.
Persons ages 25 - 54 were selected because they were at increased risk
of dying with flu and pneumonia and had not been targeted in previous
flu shot communication campaigns. African Americans and Latino/Hispanic
Americans were chosen because they are disproportionately affected by
diabetes and are less likely to receive pneumococcal and annual flu shots.
Family members and friends of persons with diabetes were selected as a
secondary target audience because they are impacted by the disease and
may have the ability to influence persons with diabetes. Physicians and
other health care providers were chosen because they provide and prescribe
health care and often carry credibility with their patients.
Campaign settings included grocery stores and pharmacies, local malls and theatres, churches and other religious organizations, community centers and local YMCAs, and physicians' offices and health departments. Displaying materials, such as question sheets and brochures, and distributing information to all of the campaign settings allowed the key messages to reach the primary and secondary audiences both directly and indirectly. Partners and resources were numerous and varied. Partners were key for DCPs to be able to disseminate the messages and affect pneumococcal and flu vaccination among target audiences. Such partners included:
The CDC was responsible for launching the campaign at the national level, while DCPs agreed to localize the effort. The campaign began with a pilot in September of 1997 and was offered nationally in the fall of 1998, 1999 and 2000. Internal communication was used to discuss the progress of the campaign, elicit feedback, and generate ideas on events that were occurring or those that could be planned to further campaign efforts. External communication was used to update stakeholders on the progress of the campaign and to ensure their needs were being met. New partners were invited to assist in strategy and implementation development, and existing partners and staff indicated what they could contribute and how their participation would benefit the stakeholders and the campaign. The national budget for this campaign totaled $700,000 for the first two years, and was supported primarily by the CDC. DCPs were encouraged to dedicate State funds to the effort as well as solicit "in kind" or donated funds from organizations with similar missions. |
|
Step 4.10 Share and confirm communication plan with appropriate stakeholders. |
|
A preparation check was completed by the planning team to ensure that all materials were ready for dissemination, that everyone involved was aware of their responsibilities, and that the communication plan was reviewed and agreed upon by appropriate stakeholders. This task assured the planning team that the persons involved were committed to the effort and that the stakeholders' needs were being met. |
|
|
|
Step 5.1 Identify and engage stakeholders. |
|
Meetings and conference calls were held to engage the stakeholders involved in this project, including the DDT and NIP, diabetes organizations, community organizations (i.e. local grocery stores, pharmacies, community centers and YMCAs, churches and other religious organizations, physicians' offices and health departments), managed care organizations, other health service providers, DCPs, diabetes educators, and members of the primary and secondary target audiences. It was important that the planning team review the communication plan once more and ensure commitment and support from the individuals mentioned above. Team members solicited feedback on the progress of the campaign planning and asked if it was moving in a direction desirable to the stakeholders. Evaluation was discussed, and additional roles and responsibilities of those involved were confirmed. States were in the process of lining up partners for the campaign, so other organizations had an additional interest in the evaluation efforts. |
|
Step 5.2 Describe the program. |
|
Activities completed throughout this campaign were targeted at both the individual and at the community as a whole. It was important to the planning team members that those who might influence persons with diabetes also be targets of the message. Many settings were selected for the dissemination of campaign materials. Some local grocery stores agreed to display informational posters on their doors. Pharmacies agreed to leave question sheets and brochures on their counters to act as reminders to individuals picking up prescriptions. A small number of malls and area theatres also agreed to display informational posters on their entrance, exit, and restroom doors. Churches, other religious organizations, community centers, and YMCAs held informational lectures to discuss the benefit of obtaining pneumococcal and annual flu shots for persons with diabetes in addition to displaying posters for their attendees to see. Physicians' offices and health departments displayed posters and brochures in their waiting rooms as well. Numerous resources were used for this campaign. Planning team members and other partners contributed their time, expertise and vast knowledge to make the campaign work. The latest technology was used to communicate internally and externally and to disseminate information through the CDC website. Information from varied sources was collected to compile the latest and most accurate data on persons with diabetes, pneumococcal and annual flu shots, the target audiences, and best practices used when trying to reach them. Expected outcomes of the campaign were: Individually
Collectively
Below are the opportunities and challenges used to guide campaign development: Opportunities:
Challenges:
|
|
Step 5.3 Determine what information stakeholders need and when they need it. |
|
The various stakeholders involved in this campaign sometimes needed different types of information. Some simply wanted brief reports on the status of campaign planning, the persons involved, and the success of its progress. Others wanted more detail, and these stakeholders requested reports on the status of the campaign planning, challenges and opportunities that had arisen, the effect of the message on persons with diabetes, task assignments for the campaign, and the success of the campaign's progress. The planning team delivered requested information to the different stakeholders on a monthly basis. Prospect Associates gathered results on the implementation process and on some outcomes of the campaign, while Westat, the evaluation contractor, is in the process of compiling final reports on the national and state/territory efforts in the campaign. |
|
Step 5.4 Write intervention standards that correspond with the different types of evaluation. |
|
The intervention standards used were the communication objectives decided upon earlier in the campaign. The planning team, stakeholders and other partners thought that using these objectives would reveal if the campaign had moved in the desired direction. The objectives were:
The information that the contractor, Prospect Associates, collected revealed how the campaign was going through process evaluation measures. At the end of each year of the campaign, evaluation team members determined whether the objectives were met to assess the outcome/effectiveness measurements. Additionally, a national and individual state reports were to be generated. |
|
Step 5.5 Determine sources and methods that will be used to gather data. |
|
Step 5.6 Develop an evaluation design. |
|
The planning team hired Prospect Associates to complete the process evaluation. This included tracking how many consumers were exposed to campaign materials, how many PSAs ran on television, radio and in print, and how many DCPs participated in the program. Technical assistance efforts by the CDC aided in gathering data for process evaluation. The outcome/effectiveness evaluation was conducted at both local and national levels. Data were collected through surveys and focus group interviews. The process and outcome/effectiveness evaluation occurred at different times, with the process evaluation occurring while the campaign was ongoing and the outcome evaluation occurring once the campaign was over. In the last year of the campaign reported on here, Westat was hired as the evaluation contractor and they took the lead in answering the most recent National and State Report Questions |
|
Step 5.7 Develop a data analysis and reporting plan. |
|
The data analysis and reporting plans were conducted as follows:
Reporting
|
|
Step 5.8 Formalize agreements and develop an internal and external communication plan. |
|
As before, there was an internal and external communication plan, consisting of similar elements - monitored use and cost of time and resources, and documented challenges, opportunities and threats. As the campaign came close to the end each year, the planning team decided to share the results of the campaign at the annual Diabetes Translation Conference. This report, which would include outcomes, best practices, and the successes and failures of the campaign, would be beneficial to those choosing to implement this campaign or similar campaigns in the future. Before deciding to share results, the planning team formalized these plans with stakeholders and partners to ensure that their ideas were represented. |
|
Step 5.9 Develop an evaluation timetable and budget. |
|
The evaluation timetable and budget evolved as follows:
|
|
Step 5.10 Summarize the evaluation implementation plan and share it with staff and stakeholders. |
|
The summarized evaluation plan included process and outcome/effectiveness evaluation questions, data analysis and reporting plans, a brief communication plan, the allocated budget, the participation of the DCPs and timeline for evaluation. This was presented orally and then distributed to the appropriate staff and stakeholders in a document format. Questions, concerns and suggestions were solicited from staff and stakeholders. |
|
|
|
Step 6.1 Integrate communication and evaluation plans. |
|
The communication and evaluation plans were integrated throughout the campaign to ensure that the evaluation measures were tracking the actual campaign activities. Involving the creative contractor's evaluation team (Prospect Associates) in the implementation of the communication plan through teleconferences, material distribution and meetings allowed gathering of data on the program activities, thus assisting evaluation efforts. The status and completed tasks of those involved were shared with the stakeholders and partners. The communication and evaluation team stayed in close contact to ensure that the campaign was on target. |
|
Step 6.2 Execute communication and evaluation plans. |
|
The original communication plan was launched in September 1997. Process evaluation immediately began by tracking the distribution of campaign materials in the media. It was very important to the planning team that the communication campaign produce measurable. Because the campaign simultaneously executed the communication and evaluation plans, the relationship between the two became apparent. Although outcome/effectiveness evaluation would not come until later, activities were planned throughout the duration of the campaign to produce answers and information in support of the objectives stated in Phase 3. Additionally, Health Systems interventions were tracked by individual interviews and work with CDC's program development officers assigned to the DCPs. This was done to determine the 1) extent of participation in the program, 2) increase in partner and health intervention activity, 3) use of materials, 4) helpfulness of technical assistance, 5) success of their effort, and 6) suggestions for improvements. |
|
Step 6.3 Manage the communication and evaluation activities. |
|
At the CDC, the campaign had a technical monitor, with additional activity oversight by members of the DDT Health Communication Section. The creative contractor, Prospect Associates, assisted by managing the creative materials for the program and partner outreach, and assisted in capacity training and results collection. Monthly teleconferences with the DCPs covered different aspects of conducting the campaign and shared information between the states. Meetings held every two weeks by the CDC reviewed campaign activity and allowed discussion about program needs. Budgets and activities were tracked and reported to the CDC on a monthly basis. Management strategies included dealing with unexpected challenges and opportunities that arose throughout the duration of the campaign. For example, planning team members had to respond quickly to the potential flu vaccine delay and/or shortage and determine how to best implement the campaign given this situation. In this case, this included writing press releases and other media materials that emphasized prioritization of high-risk populations in the vaccination efforts, and working with local partners to develop and implement contingency plans. Some communication efforts were delayed to accommodate the new schedule of vaccine availability. |
|
Step 6.4 Document feedback and lessons learned. |
|
The campaign evolved on both a state and national level, so it was important to stay focused on what was successful and ways to increase the impact of the program. Each year the DCP partners were formally and informally provided an opportunity to give campaign related feedback and suggestions for improvement. Certain aspects that proved to be of vital importance for the future included reaching and working with more health professionals, forging new partnerships and programs, identifying more people who need the campaign information and finding methods to sustain the program in the future. It became clear that communication, although extremely important and the dominant intervention in the early phase of the campaign, was not the only intervention necessary for achieving desired behavioral outcomes and sustaining campaign success in the future. Health systems interventions and capacity building were necessary to reach the target audiences and make the campaign successful. This point was documented, and strategic recommendations for future years were proposed. |
|
Step 6.5 Modify program components based on evaluation feedback. |
|
Based on the feedback from stakeholders, partners and staff, strategic recommendations for future years were developed. For example, after the pilot year of the campaign, pneumococcal vaccination was more heavily emphasized and additional materials were developed around this message. Healthcare providers were also targeted more specifically with special materials developed for this audience. The planning team decided that for the campaign to evolve, both nationally and locally, those involved should focus on what previously worked for the campaign and on increasing the impact of the program. In order to do that, the group developed "opportunities" to guide the strategic efforts and plan for additional successful campaigns:
|
|
Step 6.6 Disseminate lessons learned and evaluation findings. |
|
Each year after the campaign was completed, lessons learned and evaluation findings were distributed to stakeholders, partners, participating DCPs, planning team members and other staff. Results were presented at a final meeting and in report format as well. Detailed reports and executive summaries were compiled because some persons wanted to see the campaign in its entirety, but others simply wanted a brief, concise document for review. Although the campaign effort was over for the year, the planning team members took this step very seriously to assist individuals who planned to implement this campaign or similar campaigns in the future. Results were placed on the CDC web page, and were shared at the annual Diabetes Translation Conference (DB-2000_Strategic_Plan). |