Social Media Evaluation Toolkit

Surveys for clients can be administered in clinic/agency settings to determine if the campaign influenced clients to seek care at the agency/clinic. The sample survey can be adopted to evaluate the reach and response to social and traditional media campaigns.

Download Media Campaign Client Survey

Through our work with EHE jurisdictions on monitoring and evaluation of social media/media (SMM) campaigns, TAP-in developed some initial guidance and tools that can serve as a starting point for EHE-funded jurisdictions in planning for and implementing how they are going to track and measure success, impact, and opportunities to improve their EHE SMM campaigns.

Download Media Monitoring Tool (xlsx)

• Each campaign should have a web page, phone number, email, and/or text address to refer people to for more information or to schedule appointments. These endpoints should feature information that is presented in a client-centered approach and very clear about how to access services.
  • Traffic to these sources can be tracked to monitor reach and impact, such as the number of web page visits and unique IP address visits, number of phone calls, emails, and/or text messages.
• With a short timeline, consider process monitoring:
  • Process monitoring involves metrics on inputs (e.g., number of ads placed or aired, duration billboard placements) and outputs (e.g., number of web page visits, phone calls, emails, text messages), but not impacts (e.g., number of clients entering or returning to care).
  • Send a template to each communications vendor to use in their final report
  • Ask for images of all campaign assets
• With more lead time, consider expanded impact evaluation, including:
  • Clinic client survey questions related to recall of the campaign(s)
    • Questions on clients’ perceived impact of campaign(s)
    • See example client survey questions. The impact indicators from this could include:
      • Number of new clients citing campaign as a factor (or who recognized campaign)
      • Number of clients re-engaging with campaign cited as a factor (or who recognized campaign)
      • Viral load suppression rate of new or re-engaging clients who cited campaign as a factor
  • Compare clinic-level data on number of patients and appointments pre- and post- campaign, and in comparison to similar time periods in prior years. There is a lot of potential confounding in this approach, especially due to COVID-19, but it is another metric that may be informative.
• Together, all of these approaches can be used to “triangulate” inferences on the potential impact of the campaign(s) individually and as a whole.

Analyzing Metrics

Definitions

• Campaign: Name or theme.
• Dates: Dates the ads ran.
• Engagements: Includes reactions, shares, and comments.
• Goal(s): Awareness, Behavior (call, click, text), Outcomes (get tested, engage in care, reach viral load suppression).
• Impressions: Number of times the post/ad was displayed. For website, use page views. For billboards radio, etc. use the number of boards/ads.
• Intended audience: Demographic information about audience.
• Platform: Social, digital, or conventional media space for campaign activity.
• Reach: Number of people who saw the post/ad. For website, use unique users. For billboards, radio, etc. use available estimates.
• Referrals/Clicks: Number of people who clicked for more info, etc. For billboards, radio, etc. use “for more info” call, text, website metrics.
• Spend: Amount of budget to place ads/boost posts on this platform.

These campaign examples showcase different media campaigns.

• DC has reached the next phase in our plan to end the HIV epidemic
  • DC Ends HIV aims to provide prevention and treatment services that are safe for people to access, supported by current science and data, and responsive to the well-being and needs of communities and individuals
• East Bay Getting to Zero
  • East Bay Getting to Zero brings people together to collaborate on creative ways to implement the East Bay HIV strategic plan, supporting community members to have more equitable access to HIV testing, prevention and treatment services.
  • East Bay Getting to Zero offers:
    • Free events, workshops and working groups open to the public
    • Systems improvement facilitation
    • Training and coaching
• Beat HIV Tarrant County 
  • Beat HIV is part of a bold approach to eliminating HIV in Tarrant County by focusing on prevention, testing and treatment.
• Love Leads Here
  • Love Leads Here is a multi-faceted effort led by the Cuyahoga County Board of Health to reach people at risk and people living with HIV with lifesaving information and resources. These awareness campaigns cover HIV testing, prevention, treatment and stigma.
• Greater Than AIDS
  • A leading public information response from KFF to the U.S. HIV epidemic. Designed to inform and inspire action, these cross-platform campaigns are distinct and yet connected under the unified Greater Than HIV brand.
• HIV Stops With Me
  • This campaign is a good example of highlighting peers/profiles of People with HIV acting as campaign ambassadors.

• TAP-in Webinar – Use of Social Media and Mobile Technology as Essential Tools for EHE
  This TAP-in webinar highlights the products and best practices from HRSA’s Social Media/Mobile Technology Initiative that focused on young people with HIV who were not virally suppressed. It provides an in-depth look at 3 of the 10 funded projects and shares knowledge of both the challenges of and successful approaches to using social media.

• Ryan White HIV/AIDS Program SPNS Initiative: Use of Social Media to Improve Engagement,Retention, and Health Outcomes along the HIV Care Continuum, 2015-2019

  •  SPNS Social Media Initiative Demonstration Site Resources | TargetHIV

  • The Special Projects of National Significance (SPNS) Program initiative “Use of Social Media to Improve Engagement, Retention, and Health Outcomes along the HIV Care Continuum” implemented and evaluated innovative social media methods to identify, link, and retain HIV positive, underserved, underinsured, hard-to-reach youth and young adults (aged 13-34) in HIV primary care and supportive services. More information about the funded projects and related publications can be found using the above links.

• Rigorously Using Evaluation Strategies to Improve Reach and Focus of New Media Outreach

  • This presentation from the NYC Department of Health and Mental Hygiene highlights approaches to evaluating media campaigns that utilize a range of social media and dating apps.

Examples below are from the Atlanta>AIDS Campaign.

Download Social Media Reach in Atlanta > AIDS Campaign