The outcome, Outcome Metrics, Data Points, and Survey

How to design effective outcomes, outcome metrics, data points, and survey

 

Outcomes are the mid-term changes or impacts that result from a program's activities and outputs. Outcome metrics are quantifiable measures used to assess the success of these outcomes. Data points are information that feeds the metrics, allowing you to track progress. In this guide, we will explore the importance of defining outcomes, outcome metrics, and data points, using the example of a program called "Girls Code," which aims to empower young girls and reduce their risk of human trafficking.

Defining Outcomes: Outcomes reflect the broader impact of your program and help you understand whether the problem you are addressing will be solved or mitigated.

Example of Outcome for Girls Code: Outcome: "Improving the quality of life of these young girls who otherwise would have been victims of human trafficking."

Why Outcomes Matter: Outcomes are vital because they capture the meaningful changes experienced by beneficiaries or participants due to the program. Measuring outcomes allows you to assess the effectiveness and impact of your program.

Defining Outcome Metrics: Outcome metrics are the quantifiable measures used to evaluate the success of outcomes. These metrics should be Specific, Measurable, Achievable, Relevant, and Time-bound (SMART).

Example of Outcome Metric for Girls Code (Outcome Metric 1): Outcome Metric: "% of girls who were saved from trafficking and that went on to take a job in the tech industry."

Example of Outcome Metric for Girls Code (Outcome Metric 2): Outcome Metric: "% of girls that earn more than the median salary for the position based on the location."

Defining Data Points for Outcome Metrics:

Data points are specific information that provides the necessary data to calculate outcome metrics. They are often collected from various sources, such as surveys, databases, and external records.

The examples provided below are tailored for users who are proficient in SQL. If you're unfamiliar with SQL, you can still document the data sources without SQL queries.

Data Point for Outcome Metric 1:

  • Data Point 1: "Number of girls that took a job in the tech industry after course completion."
    • Data Source: "Post-Program Survey data."
    • Data Table: "Survey Responses Table"
    • Data Fields: "user_id, got_job (Yes/No), job_industry"
    • Calculation: "COUNT of unique user_id where got_job = 'Yes' and job_industry = 'Tech'."
  • Data Point 2: "Total girls rescued from the border areas ready to be trafficked."
    • Data Source: "Registration system."
    • Data Table: "Excel sheet - Registration system"
    • Data Fields: "user_id, rescued_date, rescued_location"
    • Calculation: "COUNT of unique user_id where rescued_location = 'Border areas'."

Data Point for Outcome Metric 2:

  • Data Point 3: "The median salary for that location and that position."
    • Data Source: "Job market data"
    • Data Table: "Salary Survey Table"
    • Data Fields: "job_title, location, median_salary"
    • Calculation: "SELECT median_salary WHERE job_title = 'Software Developer' AND location = 'XYZ location'."
  • Data Point 4: "Number of girls that have a salary greater than the median income for that position and that location."
    • Data Source: "Post-Program Survey data"
    • Data Table: "Survey Responses Table"
    • Data Fields: "user_id, annual_compensation, job_title, location"
    • Calculation: "COUNT of unique user_id where annual_compensation > (median_salary from Data Point 3) AND job_title = 'Software Developer' AND location = 'XYZ location'."

Survey Questions for Data Points: Surveys are often used to collect data for outcome metrics. Here are relevant survey questions for the data points above:

  • Did you get a job after completing the course? (Yes/No)
    • If yes, what industry did you get a job in? (Dropdown options: Tech, Healthcare, Education, etc.)
  • What is your annual compensation?

Summary: Measuring outcomes is fundamental to understanding the impact of your program. By defining clear outcomes, outcome metrics, and associated data points, you can effectively track and measure the mid-term changes experienced by your program's beneficiaries. These insights enable you to evaluate the effectiveness of your program, make informed decisions, and communicate the impact of your work to stakeholders.