No-Spin’s Study Overview

Large, high-quality RCT of Bottom Line – a program providing intensive advising to low-income students to help them get into and graduate from college – previously found a sizable 8 percentage point increase in bachelor's degree completion and now finds an annual earnings gain of 8% ($3,661) 8-9 years after high school graduation, but no detectable effect on the percent employed. Longer-term follow-up to measure effects at the 10-year mark is ongoing. 

Program:

  • Bottom Line is “an intensive college advising program that works with low-income and first generation students, beginning in high school and, for many students, continuing through college. Advisors help students identify well-matched, higher-quality colleges, complete applications and financial aid forms, and navigate the transition to college.”
  • Students are eligible for the program if they have a high school grade point average of 2.5 or greater and come from families that make less than 200% of the federal poverty guidelines.
  • The estimated per-student cost of Bottom Line in 2021 was approximately $4,000.

Study Design:

  • The study sample comprised 2,422 eligible high school students in New York City, Boston, and Worcester, MA, who were randomly assigned to participate in Bottom Line (treatment) or receive usual services (control).
  • The average household income of these students was approximately $23,000. 70% were female, 64% were Black or Hispanic, and 81% were children whose parents had not attended college.
  • Based on our review criteria, this was a well-conducted RCT.

Initial Findings on the Long-Term Outcomes:

  • At follow-up 8 or 9 years after high school graduation (depending on the year of program entry), the study found a statistically significant 8% ($3,661) increase in annual earnings. The treatment group earned an average of $50,731 compared to the $47,070 for the control group (p<0.05).
  • The study found no detectable effect on the percent employed at the 8-9 year mark. 88.4% of treatment group members were employed versus 85.7% of control group members – a difference that was not statistically significant.
  • Importantly, these are initial findings on the study's two primary long-term outcomes. Final results at the study's preregistered primary endpoint - 10 years - will be reported in the future.
  • These findings build on previous study results at the five-year mark showing that Bottom Line produced a sizable, statistically significant 8 percentage point increase in bachelor’s degree completion (55% of the treatment group earned a bachelor's degree versus 47% of the control group, p<0.01).

Comment:

  • Disclosure: The Coalition for Evidence-Based Policy (author of No-Spin Evidence Review) and Arnold Ventures (funder of No-Spin Evidence Review) both helped fund the Bottom Line RCT.

Click or tap a highlight to see No-Spin’s comment