A Randomized Controlled Trial (RCT) of...
Bottom Line, An Intensive Advising Program to Help Low-Income Students Get Into and Graduate from College
Reviewed
Barr and Castleman (October 2026) posted initial long-term RCT results for Bottom Line. This large, high-quality RCT, which previously found a sizable (8 percentage point) increase in bachelors' degree completion, shows an 8% ($3,661) increase in annual earnings 8-9 years after high school graduation, and no detectable effect on the percent employed. Longer-term study follow-up is ongoing.
Relevant Excerpt from Study Report:
We measure labor market outcomes in 2024 (the most recent data currently available) when members of the study sample were approximately 26 to 27 years old. Students offered advising earned approximately $3,700 more in 2024. This is an 8 percent increase relative to the control group average of about $47,000. Advising also improved students’ economic standing relative to their peers. To measure standing, we rank each student against a nationally representative sample from the same birth cohorts. The average rank of the control group was right at the middle of the national distribution; advising raised a student’s rank by about four points on average, moving students to roughly the 54th percentile in the earnings distribution. The estimated effect on employment is positive but imprecise.
We have no suggested revisions to the study excerpt.
No-Spin’s Study Overview
Large, high-quality RCT of Bottom Line – a program providing intensive advising to low-income students to help them get into and graduate from college – previously found a sizable 8 percentage point increase in bachelor's degree completion and now finds an annual earnings gain of 8% ($3,661) 8-9 years after high school graduation, but no detectable effect on the percent employed. Longer-term follow-up to measure effects at the 10-year mark is ongoing.
Program:
- Bottom Line is “an intensive college advising program that works with low-income and first generation students, beginning in high school and, for many students, continuing through college. Advisors help students identify well-matched, higher-quality colleges, complete applications and financial aid forms, and navigate the transition to college.”
- Students are eligible for the program if they have a high school grade point average of 2.5 or greater and come from families that make less than 200% of the federal poverty guidelines.
- The estimated per-student cost of Bottom Line in 2021 was approximately $4,000.
Study Design:
- The study sample comprised 2,422 eligible high school students in New York City, Boston, and Worcester, MA, who were randomly assigned to participate in Bottom Line (treatment) or receive usual services (control).
- The average household income of these students was approximately $23,000. 70% were female, 64% were Black or Hispanic, and 81% were children whose parents had not attended college.
- Based on our review criteria, this was a well-conducted RCT.
Initial Findings on the Long-Term Outcomes:
- At follow-up 8 or 9 years after high school graduation (depending on the year of program entry), the study found a statistically significant 8% ($3,661) increase in annual earnings. The treatment group earned an average of $50,731 compared to the $47,070 for the control group (p<0.05).
- The study found no detectable effect on the percent employed at the 8-9 year mark. 88.4% of treatment group members were employed versus 85.7% of control group members – a difference that was not statistically significant.
- Importantly, these are initial findings on the study's two primary long-term outcomes. Final results at the study's preregistered primary endpoint - 10 years - will be reported in the future.
- These findings build on previous study results at the five-year mark showing that Bottom Line produced a sizable, statistically significant 8 percentage point increase in bachelor’s degree completion (55% of the treatment group earned a bachelor's degree versus 47% of the control group, p<0.01).
Comment:
- Disclosure: The Coalition for Evidence-Based Policy (author of No-Spin Evidence Review) and Arnold Ventures (funder of No-Spin Evidence Review) both helped fund the Bottom Line RCT.
Click or tap a highlight to see No-Spin’s comment