Biden himself keeps bringing up his work with segregationists from decades ago, against his aides' advice. If he puts it out there, hard to complain when someone checks his characterization against the historical record. Especially since he already has a record of bullshitting about his past involvement with civil rights.
More generally, he can't be the strongest campaigner and best shot to beat Trump while also needing the kid gloves treatment.