Yes,the bearing adapter needs to come out I can see one spot where you peened the edge over so you'll need to tap it back in & smooth it down & while your at it run some emery paper all the way around it to clean it up & maybe even take off alittle metal,then oil it & it should slip right out,if not tap it back in & sand some more until it does.