Early on in my recovery I felt like this. I felt like I was waiting for the hammer to drop, waiting for people to move on, waiting for people to discard me. it felt to me like friends and family got to a place where what I was struggling to over come was to much for them to be associated with, like somehow I was going to infect them.
If I tried to explain that to folks, they would say I was just being negativity. My response was “I may be crazy, but I am not stupid”.