I've been fooling around with a girl that my best friends brother is infatuated with...?

No you weren't wrong, he is obsessed and that is not health. Someone needs to set him straight .....maybe you should tell him what you said here; how she never was his girl and so on. And go for it with this girl, don't worry about him. Just be careful that he doesn't go crazy and try to hurt you or her.