I have been stalked on a few occasions, with one actually scaring me so badly I feared for my life....literally.
Anyways, do NOT call her back. She WILL get the impression that you care....even if you do, just a little, she'll think you like her times 50. Not even kidding. To break up a friendship over a guy that you weren't even remotely close to dating is....well, VERY odd to say the least. It sends ALL KINDS of red flags. I'd just shy away. And if she does move to your area, do your best to not hang out in her group, unless it's completely unavoidable. She'll hopefully get the picture.
Or you could start by changing your number if it gets bad....it's temporary sometimes (because if you know people she knows, she could still find out your number), but at least it might get her out of the way for a while. :)