I always thought it meant something like "knowledge of the few"; like "the esoteric philosophers pontificated the meaning of life". (http://dictionary.reference.com/search?q=esoteric)
I'm using it sarcastically in the previous comment, like "who does hunkpapap think he is to give everyone else a grammar lesson? He's not an english teacher."
Oh, haha.