Back-Handed Compliment?

The following was said to me recently after I finished leading our Brigade service:

I’m just not sure about you being called to your home Church.  I think you should be seeking somewhere with a much larger Youth Ministry. You’re good; too good for us. – {withheld}

Interesting theology wrapped up in that I think.