I wish it were that easy to just be in the best spiritual company. I have a feeling that will happen much more after the transition from the present physical earth.
I have seen people talk about keeping spiritual company who remove themselves from it. I am reminded of the story that Amma told of the porcupines that experienced a particularly cold winter. They did not care to experience the quills of each other but they recognized that if they did not huddle together to keep warm they would be vanquished by the cold winter. So it is with us; we are sensitive to the ego barbs of our spiritual friends. Yet if we become hermits or return to our old life we will also become stagnate spiritually speaking. We have the choice and we make the choices in the company we choose. We cannot expect our spiritual friends to be perfect when we ourselves have so many imperfections.