Follow the leader: Herding behavior in heterogeneous populations