Harry identifies two reasons this should worry us:
I think it is more worthy of attention than Laura says, for two reasons. First, these schools are typically lavished with public money, relative to other schools which could make much better use of that money. States should be shifting money from such schools to schools with high-need students, and using at least part of that money to fund reform and improvement efforts. Second, these schools typically have some, and sometimes have a good number, of students from low-income families; and these students are typically seen just as problems, and are in the lousy situation of being in a school where their achievement doesn't matter much. KTM points to this excellent paper by Paul Attewell arguing that in affluent "star" schools attention is lavished on those most likely to attend Ivy League colleges, at the expense of all lower-achieving students. (Attewell's paper was written prior to implementation of NCLB, and it would be interesting to see whether the dynamics he identifies have changed at all).
I'd add a third reason: those schools are often the model for schools in poor districts. The affluent assume that what works in their school district, for their children, must be what works, and vote, and donate, accordingly.
This article available online at:
http://www.theatlantic.com/business/archive/2009/06/the-rich-really-are-different/18719/