Yeah, that's pretty much my objection to it. You have just as much color as I do (being "of color" myself). :) You just happen to be pinky-beige and I'm more yellow-brown.
No, of course it's not incumbent upon the discriminated to do all the work. Heck, if it were, it'd be a whole other sort of discrimination, I figure. And I really do think it's an interesting idea. I guess I'd suggest more of the asking of non-white folk if they'd be interested and/or willing to participate, from either the mentor or mentee side.
I know there's talk, at least there has been in the romance genre, about the ghettoization of black romance/black authors. Pushing for more recognition/acceptance/etc tends to lead to different marketing strategies, creating of race/culture specific lines that aren't always apprecited. As spec fiction is a whole different game, and at least theoretically more accepting of "the other", I don't know if the same thing does or would happen there.
And I only know about black vs. non-black. There has not been so much talk that I've seen thus far re: Latino/a or Asian or any other group because the writer population representations there are even *smaller*, to the best of my knowledge.
I know I have to consciously work on the diversity in my own writing, and have done, though I have farther to go. It's very easy to fall into the trap of writing only in colors that have come before, so to speak.