About That Bastard, Madoff

Roger Ehrenberg explains the concept of fraudulent conveyance:

Say you were an investor in Madoff's funds. A few years back you decided to diversify. You asked Madoff for your money back and you got it. You then invested the proceeds in an array of other assets. Madoff then goes bust in a massive fraud. One day you get a letter from a bankruptcy trustee. The letter says that you need to repay a large chunk of your original investment in order to satisfy the claims of other investors who were less fortunate (or smart) than you. Is this fair? Is this right?