Leave your brakes on so you don't die when the bike falls apart. You won't lose any fixie cred because you don't have any to start off with by riding a bike from Target. That is insane that they can sell bikes for that cheap.
I honestly don't even feel like I need the rear brake anymore and I've only been riding it for a few days since I got it. I'll keep it until I get more comfortable with big downhills though. The brakes are garbage anyway, they really don't even fit the bike. After having it adjusted at the LBS the pads don't even touch the rim 100%
They were on clearance, MSRP was like $120 or so. Still feels really solid for the price, however, I can see it lasting a good year easily stock.