Market commentator Marc Faber faced a growing backlash Tuesday for his racially charged comments.