The distinction between brute luck and option luck is fundamental for luck egalitarianism. Many luck egalitarians write as if it could be used to specify which outcomes people should be held responsible for. In this paper, I argue that the distinction can’t be used this way. In fact, luck egalitarians tend to rely instead on rough intuitive judgements about individual responsibility. This makes their view vulnerable to what’s known as the neutrality objection. I show that attempts to avoid this objection are unsuccessful. I conclude that until it provides a better account of attributing responsibility, luck egalitarianism remains incomplete.