A well-known trilemma faces the interpretation of Kant’s theory of affection, namely whether the objects that affect us are empirical, noumenal or both. I argue that, according to Kant, the things that affect us and cause representations in us are not empirical objects. I articulate what I call the Causal Power Argument, according to which empirical objects cannot affect us because they do not have the right kind of power to cause representations. All the causal powers that empirical objects have are moving powers, and such powers can only have spatial effects. According to Kant, however, the representations that arise in us as a result of the affection of our sensibility are non-spatial. I show that this argument is put forward by Kant in a number of passages, and figures as a decisive reason for rejecting empirical affection and instead endorsing affection by the things in themselves.