We propose an extension of the anisotropic interaction model which allows for collision avoidance in pairwise interactions by a rotation of forces (Totzeck (2020) Kinet. Relat. Models 13(6), 1219–1242.) by including the agents’ body size. The influence of the body size on the self-organisation of the agents in channel and crossing scenarios as well as the fundamental diagram is studied. Since the model is stated as a coupled system of ordinary differential equations, we are able to give a rigorous well-posedness analysis. Then we state a parameter calibration problem that involves data from real experiments. We prove the existence of a minimiser and derive the corresponding first-order optimality conditions. With the help of these conditions, we propose a gradient descent algorithm based on mini-batches of the data set. We employ the proposed algorithm to fit the parameter of the collision avoidance and the strength parameters of the interaction forces to given real data from experiments. The results underpin the feasibility of the method.