A school offers both Spanish and Chinese language classes. This past week, $10$ students dropped from the Chinese classes, which increased the number of students who take neither class from $27$ to $31$. How did this change impact the number of students who take the Spanish class but not the Chinese class?