If $a \clubsuit b = a^2 - 2ab + b^2$ and $2 \clubsuit x = 81$, find the sum of all possible values of x.
