Find the smallest positive integer $B$ so that when we express the decimal number $582$ as a base $B$ number, we still get a $2$-digit number.