Five workers have been hired to complete a job. If one additional worker is hired, they could complete the job $4$ days earlier. If the job needs to be completed $20$ days earlier, how many additional workers should be hired?