They said, dress the way, you want to be addressed
I also believe that physical appearance should be taken into consideration when going for a job interview as it can give one a lot of advantages in the presence of the interviewer.
Imagine not dressing appropriately, it can affect one's confidence in front of an interviewer whose eyes are scanning you from head to toe.