Realm keeps saying that I am not white-listed

Sometimes, when I try to get into a realm, it says that I am not white-listed on that server. I then try to contact the owner of that realm, he says that there is nothing wrong.