In nature, almost everything has a predators that would easily be able to kill them. This definitely includes humans as there are many animals that could easily end our lives. This is not the case for polar bears.
They are the apex. There is no need for aggression if there is essentially no competition. Just because they look friendly does not mean you should approach. They will kill you.