Numerous people have complained of being forced from their homes or priced out of the housing market as a result of large events such as the World Cup and the Olympic Games, a U.N. human rights investigator said Monday.