Dunedin police are warning residents not to approach a man they've spent most of the day looking for.