Former levelling up minister Neil O'Brien says Britons have become used to crime and disorder despite wanting to live in a "civilised, orderly society".