The U.S. national debt exceeded $34 trillion this week for the first time ever, setting off alarm bells over unprecedented levels of government spending.