(CNN) — An American citizen says he and his wife were detained for hours by US border agents when they returned to the United States after a short trip to Canada.