North Korea threatens to call off summit