on the horns of a dilemma

From horn (“alternative in an argument”), from Latin argūmentum cornūtum (“argument with alternatives”, literally “horned argument”), a reference to an alternative that one can metaphorically get caught on or injured by.