There are different ways of doing this. One way might be a zener diode rated for just above your operating voltage. Perhaps 1.8 to 2.4 volts? Depends on the tolerance of your load. The zener would be reverse biased to ground from your converter positive output. If the zener voltage is reached the zener will avalanche and recover when the overvoltage goes away. This is better for transient spikes.
Other options exist with fast switching diodes. In this case your diode may become a sacrificial lamb so to speak and destroy itself. And in this case you probably need a fuse. When the reverse breakdown voltage is exceeded the diode will momentarily short, drawing supply power to ground. The diode will overheat and open up, and the overvoltage condition will re-establish. This is why you need a fuse. Don't put it in series with the zener, because when the fuse blows it will be, in effect, the same as the diode blowing, so you'll have two blown components and no protection. The overvoltage will find its way back to the load.
Put the fuse in series with the POWER LEAD, BEFORE the diode. This way, when the diode is shorted it will overcurrent the fuse and blow it, opening the circuit so that power no longer can be drawn by the load. Of coarse the diode will likely be shot too. So, both of these components will have to be replaced. Like I said, this is a sacrificial lamb method but it does protect your load, and hopefully it will protect your power supply too, but then again the power supply is probably already faulty when this circuit becomes needed.