The things that are critical are the voltage, and whether the centre of the connector is positive or negative.
It's fine if the PSU has a somewhat higher current rating; the device will only take the current it needs, regardless.
Both the item in your photo and the amazon PSU are 9V with positive centre connection, so it should be fine.
You do have to be really careful with guitar pedals and their power supplies, as traditionally they use connectors with negative inner (and positive outer).
Swapping one of those with another device that uses the near-universal positive centre wiring can cause serious problems or damage...