It means the 'voltage across it', voltage at the high end, minus the voltage at the low end - or stick your meter directly across the resistor and measure the voltage across it.
You were 'probably' correct wih "the amount that it reduces", but it's not a very accurate term.