I did not read all the specs on the datasheet obviously. It's an LDO regulator, I expected it to handle more than 1 volt over the voltage it's supposed to regulate otherwise it's not all that useful, and it's not. It looks like it would be more useful in it's lower voltage parts, but regulating 6v down to 5v doesn't help me.
I only gave it 5.2 volts on the actual circuit, but it was exhibiting other strange behavior which is why I took it off to test it individually. On the breadboard I connected it straight to a walwart, which gave me something like 13v-14v. On the circuit, I expect it to handle voltages up to 12 volts, though, so I'll switch parts.
It's not a big deal. I bought 3 of them, thats $1.50 down the drain. I'll move to the LD1117.