You will get a lot of variation in the battery voltage between full charge (over 20V) and near flat, around 16.5 - 17v.
The best option is a little buck regulator module, as Dandak suggested.
Get one with an output covering 12V and a current rating of 3A or more (as the listed ratings are usually the short-term just before failure ones, not continuous use).
This is a very common type available from numerous places; they seem to be pretty god, I've not had a problem with one so far:
Adjust the output voltage before connecting the LEDs.