That should be fine; just be sure the battery cannot be shorted, and cannot be crushed.
It's connected to a proper charge circuit, so cannot be overcharged.
Note that the charge facility on the feather is only rated 100mA - so 25 hours or more to charge from flat for a 2.5AH cell.
An 18650 or similar standard cell with a holder and separate charger, so you can swap charged cells in, may be more practical.
There are two common problems with lithium cells, and both relate to misuse in different ways.
The first is mainly related to packs that use multiple cells in series, in things that do not monitor or control every cell separately.
If one cell has a slightly different capacity to another, eventually one can be overcharged while the rest are still not full, and that one cell can burst.
(Or DIY charge circuits that have no proper voltage control).
Any overcharge can cause cells to rupture, so using a properly designed charge circuit is essential.
Properly designed packs (or pack chargers) have "balance" charge that monitors and controls the voltage on each cell.
And, simple physical damage. LiPo cells with soft cases can be damaged by being dropped or crushed, as the internal insulation can be damaged.
That can cause an internal short and massive heat build up.
Cased cells such as 18650s from major manufacturers are somewhat more resilient, but still sensitive to overcharging.