Unless I am drilling thick metal, I do not use lubricants. They will mess up the plastic if that is the case style, and thin aluminum is done long before the drill bit gets hot.
Safety accessories, Safety glasses (a pain, but good for your remaining good eye) and a vice. A vice holds it steady, which is important, and will not allow the part to spin. If you hold it you could get a major and nasty gash. Drill presses make the drill go in steady and smooth, which was your original complaint. I also like automatic center punches a lot for precision.
For old folks like myself reading glasses or a head visor is also handy. Helps get it into the right place
When drilling go slow, touch the work to mark the part and see where the drill is actually going, then slow and steady, let the drill do the work. If you try to force it it will not cut cleanly, even to the point of tearing out the part material (ouch!).