Pretty new bit doesn't quantify the quality of the bit in the first place. I had zero luck getting good holes with even the most expensive Lowes/HD bits from Dewalt, Irwin, whomever.
Look at the cutting face of the bit and see if the cutting edge is jagged. Most premium drill bits aren't intended for hand drilling anyway, and one cut on tool steel or titanium can ruin them, especially used in a hand drill.
As Nathan mentioned, split point bits are highly recommended for titanium, and I start my holes by center punching my mark and using combined drill and countersink. I've drilled a *TON* of 0.063 6al4v in the past few months. I highly recommend Drillco Nitro bits.
Cutting ti without coolant not only destroys bits, but can build up Alpha Case (which makes it harder to drill) and embrittle the Ti as it absorbs oxygen at elevated temperatures.
Here's a secret trick; Try drilling it submerged in water. Rigging a secure clamping method is the hard part, but especially since you're hand drilling, it could be a cheap and super effective way to keep the workpiece and your tooling cool. Just don't shock yourself.
