To attach the neck I needed to drill parallel to the body, NOT perpendicular to the top surface of the neck. To do this I clamped the neck to this jig, doing t this way allowed me to line up the brad point bit right in the center of the maple strip of my neck.
The bit tracked straight! I was a bit worried about this since I was just using the spring clamps.
I also wrapped the neck with a bit of rubber carpet backing to both protect it and help keep it from shifting.
Here it is all bolted on (temporarily).