Maybe some threaded inserts would be the trick here. They require a bigger hole anyway and might just be big enough to cover the original holes. I'd dowel, then drill for the inserts if the new hole didn't remove most of the original one.
I wonder how well a wood screw would work when half it's diameter is in dowel instead of virgin wood??........Bill