Part of the reason I have mentioned the annex is that as a male Buddy is going to face a number of challenges when he is introduced to the local environment. If there are any female relative in the area they will likely drive him away to prevent inbreeding. Any dominant local males will do the same. It is the dominant, elder males that get first dibs on the females in heat.
So, if Buddy gets free at this time and cannot be coaxed to come back home, he will face very tough odds. He will have to find a new place to live and there will likely be very few leaves on the trees, thus he will be unable to make a drey. Also, he won't have put aside a winter/spring stock pile of food.
You may well already know these things, but as I have said before I would rather not assume.