Just another point of view...
You don't sound happy - you are isolated where you live from your friends and family, you stay at home with a young child by yourself and are feeling neglected by your husband, who you say is your "only friend".
However, looking at it from his point of view isn't so wonderful either - he works all day and comes home to a lonely, depressed wife that is crying and uses him as her only social and emotional outlet. She's not as independent as she used to be and relies on him to do basic things with her like shopping, and gets upset with him or feels neglected when he wants to do some things on his own like play computer games, which is his own outlet.
Right now neither of you is happy, and it's relatively easy to see why. Now, you have a number of options for fixing things, and I personally think that it comes down to 3 things:
1. Be happy where you are
Actively become a part of this small community. Make some new friends, take a class, join a mother's group, even if it is in the next town over. Get some things going in your own life that are independent from your husband. Stop depending on him for your only source of companionship, get yourself out there and see what comes of it. You'll be much happier and independent, trickling down to make your husband much happier when his home isn't a scene of depression and loneliness. Give him his space and his own time to decompress and plan some cool local stuff to do together on the weekends or a couple of evenings. Rent a movie, go biking, farmer's market, plan to cook something new together - try to make your time together interesting and less constant. When is the last time he had the house to himself for a couple of hours? It sounds like he could just use a bit of space now and then, and you may find that your mood will greatly affect his.
2. Can't be happy where you are?
Move. Either move back or move on to somewhere else. I get that being burgled terrified you. It happened to me as well, and I was in the house at the time. Moving out to the country was kind of extreme, but we're different. Move back and get a dog. Move to where you are going to be happy. Is living in bumfeck nowhere just to avoid being burgled worth you two being so miserable?
3. Marriage Counseling
A lot of people will tell you to jump straight into this, but I think that you should take an honest look at 1 and 2 before this step.
As for your husband's friend? Drop it, forget about it and avoid him. Your feelings for him are borne out of your frustration with your husband and your boredom with your life, nothing more. No good will come from this.