We also had to provide food for these animals.  Hay for the calves as well as grain.

Start small - chickens are a good way to start out with livestock and I find that I'm usually low on eggs, as fresh eggs are a good seller.  If you are in a good location, you can set up an honor-system type roadside stand to sell extra veggies from your husband's garden.  With that stand, put out flyers to describe other produce you have available (the goat meat, eggs, certain veggies/fruits that are too delicate to be out on the stand all day) or things that are short season, such as strawberries or raspberries.  You can say that you will have canning quantities of tomatoes available, for instance, but that the customers have to pre-order them, then they have to pick them up on the weekend, for example.

Don't expect to make a lot of money right off the bat, and don't go whole-hog on anything until you know you have a market.  Yes, I have a high demand for my eggs, but vastly increasing the size of my flock would be a mistake, as it would require more space, more feed, and more work.  It takes time to figure out the balance that works for you.

You may have to set aside a bit of money each month to gradually work up to what you are planning to do.  If you need to put up fencing, decide first what kind of animals you are going to put behind the fence.  Then, buy a roll of fencing one month, a few fence posts the next.  Buy the support timbers for your lean-to (if that is the shelter you need for your animals), then the next month buy the metal sheeting to cover it.

Farming of any sort is definitely a delayed-gratification situation!

Karen

If it is the cost of animals that are prohibitive then:

Barter.  You have said that you have butchered and sold some in the past.  I am sure that you could find a local owner who may be willing to part with this many of this animal for a kid or such.  You may be able to do this through your local Co-op or 4H or something similar. (like next door neighbors)

Chickens are on the cheaper side of things as initial purchases go.  You may lose a few but even if you mess up terribly the investment on the animals was minimal.  -- Also, you can create a small chicken coup/tractor for cheap and IF you can use stuff from a local dump (depends on your area) you can do it for next to nothing.

If you are worried about feed costs to animal ratio then:

Pigs eat alot but aren't too bad because they are decently low initial cost and the upside to them is they eat a wide variety of items.  Which can help on food bills especially if you have a large vegetable garden (as you said).  I'm not sure if it is a good idea (might want to ask someone to confirm) but tons of extra's can be given to them.  (Also, if you have extra dairy I believe it is safe to give to them as well)

Your two biggest hurdles are going to be Fencing and Tools.  Chickens require much less in the Fencing category (Make a Tractor or two) but with any other animal your going to need some.  Each animal requires different things in fencing and I am sure there are posts that cover just that so I won't any further.

Tools.  Can't live without them.  They can be really costly.  Again, there are some great posts on here specifically about them.

Just a general note that has helped me for everything:

I have a local Habitat Re-store which you may have.  They are a nonprofit (I think) that people donate extra building supplies to (and other things) and they sell things for a fraction of the general cost.  They are AMAZING for cheap building materials.

I hope any of this helps and I am sorry I cannot provide more info.