Not sure where you're located so don't know your specific laws/rules/etc. But perhaps you can use the milk/cheeses you make to generate a little income to help defray the cost of keeping the goats. Especially if there's a nearby farmers market. I don't have my goats yet (coming soon!) but I used to sell my excess chicken eggs to friends/neighbors and at work to folks who wanted good, all natural, humanely raised and naturally fed chicken eggs. I'm sure most if not all of them would have been more than happy to buy cheeses as well. There may also be a market for all natural soaps and lotions you can make from goats milk. There are quite a few options really... Just some thoughts. Oh, and since the does will need to have kids in order to produce milk, you'll need to consider what you'll do with the babies... if selling them, you need to know the market in your area as to whether it would be better to start out with a registered herd vice a herd on non-papered animals.