x2 on the above--I don't mean to sound harsh and hope it doesn't read that way. Just would hate for you to have this take a bad turn.
I am wondering if he is actually older than 2-3 weeks. My bottle kids don't really eat hay or grain until much older. My dam raised kids will start to nibble a tiny bite here and there because they see mom do it.
At 2-3 weeks old, I would say that he should be getting between 12 minimum oz of milk per day, probably more like 18-24 oz. My bottle feeding schedule is a bit different from what was offered before. Here is a excerpt from notes I give out with all new purchases:
For the first few weeks, we give them a 4-8 ounce bottle 3 times per day, spacing out the feedings as best as we can (usually before leaving for work at 6, when we get home at 3, and then before bed at 8). We gradually increase the amount to match what the kid will drink, but never offer more than 12 ounces per feeding (too much milk can cause diarrhea as can making any diet changes too quickly). **Miniature breeds drink less than standard sizes**
We begin to offer hay and goat feed at one week, encouraging them to try it. By three weeks we like to see them start nibbling at it on their own. Bottle raised kids usually take longer to eat solids than dam raised kids so offer it in small quantities but don't fret if they don't do much with it right away.
At week 7, we assess the kid's weight, size, and how well they seem to be eating hay/feed and drinking water. If they eat and drink well and have tripled their birth weight, we begin weaning by cutting back to 2 feedings a day and increasing their hay and feed a little to compensate.
At week 8, if cutting back to 2 bottles went well and the kids are eating the increased amount of hay and feed, we cut back to one bottle per day for the week and then quit bottles at the end of the week. They may cry and put up a fuss and yell for you to bring them a bottle, but if you are sure they are ready for weaning, do not give in.