I don't think your main points here are true.
> Animals are extremely efficient at converting inedible food to edible nutrition.
Animals are pretty inefficient at converting plants to calories, e.g. see https://learn.uvm.edu/foodsystemsblog/2014/07/10/meat-vs-veg...
Most of the energy spent getting grains to the table is in transport/processing. If you just compare the production, grains are way more efficient than animals.
Even though I'm sure goats are better than cows, they aren't as efficient as plants at producing calories, and in all cases you still have to process and transport them.
However if you've got some data showing otherwise I'm open to being convinced here.
> Until we solve that problem, it's better to stop growing too many plants
I think this is making perfect the enemy of the good. Plants use less water, produce substantially less GHG emissions, and so are still a net major win on environmental terms vs. the status quo.