1 acre is about 4,050 m^2, and incident sunlight has an average intensity of 1kW/m^2.
So your avocado orchard is converting incident sunlight to food calories with an efficiency of about 0.025%.
(This ... isn't wildly inefficient for photosynthesis, though typical values range from 1--3% AFAIU, though I've not computed this on a per-acre / per-hectare basis.)
Mind too that you're getting more than just avocado meat, there are also the skins and pits as you note, as well as leaves and wood, all of which could be used as fuel should we really want to.
Ecologists look at the net total energy conversion of ecosystems, often expressed not in terms of energy but as carbon fixation --- how much CO2 is captured from the atmosphere and converted to biomass.
And that amount is ... surprisingly limited. We'll often hear that humans use only a small fraction of the sunlight incident on the Earth's surface, but once you start accounting for various factors, that becomes far less comforting than it's usually intended. Three-quarters of Earth's surface is oceans (generally unsuitable for farming), plants and the biosphere require a certain amount of that activity, etc., etc. It turns out that humans already account for about 40% of net primary productivity (plant metabolism) of the biosphere. Increasing our utilisation of that is ... not likely, likely greatly disruptive, and/or both.
Another interesting statistic: In 1900, just as the Model T Ford was being introduced, and local transport (that is, exclusive of inter-city rail and aquatic transport) was principally dependent on human feet or horse's hooves, twenty percent of the US grain crop went to animal feed. (And much of that ended up on city streets.) We had a biofuel-based economy, and it consumed much of our food supply.
(Stats are for the US but would be typical of other countries of the time.)
This isn't an argument that fossil fuels are "good", or that renewables are "bad". It does point out, however, that changing our present system is hard, and any solution will cause pain and involve compromises.