"starting an organic is not cheap"
You mean garden, right? Not farm?
A garden is very much a kind of "do only as much as you feel like doing" kind of thing.
I have a mini garden, which I suppose is more or less organic by default, because I don't fertilize (or buy soil for that matter), with chemicals or otherwise. I had a big compost bin already -- it was there when we moved in -- so I dumped a bunch of the soil from the bottom of that into some planters, plugged in seedlings for tomatoes and peppers from the supermarket plus a few basil plants, and just watered those now & again. At one point I put in stakes and tied the plants to them to protect them from getting blown over, but otherwise that was all the work (beyond harvesting the veggies when they were ready).
We also have fruit trees and berry bushes, which are even better -- it doesn't work out every season (sometimes there's a late frost that kills the cherries, etc.) but every year we get at least something -- sometimes an overwhelming amount of either cherries, apples, figs, kiwis, raspberries, red currants, and some other kind of berry who's name I can never remember but is sort of like a big raspberry. It's important to pick trees/bushes that are relatively "native" to your area so they won't require much care (our fig is a bit too far north for its liking, unfortunately, so the fruit isn't often ripe in time), but otherwise it's easy going.
Final note: ideally find a neighbor or two who already has a garden going. You can research how to grow anything online, but there's such a glut of information -- often focused on people with more spare time than you may have, and often based on a different region than yours -- that it's much easier if you have someone local you can ask for advice.