Our city doesn't offer compost pick-up, like some places. Heck, most of our neighbors don't even use their recycle bins. Fortunately, a quick internet search turned up several local places where I can schlep my compostables every week. If you've wanted to reduce your waste without doing your own compost, search online for a drop-off in your area. Specialty grocery stores and farmer's markets are a good place to start.
Even though those food scraps are biodegradable, once they're sealed in a plastic bag and buried in a landfill, they're not so easily broken down. Who needs the guilt? ;-)