Wow..you really don't know the game very well, do you?
First off, even though the menu says "season" it means per year. An optimal gatherer will produce 600-800 of EACH of the 4 food types it makes per year (with 4 workers), for a total of 2400-3200 food annually. Less than optimal conditions such as long walks from home to work, from work to the storage barn, or back to town to get tools/clothes, or less mature woods or mountains in the gathering area all reduce output. This is why you should not have the forester that is cutting logs and the gatherer paired together. Put a forester near the gatherer, sure, but set it to plant only and leave it off most of the time, only turn it on once every couple years to keep the forest full, and have another forester elsewhere do the actual logging.
Second, citizens eat on average 100 food per year. That optimal gatherer will feed 24-36 people per year. Remember children and students eat too, and they eat the same amount as adults.
Third, food diversity is key to good citizen health. The more food types you have, the better, so limiting yourself to one or two crops is a bad idea, especially if you get hit with a blight which will spread to other fields growing the same type of food. Also, since all the crops grow at different speeds, having a diverse crop allows for a longer effective harvest, rather than having everything demanding attention all at once (see below why this is bad)
Fourth, people have to do other stuff besides work...they go home to eat or get warm, and they have to get food and firewood and bring it home. They go get new tools or clothes when theirs wear out. They go see the herbalist when their health is low or to the hospital when sick. Having a single farmer means that if he's busy during autumn, your harvest just sits in the field...combine that with an early freeze and you just lost the whole crop.
Fifth, both with pastures and with fields, optimal output is achieved at max size. Your 12x12 farm produces 1008 food, or 7 food per tile...my 15x15 farms produce 1596 food per year, which is 7.1 food per tile. The same applies to pastures...20x20 pastures hold the most animals, which in turn means the highest breeding rate, and thus, the most food and materials per year.
Lastly, farms ARE good for food...when staffed by 4 workers they are the 2nd most efficient in terms of food per worker at ~400 food per worker per year. (only the gatherer makes more food per worker, 600-800 per year). Farms are also the 2nd best in terms of food production per tile of area...gatherers make more food per worker, but they require an enormous area that you could easily fit at least 9 farms into, yielding more than 4x the food from the same land area. Only the fishing dock, with its 8 tile footprint on land, makes more food per tile of land, but does so at around 250 food per worker for most docks. The hunter is the LEAST efficient food producer in the game, they require huge area and only make about 200 food per worker, the only real reason to use them is for the fact that they also give leather, which you will likely need long before you get enough cows to supply your tailors on their own.
[Edited by ninjafroggie, 2/27/2014 12:46:19 AM]