When feasible, I hose aphids off with sprayer. I squash bigger pests. I do not use any poisons. If there is an insect invasion I use food grade diatomaceous earth. I think this kills all insects so use only as needed and preferably not on plants getting pollinated.
I too am having trouble with seeds being eaten before they are above ground and then maybe some cut worms in the soil get others.
Also a change from being able to grow in all seasons in California too much shorter period in Oregon.