leaf spots

[nancycee]

I have been pruning any leaf off my tomato plants that have early blight/septoria spots that I see. Should I be doing this? I have to remove leaves on a daily basis. But when I look at others pictures, I do see the same spots. Am I being overzealous?
I lost all my plants to late blight 2 or 3 summers ago. I gave up my garden because of it. But I missed it too much, so decided to try again. But it's just not going well again.
So many different issues no matter what I do. If I get a tomato out of it, I will be surprised.. As of right now, any flower I do manage to get drops. I am hoping that with the cooler weather forecast for next week maybe I will get some fruit to set.
I have woken up the last 2 days to what I believe must be some type of bug larvae or egg. Tiny raised black spots on my tomato leaf that I can actually wipe off. This is in addition to the specks from blight/septoria. So i have removed those leaves as well.
Should I continue to remove the leaves with spots or leave them to see what happens?