Oh Yeah, If you aren't going to be able to check them out but once a week, you need to start spraying NOW.
I shudder to think what a single hornworm can do when left alone for a week. If I start thinking about the damage from three or four, I go into panic mode.