Weeds are taking over.

[jardinlady]

Please help, I really need your imput, solution to this matter.
My yard is infested by weeds, I keep pulling them out and they keep comming in and they are stronger than ever.
Just 3 weeks ago I had pulled all the weeds out and the back yard was clean and now they are tall and all over the place. Thankfully when I cleaned my back yard last time I decided to put a fence around my vegetable garden so weeds over there are not as bad.
Do you have a good idea of how to take care of weeds, something more permanent?
I have not used any quemicals like weed killer etc... because I have 2 dogs that go to the backyard all the time and also because I have vegetables growing in the backyard so I did not want to kill my vegetable plants.

Help, prety please