Yes, quite a lot of trouble. Especially before our Queen came and made the girdle to protect us, but they often harried the march wardens who protected our borders even so.

And after it fell the wolves came again. And the great spiders from Nan Dungortheb. They are also as big as you or bigger, and much more vicious than any Valar or God. [Morgoth at least had the good grace to fear the void. The spiders did not.]