I'm using VYL media as my provider and for the past week or so have been noticing a intermittent lagging on the provider's account. First thing i did was to call VYL media thinking that it could be a fault on their end but their technical support said that problem would not, actually i believe he used the word never, originate from their end. I went on asking his opinion on me possibly changing my network card
It's difficult to believe that such issue caused from the pbx. Are you using only one sip provider? If you have some other registered providers or even sip phones a problem caused from the pbx network card should impact all the voip peers.
Issue a "sip show peers" then compare the values between peers to have an idea about the route quality, check also your router and do a trace to the provider proxy to get some info that may be useful.