My guess is that you should be capturing on BRIDGE interface. CPU usage and memory usage seem not to be the bottleneck. Try to switch capturing the BRIDGE interface only and make sure you capture only one way, e.g use source address of your local lan.
