Greetings
If I understand you correctly, the remote office users are sending the printjobs through the vpn tunnel to your local printserver, thus then the server is again transmitting that job through vpn back to the remote office's printer?
Depends on what infrastructure you are using, if you are using windows terminal server/citrix, take a look at ThinPrint, it's not for free but works very well. If the users at the remote office have fat clients, install the printer driver on their pcs directly and print directly to the printers ip address and dont take a roundtrip over the server.