If the VPN server at your main office is also their edge router, it may not like traffic coming in the external interface which is destined to go out the external interface.
Perhaps remote desktop'ing into a PC at the main office will work for you, alternatively establish a VPN with your customer's network, or obtain a static IP from your provider and modify the customers firewall accordingly.