Currently, bitcoind takes a -bind argument which instructs the server to listen only on a specific IP address, however, this setting does not extend to the RPC server when -server is specified.
Please make the -bind setting set the RPC server bind address, or create an -rpcbind setting to specify it separately.