Cavity optomechanical systems converting quantum state between photons facilitate the development of scalable quantum information processors. The control of state transfer in such systems require producing fast and robust transfer to the target state with high fidelity. Shortcuts to adiabaticity (STA) has recently been proved a powerful method for performing fast quantum state conversion in optomechanical systems, which is, however, not robust enough against deviations in control parameters. Here a scheme to realize robust photon state transfer in a universal cavity optomechanical system by combining STA with optimal control technique (OCT) is proposed. Minimizing systematic error sensitivities with adjustable optimization parameters allows to control simultaneously the transfer speed, fidelity, and robustness against errors. Numerical results show that the optimized scheme is insensitive to deviations in optomechanical coupling and frequency detuning over a broad range. The effects of dissipation on the transfer fidelity are also examined for practical implementation of the scheme in realistic scenarios.