In this paper we study pseudo-multipliers associated to the harmonic oscillator (also called Hermite multipliers) belonging to the ideal of $r$-nuclear operators on Lebesgue spaces.