We demonstrate deterministic two-qudit gates using the time and frequency degrees of freedom of a single photon, showing the potential of our scheme for deterministic quantum computing in high-dimensional Hilbert spaces.