Two level systems located close to a metal nanostructure are basic components for quantum plasmonics. The two level system can be either a QD or an impurity hosted in a semiconductor matrix which has an interface with the metal. The non‐linear shape of the plasmon dispersion relation together with the dissipation part of the metal response produces a highly structured spectral density of the system. Semiconductors are ideal for modulating the qubit‐plasmon coupling. By using a Green's function approach jointly with a time‐convolutionless master equation, we analyze the non‐Markovian dissipative features on the qubit time evolution. For weak to moderate qubit‐metal coupling strength, and on timescales large compared to the surface plasmon oscillation time, a Markovian approximation for the master equation results to be adequate to describe the qubit main optical properties: surface enhancements of rate emission, optical spectra and time‐dependent photon‐photon correlation functions. The qubit decay shows a crossover passing from being purely dissipative for small qubit‐surface distances to plasmon emission for larger separations.