Supersymmetric scenarios with R-parity conservation are becoming very constrained due to the lack of missing energy signals, thus motivating those scenarios with R-parity violation. In view of this, we consider a supersymmetric model with R-parity violation and extended by an anomalous horizontal $U(1)_H$ symmetry, where a self-consistent framework with baryon-number violation is achieved along with a proper supression for lepton number violating dimension-5 operators in order to keep a proton decay safe. With the introduction of right-handed neutrinos both Dirac and Majorana masses can be accommodated within this model. The implications for collider physics are discussed.