In last decade graphics system have shown a great impact in our lives not only as a commodity itself but also for specialised use. Various powerful and expensive platforms to support graphical applications appeared in recent years. All these platforms require a high performance core that manages and schedules the high speed data of graphics peripherals. In this article, we design and propose a pattern-based graphics controller (PGC) that handles graphics peripherals efficiently. The proposed system is highly reliable in terms of cost, performance and power. The PGC-based system is implemented and tested on a Xilinx ML505 FPGA board. When compared with the baseline systems, the results show that the PGC captures video at 2.5×, 1.78× and 5× of higher frame rate and achieves 1.8× to 14.6× of speedup while executing different image processing applications. PGC consumes 16% to 28% of less on-chip power than the baseline systems.