In most cases, stone mastic asphalt (SMA) mixtures placed in thin layers and subjected to stress develop early cracks (potentially resulting from being improperly affixed to the underlying layer, placed over previously cracked asphalt pavement, or placed over Portland cement concrete slabs). However, the filler used in SMA production is very influential on the performance of the mix. Fillers used in this type of mixture have a low plastic index or are inert (calcium carbonate or lime), so it is important to understand the effect of each material on the possible fissuring and cracking process of the SMA mixture. The objective of this study is to present an evaluation of the behavior of SMA asphalt mixtures with different types of filler and at different temperatures using the semicircular bend (SCB) fracture energy test. This research compares results between fracture energy and different types of filler in SMA asphalt mixtures at temperatures ranging from -10 to 25 °C.