Thanks to this stack overflow answer ( https://stackoverflow.com/a/41678350/232122 ) I was able to fix the font preloading! If we put fonts.css in the public/folder and include it with normal html, we can avoid going through the build pipeline!