Grit Bricks are used for crafting Stucco Bricks.
Putting some Grit, along with some sort of fuel, into a Forge will yield a Grit Brick once the smelting process completes.