The church got its ordinary name from the red bricks decorating the frontal walls. The fourth Reformed church was built from the donations of the chief justice and his wife in neo-gothic style in 1887. Its special features include the dry frescoes which are unusual in Reformed churches. The frescoes without human figures recall psalms.