In order to solve the problems of resource utilization of coal-based solid wastes such as coal gangue and reducing carbon emissions, a new type of filling and grouting material was prepared by partially replacing cement with calcined coal gangue powder and fly ash as raw materials and mixing nano silica. X-ray diffraction (XRD) and scanning electron microscopy (SEM) were used to analyze the composition and microstructure of the raw materials. Combined with the Box-Behnken experimental design, the influence of each component on the compressive strength and fluidity of the slurry was determined, and the optimal mix ratio was obtained, and a new damage constitutive model was established, which can fully describe the stress-strain curve and provide a reference for the application of engineering practice. The test results show that the order of influence of each key factor on the fluidity of grouting materials is as follows: B (fly ash substitution rate), > A (calcined coal gangue powder substitution rate), > C (nano SiO2 addition rate). The order of influence on compressive strength is as follows: B (fly ash substitution rate), > C (nano SiO2 addition rate), > A (calcined coal gangue powder substitution rate). The optimal ratio of each factor was as follows: the substitution rate of calcined coal gangue powder cement was 21.16%, the substitution rate of fly ash cement was 30.3%, and the addition rate of nano SiO2 was 0.511%.