The current studies provide insights into how predictions based on results of physicochemical and in vitro tests are consistent with the results of in vivo studies. The new biomicroconcrete type materials were obtained by mixing the solid phase, composed of hybrid hydroxyapatite/chitosan granules and highly reactive α-tricalcium phosphate powder, used as the setting agent. This approach guaranteed a good adhesion of the continuous cement phase to the surface of granules. It has been demonstrated that developed biomicroconcretes are surgically handy, possessed favorable physicochemical and biological properties and can be considered as effective bone implant material. The hierarchical porosity and compressive strength (2–6 MPa) similar to cancellous bone made them suitable for low-load bearing applications. Despite the fact that final setting times of biomicroconcretes were longer than recommended in the literature (i.e., exceeded 15 min), their short cohesion time allows for a successful implantation in a rabbit femoral defect model. Histological analysis and Raman studies revealed newly formed bone tissues around the sides of implanted materials. Furthermore, the process of neovascularization and reconstruction of the bone tissue, as well as a reverse scaffolding process, was visible. No signs of inflammation or adverse tissue reactions were observed during the experiment.