The effects of the zinc and fibre source in piglets’ diet on the bone mineral content, density, and strength parameters of the femur were investigated using 24 piglets fed a diet supplemented with either lignocellulose (LC) or potato fibre (PF). Half of each group of piglets consumed a diet with ZnSO4 monohydrate or with zinc glycinate (ZnGly). The diets contained similar amounts of lysine, energy, and fibre. Bone mineral content and density were over 9% higher in pigs receiving diets with ZnGly than in animals fed diets with ZnSO4. Moreover, ZnGly strongly improved maximum and elastic strength (by 25.7 and 20.0%, respectively, p < 0.0001) and bone stiffness (by 29.4%, p < 0.0001). Only the mass of the femur was affected by the type of fibre in the diet, as the femurs of piglets fed diets with LC were over 7% (p < 0.0001) heavier than in piglets fed diets with PF. The intake of digestible zinc and the zinc content in the blood serum were positively correlated with the measured bone parameters and, depending on the parameter, “r” ranged from 0.749 to 0.866 and from 0.400 to 0.479, respectively. It can be concluded that bone parameters are affected more strongly by the organic than inorganic source of zinc.