The species Lactococcus lactis is a bacterium extensively used in the dairy industry. This bacterium is Generally Recognized as Safe and was added to the European Food Safety Authority’s Qualified Presumption of Safety list. The major functions of this species in dairy fermentation are the production of lactic acid from lactose, citric acid fermentation, and the hydrolysis of casein. But, the representatives of this species that produce bacteriocin substances can also exert an inhibitory effect against spoilage bacteria. The aims of this study were to test three lactococcal strains isolated from raw goat milk for their postbiotic activity and to test their stability in goat milk yogurts after their application in encapsulated form for their further application. To achieve these aims, validated methods were used. Three Lactococcus lactis strains (identified by Blastn 16S rRNA analysis) produced bacteriocin substances/postbiotics. These concentrated postbiotics inhibited the growth of enterococci and staphylococci (by up to 97.8%), reaching an inhibitory activity of up to 800 AU/mL. The encapsulated (freeze-dried) lactococci survived in the goat milk yogurts with sufficient stability. Strain MK2/8 fortified the yogurts in the highest amount (8.1 ± 0.0 cfu/g log 10). It did not influence the pH of the yogurt.