Marko Radojćić On AI from Serbia by Marko Radojcic

Civil Engineer and an experienced IT guy reflecting on AI. Personal blog

YugoGPT Florida quantization testing results

Published on May 23, 2025

4bit quantized YugoGPT-Florida results published.

Thank you Dejan Čugalj for developing the model and SerbianLLMBenchmark

Резултати YugoGPT-Florida модела у четворобитној квантизацији на серији тестова за српски језик. Чак и квантизован модел има сјајне резултате у логици, резону и општем знанју док се слабије сналази са домен-специфичним темама. (препорука - Retrieval Augmented Generation)

Results of the YugoGPT-Florida model in four-bit quantization on a series of tests for the Serbian language. Even the quantized model has excellent results in logic, reasoning and general knowledge, while it performs less well on domain-specific topics. (Recommendation - Retrieval Augmented Generation)