I think it's because most slavs were still pagan back in the early medieval era and Christians specifically targeted them for slavery due to that. Christians were not allowed to enslave each other but pagans would be considered fair game, mostly. So pagans from eastern and northern europe were targeted the most.