RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0!

ssdavidson
Wed, 19 Jul 2023 17:33:47 +0000

@ehalit would you mind sharing your script for loading falcon-7b-instruct directly? I am still getting this same error when trying to load falcon-7b-instruct. Many thanks!