Change inference device to accelerate inference on Mac and reduce memory leak
Change the inference device for Mac to accelerate inference and reduce memory leak