Commit Graph

8 Commits

Author SHA1 Message Date
henryruhs
7abb42724e Introduce lint pipeline and fix some minor issues flake8 complained about 2023-05-31 10:32:40 +02:00
Somdev Sangwan
4867f356ef
fix gpu issues for some envs 2023-05-31 12:43:43 +05:30
Somdev Sangwan
1cc34ce8e0 bruh moment 12 2023-05-31 12:42:34 +05:30
Shivam Kumar
9c1ea4fa01
Fix GPU not being used even when it available
On lots of systems onnxruntime doesn't detect GPU unless pytorch is imported before it. So despite having CUDA and CUDNN setup correctly, it is only using CPUExecutionProvider. By importing pytorch first, the issue is fixed. So let's use this until any official solution is available.

See: https://stackoverflow.com/questions/75294639/onnxruntime-inference-with-cudnn-on-gpu-only-working-if-pytorch-imported-first
2023-05-31 09:20:41 +05:30
henryruhs
dc0653ad39 Restore globals, add process time for better comparison 2023-05-30 01:03:43 +02:00
henryruhs
54f800dd0e Add GPU support, Quit on missing model, Remove globals (sorry) 2023-05-30 00:40:02 +02:00
Somdev Sangwan
4bb6ea416e reverse providers logic 2023-05-29 23:10:52 +05:30
Somdev Sangwan
32ebd9191c bruh moment 3 2023-05-29 19:13:55 +05:30