GPUs in our system have ids from 0 to n-1 where n is the total number of GPUs.
Only one GPU is set as current GPU. Current GPU means a GPU which is ready for computation.
We can find out id of current GPU by calling function cudaGetDevice().
Note: Here, device_id gives id of current GPU after calling cudaGetDevice(&device_id) function.