MP1 - Running time

MP1 - Running time

par Gaston Emil Wolfart,
Nombre de réponses : 6

Hello,

When I try to run my DQN implementation in the 3.1 for the miniproject 1 for 1000 Episodes it takes quite a long time 20min + and I was wondering how long it takes you to see if I made a mistake in my code or if I should let it run.


Thanks in advance,

Gaston Wolfart

En réponse à Gaston Emil Wolfart

Re: MP1 - Running time

par Tobia Fjellman,
Hey !
Last time I checked, I believe my code ran in only a couple of minutes.
Are you using pytorch or tensorflow ?
Have a nice day !
En réponse à Tobia Fjellman

Re: MP1 - Running time

par Gaston Emil Wolfart,
I'm using Pytorch on my GPU, granted it is not the most powerful one. What are you using ?
En réponse à Gaston Emil Wolfart

Re: MP1 - Running time

par Tobia Fjellman,
Thanks for the details. I indeed think its surprising it takes so long on your GPU. It might be because we are still in the regime where the overhead is not really worth it.
As for my initial message : never mind, I was comparing to simulations which I was running with a lighter version of the code that slightly deteriorates the quality of the training. My normal code takes a similar amount as yours (though I currently run it on my CPU).
I hope that google colab solved your issue !