Moved code to lightning

Updating codebase to make use of pytorch-lightning

• Main train/valid loops are handled by lightning
• Removed device-handling code
• Each model implements its own train/valid/predict steps
• Updated config files for use with lightning
• Using lightning checkpointing and logging callbacks
• Updated DeviceMonitor to be compatible with lightning

src/ptbench/models/alexnet.py

@@ -74,7 +74,7 @@ class Alexnet(pl.LightningModule):
         # Forward pass on the network
         outputs = self(images)
 
-        training_loss = self.hparams.criterion(outputs, labels.double())
+        training_loss = self.hparams.criterion(outputs, labels.float())
 
         return {"loss": training_loss}
 
@@ -89,7 +89,7 @@ class Alexnet(pl.LightningModule):
 
         # data forwarding on the existing network
         outputs = self(images)
-        validation_loss = self.hparams.criterion_valid(outputs, labels.double())
+        validation_loss = self.hparams.criterion_valid(outputs, labels.float())
 
         return {"validation_loss": validation_loss}