[notification] Quirks

For some reason, the following is happening (staging):

  1. I get "failed" e-mail notifications for cached (successful) experiments. How to reproduce: fork a successful experiment, run it, wait for the e-mail.

  2. I don't get an e-mail for experiments that execute, but fail.