[SampleSet] Do not load delayed attributes by not copying them over

4 jobs for lighter-samplesets in 14 minutes and 1 second (queued for 1 second)