In the same way that the "Rate" button appears and displays the work that has been submitted, there should be a separate button for users who do not submit the activity, since it does affect their grade if they are not graded individually.