This is the current view:
The problem is that the implication of the top box is to allow those in the list to be able to act as delegates of you in your mail/calendar/etc. This is misleading.
Suggestion: Please provide more granular and thus more specific access to the calendar (which most users will grant to others) and to the others (which are rarely delegated from my experience).