In this structure you could not.
This is a many to many relationship, model it as such.
EDIT (reviewing the scenario):
The above requirements are not enough to determine the 'exact solution'
At the risk of overly simplifying, you should:
1) check if you can stick the new information into any existing tables/entities
2) if not, then check if adding attributes/columns to any of the existing tables/entties
3) if not, then add a new table
The decisions are never clearly cut and you should consider several scenarios and their consequences. You should also periodically review your model as it envolves to look for opportunities to normalize it as it will greatly impact overall functionality of your system.
So, for example, as you state that you already have a many to many table for groups the main question now is weather to reuse that table or create a new one.
This depends on the other attributes that are in this table. Maybe for your business model/use case it makes sense, maybe it does not.
Maybe you need to model a table called as "MemoRecipients" which will store info on recipients (delivery, acknowledgement, etc...). Then you should ask yourself do you need the times for all these statuses, etc, etc...
Only you can determine what is a proper design decision for your problem space.