Sorry, That is not the way to delete a message. If you add some files as attachment, that remove button will remove that selected file.
To delete a message go to Messagebox and then select checkbox left side of that message. Then select “Delete” from Bulk actions. See screenshot attached.