You cannot delete users from your organization. However, you can limit them from viewing or receiving notifications of the activity going on in your organization by blocking them. Please refer to this article for a detailed step-by-step guide. You can always unblock this user at a later date, if you want to do so.