If you have gathered enough offers, or if you made a mistake when entering the case, you can prevent the case from continuing to be visible by archiving the case, using the archive button, pictured below.

If you wish to restore a case that you had archived, then you can "un"-archive the case with the restore button, pictured below.