In the Field and Community Services module, you can delete a case or activity from the ellipses on the top right hand side here:

​​

For additional information you may wish to review: Field & Community Services Cases and Activities