Here's two ways:
1. In grid mode (press 'g' key), select them, then press 'Delete'.
2. in loupe view, select them using the filmstrip, then context-click them and choose 'Remove from Collection'.
Definitions: "context-click" - right-click in Windows, ctrl-click on Mac.
~R.