Q: Is there a way to have the calendar reminders to show when the calendar is not running?

A: Yes, try this:

1. Start Windows Calendar
2. Go to File>> Options
3. Place a checkmark in the checkbox titled: Reminders should show when Windows Calendar is not running
4. Click OK