You can make changes while the App is in use.  In order for your changes to be reflected on the App and collected data, you must go to the event selection page and click Sync.