It’s a bug in our version 9.05.701A, not sure about others. Refresh all in runtime dashboards doesn’t work unless you’re in developer mode. As a workaround, I set the query properties to “Auto Refresh on Load” to true in dashboards where refresh all is needed.