We have PRB0287641 (Pre-Issue - Custom layers not loading on initial form load and requires a refresh to load the custom layer) open after being able to recreate the issues, thanks to this post:
We’re still testing 2024.1 but this is crippling our planned upgrade for production. The workaround of refreshing the page isn’t relevant because we don’t expect our users to recognize whether they hit the right layer or not.