Do you have a lot of files it might try to preview? I remember encountering similar loading times in my photos folder because it ties to load previews for every file.

I think half the reason immutable distros started being recommended to people is the fallout after LTT’s Linux challenge. I noticed some people presenting immutable distros as the solution to prevent things like accidentally removing the desktop.