Well, you could if the package was set up differently, or if you wanted to go at it manually. But they way the maintainers set the dependencies makes apt think it has to remove the whole DE, or at least a bunch of essential parts of it.
Can't you pass something like --unmerge or --nodeps so package manager will ignore dependencies? And then add it to apt equivalent of package.prpvided to tell that this package is managed by another package manager(you).