In case it was not clear, “clean up” includes having a reasonable README file and generally taking care of your project so that a random visitor can find out what you did.
Among other things, if your project does not depend on one of the submodules, then you should remove the submodule from the dependencies. Please practice good software practices.