Just clone into your home and create two symbol links, for example:
.vimrc: ~ $ ln -s /home/$USER/vimconfig/.vimrc .vimrc
.vim: ~ $ ln -s /home/$USER/vimconfig/.vim .vim
~ $ cd /home/$USER/vimconfig/
~ $ git submodule init
~ $ git submodule update
Use vim =)