Not sure if this is the best procedure but is what worked for me.
- Install Jenkins with the native package manager: sudo apt-get install jenkins
- Switch to jenkins user: sudo su – jenkins
- Install RVM following the single user installation procedure
Hope this helps you.