Xen Virtualization on Linux and Solaris

Following post is a brief instruction of port 2.6.34.7 xenified aka Suse kernel to Ubuntu 10.10 desktop , to support Dom0 under Xen 4.0.1. Vanilla 2.6.34.7 gets patched via Andrew Lyon’s rebased patch set xen-patches-2.6.34-5.tar.bz2.
Kernel configuration is similar kernel-xen config on Suse’s 11.3 . Xen back-end,evtchn,gntdev divices get loaded via /etc/init.d/xend at startup. Xen 4.0.1 and Libvirt 0.8.3 installations are just the same as in [1].

# cd /usr/src/xenLinux/
# wget http://gentoo-xen-kernel.googlecode.com/files/xen-patches-2.6.34-5.tar.bz2

Untar linux-2.6.34.7.tar.bz2 and apply patches.

# cd /usr/src/xenLinux/
# bzcat linux-2.6.34.7.tar.bz2 | tar xf -
# mkdir -p xen-patches-2.6.34-5
# cd xen-patches-2.6.34-5
# bzcat ../xen-patches-2.6.34-5.tar.bz2 | tar xf -
# cd ../linux-2.6.34.7

Run script

#!/bin/bash
for P in `ls ../xen-patches-2.6.34-5/6*.patch1 | sort `
do
patch -p1 -s -i $P
if [ $? = 0 ]; then
echo $P applied
else
echo "Error processing "$P
exit 1
fi
done

Build kernel :-

# make menuconfig
# make -j(x)(number_of_cores)
# make modules_install install
# mkinitramfs -o /boot/initrd.img-2.6.34.7-0.3-xen 2.6.34.7-0.3-xen





Link to .config file

Update /etc/init.d/xend correspondently

case "$1" in
start)
mkdir -p /var/lock/subsys
touch /var/lock/subsys/xend
test -z "$XENSTORED_ROOTDIR" || export XENSTORED_ROOTDIR
test -z "$XENCONSOLED_TRACE" || export XENCONSOLED_TRACE
[[ "$XENSTORED_TRACE" == @(yes|on|1) ]] && export XENSTORED_TRACE
[[ "$XENBACKENDD_DEBUG" == @(yes|on|1) ]] && export XENBACKENDD_DEBUG
if (uname -r |grep 2.6.34.7-0.3-xen) ; then
modprobe evtchn
modprobe blktap
modprobe blkbk
modprobe xenblk
modprobe netbk
modprobe gntdev
modprobe usbbk
fi
xend start
await_daemons_up
;;

Build in Debian way is possible after applying hack from [2].
kernel.patch


root@boris-System-P5Q3:/usr/src3/linux-2.6.34.7# patch -p0 < kernel.patch
patching file arch/x86/Makefile
Hunk #1 succeeded at 154 (offset -1 lines).
Hunk #2 succeeded at 179 (offset 2 lines).

Now build and install linux-image

aptitude install kernel-package fakeroot
export CONCURRENCY_LEVEL=(number_of_cores) +1
make-kpkg clean
fakeroot make-kpkg --initrd --append-to-version=-0.4-xen kernel-image kernel-headers
dpkg -i ../linux-image-2.6.34.7-0.4-xen_2.6.34.7-0.4-xen-10.00.Custom_amd64.deb

At this point we are done with kernel . Next : disable Network manager

# chkconfig network-manager off
# gedit /etc/network/interfaces
auto lo
iface lo inet loopback

auto eth0
iface eth0 inet dhcp

Restart netwoking :-

# /etc/init.d/networking restart

Install required packages

apt-get install libcurl4-openssl-dev \
xserver-xorg-dev \
mercurial gitk \
build-essential \
libncurses5-dev \
uuid-dev gawk \
gettext texinfo bcc \
libncurses5-dev dpkg-dev debhelper \
iasl texinfo bridge-utils bison flex
apt-get build-dep xen-3.3

Extract Xen 4.0.1 archive :-

cd /usr/src
gunzip xen-4.0.1.tar.gz
tar -xvf xen-4.0.1.tar
cd xen-4.0.1

Apply following patch to xen-4.0.1 folder

--- .orig/tools/hotplug/Linux/xen-backend.rules 2010-10-05 14:08:56.436012895 +0400
+++ /tools/hotplug/Linux/xen-backend.rules 2010-10-05 11:48:38.694087211 +0400
@@ -9,3 +9,5 @@
KERNEL=="evtchn", NAME="xen/%k"
KERNEL=="blktap[0-9]*", NAME="xen/%k"
KERNEL=="pci_iomul", NAME="xen/%k"
+KERNEL=="gntdev", NAME="xen/%k"
+KERNELS=="xen", KERNEL=="xvd*", SUBSYSTEM=="block", OPTIONS+="last_rule"

At this point create grub2-fix.patch1 as raw content of http://xenbits.xensource.com/xen-unstable.hg?rev/6eaab8297681 Changeset 22238 pygrub: support grub2 “(hdX,msdosY)” partition syntax

patch -p1 -s -i ../grub2-fix.patch1
make xen
make tools
make install-xen
make install-tools PYTHON_PREFIX_ARG=

Set up xend,xendomains to run as services

update-rc.d xend defaults 20 21
update-rc.d xendomains defaults 21 20

Create new Grub Entry and reboot into Xen environment :-

menuentry "Xen 4.0.1 / Ubuntu 10.10 kernel 2.6.34.7-0.3-xen" {
insmod ext2
set root='(hd1,9)'
multiboot (hd1,9)/xen.gz dummy=dummy dom0_mem=1024M
module (hd1,9)/vmlinuz-2.6.34.7-0.3-xen dummy=dummy root=/dev/sdb10 ro console=tty0
module (hd1,9)/initrd.img-2.6.34.7-0.3-xen
}



root@boris-System-P5Q3:~# xm info
host : boris-System-P5Q3
release : 2.6.34.7-0.3-xen
version : #1 SMP Sun Oct 17 16:22:51 MSD 2010
machine : x86_64
nr_cpus : 4
nr_nodes : 1
cores_per_socket : 4
threads_per_core : 1
cpu_mhz : 2833
hw_caps : bfebfbff:20100800:00000000:00000940:0408e3fd:00000000:00000001:00000000
virt_caps : hvm
total_memory : 8190
free_memory : 7083
node_to_cpu : node0:0-3
node_to_memory : node0:7083
node_to_dma32_mem : node0:3259
max_node_id : 0
xen_major : 4
xen_minor : 0
xen_extra : .1
xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler : credit
xen_pagesize : 4096
platform_params : virt_start=0xffff800000000000
xen_changeset : unavailable
xen_commandline : dummy=dummy dom0_mem=1024M
cc_compiler : gcc version 4.4.5 (Ubuntu/Linaro 4.4.4-14ubuntu5)
cc_compile_by : root
cc_compile_domain :
cc_compile_date : Fri Oct 15 10:17:36 MSD 2010
xend_config_format : 4

root@boris-System-P5Q3:~# virsh version
Compiled against library: libvir 0.8.3
Using library: libvir 0.8.3
Using API: Xen 3.0.1
Running hypervisor: Xen 4.0.0



References
1. Set up Xen 4.0.1 & Libvirt 0.8.3 on top of Ubuntu 10.10 Desktop
2. http://lists.xensource.com/archives/html/xen-users/2010-09/msg00394.html

This entry was posted on Sunday, October 17th, 2010 at 6:08 pm and is filed under Uncategorized. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.