VMs on Proxmox 2.1-14 (pve-qemu-kvm 1.1-8, 2.6.32-14-pve) have an
annoying problem with our installations, where the deployed
system freezes as soon as some action takes place on the network
stack. For example invoking "lsof -i -n" on the rebooted system
causes such a freeze.
The only solution to work around this issue seems to be stopping
and then restarting the VM. As we need to handle this
automatically we need some kind of API to retrieve system state.
By writing the current deployment state into some file and
providing it through http://$DEPLOYMENT_SYSTEM:4242/status this
should get us there.
From: Michael Prokop <mprokop@sipwise.com>
The udev rules need the real MAC addresses and we can't mess
with them before the rules are in place
Thanks Richard for helping with debugging
From: Michael Prokop <mprokop@sipwise.com>
logit() isn't available inside the subshell in the chroot so don't
use it there, we already have it at the according place...
From: Michael Prokop <mprokop@sipwise.com>
When doing automated pro deployments we also have to stop monit
to be able to unmounted the disk in a clean way...
From: Michael Prokop <mprokop@sipwise.com>
Fix what has been broken in r10823: the "Dump completed on"
is present iff "--skip-comments" option is not used.
From: Michael Prokop <mprokop@sipwise.com>
We write data into the DB in revision scripts, like e.g.:
| $SVN/dev/ngcp/db-schema/trunk$ cat db_scripts/diff/9675.up
| INSERT INTO provisioning.voip_preferences (attribute, type, dom_pref, usr_pref, peer_pref, data_type, max_occur, description) VALUES('mobile_push_enable', 1, 1, 1, 0, 'boolean', 1, 'Send inbound call to Mobile Push server when called subscriber is not registered. This can not be used together with CFNA as call will be then simply forwarded.');
As suggested by Daniel let's also put data into the DB dumps.
From: Michael Prokop <mprokop@sipwise.com>
Might become useful for low-mem VMs once, implemented while
figuring out installing an etch system for Andi :)
From: Michael Prokop <mprokop@sipwise.com>
Starting with recent trunk versions we no longer ship
kamailio init script but just our kamailio-lb + kamailio-proxy.
From: Michael Prokop <mprokop@sipwise.com>
Inside the pool there might be versions which have been released inside a
maintenance branch but which don't cover recent changes in trunk.
This caused current trunk installations to fail with:
| mv: cannot stat `/etc/ngcp-config/config.yml': No such file or directory
So get rid of every file without "svn" in the filename, so e.g.:
ngcp-installer-ce_0.7.2+0~1339173026.svn9034.165_all.deb (trunk version)
is preferred over:
ngcp-installer-ce_0.7.3_all.deb (release into 2.5 repository)
When we're installing trunk we don't care about released versions,
so get rid of them.
Tricky.
From: Michael Prokop <mprokop@sipwise.com>
This avoids the svn commits with the only change being:
| --- Dump completed on 2012-06-06 6:09:22
| +-- Dump completed on 2012-06-06 16:35:16
From: Michael Prokop <mprokop@sipwise.com>
The:
| ERROR 2002 (HY000): Can't connect to local MySQL server through socket ...
gets displayed several times, though it's not an issue.
Seems to be some async foo or race condition I couldn't identify
yet, until it's resolved display a message to the user so nobody
thinks that's a real error.
From: Michael Prokop <mprokop@sipwise.com>
Hopefully this solves our failing daily builds where we get:
| 06:09:57 curl: (28) Operation timed out after 30000 milliseconds with 0 bytes received
like in https://jenkins.mgm.sipwise.com/job/vmbuilder-ce/192/
From: Michael Prokop <mprokop@sipwise.com>
By default we use eth1 for the crosslink / interconnect device,
but there are VMs which use eth0 - so support this in the deployment
process so we get a happy heartbeat service...
From: Michael Prokop <mprokop@sipwise.com>
Pro looks different, at least for the 2nd node,
we might have to investigate on that, but for the time
being just stay at CE to keep svn logs sane...
From: Michael Prokop <mprokop@sipwise.com>
I don't see any reason why we shouldn't have openssh-server on
each system we install, if manually testing installations of
ngcp-installer on plain Debian systems with the deployment ISO
it's annoying to not be able to login after initial deployment,
so let's change this...
From: Michael Prokop <mprokop@sipwise.com>
Until we've according DHCP/DNS/VM infrastructure that's the easiest
solution...
Thanks for the template, Richard.
From: Michael Prokop <mprokop@sipwise.com>
This is hackish™ and we should figure out a way how to get
rid of this kill-foo in the long run.
Actually the installation still works but if you care about the
error messages or want to debug the resulting system in *live*
mode then it's annoying if you're not aware of what to do...
From: Michael Prokop <mprokop@sipwise.com>
We want to have /etc/fstab being up2date on the live
system after installation, so force processing the
according uevents between kernel and userspace...
From: Michael Prokop <mprokop@sipwise.com>
Booting with Debian installation and bootoption puppet=192.168.51.25
sets up the host for puppet node deployment.
From: Michael Prokop <mprokop@sipwise.com>
For whatever reason the swap partition isn't enabled by default
anymore. Used to work in all my previous test runs (which
confused me already - haha), I've no idea why it's failing now
again. So re-add the mkswap command so we can at least release
2.4.1 now. Meh… ☠
From: Michael Prokop <mprokop@sipwise.com>
parted enables the swap partition during partition creation time
already, so we'd have to rewrite the partition stuff as well.
Turns out the difference between VM sizes (no swap vs. swap) is just
about 30MB, so let's drop the efforts regarding removal-but-enabling-swap-afterwards
and instead we get a even more homogeneous solution. :)
From: Michael Prokop <mprokop@sipwise.com>
As reported by Andrew CE systems tend to run in OOM conditions
pretty soon sometimes. So lets enable a swap partition in all
our systems by default.
To avoid a bigger VM image we create an init script on CE systems
which enables the swap partition during bootup and then destroys
itself (the script, not the swap partition :)).
From: Michael Prokop <mprokop@sipwise.com>
bootoption ngcprelease is too confusing, so drop it.
instead ngcpautobuildrelease does exactly what it says:
ngcpautobuildrelease=2.4-rc0
will skip generation of sources.list inside ngcp-installer and instead
use the defaults, except for the release it will use:
deb http://deb.sipwise.com/autobuild/ release-2.4-rc0 main
so we can test release candidates of upcoming stable releases without
manual intervention or adjusting ngcp-installer for each single test
release.
When installing a trunk release we also take the most recent version
of the installer, the installer will use the sources.list.trunk file
then anway. \o/
From: Michael Prokop <mprokop@sipwise.com>
we need a decent way to test unfinished releases during the release
cycle, using ngcprelease=2.4-rc1 allows us to test the installer
without any manual intervention against the 2.4-rc1 release on jenkins
From: Michael Prokop <mprokop@sipwise.com>
Building the offline mirror on request is slow and we don't
use it anymore since we provide the mirror on the ISO itself,
so instead test for /srv/mirror/debian only.
While at it don't hardcode "squeeze" in the mirror test but
instead use ${DEBIAN_RELEASE}.
From: Michael Prokop <mprokop@sipwise.com>
Instead of providing the installation details to the screen and
sleep a certain amount let's log the data to
/tmp/installer-settings.txt instead.
While at it also make sure bootoption 'ngcpce' is used so it's
available in the logo screen as well as inside the script.
From: Michael Prokop <mprokop@sipwise.com>
When deploying inside Kantan we want to be able to skip certain
stuff while providing data to the outside host. The bootoption
'kantan' provides that option and since we want to be able to
halt the system after installation also support the 'ngcphalt'
bootoption.
From: Michael Prokop <mprokop@sipwise.com>
Using bootoption "ngcpvers=2.1" should install our platform
version 2.1 and needs to automatically be aware of installing
Debian/lenny.
I'm not entirely happy with hardcoding release vs. platform vs.
installer version, but that's the best we can do for now.
From: Michael Prokop <mprokop@sipwise.com>
We are providing it (and depend on it) on our pro installations
already, but if we're deploying a CE edition on a physical
server system and network doesn't work after deploying it's
just a waste of time. So just install it on all our own systems
by default.
Ack-ed by: Daniel
From: Michael Prokop <mprokop@sipwise.com>
define default values at beginning of file
move setting hostname to default after cmdline/profile scanning
load "ip=<client-ip>:<srv-ip>: ..." in array variable
re-orded and additional commandline output
remove more hardcoded parameters (devs, IPs, hostnames)
full profile for sppro/spce
Otherwise we're creating broken systems which don't work as supposed.
And while at it do not append variables to files but instead override
any existing values, otherwise we might have broken config files.
From: Michael Prokop <mprokop@sipwise.com>
With the current bridge setup for installing pro systems on Proxmox
we have to use ip=....:eth1:off for getting into the internet[tm].
Since the internal network device needs to be eth0 then we've
to check for the specificed ip=... device and use the other[tm] one
for configuration.
From: Michael Prokop <mprokop@sipwise.com>
get profile configuration from file(s) in directory (instead of from one file
only), assume there is a file "default.sh" which is sourced in deployment.sh
+ minimal example profile setting for my SPPRO/CE VMs
SP/CE version can be specified by ngcpvers=N.N in bootparms and commandline,
and as SP_VERSION in profile file
ngcp-installer version as ngcpinstvers=N.N.N in bootparms and commandline,
and as INSTALLER_VERSION in profile file
commandline overrides profile overrides bootparms
* do not hardcode deb.sipwise.com/kantan/
* do not remove profile file, instead store profile file under its profile name
* try to run wget multiple times before giving up
* drop duplicate ngcpprofile code
* send error messages to stderr
From: Michael Prokop <mprokop@sipwise.com>
Swap partition has been prepared already but wasn't
enabled through /etc/fstab.
Thanks to Richard for finding and reporting this issue.
Closes: https://bugtracker.sipwise.com/view.php?id=665
From: Michael Prokop <mprokop@sipwise.com>
This actually isn't necessary but it's nice to be able
to re-execute /tmp/netscript.grml without having to reboot.
So let's make sure rereading the partition table (and therefore
no processes running on /mnt/* are left behind) works.
From: Michael Prokop <mprokop@sipwise.com>
Initial step towards our network (re)design, as stated at
https://sipwise.titanpad.com/install-instructions
While at it add some further useful default settings
and drop getProxmoxBootParam workaround.
From: Michael Prokop <mprokop@sipwise.com>
Oh boy, finding this issue was everything but nice.
* USB pens: nice
* local deployment ISOs: nice
* CD drives (esp. by IBM and Lenovo): fsck you!
From: Michael Prokop <mprokop@sipwise.com>
And while at it adjust way we're calling ngcp-installer so we can
catch its pipe status. Also make sure logfiles are cleaned before
we store them for later usage (ha!).
From: Michael Prokop <mprokop@sipwise.com>
sfdisk fails on some special disk geometries and forcing the
partition schema using --force isn't relevant enough since
we can just use parted as for physical installations as well.
From: Michael Prokop <mprokop@sipwise.com>
This is what has been used as deployment of mgmt1a and mgmt1b in
full automated installation mode through the bootmenu without any
further manual intervention (except for pressing "r" for reboot
and mounting /mnt/glusterfs on rebooted sp1 :)) using
grml-sipwise_2011.05.16.iso:
ngcppro ssh=grml2011 netscript=http://deb.sipwise.com/kantan/deployment.sh ngcpsp1 \
ngcphostname=sp1 ip=192.168.1.101::192.168.1.1:255.255.255.0:sp1:eth0:off dns=195.58.160.194 \
ngcpip1=192.168.1.101 ngcpip2=192.168.1.102 ngcpeaddr=192.168.1.103 ngcpeiface=b0 ngcpmcast=226.94.1.1
ngcppro ssh=grml2011 netscript=http://deb.sipwise.com/kantan/deployment.sh ngcpsp2 \
ngcphostname=sp2 ip=192.168.1.102::192.168.1.1:255.255.255.0:sp2:eth0:off dns=195.58.160.194 \
ngcpip1=192.168.1.101 ngcpip2=192.168.1.102 ngcpeaddr=192.168.1.103 ngcpeiface=b0 ngcpmcast=226.94.1.1
From: Michael Prokop <mprokop@sipwise.com>
The netscript does more than just vmbuilder stuff nowadays,
therefore move it from the vmbuilder package to a separate
package. ngcp-deployment provides everything needed for the
deployment itself, whereas ngcp-vmbuilder takes care of just
building the VMware/Virtualbox images based on the disk image
which might be the result of ngcp-deployment.
While at it provide the netscript as /usr/sbin/ngcp-deployment so
it can be used offline on the deployment ISOs itself as well
(offline usage by using /srv/mirror as mirror being WIP).
From: Michael Prokop <mprokop@sipwise.com>
Michael Prokop
Jon Bonilla
Andrew Pogrebennyk
Erhard Rank