Skip to main content

Enterprise Deployment with Corosync

About​

by Emmanuel Schmidbauer2

This is uses the same concept discussed here, which I also wrote.

This setup was tested on Debian Squeeze. There are two example servers here, fs01-a (10.10.10.8) and fs01-b (10.10.10.9).

10.10.10.11 will be the floating IP used here. This tutorial assumes you have ODBC setup so both nodes can connect to the same database. Please note that 10.10.10.11 should be a public facing IP, it is only used as an example here.

Click here to expand Table of Contents

Network Configuration​

Add each node to hosts file​

root@fs01-a:~# echo "10.10.10.8   fs01-a" >> /etc/hosts
root@fs01-a:~# echo "10.10.10.9   fs01-b" >> /etc/hosts
root@fs01-b:~# echo "10.10.10.8   fs01-a" >> /etc/hosts
root@fs01-b:~# echo "10.10.10.9   fs01-b" >> /etc/hosts

Create SSH keys​

root@fs01-a:~# ssh-keygen -t dsa -f ~/.ssh/id_dsa -N ""
root@fs01-b:~# ssh-keygen -t dsa -f ~/.ssh/id_dsa -N ""

Create SSH key to other server​

root@fs01-a:~# scp -P 22 .ssh/id_dsa.pub root@fs01-b:/root/
root@fs01-a:~# cat id_dsa.pub >> .ssh/authorized_keys
root@fs01-a:~# rm -rf fs01-b.pub
root@fs01-b:~# scp -P 22 .ssh/id_dsa.pub root@fs01-a:/root/
root@fs01-b:~# cat id_dsa.pub >> .ssh/authorized_keys
root@fs01-b:~# rm -rf fs01-a.pub

Allow FreeSWITCH to bind to nonlocal IP​

Add the following line to /etc/sysctl.conf

echo 'net.ipv4.ip_nonlocal_bind=1' >> /etc/sysctl.conf

Restart networking:

/etc/init.d/networking restart

Run:

sysctl -p

You should see:

net.ipv4.ip_nonlocal_bind = 1

If you don't, you did something wrong, if you do, continue...

Corosync/Pacemaker​

Install Corosync & Pacemaker​

apt-get install pacemaker crmsh -y

corosync is included as a dependency of pacemaker

Configure Corosync​

root@fs01-a:~# export ais_port=4000
root@fs01-a:~# export ais_mcast=226.94.1.1
root@fs01-a:~# export ais_addr=`ip addr | grep "inet " | tail -n 1 | awk '{print $4}' | sed s/255/0/`
root@fs01-a:~# cp /etc/corosync/corosync.conf.example /etc/corosync/corosync.conf
root@fs01-a:~# sed -i.bak "s/.*mcastaddr:.*/mcastaddr:\ $ais_mcast/g" /etc/corosync/corosync.conf
root@fs01-a:~# sed -i.bak "s/.*mcastport:.*/mcastport:\ $ais_port/g" /etc/corosync/corosync.conf
root@fs01-a:~# sed -i.bak "s/.*\tbindnetaddr:.*/bindnetaddr:\ $ais_addr/g" /etc/corosync/corosync.conf
root@fs01-a:~# cat >> /etc/corosync/corosync.conf <<EOT
        aisexec {
                user: root
                group: root
        }
        service {
                name: pacemaker
                ver: 0
        }
EOT
root@fs01-a:~# corosync-keygen
root@fs01-a:~# scp -P 22 /etc/corosync/authkey root@fs01-b:/etc/corosync/authkey
root@fs01-a:~# scp -P 22 /etc/corosync/corosync.conf root@fs01-b:/etc/corosync/corosync.conf
root@fs01-a:~# sed -i "s/no/yes/g" /etc/default/corosync
root@fs01-b:~# sed -i "s/no/yes/g" /etc/default/corosync

OpenAIS is deprecated in favor of corosync.

https://github.com/corosync/openais

The LSB (Linux Standards Base) Script

Copy and paste this script into /etc/init.d/FSSofia on both nodes.

#!/bin/sh
### -*- mode:shell-script; indent-tabs-mode:nil; sh-basic-offset:2 -*-
### BEGIN INIT INFO
# Provides: FSSofia
# Required-Start: $network $remote_fs $local_fs
# Required-Stop: $network $remote_fs $local_fs
# Default-Start: 2 3 4 5
# Default-Stop: 0 1 6
# Short-Description: FSSofia
# Description: FSSofia Status
### END INIT INFO
#set -x

FS_CLI_PROG='/usr/local/freeswitch/bin/fs_cli'
FS_CLI_HOST='127.0.0.1'
FS_CLI_PORT='8021'
FS_CLI_PASS='ClueCon'
PROFILES='internal'

usage() {
  echo "Usage: $0 profile1[,profile2[,etc]] {start|stop|status}"
  exit 1
}

fs_cli() {
  $FS_CLI_PROG -H $FS_CLI_HOST -P $FS_CLI_PORT -p $FS_CLI_PASS -x "$1"
}

sofia_profile_started() {
  fs_cli "sofia xmlstatus" | grep "<name>$1</name>" | wc -l
}

if [ $# != 1 ]; then
  usage
fi


#PROFILES=`echo $1 | tr ',' ' '`
CMD=$1
#was $2

case "$CMD" in
  'start')
     fs_cli "sofia recover"
     exit 0
     ;;
  'stop')
     exit 0
     ;;
  'status')
     for p in $PROFILES; do
       if [ `sofia_profile_started "$p"` -eq 0 ]; then
         echo "$p DOWN"
         exit 3
       fi
     done
     echo "OK"
     exit 0
     ;;
  *)
     usage
     ;;
esac

Make the script executable

root@fs01-a:~# chmod +x /etc/init.d/FSSofia
root@fs01-b:~# chmod +x /etc/init.d/FSSofia

Restart Corosync​

root@fs01-a:~# /etc/init.d/corosync restart
root@fs01-b:~# /etc/init.d/corosync restart

crm configure show​

Configure corosync/pacemaker as follows

root@fs01-a:~# crm configure edit
node fs01-a \
       attributes standby="off"
node fs01-b \
       attributes standby="off"
primitive fs lsb:FSSofia \
       op monitor interval="1s" enabled="true" timeout="2s" on-fail="standby" \
       meta target-role="Started"
primitive fs-ip ocf:heartbeat:IPaddr2 \
       params ip="10.10.10.11" nic="eth0:0" cidr_netmask="24" \
       op monitor interval="10s"
group cluster_services fs-ip fs
location cli-prefer-cluster_services cluster_services \
       rule $id="cli-prefer-rule-cluster_services" inf: #uname eq fs01-a
property $id="cib-bootstrap-options" \
       dc-version="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" \
       cluster-infrastructure="openais" \
       expected-quorum-votes="2" \
       stonith-enabled="false" \
       last-lrm-refresh="1348755080" \
       no-quorum-policy="ignore"
rsc_defaults $id="rsc-options" \
       resource-stickiness="100"

Configure FreeSWITCH​

Set FreeSWITCH to listen on the floating IP and configure ODBC.

sofia.conf.xml​

You should have the following parameters set in sofia.conf.xml on both nodes. The Database needs to be shared between the two+ nodes. Please see the databases wiki for the proper odbc connection string.

<param name="odbc-dsn" value="database:username:password"/>
<param name="track-calls" value="true"/>
<param name="rtp-ip" value="10.10.10.11"/>
<param name="sip-ip" value="10.10.10.11"/>
<param name="presence-hosts" value="10.10.10.11"/>
<param name="ext-rtp-ip" value="10.10.10.11"/>
<param name="ext-sip-ip" value="10.10.10.11"/>

Configure sip_profiles​

You should edit all sip profiles that you wish to use (typically internal.xml and external.xml). Adding the following line to tell these modules how to connect to your shared database and to track the active calls.

<param name="odbc-dsn" value="database:username:password"/>
<param name="track-calls" value="true"/>

switch.conf.xml​

You should have the following parameters set in switch.conf.xml on both nodes

<param name="switchname" value="fs01"/>
<param name="core-db-dsn" value="database:username:password"/>
<param name="core-recovery-db-dsn" value="database:username:password"/>

Other XML Files​

These are not necessary for everyone that wants HA. But you may need to add in the "odbc-dsn" parameter depending on what you are using freeswitch for:

# Add the following line in db.conf.xml, voicemail.conf.xml, lcr.conf.xml, and nibblebill.conf.xml
<param name="odbc-dsn" value="database:username:password"/>

Start FreeSWITCH​

Start FreeSWITCH on both nodes.

root@fs01-a:~# /etc/init.d/freeswitch start
root@fs01-b:~# /etc/init.d/freeswitch start

Start Corosync​

Start Corosync on both nodes.

root@fs01-a:~# /etc/init.d/corosync start
root@fs01-b:~# /etc/init.d/corosync start

Start Pacemaker​

Start Corosync on both nodes.

root@fs01-a:~# /etc/init.d/pacemaker start
root@fs01-b:~# /etc/init.d/pacemaker start

TEST!​

Make a call and don't hang up.

CLI on both FS nodes​

root@fs01-a:~# /usr/local/freeswitch/bin/fs_cli
root@fs01-b:~# /usr/local/freeswitch/bin/fs_cli

Crash the primary server​

freeswitch@default> fsctl crash

Voilà, the call should continue almost instantly on the standby server!

To Do​

TODO: Fill in how to setup/install corosync

See also​

Enterprise Deployment

High Availability

Clusters From Scratch (Pacemaker, Corosync home; Red Hat)

Debian Clusters

crmsh - the cluster management shell (alternative to pcs)

SmartVox Discussion of Pacemaker with OpenSIPS