Archive for the ‘server’ Category

« Older Entries

Ignore monit in awstats

Wednesday, May 22nd, 2013

Find monit user agent in apache access.log.

awstats.conf:

SkipUserAgents="monit/5.0.3"

Tags:
Posted in server | No Comments »

netatalk 3.0.3 Ubuntu 12.04.2/10.04.3 LTS (Precise Pangolin)

Monday, May 20th, 2013

Netatalk for use with Time Machine on MAC OSX Mountain Lion 10.8.3.

sudo -i
apt-get install build-essential pkg-config checkinstall git-core avahi-daemon libavahi-client-dev libdb5.1-dev db-util db5.1-util libgcrypt11 libgcrypt11-dev
wget http://prdownloads.sourceforge.net/netatalk/netatalk-3.0.3.tar.bz2?download
tar jxvf netatalk-3.0.3.tar.bz2?download
mv netatalk-3.0.3 /usr/src
cd /usr/src/netatalk-3.0.3
./configure --with-init-style=debian --with-zeroconf
make
checkinstall
exit

/usr/local/etc/afp.conf:

1
2
3
4
5
6
7
8
9
10

[Global]
mimic model = TimeCapsule6,106
log level = default:warn
log file = /var/log/afpd.log
hosts allow = 192.168.1.0/16
 
[TimeMachine]
path = /mnt/timemachine
valid users = tmuser
time machine = yes

For Ubuntu 10.04.03 use this apt-get line instead:

apt-get install build-essential pkg-config checkinstall git-core avahi-daemon libavahi-client-dev libdb4.8-dev db4.8-util libgcrypt11 libgcrypt11-dev

Resource:
https://gist.github.com/vena/2856490
https://wiki.archlinux.org/index.php/Netatalk#Netatalk

Posted in mac, server | No Comments »

Learn spamassasin

Monday, May 20th, 2013

sa-learn --no-sync --spam /folder/to/.Spam/
sa-learn --no-sync --ham /forlder/to/ham
sa-learn --sync

Posted in server | No Comments »

Parse old gzipped apache(vhost_combined) logs with awstats

Saturday, May 11th, 2013

Parse all logs to new log-file in chronological order.

zgrep ^blog.seljebu.no `find -name "other_vhosts_access.log.[0-9]*.gz" | sort -n -t . -k 4 -r` | sed 's/\.\/other_vhosts_access.log.[0-9]*.gz:blog.seljebu.no:80 //g' > blog.seljebu.no/old.log
grep ^blog.seljebu.no other_vhosts_access.log.1 | sed 's/blog.seljebu.no:80 //g' >> blog.seljebu.no/old.log
grep ^blog.seljebu.no other_vhosts_access.log | sed 's/blog.seljebu.no:80 //g' >> blog.seljebu.no/old.log

Make config-file for awstats.

1
2
3
4
5
6

#/etc/awstats/awstats.blog.seljebu.no.conf
LogFile="/var/log/apache2/blog.seljebu.no/old.log"
LogFormat=1
SiteDomain="blog.seljebu.no"
HostAliases="blog.seljebu.no"
DirData=/var/lib/awstats

Delete awstats database and update awstats. If you get a lot of corrupted/dropped records, you could use -showcorrupted/-showdropped.

rm /var/lib/awstats/awstats*blog.seljebu.no*
/usr/lib/cgi-bin/awstats.pl -config=blog.seljebu.no -update

Make individual log-files for virtualhosts.

1
2
3
4
5

<VirtualHost *:80>
        Servername blog.seljebu.no
        CustomLog /var/log/apache2/blog.seljebu.no/access.log combined
        ...
</VirtualHost>

Add new log files to logrotate.

#/etc/logrotate.d/apache2 
/var/log/apache2/*/*.log /var/log/apache2/*.log {
        weekly
        ...
}

Update awstats config-file.

1
2
3

#/etc/awstats/awstats.blog.seljebu.no.conf
LogFile="/var/log/apache2/blog.seljebu.no/access.log"
...

Add to cron.

#/etc/cron.d/awstats
*/10 * * * * www-data /usr/lib/cgi-bin/awstats.pl -config=blog.seljebu.no -update >/dev/null

Posted in server | No Comments »

Move/convert LXC(Linux Container) to Virtualbox/KVM/real machine

Friday, May 10th, 2013

Some adjustments might be needed, but this will guide you trough the concepts of moving a linux container to a bare metal machine/hypervisor.

Backup contents of server with rsync.

lxc-stop -n name
rsync -av /opt/lxc/name/root-filesystem/* /media/usb-stick-with-linux-filesystem

Start virtualbox/real machine with ubuntu server iso, rescue mode. Open a terminal in installer environment, format and mount disk.

fdisk /dev/sdX
mkfs.ext4 /dev/sdX1
mkswap /dev/sdX2
mkdir /target
mount /dev/sdX1 /target

Copy contents of linux container to new root filesystem.

mount /dev/sdb1 /mnt
mount -o bind /target /mnt/mnt
mount -o bind /dev /mnt/dev
mount -o bind /run /mnt/run
mount -o bind /proc /mnt/proc
mount -o bind /sys /mnt/sys
chroot /mnt /bin/bash
rsync -av --exclude 'dev' --exclude 'run' --exclude 'proc' --exclude 'sys' --exclude 'mnt' / /mnt

Exit chroot of lxc container, and chroot into new partition.

exit
cd /target
mkdir dev sys proc run mnt
mount -o bind /dev /target/dev
mount -o bind /run /target/run
mount -o bind /proc /target/proc
mount -o bind /sys /target/sys
chroot /target /bin/bash

Check fstab(normally filesystem is mounted by LXC-instance).

1
2
3

#/etc/fstab
/dev/sda1 / ext4 defaults 0 0
/dev/sda2 none swap defaults 0 0

Install linux kernel and grub(make it bootable). Network is needed for this step, make sure resolv.conf is valid.

apt-get update
apt-get -o DPkg::Options::="--force-confmiss" install linux-image grub2

Since LXC does not use normal init/upstart, we need to make sure configfiles in /etc/init exists. This is done by reinstalling ubuntu-minimal dependencies.

sudo apt-get -o DPkg::Options::="--force-confmiss" --reinstall install adduser bzip2 console-setup dash dhcp3-client eject gnupg ifupdown initramfs-tools iproute iputils-ping kbd less locales lsb-release makedev mawk module-init-tools net-tools netbase netcat-openbsd ntpdate passwd procps python rsyslog sudo tasksel tzdata ubuntu-keyring udev upstart ureadahead vim-tiny whiptail

Make sure SSH is enabled.

update-rc.d ssh defaults

That should be it. Exit chroot, umount and reboot. Remove ubuntu-iso, cross fingers.

Posted in server | No Comments »

Upgradring zfs-on-linux (ZoL)

Monday, December 3rd, 2012

Binary packages are called spl-dkms and zfs-dkms (use apt-cache showsrc zfs-linux).

1
2

apt-get update
apt-get install spl-dkms zfs-dkms

Tags:
Posted in server | No Comments »

automatically mount zfsonlinux file systems during startup

Tuesday, May 8th, 2012

Change /etc/default/zfs:

1
2
3
4
5

# Automatically run `zfs mount -a` at system startup if set non-empty.
ZFS_MOUNT='yes'
 
# Automatically run `zfs unmount -a` at system shutdown if set non-empty.
ZFS_UNMOUNT='yes'

Add zfs-mount to runlevels:

1

update-rc.d zfs-mount defaults

Tags:
Posted in server, tips | No Comments »

nfs4 and all_squash

Sunday, May 6th, 2012

all_squash does not work when directory/share is on the same filesystem. Example:

/etc/exports:

1
2

/media/mount 192.168.0.0/24(rw,async,no_subtree_check,fsid=0)
/media/mount/folder 192.168.0.0/24(all_squash,anonuid=1000,anongid=100,rw,async,no_subtree_check)

We have to mount folder with a bind to get this working. Move folder to new location, here I'm hiding it:

1
2

mv /media/mount/folder /media/mount/.folder
mkdir /media/mount/folder

/etc/fstab:

1
2

/dev/sdb1 /media/mount ext4 defaults 0 0
/media/mount/.folder /media/mount/folder none bind 0 0

Mount and reload nfs exports:

1
2

mount /media/mount/folder
exportfs -r

Reference: http://www.spinics.net/lists/linux-nfs/msg16593.html

Posted in server, tips | 1 Comment »

roundcube, sqlite2, ubuntu 11.10 and cherokee

Wednesday, February 15th, 2012

Roundcube only supports sqlite2(RC v0.7.1). Unfortunately Ubuntu 11.10 doesn't have sqlite2 available in the repos(not sure why, security?), and MySQL/PostgreSQL seems like an overkill for a single user roundcube installation.

Fix: install php5-sqlite and get sqlite2 from natty(11.04). The module sqlite.so is actually loaded by default(/etc/php5/cgi/conf.d/sqlite.ini) but missing in the oneiric package.

1
2
3
4
5

apt-get install php5-sqlite
wget http://security.ubuntu.com/ubuntu/pool/main/p/php5/php5-sqlite_5.3.5-1ubuntu7.7_i386.deb
dpkg -x php5-sqlite_5.3.5-1ubuntu7.7_i386.deb /tmp
cp /tmp/usr/lib/php5/20090626+lfs/sqlite.so /usr/lib/php5/20090626+lfs/
service cherokee restart

Reference: https://bugs.launchpad.net/ubuntu/+source/php5/+bug/875262

Tags: , , ,
Posted in server | No Comments »

Auto update iptables DDWRT

Thursday, December 15th, 2011

custom script:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25

wan=`nvram get wan_ipaddr`
last=`cat /tmp/last_wan_ipaddr`
echo "WAN IP: $wan" > /tmp/ipv6forward.log
echo "Last WAN IP: $last" >> /tmp/ipv6forward.log
# Check if IP is updated
if [ "$wan" != "$last" ]; then
  echo "New WAN IP detected." >> /tmp/ipv6forward.log
  # If this is the first time script is adding rules, add a FILTER rule that accept the DNAT FORWARD rule
  if [ -f /tmp/last_wan_ipaddr ]; then
    # Not first time, delete old DNAT
    iptables -t nat -D PREROUTING -j DNAT -d $last -p 41 --to-destination 10.10.10.7 >> /tmp/ipv6forward.log    
  else
    # First time, wait for router to settle (ddwrt will clear iptables on startup)
    sleep 30
    # Remove DROP policy
    iptables -t filter -D FORWARD -j DROP >> /tmp/ipv6forward.log
    # Add DNAT rule
    iptables -t filter -A FORWARD -j ACCEPT -p 41 -d 10.10.10.7 >> /tmp/ipv6forward.log
    # Add DROP polocy (last place)
    iptables -t filter -A FORWARD -j DROP >> /tmp/ipv6forward.log
  fi
  iptables -t nat -A PREROUTING -j DNAT -p 41 -d $wan --to-destination 10.10.10.7 >> /tmp/ipv6forward.log
  # write wan_ipaddr to tmp
  echo $wan > /tmp/last_wan_ipaddr
fi

startup script:

1
2

nvram get rc_custom > /tmp/custom.sh
chmod +x /tmp/custom.sh

cron:

1

* * * * * root /tmp/custom.sh

Tags: , , ,
Posted in server | No Comments »

« Older Entries