DevOps技术分享 » SHELL

[SHELL] WEB页面监控脚本

showerlee — Wed, 04 Jun 2014 07:31:50 +0000

新的博客站终于备案并迁移成功 http://www.showerlee.com

有需要的小伙伴可以站内向我咨询,绝对免费哦.

51CTO同时作为我的备份博客站同步发布我的最新博文,欢迎大家的访问.

最近刚好需要测试一下新建站的稳定性,所以写了个SHELL脚本放到本机(最近换了mac本),能够实时查看你需要监控的WEB页面状态,并发送到指定邮箱.

这里赞一下OS X自带有crontab计划任务,可以直接在本机测试脚本啦^_^

# vi check_web_alive.sh

---------------------------------------------------------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

# define url

WEB_URL=("http://www.example.com" "http://www1.example.com" "http://www2.example.com")

# check network

NET_ALIVE=$(ping -c 5 8.8.8.8 |grep 'received'|awk 'BEGIN {FS=","} {print $2}'|awk '{print $1}')

if [ $NET_ALIVE == 0 ]; then

echo "Network is not active,please check your network configuration!"

exit 0

# check url

for((i=0; i!=${#WEB_URL[@]}; ++i))

{

ALIVE=$(curl -o /dev/null -s -m 10 -connect-timeout 10 -w %{http_code} ${WEB_URL[i]} |grep"000000")

if [ "$ALIVE" == "000000" ]; then

echo "'${WEB_URL[i]}' can not be open,please check!" | mail -s "Website Notification to ${WEB_URL[i]}" yourname@example.com

echo "failed"

else

echo "'${WEB_URL[i]}' is OK!"

}

---------------------------------------------------------------------

声明: 本文采用 CC BY-NC-SA 3.0 协议进行授权

转载请注明来源：DevOps技术分享

本文链接地址：http://www.showerlee.com/archives/1187

[SHELL] LINUX流量监控脚本

showerlee — Wed, 26 Feb 2014 05:12:30 +0000

最近比较忙,好久没更新博客了,今天刚好不忙写了一个流量监控脚本.

测试在centos下已通过,有需要的朋友可以试试,有BUG或者需要添加其他功能话可以给我留言.

# vi /etc/rc.d/traffic_monitor.sh

----------------------------------------------

#!/bin/bash

PATH=/bin:/usr/bin:/sbin:/usr/sbin:/usr/local/bin:/usr/local/sbin;

export PATH

function traffic_monitor {

# 系统版本

OS_NAME=$(sed -n '1p' /etc/issue)

# 网口名

eth=$1

#判断网卡存在与否,不存在则退出

if [ ! -d /sys/class/net/$eth ];then

echo -e "Network-Interface Not Found"

echo -e "You system have network-interface:\n`ls /sys/class/net`"

exit 5

while [ "1" ]

# 状态

STATUS="fine"

# 获取当前时刻网口接收与发送的流量

RXpre=$(cat /proc/net/dev | grep $eth | tr : " " | awk '{print $2}')

TXpre=$(cat /proc/net/dev | grep $eth | tr : " " | awk '{print $10}')

# 获取1秒后网口接收与发送的流量

sleep 1

RXnext=$(cat /proc/net/dev | grep $eth | tr : " " | awk '{print $2}')

TXnext=$(cat /proc/net/dev | grep $eth | tr : " " | awk '{print $10}')

clear

# 获取这1秒钟实际的进出流量

RX=$((${RXnext}-${RXpre}))

TX=$((${TXnext}-${TXpre}))

# 判断接收流量如果大于MB数量级则显示MB单位,否则显示KB数量级

if [[ $RX -lt 1024 ]];then

RX="${RX}B/s"

elif [[ $RX -gt 1048576 ]];then

RX=$(echo $RX | awk '{print $1/1048576 "MB/s"}')

$STATUS="busy"

else

RX=$(echo $RX | awk '{print $1/1024 "KB/s"}')

# 判断发送流量如果大于MB数量级则显示MB单位,否则显示KB数量级

if [[ $TX -lt 1024 ]];then

TX="${TX}B/s"

elif [[ $TX -gt 1048576 ]];then

TX=$(echo $TX | awk '{print $1/1048576 "MB/s"}')

else

TX=$(echo $TX | awk '{print $1/1024 "KB/s"}')

# 打印信息

echo -e "==================================="

echo -e "Welcome to Traffic_Monitor stage"

echo -e "version 1.0"

echo -e "Since 2014.2.26"

echo -e "Created by showerlee"

echo -e "BLOG: http://www.showerlee.com"

echo -e "==================================="

echo -e "System: $OS_NAME"

echo -e "Date: `date +%F`"

echo -e "Time: `date +%k:%M:%S`"

echo -e "Port: $1"

echo -e "Status: $STATUS"

echo -e " \t RX \tTX"

echo "------------------------------"

# 打印实时流量

echo -e "$eth \t $RX $TX "

echo "------------------------------"

# 退出信息

echo -e "Press 'Ctrl+C' to exit"

done

}

# 判断执行参数

if [[ -n "$1" ]];then

# 执行函数

traffic_monitor $1

else

echo -e "None parameter,please add system netport after run the script! \nExample: 'sh traffic_monitor eth0'"

----------------------------------------------

# sh traffic_monitor.sh eth0

如图:

声明: 本文采用 CC BY-NC-SA 3.0 协议进行授权

转载请注明来源：DevOps技术分享

本文链接地址：http://www.showerlee.com/archives/1099

[SHELL] LNMP一键安装脚本设计(v1.0)

showerlee — Mon, 02 Dec 2013 10:22:49 +0000

周末奋战了2天,终于把LNMP的centos和ubuntu双系统的一键安装脚本搞定,晚上可以好好休息休息了.

本版本的测试环境为Ubuntu server 12.10和Centos6.3的x86和x64

欢迎前来测试...

程序下载地址:

Onekey_LNMP_v1.0: http://www.showerlee.com/down/Onekey_lnmp_v1.0.zip

以下为部分脚本内容:

# cat install_lamp.sh

----------------------------------------------------

#!/bin/bash

PATH=/bin:/usr/bin:/sbin:/usr/sbin:/usr/local/bin:/usr/local/sbin;

export PATH

# LAMP目录

DEFAULT_DIR=$(pwd)

LOG_DIR=$(pwd)/log

INIT_DIR=/etc/init.d

MYSQL_DIR=/usr/local/mysql

NGINX_DIR=/usr/local/nginx

PHP_DIR=/usr/local/php5

. lib/check_env.sh

. lib/mysql.sh

. lib/nginx.sh

. lib/php.sh

echo "=================================================================

Welcome to Onekey LNMP installation,created by showerlee.

Version:1.0

QQ:381362772

BLOG:http://www.showerlee.com

Since 2013.12.1

==================================================================

Select option for your choice.

1 install all service(nginx + php + mysql)

2 install nginx+php

3 install nginx

4 install mysql

5 quit"

sleep 0.1

read -p "Please Input 1,2,3,4,5: " SERVER_ID

if [[ $SERVER_ID == 1 ]]; then

check_env_ins

mysql_ins

nginx_ins

php_ins

elif [[ $SERVER_ID == 2 ]]; then

check_env_ins

nginx_ins

php_ins

elif [[ $SERVER_ID == 3 ]]; then

check_env_ins

nginx_ins

elif [[ $SERVER_ID == 4 ]]; then

check_env_ins

mysql_ins

else

exit

-----------------------------------------

# cat lib/check_env.sh

----------------------------------------------------

# check the system environment

function check_env_ins {

local IN_LOG=$LOG_DIR/check_env_install-$(date +%F).log

echo "check the system environment..."

sleep 1

# 判断是否为root用户

if [ $UID != 0 ]; then

echo "You must be root to run the install script."

exit 0

# 安装开发包(使用默认CENTOS更新源):

echo "Install the Dependency package..."

sleep 1

OS_NAME=$(sed -n '1p' /etc/issue |awk '{print $1}')

if [ $OS_NAME == 'CentOS' ]; then

yum -y install lsof wget gcc gcc-c++ ncurses ncurses-devel cmake \

make perl bison openssl openssl-devel pcre-devel gcc* libxml2 \

libxml2-devel curl-devel libjpeg* libpng* freetype* zlib-devel

elif [ $OS_NAME == 'Ubuntu' ]; then

apt-get update

apt-get install -y cmake gcc g++ make autoconf libltdl-dev \

libgd2-xpm-dev libfreetype6 libfreetype6-dev libxml2-dev \

libjpeg-dev libpng12-dev libcurl4-openssl-dev libssl-dev \

patch libmcrypt-dev libmhash-dev libncurses5-dev openssl \

libreadline-dev bzip2 libcap-dev ntpdate diffutils \

exim4 iptables unzip sudo libpcre3 libpcre3-dev

else

echo "unknown system,quit..."

exit 0

# 关闭相关服务和SELINUX

echo "Stop useless service..."

sleep 1

if [ $OS_NAME == 'CentOS' ]; then

iptables -F >> $IN_LOG 2>&1

service iptables save 2>/dev/null

setenforce 0 >> $IN_LOG 2>&1

sed -i '/SELINUX/s/enforcing/disabled/g' /etc/selinux/config >> $IN_LOG 2>&1

chkconfig httpd off >> $IN_LOG 2>&1

chkconfig mysql off >> $IN_LOG 2>&1

service httpd stop >> $IN_LOG 2>&1

service mysql stop >> $IN_LOG 2>&1

sleep 1

elif [ $OS_NAME == 'Ubuntu' ]; then

iptables -F >> $IN_LOG 2>&1

iptables-save >> $IN_LOG 2>&1

update-rc.d -f nginx remove >> $IN_LOG 2>&1

update-rc.d -f mysql remove >> $IN_LOG 2>&1

$INIT_DIR/nginx stop >> $IN_LOG 2>&1

$INIT_DIR/mysql stop >> $IN_LOG 2>&1

else

echo "unknown system,quit..."

exit 0

# 判断能否访问公网

echo 8.8.8.8 >> /etc/resolv.conf >> $IN_LOG 2>&1

echo "Check your Networking..."

NET_ALIVE=$(ping 8.8.8.8 -c 5 |grep 'received'|awk 'BEGIN {FS=","} {print $2}'|awk '{print $1}')

if [ $NET_ALIVE == 0 ]; then

echo "Network is not active,please check your network configuration!"

exit 0

else

echo "Network is active,continue.."

sleep 1

# 同步时间

echo "synchronize time..."

ntpdate tiger.sina.com.cn >> $IN_LOG 2>&1

hwclock -w

echo "finish check..."

sleep 1

}

--------------------------------------------

# cat lib/nginx.sh

----------------------------------------------------

# nginx install function

function nginx_ins {

local IN_LOG=$LOG_DIR/nginx_install-$(date +%F).log

echo "Install the Nginx service..."

sleep 1

# 安装前的初始配置工作：

echo "The initial configuration before installation..."

sleep 1

# 添加nginx用户和用户组

groupadd nginx >> $IN_LOG 2>&1

useradd -g nginx -s /bin/false -M nginx >> $IN_LOG 2>&1

# nginx安装

echo "make install nginx package..."

sleep 1

cd $DEFAULT_DIR/src

tar -zxvf nginx-1.4.1.tar.gz >> $IN_LOG 2>&1

cd nginx-1.4.1

./configure --prefix=$NGINX_DIR --pid-path=/var/run/nginx.pid --lock-path=/var/lock/nginx.lock --user=nginx --group=nginx --with-http_ssl_module --with-http_dav_module --with-http_flv_module --with-http_realip_module --with-http_gzip_static_module --with-http_stub_status_module --with-mail --with-mail_ssl_module --with-debug --http-client-body-temp-path=/var/tmp/nginx/client --http-proxy-temp-path=/var/tmp/nginx/proxy --http-fastcgi-temp-path=/var/tmp/nginx/fastcgi --http-uwsgi-temp-path=/var/tmp/nginx/uwsgi --http-scgi-temp-path=/var/tmp/nginx/scgi >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

make >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

make install >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

else

echo "compilation finish..."

# 判断目录是否创建:

if [ ! -d $NGINX_DIR ];then

echo "$NGINX_DIR is not exist,stop..."

exit 0

# nginx配置项：

echo "configuration after the installation...."

sleep 1

# 创建缓存目录：

mkdir -p /var/tmp/nginx/client >> $IN_LOG 2>&1

OS_NAME=$(sed -n '1p' /etc/issue |awk '{print $1}')

if [ $OS_NAME == 'CentOS' ]; then

# 创建nginx启动脚本

[ -e $INIT_DIR/nginx ] && mv $INIT_DIR/nginx $INIT_DIR/nginx.old >> $IN_LOG 2>&1

cd $DEFAULT_DIR

cp conf/nginx $INIT_DIR/ >> $IN_LOG 2>&1

chmod 755 $INIT_DIR/nginx >> $IN_LOG 2>&1

chkconfig --add nginx >> $IN_LOG 2>&1

# 启动nginx并设置开机启动

echo "start nginx service..."

sleep 1

service nginx start >> $IN_LOG 2>&1

chkconfig nginx on >> $IN_LOG 2>&1

elif [ $OS_NAME == 'Ubuntu' ]; then

# 创建nginx启动脚本

cd $DEFAULT_DIR

cp conf/nginx_ubuntu $INIT_DIR/nginx >> $IN_LOG 2>&1

chmod 755 $INIT_DIR/nginx >> $IN_LOG 2>&1

update-rc.d -f nginx defaults >> $IN_LOG 2>&1

# 启动nginx并设置开机启动

echo "start nginx service..."

sleep 1

$INIT_DIR/nginx start >> $IN_LOG 2>&1

else

echo "unknown system,quit..."

exit 0

# 设置环境变量

echo 'PATH=$PATH:/usr/local/nginx/sbin;export PATH' >> /etc/profile

source /etc/profile >> $IN_LOG 2>&1

# 判断服务是否启动

PORT_80=$(lsof -i:80|wc -l)

if [ $PORT_80 == 0 ]; then

echo "Nginx service is not active,please check your configure!"

exit 0

else

echo "Congratulation,Nginx service has been installed correctly!"

}

-------------------------------------------------

# cat lib/mysql.sh

----------------------------------------------------

# mysql install function

function mysql_ins {

local IN_LOG=$LOG_DIR/mysql_install-$(date +%F).log

echo "Install the MySQL service..."

sleep 1

# 安装前的初始配置工作：

echo "The initial configuration before installation..."

sleep 1

mkdir -p $MYSQL_DIR >> $IN_LOG 2>&1

useradd -d $MYSQL_DIR mysql >> $IN_LOG 2>&1

mkdir -p $MYSQL_DIR/data >> $IN_LOG 2>&1

mkdir -p $MYSQL_DIR/log >> $IN_LOG 2>&1

chown -R mysql:mysql $MYSQL_DIR/data/ >> $IN_LOG 2>&1

chown -R mysql:mysql $MYSQL_DIR/log/ >> $IN_LOG 2>&1

chmod 750 $MYSQL_DIR/data >> $IN_LOG 2>&1

chmod 750 $MYSQL_DIR/log >> $IN_LOG 2>&1

# 解包编译安装:

echo "make install the MySQL package..."

sleep 1

cd $DEFAULT_DIR

cd src/

tar -zxvf mysql-5.6.13.tar.gz >> $IN_LOG 2>&1

cd mysql-5.6.13

cmake -DCMAKE_INSTALL_PREFIX=$MYSQL_DIR \

-DMYSQL_UNIX_ADDR=/tmp/mysql.sock \

-DDEFAULT_CHARSET=gbk \

-DDEFAULT_COLLATION=gbk_chinese_ci \

-DEXTRA_CHARSETS=all \

-DWITH_MYISAM_STORAGE_ENGINE=1 \

-DWITH_INNOBASE_STORAGE_ENGINE=1 \

-DWITH_ARCHIVE_STORAGE_ENGINE=1 \

-DWITH_BLACKHOLE_STORAGE_ENGINE=1 \

-DWITH_MEMORY_STORAGE_ENGINE=1 \

-DWITH_FEDERATED_STORAGE_ENGINE=1 \

-DWITH_READLINE=1 \

-DENABLED_LOCAL_INFILE=1 \

-DMYSQL_DATADIR=$MYSQL_DIR/data \

-DMYSQL_USER=mysql \

-DMYSQL_TCP_PORT=3306 \

-DSYSCONFDIR=/etc \

-DWITH_SSL=yes >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

make >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

make install >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

else

echo "compilation finish..."

# 判断目录是否创建:

if [ ! -d $MYSQL_DIR ];then

echo "$MYSQL_DIR is not exist,stop..."

exit 0

# mysql配置项：

echo "configuration after the installation...."

sleep 1

[ -e /etc/my.cnf ] && rm -rf /etc/my.cnf >> $IN_LOG 2>&1

cd $DEFAULT_DIR

cp conf/my.cnf /etc/my.cnf >> $IN_LOG 2>&1

# 将mysql的库文件路径加入系统的库文件搜索路径中

ln -s $MYSQL_DIR/lib/mysql /usr/lib/mysql >> $IN_LOG 2>&1

# 输出mysql的头文件到系统头文件

ln -s $MYSQL_DIR/include/mysql /usr/include/mysql >> $IN_LOG 2>&1

# 进入安装路径,初始化配置脚本

echo "Initialize the configuration of the MySQL..."

sleep 1

cd $MYSQL_DIR

scripts/mysql_install_db --user=mysql --datadir=$MYSQL_DIR/data >> $IN_LOG 2>&1

OS_NAME=$(sed -n '1p' /etc/issue |awk '{print $1}')

if [ $OS_NAME == 'CentOS' ]; then

# 复制mysql启动脚本到系统服务目录

[ -e $INIT_DIR/mysqld ] && mv $INIT_DIR/mysqld $INIT_DIR/mysqld.old >> $IN_LOG 2>&1

cp $MYSQL_DIR/support-files/mysql.server $INIT_DIR/mysqld >> $IN_LOG 2>&1

# 系统启动项相关配置

chkconfig --add mysqld >> $IN_LOG 2>&1

chkconfig --level 35 mysqld on >> $IN_LOG 2>&1

# 启动mysql

service mysqld start >> $IN_LOG 2>&1

elif [ $OS_NAME == 'Ubuntu' ]; then

# 复制mysql启动脚本到系统服务目录

update-rc.d -f mysqld remove >> $IN_LOG 2>&1

[ -e $INIT_DIR/mysqld ] && mv $INIT_DIR/mysqld $INIT_DIR/mysqld.old >> $IN_LOG 2>&1

cp $MYSQL_DIR/support-files/mysql.server $INIT_DIR/mysqld >> $IN_LOG 2>&1

# 系统启动项相关配置

chmod 755 $INIT_DIR/mysqld >> $IN_LOG 2>&1

update-rc.d -f mysqld defaults >> $IN_LOG 2>&1

# 启动mysql

$INIT_DIR/mysqld start >> $IN_LOG 2>&1

else

echo "unknown system,quit..."

exit 0

# 配置权限

echo "Configure MySQL authority..."

sleep 1

$MYSQL_DIR/bin/mysqladmin -u root password 123456 >> $IN_LOG 2>&1

#给root用户非本地链接所有权限,并改密码和赋予其给其他人下发权限.

$MYSQL_DIR/bin/mysql -u root -p123456 -e "grant all privileges on *.* to root@'%' identified by '123456' with grant option;" >> $IN_LOG 2>&1

$MYSQL_DIR/bin/mysql -u root -p123456 -e "grant all privileges on *.* to root@'localhost' identified by '123456' with grant option;" >> $IN_LOG 2>&1

# 设置环境变量

echo 'PATH=$PATH:/usr/local/mysql/bin;export PATH' >> /etc/profile

source /etc/profile >> $IN_LOG 2>&1

# 判断服务是否启动

PORT_3306=$(lsof -i:3306|wc -l)

if [ $PORT_3306 == 0 ]; then

echo "MySQL service is not active,please check your configure!"

exit 0

else

echo "Congratulation,MySQL service has been installed correctly!"

}

---------------------------------------------

# cat lib/php.sh

----------------------------------------------------

# php install function

function php_ins {

local IN_LOG=$LOG_DIR/php_install-$(date +%F).log

echo "Install the PHP module for nginx..."

sleep 1

# 安装前的初始配置工作：

echo "The initial configuration before installation..."

sleep 1

# 添加php用户组

groupadd nobody >> $IN_LOG 2>&1

# php安装

cd $DEFAULT_DIR/src

tar -jxvf php-5.4.13.tar.bz2 >> $IN_LOG 2>&1

cd php-5.4.13

# 此处编译安装了我们项目经常用到的PHP模块,如有其它需要可以自定义添加.

./configure --prefix=$PHP_DIR --enable-fastcgi --enable-fpm --with-libxml-dir=/usr/local/lib --with-zlib-dir=/usr/local/lib --with-mysql=$MYSQL_DIR --with-mysqli=$MYSQL_DIR/bin/mysql_config --with-gd --enable-soap --enable-sockets --enable-xml --enable-mbstring --with-png-dir=/usr/local --with-jpeg-dir=/usr/local --with-curl=/usr/lib --with-freetype-dir=/usr/include/freetype2/freetype/ --enable-bcmath --enable-zip --enable-maintainer-zts >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

make >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

make install >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

else

echo "compilation finish..."

# 判断目录是否创建:

if [ ! -d $PHP_DIR ];then

echo "$PHP_DIR is not exist,stop..."

exit 0

# PHP配置项：

echo "configuration after the installation...."

sleep 1

cd $DEFAULT_DIR/src/php-5.4.13

cp php.ini-development $PHP_DIR/lib/php.ini

# 隐藏PHP版本信息：

# echo "expose_php = Off" >> $PHP_DIR/lib/php.ini

# 关闭警告及错误信息,爆路径:

echo "display_errors = Off" >> $PHP_DIR/lib/php.ini

# 调整时区,防止phpinfo()函数报错.

echo "date.timezone =PRC" >> $PHP_DIR/lib/php.ini

# 开启php错误日志并设置路径.

echo "log_errors = On" >> $PHP_DIR/lib/php.ini

echo "error_log = $NGINX_DIR/logs/php_error.log" >> $PHP_DIR/lib/php.ini

# 配置启动FastCGI进程：

cd $PHP_DIR/etc/

[ ! -e php-fpm.conf ] && cp php-fpm.conf.default php-fpm.conf

# 设置开机启动

# 注:ubuntu添加启动项需插入到 exit 0 前

if [ $OS_NAME == 'CentOS' ]; then

echo "$PHP_DIR/sbin/php-fpm" >> /etc/rc.local

elif [ $OS_NAME == 'Ubuntu' ]; then

sed -i "/^exit 0/ i\\$PHP_DIR\/sbin\/php-fpm" /etc/rc.local

else

echo "unknown system,quit..."

exit 0

# 配置nginx加载php-fpm

sed -i '$ i\ include \"\/usr\/local\/nginx\/conf\/vhosts\/\*.conf\"; ' $NGINX_DIR/conf/nginx.conf >> $IN_LOG 2>&1

mkdir -p $NGINX_DIR/conf/vhosts >> $IN_LOG 2>&1

mkdir -p $NGINX_DIR/html/127.0.0.1 >> $IN_LOG 2>&1

cd $DEFAULT_DIR

cp conf/default.conf $NGINX_DIR/conf/vhosts/ >> $IN_LOG 2>&1

cp conf/info.php $NGINX_DIR/html/127.0.0.1/ >> $IN_LOG 2>&1

# 重启nginx和php-fpm:

echo "restart nginx and php-fpm to load the php module..."

$INIT_DIR/nginx restart >> $IN_LOG 2>&1

sleep 1

killall php-fpm >> $IN_LOG 2>&1

$PHP_DIR/sbin/php-fpm >> $IN_LOG 2>&1

sleep 1

# 判断php-fpm服务是否启动

PORT_9000=$(lsof -i:9000|wc -l)

if [ $PORT_9000 == 0 ]; then

echo "php-fpm service is not active,please check your configure!"

exit 0

else

echo "php-fpm service start..."

# 判断PHP是否加载:

PHP_LOAD=$(curl --head http://127.0.0.1/info.php |grep PHP |wc -l)

if [ $PHP_LOAD == 0 ]; then

echo "PHP does not load,please check your configure!"

exit 0

else

echo "Congratulation,PHP module has been installed correctly!"

}

------------------------------------------

声明: 本文采用 CC BY-NC-SA 3.0 协议进行授权

转载请注明来源：DevOps技术分享

本文链接地址：http://www.showerlee.com/archives/1007

[SHELL] LAMP一键安装脚本设计(v2.1)

showerlee — Sat, 30 Nov 2013 14:14:43 +0000

这个周末刚好闲下来,终于把支持ubuntu的版本搞定,期间还算顺利.

本版本的测试环境为Ubuntu server 12.04.3 x86 & x64

在2.0版本基础上修复了一些已知BUG,有需要的朋友可以尝试在其他版本的centos和ubuntu系统版本上测试下,如有问题,请在此留言.

程序下载地址:

Onekey_LAMP_v2.1: http://www.showerlee.com/down/Onekey_lamp_v2.1.zip

以下为部分脚本内容:

# cat install_lamp.sh

----------------------------------------------------

#!/bin/bash

PATH=/bin:/usr/bin:/sbin:/usr/sbin:/usr/local/bin:/usr/local/sbin;

export PATH

# LAMP目录

DEFAULT_DIR=$(pwd)

LOG_DIR=$(pwd)/log

INIT_DIR=/etc/init.d

MYSQL_DIR=/usr/local/mysql

APACHE_DIR=/usr/local/apache2

PHP_DIR=/usr/local/php5

PCRE_DIR=/usr/local/pcre

. lib/check_env.sh

. lib/mysql.sh

. lib/apache.sh

. lib/php.sh

echo "=================================================================

Welcome to Onekey LAMP installation,created by showerlee.

Version:2.1

QQ:381362772

BLOG:http://www.showerlee.com

Since 2013.11.30

==================================================================

Select option for your choice.

1 install all service(apache + php + mysql)

2 install apache+php

3 install apache

4 install mysql

5 quit"

sleep 0.1

read -p "Please Input 1,2,3,4,5: " SERVER_ID

if [[ $SERVER_ID == 1 ]]; then

check_env_ins

mysql_ins

apache_ins

php_ins

elif [[ $SERVER_ID == 2 ]]; then

check_env_ins

apache_ins

php_ins

elif [[ $SERVER_ID == 3 ]]; then

check_env_ins

apache_ins

elif [[ $SERVER_ID == 4 ]]; then

check_env_ins

mysql_ins

else

exit

-------------------------------------------------------

# cat lib/check_env.sh

----------------------------------------------------

# check the system environment

function check_env_ins {

local IN_LOG=$LOG_DIR/check_env_install-$(date +%F).log

echo "check the system environment..."

sleep 1

# 判断是否为root用户

if [ $UID != 0 ]; then

echo "You must be root to run the install script."

exit 0

# 安装开发包(使用默认CENTOS更新源):

echo "Install the Dependency package..."

sleep 1

OS_NAME=$(sed -n '1p' /etc/issue |awk '{print $1}')

if [ $OS_NAME == 'CentOS' ]; then

yum -y install lsof wget gcc-c++ ncurses ncurses-devel cmake \

make perl bison openssl openssl-devel gcc* libxml2 \

libxml2-devel curl-devel libjpeg* libpng* freetype*

elif [ $OS_NAME == 'Ubuntu' ]; then

apt-get update

apt-get install -y cmake gcc g++ make autoconf libltdl-dev \

libgd2-xpm-dev libfreetype6 libfreetype6-dev libxml2-dev \

libjpeg-dev libpng12-dev libcurl4-openssl-dev libssl-dev \

patch libmcrypt-dev libmhash-dev libncurses5-dev \

libreadline-dev bzip2 libcap-dev ntpdate diffutils \

exim4 iptables unzip sudo

# 安装chkconfig

dpkg -i $DEFAULT_DIR/src/chkconfig_11.0-79.1-2_all.deb

ln -s /usr/lib/insserv/insserv /sbin/insserv >> $IN_LOG 2>&1

else

echo "unknown system,quit..."

exit 0

# 关闭相关服务和SELINUX

echo "Stop useless service..."

sleep 1

if [ $OS_NAME == 'CentOS' ]; then

iptables -F >> $IN_LOG 2>&1

service iptables save 2>/dev/null

setenforce 0 >> $IN_LOG 2>&1

sed -i '/SELINUX/s/enforcing/disabled/g' /etc/selinux/config >> $IN_LOG 2>&1

sleep 1

elif [ $OS_NAME == 'Ubuntu' ]; then

iptables -F >> $IN_LOG 2>&1

iptables-save >> $IN_LOG 2>&1

else

echo "unknown system,quit..."

exit 0

chkconfig httpd off 2>/dev/null

chkconfig mysql off 2>/dev/null

service httpd stop 2>/dev/null

service mysql stop 2>/dev/null

# 判断能否访问公网

echo 8.8.8.8 >> /etc/resolv.conf >> $IN_LOG 2>&1

echo "Check your Networking..."

NET_ALIVE=$(ping 8.8.8.8 -c 5 |grep 'received'|awk 'BEGIN {FS=","} {print $2}'|awk '{print $1}')

if [ $NET_ALIVE == 0 ]; then

echo "Network is not active,please check your network configuration!"

exit 0

else

echo "Network is active,continue.."

sleep 1

# 同步时间

echo "synchronize time..."

ntpdate tiger.sina.com.cn >> $IN_LOG 2>&1

hwclock -w

echo "finish check..."

sleep 1

}

----------------------------------------------------

# cat lib/apache.sh

----------------------------------------------------

# apache install function

function apache_ins {

local IN_LOG=$LOG_DIR/apache_install-$(date +%F).log

echo "Install the Apache service..."

sleep 1

# pcre依赖包安装

echo "install the dependency pcre package..."

sleep 1

cd $DEFAULT_DIR/src

tar -xzvf pcre-8.32.tar.gz >> $IN_LOG 2>&1

cd pcre-8.32

./configure --prefix=$PCRE_DIR >> $IN_LOG 2>&1

make >> $IN_LOG 2>&1

make install >> $IN_LOG 2>&1

# apache安装

echo "install apache package..."

sleep 1

# 注:httpd-2.4.3-deps.tar.bz2已集成APR，安装apache前检查pcre是否安装成功.

cd $DEFAULT_DIR/src

tar jxvf httpd-2.4.4.tar.bz2 >> $IN_LOG 2>&1

tar jxvf httpd-2.4.3-deps.tar.bz2 >> $IN_LOG 2>&1

cp -rf httpd-2.4.3/* httpd-2.4.4

cd httpd-2.4.4

./configure --prefix=$APACHE_DIR --enable-so --enable-rewrite \

-enable-ssl=static -with-ssl=/usr/local/ssl -enable-mods-shared=all \

--with-pcre=$PCRE_DIR/bin/pcre-config >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

make >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

make install >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

else

echo "compilation finish..."

# 判断目录是否创建:

if [ ! -d $APACHE_DIR ];then

echo "$APACHE_DIR is not exist,stop..."

exit 0

# mysql配置项：

echo "configuration after the installation...."

sleep 1

# 防止apache启动报错.

echo "ServerName localhost:80" >> $APACHE_DIR/conf/httpd.conf

# 设置开机启动

# 注:ubuntu添加启动项需插入到 exit 0 前

if [ $OS_NAME == 'CentOS' ]; then

echo "$APACHE_DIR/bin/apachectl start" >> /etc/rc.local

elif [ $OS_NAME == 'Ubuntu' ]; then

sed -i "/^exit 0/ i\\$APACHE_DIR\/bin\/apachectl start" /etc/rc.local

else

echo "unknown system,quit..."

exit 0

# 启动apache

echo "start apache httpd service..."

sleep 1

$APACHE_DIR/bin/apachectl start >> $IN_LOG 2>&1

# 设置环境变量

echo 'PATH=$PATH:/usr/local/apache2/bin;export PATH' >> /etc/profile

source /etc/profile >> $IN_LOG 2>&1

# 判断服务是否启动

PORT_80=$(lsof -i:80|wc -l)

if [ $PORT_80 == 0 ]; then

echo "Apache httpd service is not active,please check your configure!"

exit 0

else

echo "Congratulation,Apache httpd service has been installed correctly!"

}

----------------------------------------------------

# cat lib/mysql.sh

----------------------------------------------------

# mysql install function

function mysql_ins {

local IN_LOG=$LOG_DIR/mysql_install-$(date +%F).log

echo "Install the MySQL service..."

sleep 1

# 安装前的初始配置工作：

echo "The initial configuration before installation..."

sleep 1

mkdir -p $MYSQL_DIR >> $IN_LOG 2>&1

useradd -d $MYSQL_DIR mysql >> $IN_LOG 2>&1

mkdir -p $MYSQL_DIR/data >> $IN_LOG 2>&1

mkdir -p $MYSQL_DIR/log >> $IN_LOG 2>&1

chown -R mysql:mysql $MYSQL_DIR/data/ >> $IN_LOG 2>&1

chown -R mysql:mysql $MYSQL_DIR/log/ >> $IN_LOG 2>&1

chmod 750 $MYSQL_DIR/data >> $IN_LOG 2>&1

chmod 750 $MYSQL_DIR/log >> $IN_LOG 2>&1

# 解包编译安装:

echo "make install the MySQL package..."

sleep 1

cd $DEFAULT_DIR

cd src/

tar -zxvf mysql-5.6.13.tar.gz >> $IN_LOG 2>&1

cd mysql-5.6.13

cmake -DCMAKE_INSTALL_PREFIX=$MYSQL_DIR \

-DMYSQL_UNIX_ADDR=/tmp/mysql.sock \

-DDEFAULT_CHARSET=gbk \

-DDEFAULT_COLLATION=gbk_chinese_ci \

-DEXTRA_CHARSETS=all \

-DWITH_MYISAM_STORAGE_ENGINE=1 \

-DWITH_INNOBASE_STORAGE_ENGINE=1 \

-DWITH_ARCHIVE_STORAGE_ENGINE=1 \

-DWITH_BLACKHOLE_STORAGE_ENGINE=1 \

-DWITH_MEMORY_STORAGE_ENGINE=1 \

-DWITH_FEDERATED_STORAGE_ENGINE=1 \

-DWITH_READLINE=1 \

-DENABLED_LOCAL_INFILE=1 \

-DMYSQL_DATADIR=$MYSQL_DIR/data \

-DMYSQL_USER=mysql \

-DMYSQL_TCP_PORT=3306 \

-DSYSCONFDIR=/etc \

-DWITH_SSL=yes >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

make >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

make install >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

else

echo "compilation finish..."

# 判断目录是否创建:

if [ ! -d $MYSQL_DIR ];then

echo "$MYSQL_DIR is not exist,stop..."

exit 0

# mysql配置项：

echo "configuration after the installation...."

sleep 1

[ -e /etc/my.cnf ] && rm -rf /etc/my.cnf >> $IN_LOG 2>&1

cd $DEFAULT_DIR

cp conf/my.cnf /etc/my.cnf >> $IN_LOG 2>&1

# 将mysql的库文件路径加入系统的库文件搜索路径中

ln -s $MYSQL_DIR/lib/mysql /usr/lib/mysql >> $IN_LOG 2>&1

# 输出mysql的头文件到系统头文件

ln -s $MYSQL_DIR/include/mysql /usr/include/mysql >> $IN_LOG 2>&1

# 进入安装路径,初始化配置脚本

echo "Initialize the configuration of the MySQL..."

sleep 1

cd $MYSQL_DIR

scripts/mysql_install_db --user=mysql --datadir=$MYSQL_DIR/data >> $IN_LOG 2>&1

# 复制mysql启动脚本到系统服务目录

[ -e $INIT_DIR/mysqld ] && mv $INIT_DIR/mysqld $INIT_DIR/mysqld.old >> $IN_LOG 2>&1

cp $MYSQL_DIR/support-files/mysql.server $INIT_DIR/mysqld >> $IN_LOG 2>&1

# 系统启动项相关配置

chkconfig --add mysqld >> $IN_LOG 2>&1

chkconfig --level 35 mysqld on >> $IN_LOG 2>&1

# 启动mysql

service mysqld start >> $IN_LOG 2>&1

# 配置权限

echo "Configure MySQL authority..."

sleep 1

$MYSQL_DIR/bin/mysqladmin -u root password 123456 >> $IN_LOG 2>&1

#给root用户非本地链接所有权限,并改密码和赋予其给其他人下发权限.

$MYSQL_DIR/bin/mysql -u root -p123456 -e "grant all privileges on *.* to root@'%' identified by '123456' with grant option;" >> $IN_LOG 2>&1

$MYSQL_DIR/bin/mysql -u root -p123456 -e "grant all privileges on *.* to root@'localhost' identified by '123456' with grant option;" >> $IN_LOG 2>&1

# 设置环境变量

echo 'PATH=$PATH:/usr/local/mysql/bin;export PATH' >> /etc/profile

source /etc/profile >> $IN_LOG 2>&1

# 判断服务是否启动

PORT_3306=$(lsof -i:3306|wc -l)

if [ $PORT_3306 == 0 ]; then

echo "MySQL service is not active,please check your configure!"

exit 0

else

echo "Congratulation,MySQL service has been installed correctly!"

}

----------------------------------------------------

# cat lib/php.sh

----------------------------------------------------

# php install function

function php_ins {

local IN_LOG=$LOG_DIR/php_install-$(date +%F).log

echo "Install the PHP module for apache..."

sleep 1

cd $DEFAULT_DIR/src

tar -jxvf php-5.4.13.tar.bz2 >> $IN_LOG 2>&1

cd php-5.4.13

# 此处编译安装了我们项目经常用到的PHP模块,如有其它需要可以自定义添加.

./configure --prefix=$PHP_DIR --with-apxs2=$APACHE_DIR/bin/apxs \

--with-libxml-dir=/usr/local/lib --with-zlib-dir=/usr/local/lib \

--with-mysql=$MYSQL_DIR --with-mysqli=$MYSQL_DIR/bin/mysql_config \

--with-gd --enable-soap --enable-sockets --enable-xml --enable-mbstring \

--with-png-dir=/usr/local --with-jpeg-dir=/usr/local --with-curl=/usr/lib \

--with-freetype-dir=/usr/include/freetype2/freetype/ --enable-bcmath \

--enable-calendar --enable-zip --enable-maintainer-zts >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

make >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

make install >> $IN_LOG 2>&1

if [[ $? != 0 ]]; then

echo "error in the compilation,stop.."

exit 0

else

echo "compilation finish..."

# 判断目录是否创建:

if [ ! -d $PHP_DIR ];then

echo "$PHP_DIR is not exist,stop..."

exit 0

# PHP配置项：

echo "configuration after the installation...."

sleep 1

cp php.ini-development $PHP_DIR/lib/php.ini

echo "AddType application/x-httpd-php .php" >> $APACHE_DIR/conf/httpd.conf

sed -i '/DirectoryIndex index.html/s/$/ &index.php/g' $APACHE_DIR/conf/httpd.conf

# 隐藏PHP版本信息：

# echo "expose_php = Off" >> $PHP_DIR/lib/php.ini

# 关闭警告及错误信息,爆路径:

echo "display_errors = Off" >> $PHP_DIR/lib/php.ini

# 调整时区,防止phpinfo()函数报错.

echo "date.timezone =PRC" >> $PHP_DIR/lib/php.ini

# 开启php错误日志并设置路径.

echo "log_errors = On" >> $PHP_DIR/lib/php.ini

echo "error_log = $APACHE_DIR/logs/php_error.log" >> $PHP_DIR/lib/php.ini

cd $DEFAULT_DIR

cp conf/info.php $APACHE_DIR/htdocs >> $IN_LOG 2>&1

# 重启apache:

echo "restart apache to load the php module..."

$APACHE_DIR/bin/apachectl stop >> $IN_LOG 2>&1

$APACHE_DIR/bin/apachectl start >> $IN_LOG 2>&1

# 判断PHP是否加载:

PHP_LOAD=$(curl --head http://localhost/info.php |grep PHP |wc -l)

if [ $PHP_LOAD == 0 ]; then

echo "PHP does not load,please check your configure!"

exit 0

else

echo "Congratulation,PHP module has been installed correctly!"

}

----------------------------------------------------

声明: 本文采用 CC BY-NC-SA 3.0 协议进行授权

转载请注明来源：DevOps技术分享

本文链接地址：http://www.showerlee.com/archives/1005

[SHELL] LAMP一键安装脚本设计(v1,v2)

showerlee — Fri, 29 Nov 2013 07:14:33 +0000

最近一直在学习PYTHON,抽空在闲暇时间利用SHELL编写了一个LAMP一键安装脚本,目前分v1无人值守版本和v2用户自定义版本,下面把脚本的一些设计思路和部分SHELL脚本写了下来,供大家参考.

目前版本的测试环境为CentOS6.3 x86和x64版本,后期会针对ubuntu系统环境以及LNMP架构进行更新.

开始正题:

v1版本很简单,项目下分conf和src目录,分别放置相关配置文件和LAMP编译包,以及4个shell安装脚本,无人值守情况下,运行相应脚本文件即可完成安装.

如图:

v2版本相对比较系统:

conf目录放置配置文件

lib目录放置安装具体服务的SHELL脚本(apache,mysql,php等),脚本内为相应的方法,供主脚本调用

log目录放置安装日志

src目录放置LAMP具体编译包

install_lamp.sh脚本为主配置脚本,运行后会提供给用户可选择安装界面,供用户自定义安装

如图:

以下介绍v2版本的具体脚本内容,具体安装包下载地址如下:

Onekey_LAMP_v1: http://www.showerlee.com/down/lamp_v1.zip

Onekey_LAMP_v2: http://www.showerlee.com/down/lamp_v2.zip

注:系统编码使用UTF-8,加载mysql与apache的环境变量

apache编译包版本为2.4.4,DocumentRoot路径/usr/local/apache2/htdocs,加载https加密通道.

mysql编译包版本为5.6.13,库文件路径/usr/local/mysql/data.

mysql安装初始账户密码为root/123456

php编译包版本为5.4.13,默认加载了笔者线上常用的模块

# cat install_lamp.sh

----------------------------------------------------

#!/bin/bash

PATH=/bin:/usr/bin:/sbin:/usr/sbin::/usr/local/bin:/usr/local/sbin;

export PATH

# LAMP目录

DEFAULT_DIR=$(pwd)

LOG_DIR=$(pwd)/log

MYSQL_DIR=/usr/local/mysql

APACHE_DIR=/usr/local/apache2

PHP_DIR=/usr/local/php5

PCRE_DIR=/usr/local/pcre

. lib/check_env.sh

. lib/mysql.sh

. lib/apache.sh

. lib/php.sh

echo "Welcome to Onekey LAMP installation,select option for your choice.

1 install all service(apache + php + mysql)

2 install apache+php

3 install apache

4 install mysql

5 quit"

sleep 0.1

read -p "Please Input 1,2,3,4,5: " SERVER_ID

if [[ $SERVER_ID == 1 ]]; then

check_env_ins

mysql_ins

apache_ins

php_ins

elif [[ $SERVER_ID == 2 ]]; then

check_env_ins

apache_ins

php_ins

elif [[ $SERVER_ID == 3 ]]; then

check_env_ins

apache_ins

elif [[ $SERVER_ID == 4 ]]; then

check_env_ins

mysql_ins

else

exit

-------------------------------------------------------

# cat lib/check_env.sh

----------------------------------------------------

# check the system environment

function check_env_ins {

local IN_LOG=$LOG_DIR/check_env_install-$(date +%F).log

echo "check the system environment..."

sleep 1

# 关闭相关服务和SELINUX

echo "Stop useless service..."

sleep 1

chkconfig httpd off 2>/dev/null

chkconfig mysql off 2>/dev/null

service apache2 stop 2>/dev/null

service mysql stop 2>/dev/null

iptables -F >> $IN_LOG 2>&1

service iptables save 2>/dev/null

setenforce 0 >> $IN_LOG 2>&1

sed -i '/SELINUX/s/enforcing/disabled/g' /etc/selinux/config >> $IN_LOG 2>&1

sleep 1

# 判断能否访问公网

echo 8.8.8.8 >> /etc/resolv.conf >> $IN_LOG 2>&1

echo "Check your Networking..."

NET_ALIVE=$(ping 8.8.8.8 -c 5 |grep 'received'|awk 'BEGIN {FS=","} {print $2}'|awk '{print $1}')

if [ $NET_ALIVE == 0 ]; then

echo "Network is not active,please check your network configuration!"

exit 0

else

echo "Network is active,continue.."

sleep 1

# 安装开发包(使用默认CENTOS更新源):

echo "Install the Dependency package..."

sleep 1

yum -y install lsof wget gcc-c++ ncurses ncurses-devel cmake \

make perl bison openssl openssl-devel gcc* libxml2 \

libxml2-devel curl-devel libjpeg* libpng* freetype*

# 同步时间

echo "synchronization time..."

ntpdate tiger.sina.com.cn >> $IN_LOG 2>&1

hwclock -w

sleep 1

}

----------------------------------------------------

# cat lib/apache.sh

----------------------------------------------------

# apache install function

function apache_ins {

local IN_LOG=$LOG_DIR/apache_install-$(date +%F).log

echo "Install the Apache service..."

sleep 1

# pcre依赖包安装

echo "install the dependency pcre package..."

sleep 1

cd $DEFAULT_DIR/src

tar -xzvf pcre-8.32.tar.gz >> $IN_LOG 2>&1

cd pcre-8.32

./configure --prefix=$PCRE_DIR >> $IN_LOG 2>&1

make >> $IN_LOG 2>&1

make install >> $IN_LOG 2>&1

# apache安装

echo "install apache package..."

sleep 1

# 注:httpd-2.4.3-deps.tar.bz2已集成APR，安装apache前检查pcre是否安装成功.

cd $DEFAULT_DIR/src

tar jxvf httpd-2.4.4.tar.bz2 >> $IN_LOG 2>&1

tar jxvf httpd-2.4.3-deps.tar.bz2 >> $IN_LOG 2>&1

cp -rf httpd-2.4.3/* httpd-2.4.4

cd httpd-2.4.4

./configure --prefix=$APACHE_DIR --enable-so --enable-rewrite \

-enable-ssl=static -with-ssl=/usr/local/ssl -enable-mods-shared=all \

--with-pcre=$PCRE_DIR/bin/pcre-config >> $IN_LOG 2>&1

make >> $IN_LOG 2>&1

make install >> $IN_LOG 2>&1

# 判断目录是否创建:

if [ ! -d $APACHE_DIR ];then

echo "$APACHE_DIR is not exist,stop..."

exit 0

# mysql配置项：

echo "configuration after the installation...."

sleep 1

# 防止apache启动报错.

echo "ServerName localhost:80" >> $APACHE_DIR/conf/httpd.conf

# 设置开机启动

echo "$APACHE_DIR/bin/apachectl start" >> /etc/rc.local

# 启动apache

echo "start apache httpd service..."

sleep 1

$APACHE_DIR/bin/apachectl start >> $IN_LOG 2>&1

# 设置环境变量

echo "PATH=$PATH:$APACHE_DIR/bin;export PATH" >> /etc/profile

source /etc/profile

# 判断服务是否启动

PORT_80=$(lsof -i:80|wc -l)

if [ $PORT_80 == 0 ]; then

echo "Apache httpd service is not active,please check your configure!"

exit 0

else

echo "Congratulation,Apache httpd service has installed correctly!"

}

----------------------------------------------------

# cat lib/mysql.sh

----------------------------------------------------

# mysql install function

function mysql_ins {

local IN_LOG=$LOG_DIR/mysql_install-$(date +%F).log

echo "Install the MySQL service..."

sleep 1

# 安装前的初始配置工作：

echo "The initial configuration before installation..."

sleep 1

mkdir -p $MYSQL_DIR >> $IN_LOG 2>&1

useradd -d $MYSQL_DIR mysql >> $IN_LOG 2>&1

mkdir -p $MYSQL_DIR/data >> $IN_LOG 2>&1

mkdir -p $MYSQL_DIR/log >> $IN_LOG 2>&1

chown -R mysql:mysql $MYSQL_DIR/data/ >> $IN_LOG 2>&1

chown -R mysql:mysql $MYSQL_DIR/log/ >> $IN_LOG 2>&1

chmod 750 $MYSQL_DIR/data >> $IN_LOG 2>&1

chmod 750 $MYSQL_DIR/log >> $IN_LOG 2>&1

# 解包编译安装:

echo "make install the MySQL package..."

sleep 1

cd $DEFAULT_DIR

cd src/

tar -zxvf mysql-5.6.13.tar.gz >> $IN_LOG 2>&1

cd mysql-5.6.13

cmake -DCMAKE_INSTALL_PREFIX=$MYSQL_DIR \

-DMYSQL_UNIX_ADDR=/tmp/mysql.sock \

-DDEFAULT_CHARSET=gbk \

-DDEFAULT_COLLATION=gbk_chinese_ci \

-DEXTRA_CHARSETS=all \

-DWITH_MYISAM_STORAGE_ENGINE=1 \

-DWITH_INNOBASE_STORAGE_ENGINE=1 \

-DWITH_ARCHIVE_STORAGE_ENGINE=1 \

-DWITH_BLACKHOLE_STORAGE_ENGINE=1 \

-DWITH_MEMORY_STORAGE_ENGINE=1 \

-DWITH_FEDERATED_STORAGE_ENGINE=1 \

-DWITH_READLINE=1 \

-DENABLED_LOCAL_INFILE=1 \

-DMYSQL_DATADIR=$MYSQL_DIR/data \

-DMYSQL_USER=mysql \

-DMYSQL_TCP_PORT=3306 \

-DSYSCONFDIR=/etc \

-DWITH_SSL=yes >> $IN_LOG 2>&1

make >> $IN_LOG 2>&1

make install >> $IN_LOG 2>&1

# 判断目录是否创建:

if [ ! -d $MYSQL_DIR ];then

echo "$MYSQL_DIR is not exist,stop..."

exit 0

# mysql配置项：

echo "configuration after the installation...."

sleep 1

[ -e /etc/my.cnf ] && rm -rf /etc/my.cnf >> $IN_LOG 2>&1

cd $DEFAULT_DIR

cp conf/my.cnf /etc/my.cnf >> $IN_LOG 2>&1

# 将mysql的库文件路径加入系统的库文件搜索路径中

ln -s $MYSQL_DIR/lib/mysql /usr/lib/mysql >> $IN_LOG 2>&1

# 输出mysql的头文件到系统头文件

ln -s $MYSQL_DIR/include/mysql /usr/include/mysql >> $IN_LOG 2>&1

# 进入安装路径,初始化配置脚本

echo "Initialize the configuration of the MySQL..."

sleep 1

cd $MYSQL_DIR

scripts/mysql_install_db --user=mysql --datadir=$MYSQL_DIR/data >> $IN_LOG 2>&1

# 复制mysql启动脚本到系统服务目录

cp $MYSQL_DIR/support-files/mysql.server /etc/init.d/mysqld >> $IN_LOG 2>&1

# 系统启动项相关配置

chkconfig --add mysqld >> $IN_LOG 2>&1

chkconfig --level 35 mysqld on >> $IN_LOG 2>&1

# 启动mysql

service mysqld start >> $IN_LOG 2>&1

# 配置权限

echo "Configure MySQL authority..."

sleep 1

$MYSQL_DIR/bin/mysqladmin -u root password 123456 >> $IN_LOG 2>&1

#给root用户非本地链接所有权限,并改密码和赋予其给其他人下发权限.

$MYSQL_DIR/bin/mysql -u root -p123456 -e "grant all privileges on *.* to root@'%' identified by '123456' with grant option;" >> $IN_LOG 2>&1

$MYSQL_DIR/bin/mysql -u root -p123456 -e "grant all privileges on *.* to root@'localhost' identified by '123456' with grant option;" >> $IN_LOG 2>&1

# 设置环境变量

echo "PATH=$PATH:$MYSQL_DIR/bin;export PATH" >> /etc/profile

source /etc/profile

# 判断服务是否启动

PORT_3306=$(lsof -i:3306|wc -l)

if [ $PORT_3306 == 0 ]; then

echo "MySQL service is not active,please check your configure!"

exit 0

else

echo "Congratulation,MySQL service has installed correctly!"

}

----------------------------------------------------

# cat lib/php.sh

----------------------------------------------------

# php install function

function php_ins {

local IN_LOG=$LOG_DIR/php_install-$(date +%F).log

echo "Install the PHP module for apache..."

sleep 1

cd $DEFAULT_DIR/src

tar -jxvf php-5.4.13.tar.bz2 >> $IN_LOG 2>&1

cd php-5.4.13

# 此处编译安装了我们项目经常用到的PHP模块,如有其它需要可以自定义添加.

./configure --prefix=$PHP_DIR --with-apxs2=$APACHE_DIR/bin/apxs \

--with-libxml-dir=/usr/local/lib --with-zlib-dir=/usr/local/lib \

--with-mysql=$MYSQL_DIR --with-mysqli=$MYSQL_DIR/bin/mysql_config \

--with-gd --enable-soap --enable-sockets --enable-xml --enable-mbstring \

--with-png-dir=/usr/local --with-jpeg-dir=/usr/local --with-curl=/usr/lib \

--with-freetype-dir=/usr/include/freetype2/freetype/ --enable-bcmath \

--enable-calendar --enable-zip --enable-maintainer-zts >> $IN_LOG 2>&1

make >> $IN_LOG 2>&1

make install >> $IN_LOG 2>&1

# 判断目录是否创建:

if [ ! -d $PHP_DIR ];then

echo "$PHP_DIR is not exist,stop..."

exit 0

# PHP配置项：

echo "configuration after the installation...."

sleep 1

cp php.ini-development $PHP_DIR/lib/php.ini

echo "AddType application/x-httpd-php .php" >> $APACHE_DIR/conf/httpd.conf

sed -i '/DirectoryIndex index.html/s/$/ &index.php/g' $APACHE_DIR/conf/httpd.conf

# 隐藏PHP版本信息：

# echo "expose_php = Off" >> $PHP_DIR/lib/php.ini

# 关闭警告及错误信息,爆路径:

echo "display_errors = Off" >> $PHP_DIR/lib/php.ini

# 调整时区,防止phpinfo()函数报错.

echo "date.timezone =PRC" >> $PHP_DIR/lib/php.ini

# 开启php错误日志并设置路径.

echo "log_errors = On" >> $PHP_DIR/lib/php.ini

echo "error_log = $APACHE_DIR/logs/php_error.log" >> $PHP_DIR/lib/php.ini

cd $DEFAULT_DIR

cp conf/info.php $APACHE_DIR/htdocs >> $IN_LOG 2>&1

# 重启apache:

echo "restart apache to load the php module..."

$APACHE_DIR/bin/apachectl stop >> $IN_LOG 2>&1

$APACHE_DIR/bin/apachectl start >> $IN_LOG 2>&1

# 判断PHP是否加载:

PHP_LOAD=$(curl --head http://localhost/info.php |grep PHP |wc -l)

if [ $PHP_LOAD == 0 ]; then

echo "PHP does not load,please check your configure!"

exit 0

else

echo "Congratulation,PHP module has installed correctly!"

}

----------------------------------------------------

声明: 本文采用 CC BY-NC-SA 3.0 协议进行授权

转载请注明来源：DevOps技术分享

本文链接地址：http://www.showerlee.com/archives/1000

[SHELL]mysql主从+keepalived线上恢复解决方案

showerlee — Tue, 17 Sep 2013 08:49:54 +0000

最近一个项目需要做一个mysql+keepalived高可用主从同步，配起来当然轻车熟路，但想到如何在主库挂掉，从库接管后，以最快的速度恢复数据，并让主库重新接管，所以整理了下思路，编写了如下脚本，供大家参考

mysql主从,以及keepalived高可用配置本博传送门:

http://www.showerlee.com/archives/300

http://www.showerlee.com/archives/702

一.备份从库当前数据库

注:以下的所有配置需要在数据库未运转状态下进行，建议做一个iptables规则禁止非管理员IP访问主从服务器IP，以及VIP，这样既能保证管理员可SSH远程登陆配置，又能恢复主从环境，待配置完成后解除禁止即可。

# vi /etc/rc.d/mysql_bak.sh

-------------------------

#!/bin/bash

# 环境变量

PATH=/bin:/usr/bin:/sbin:/usr/sbin; export PATH

export LANG=C

# 日常备份目录

basedir=/backup/daily/

# 数据库账户

user=root

passwd=123456

# mysql备份目录

mysql_db_bak=$basedir/$(date +%F_%H%M)

[ ! -d "$mysql_db_bak" ] && mkdir -p $mysql_db_bak

# mysql下所有库名称

db_name=("information_schema" "mysql" "test_db1" "test_db2" "test_db3" "test_db4")

# 1.备份MySQL数据库

for((i=0; i!=${#db_name[@]}; ++i))

{

mysqldump -u $user -p$passwd --opt --skip-lock-tables --flush-logs --database ${db_name[i]} > $mysql_db_bak/${db_name[i]}.sql

}

-------------------------

二.复制从（192.168.7.12）数据库备份到主库（192.168.7.9）

# vi /etc/rc.d/scp_mysql.sh

----------------------

#/bin/bash

# 环境变量

PATH=/bin:/usr/bin:/sbin:/usr/sbin; export PATH

scp /backup/daily/2013-09-10_1258/* 192.168.7.9:/tmp

----------------------

三.恢复主库（192.168.7.9）

# vi /etc/rc.d/recover_mysql.sh

------------------------------------

#/bin/bash

# 环境变量

PATH=/bin:/usr/bin:/sbin:/usr/sbin; export PATH

export LANG=C

# 数据库账户

user=root

passwd=123456

# # mysql下所有库名称

db_name=("information_schema" "mysql" "test_db1" "test_db2" "test_db3" "test_db4")

# 恢复MySQL数据库

cd /tmp

for((i=0; i!=${#db_name[@]}; ++i))

{

mysql -u $user -p$passwd -e "drop database \`${db_name[i]}\`;"

mysql -u $user -p$passwd -e "create database \`${db_name[i]}\`;"

mysql -u $user -p$passwd ${db_name[i]} < ${db_name[i]}.sql

}

# 开启从库

mysql -u $user -p$passwd -e "stop slave;"

mysql -u $user -p$passwd -e "reset slave;"

# 设置从库连接主库的相关参数，可利用相关命令查看

mysql -u $user -p$passwd -e "change master to master_host='192.168.7.9',master_user='slave',master_password='123456#',master_log_file='bin.000029',master_log_pos=106 ";

mysql -u $user -p$passwd -e "start slave;"

# 查看主从是否连接成功

mysql -u $user -p$passwd -e "show slave status\G;"

------------------------------------

四.查看主从同步信息

1.查看主库binlog日志以及偏移量

# mysql -u root -p123456 -e "show master status"

2.查看从库是否连接到主库

# mysql -u root -p123456 -e " show slave status\G;"

注:实际操作中发现，一旦VIP切换后有一定几率造成主从服务器都会同时获取到该虚IP，导致主从数据库冲突，无论重启keepalived与否都无法干掉该VIP，目前我的临时解决方案是将两台服务器均重新启动，大家如果有更好的方法请留言告知我，不胜感谢。

mysql主从,以及keepalived高可用配置本博传送门:

http://showerlee.blog.51cto.com/2047005/1220801

http://showerlee.blog.51cto.com/2047005/1188549

一.备份从库当前数据库

# vi /etc/rc.d/mysql_bak.sh

-------------------------

#!/bin/bash

# 环境变量

PATH=/bin:/usr/bin:/sbin:/usr/sbin; export PATH

export LANG=C

# 日常备份目录

basedir=/backup/daily/

# 数据库账户

user=root

passwd=123456

# mysql备份目录

mysql_db_bak=$basedir/$(date +%F_%H%M)

[ ! -d "$mysql_db_bak" ] && mkdir -p $mysql_db_bak

# mysql下所有库名称

db_name=("information_schema" "mysql" "test_db1" "test_db2" "test_db3" "test_db4")

# 1.备份MySQL数据库

for((i=0; i!=${#db_name[@]}; ++i))

{

mysqldump -u $user -p$passwd --opt --skip-lock-tables --flush-logs --database ${db_name[i]} > $mysql_db_bak/${db_name[i]}.sql

}

-------------------------

二.复制从（192.168.7.9）数据库备份到主库（192.168.7.12）

# vi /etc/rc.d/scp_mysql.sh

----------------------

#/bin/bash

# 环境变量

PATH=/bin:/usr/bin:/sbin:/usr/sbin; export PATH

scp /backup/daily/2013-09-10_1258/* 192.168.7.9:/tmp

----------------------

三.恢复主库（192.168.7.9）

版本一:

# vi /etc/rc.d/recover_mysql.sh

------------------------------------

#/bin/bash

# 环境变量

PATH=/bin:/usr/bin:/sbin:/usr/sbin; export PATH

export LANG=C

# 数据库账户

user=root

passwd=123456

# # mysql下所有库名称

db_name=("information_schema" "mysql" "test_db1" "test_db2" "test_db3" "test_db4")

# 恢复MySQL数据库

cd /tmp

for((i=0; i!=${#db_name[@]}; ++i))

{

mysql -u $user -p$passwd -e "drop database \`${db_name[i]}\`;"

mysql -u $user -p$passwd -e "create database \`${db_name[i]}\`;"

mysql -u $user -p$passwd ${db_name[i]} < ${db_name[i]}.sql

}

# 开启从库

mysql -u $user -p$passwd -e "stop slave;"

mysql -u $user -p$passwd -e "reset slave;"

# 设置从库连接主库的相关参数，可利用相关命令查看

mysql -u $user -p$passwd -e "change master to master_host='192.168.7.9',master_user='slave',master_password='123456#',master_log_file='bin.000029',master_log_pos=106 ";

mysql -u $user -p$passwd -e "start slave;"

# 查看主从是否连接成功

mysql -u $user -p$passwd -e "show slave status\G;"

------------------------------------

版本二:

(自动获取主库binlog文件,和偏移值,优化参数,推荐):

------------------------------------

#/bin/bash

# 环境变量

PATH=/bin:/usr/bin:/sbin:/usr/sbin; export PATH

export LANG=C

# 数据库参数

master_ip=192.168.7.9

mysql_master_user=root

mysql_slave_user=root

mysql_passwd=123456

master_user=slave

master_passwd=123456#

master_log_file=$(mysql -h$master_ip -u$mysql_master_user -p$mysql_passwd -e "show master status" |sed -n '2p' |awk '{print $1}')

master_log_pos=$(mysql -h$master_ip -u$mysql_master_user -p$mysql_passwd -e "show master status" |sed -n '2p' |awk '{print $2}')

# mysql库

db_name=("information_schema" "mysql" "test_db1" "test_db2" "test_db3" "test_db4")

# 恢复MySQL数据库

cd /tmp/mysql_bak

for((i=0; i!=${#db_name[@]}; ++i))

{

mysql -u $mysql_slave_user -p$mysql_passwd -e "drop database \`${db_name[i]}\`;"

mysql -u $mysql_slave_user -p$mysql_passwd -e "create database \`${db_name[i]}\`;"

mysql -u $mysql_slave_user -p$mysql_passwd ${db_name[i]} < ${db_name[i]}.sql

}

# 开启从库

mysql -u $mysql_slave_user -p$mysql_passwd -e "stop slave;"

mysql -u $mysql_slave_user -p$mysql_passwd -e "reset slave;"

mysql -u $mysql_slave_user -p$mysql_passwd -e "change master to master_host='${master_ip}',master_user='${master_user}',master_password='${master_passwd}',master_log_file='${master_log_file}',master_log_pos=${master_log_pos};"

mysql -u $mysql_slave_user -p$mysql_passwd -e "start slave;"

mysql -u $mysql_slave_user -p$mysql_passwd -e "show slave status\G;"

-----------------------------------

四.查看主从同步信息

1.查看主库binlog日志以及偏移量

# mysql -u root -p123456 -e "show master status"

2.查看从库是否连接到主库

# mysql -u root -p123456 -e " show slave status\G;"

后续:

在网上翻阅大量资料，初步判断VIP切换后造成的冲突是因为在触发切换动作时使用的pkill keepalived 来杀掉keepaliaved进程，造成系统只是杀掉keepalived自身进程，并未来得及切换VIP，

目前的解决方案是使用正规的keepalived启动脚本/etc/init.d/keepalived stop 来关闭

初步测试未发现异常。。。

如果出现主从在切换VIP时，出现了主的VIP未自动关闭，从的正常开启，导致都获取到VIP，造成互相冲突的情况，可手动输入如下命令删除一方的VIP地址

# ip addr del "虚拟ip" dev eth0

但此方法只是一个临时的解决方案，当手动删除VIP后，重启keepalived服务会无法正常开启vip，需要重启服务器方能恢复。

声明: 本文采用 CC BY-NC-SA 3.0 协议进行授权

转载请注明来源：DevOps技术分享

本文链接地址：http://www.showerlee.com/archives/917

[SHELL]shell scripts笔记(2)

showerlee — Tue, 27 Aug 2013 10:58:37 +0000

最近一直在研究shell脚本，整理了些比较有用的以备不时之需。。

1.获取字符串长度

# var=1234567890

# echo ${#var}

2.识别当前shell版本

# echo $SHELL

# echo $0

3.检查是否为超级用户

-------------------------

#!/bin/bash

if [ $UID -ne 0 ];then

echo Non root user .Please run as root.

else

echo "Root user"

-------------------------

4.修改Bash提示字符串

# cat /etc/bashrc | grep PS1

5.重定向脚本内部的文本块

-------------------------

#!/bin/bash

cat <>log.txt

LOG FILE HEADER

This is a test log file

Function: System statistions

EOF

-------------------------

6.删除空白行

# cat file.txt | tr -s '\n'

# cat file.txt | sed '/^$/d'

7.find忽略大小写

# find . -iname "example" -print

8.find 匹配多个条件

# find . $ -name "*.txt" -o -name "*.pdf" $ -print

9.否定参数

# find . ! -name "*.txt" -print

10.结合find使用xargs

# find . -type f -name "*.txt" -print0 | xargs -0 rm -f

注：这里xargs -0将\0作为输入定界符，防止搜索到带空格的字符后被find识别成2个文件

11.生成一个大小为100K的测试文件

# dd if=/dev/zero bs=100k count=1 of=date.file

12.用特定格式重命名当前目录下的图像文件、

-------------------------------

#!/bin/bash

count=1

for img in *.jpg *.png

new=image-$count.${img##*.}

mv "$img" "$new" 2> /dev/null

if [ $? -eq 0 ];

then

echo "Renaming $img to $new"

let count++

done

-------------------------------

13.URL="www.google.com"

# echo ${URL%.*} # 移除 .*所匹配的最右边的内容

http://www.google

# echo ${URL%%.*} # 将从右边开始一直匹配到最左边的*.移除（贪婪操作符）

www

# echo ${URL#*.} # 移除*.所匹配的最左边的内容

google.com

# echo ${URL##*.} # 将从左边开始一直匹配到最右边的*.移除（贪婪操作符）

com

14.将一个文件设置为不可修改：

# chattr +i file

恢复：

# chattr -i file

15.生成不同的空白文件：

----------------

for name in (1...100).txt

touch $name

done

----------------

16.移除空白行

# sed '/^$/d' file

17.打印可用的网络接口

# ifconfig | cut -c-10 |tr -d ' ' |tr -s '\n'

注：cut -c-10为提取每行前10个字符，也可以这么写 cut -c1-10，tr -d ' '为删除每行所有空格，tr -s '\n'为用单独的换行替换每一序列的一个或多个换行。

或

# ifconfig | grep '^[a-z].*' |cut -c-5

18.提取IP地址:

# ifconfig eth0 | grep 'inet addr:[0-9].*'|awk -F' ' '{print $2}'|awk -F':' '{print $2}'

子网掩码:

# ifconfig eth0 |grep '.*Mask:[0-9].*$' |awk -F':' '{print $4}'

网关:

# route |grep "^default" |awk -F' ' '{print $2}'

MAC:

# ifconfig eth0 |grep '^.*HWaddr.*$'| awk -F' ' '{print $5}'

19.添加DNS

# echo "nameserver 61.134.1.4" >> /etc/resolv.conf

20.添加临时网关

# route add default gw 192.168.7.1 eth0

21.查看网内主机活动状态：

-------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

NET_NUM=$(ifconfig eth0 | grep 'inet addr:[0-9].*'|awk -F' ' '{print $2}'|awk -F':' '{print $2}'|awk -F'.' '{print $1"."$2"."$3}')

for IP in $NET_NUM.{1..254};

ping $IP -c2 &> /dev/null ;

if [ $? -eq 0 ];

then

echo $IP is alive

done

-------------------

22.配置IP地址

-----------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin/:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

IFACE=eth0

IP_ADDR=192.168.7.74

NET_MASK=255.255.255.0

GW=192.168.7.1

# 判断是否为root权限

if [ $UID -ne 0 ];

then

echo "Run as root"

exit 1

# 关闭eth0

ifconfig $IFACE down

#配置IP和掩码

ifconfig $IFACE $IP_ADDR netmask $NET_MASK

#配置网关

route add default gw $GW $IFACE

# 开启eth0

ifconfig $IFACE up

echo "Successfully configured $IFACE"

-----------------------------

23.收集远程主机运行时间(先做加密认证)

-----------------------

#!/bin/bash

IP_LIST="192.168.0.[1..254]"

USER="test"

for IP in $IP_LIST;

UPTIME=$(ssh $USER@$IP uptime |awk '{print $3}')

echo "$IP uptime: $UPTIME"

done

------------------------

24.列出本地当前开放的端口

# netstat -ntulp |grep LISTEN |awk -F' ' '{print $4}'|sed 's/^0.0.0.0://g'|sed 's/^127.0.0.1://g'|sed 's/^::://g'|sed 's/^::1://g'|sort -n|uniq -c|awk -F' ' '{print $2}'

或

# yum install nmap -y && nmap -p1-65535 localhost

25.找出指定目录中最大的十个文件

# du -ak . |sort -nrk 1 | head -n 10

注：-a指定了所有目录和文件,-k输出第一列以KB为单位的文件大小，sort对第一列依数值逆序排序，head用来显示前10行输出

或

# find . -type f -exec du -k {} \; |sort -nrk 1 |head -n 10

或(推荐，效率最高)

# find . -type f -print0 |xargs -0 du -k |sort -nrk 1 |head -n 10

26.计算命令执行时间

# time find . -type f -exec du -k {} \; |sort -nrk 1 |head -n 10

# time find . -type f -print0 |xargs -0 du -k |sort -nrk 1 |head -n 10

27.打印出10条最常用的命令

------------------------------

#!/bin/bash

printf "COMMAND\tCOUNT\n";

cat ~/.bash_history | awk '{ list[$1]++; } \

END{

for(i in list)

{

printf("%s\t%d\n",i,list[i]); }

}'| sort -nrk 2 | head

------------------------------

注：

在上面的脚本中，用~/.bash_history作为源文件，通过管道将源输入传递给awk,在awk中，我们使用了一个关联数组，这个数组将命令作为索引，将命令的出现的次数作为数组元素值。命令每出现一次，计数值增加1(list[$1]++).$1是输入文本行的第一个单词，如果使用$0,则包含输入文本行中所有的单词。

比如说，如果ssh 192.168.0.4是.bash_history其中的一行，那么$0中包含ssh 192.168.0.4,$1中包含ssh.

一旦对命令历史文件中的所有行遍历完毕，我们就得到了一个数组，其中数组索引是命令名称，数组元素值是命令出现的次数，因此出现次数最多的命令名称就是使用最频繁的命令。

在awk的END{}语句块中，我们遍历关联数组，打印出所有的命令名及其对应的出现次数，sort -nrk 2 对第2列(COUNT)按照数值逆序排序，最后用head 命令从列表中提取出前10条命令，你可以用head -n NUMBER将前10条命令改为前5条或者是其他任意数量。

30.列出1小时内占用CPU最多的10个进程：

-----------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

SECS=3600

UNIT_TIME=60

#secs为需要进行监视的总秒数

#UNIT_TIME是取样的时间间隔，单位是秒

STEPS=$(( $SECS / $ UNIT_TIME ))

echo Watching CPU usage... ;

for((i=0;i

ps -eo comm,pcpu | tail -n +2 >> /tmp/cpu_usage.$$

sleep $UNIT_TIME

done

echo

echo CPU eaters;

cat /tmp/cpu_usage.$$ | \

awk '

{ process[$1]+=$2; }

END{

for(i in process)

{

printf("%-20s %s",i, process[i]) ;

}

}' | sort -nrk 2 | head

rm /tmp/cpu_usage.$$

#删除临时日志文件

-----------------------

注：在上面的脚本中，主要的输入源是ps -eo comm,pcpu,其中comm表示命令名(command name),pcpu表示CPU使用率(CPU usage in percent)。该命令输出所有进程名及CPU使用率，每个进程对应一行输出。因为需要监视一个小时内CPU的使用情况，所以我们得在一个每次迭代时间为60秒的for循环中不停的用ps -eo comm,pcpu |tail -n +2来获取CPU的使用统计数据，并将这些数据添加到文件/tmp/cpu_usage.$$中，60秒的迭代时间通过sleep 60来提供，这就使得每一分钟执行一次ps

tail -n +2用来将ps 输出中的头部和COMMAND %CPU剥离.

cpu_usage.$$中的$$表示当前脚本的进程ID，假设进程ID为1345，那么在脚本执行时，他会被替换成/tmp/cpu_usage.1345,因为这是一个临时文件，所以我们把它放在/tmp中。

统计文件在1小时后就准备妥当了，文件中包含了60项，分别对应每分钟的进程状态，然后用awk求出每个进程中的CPU使用情况，我们用了一个关联数组来统计CPU的使用情况，其中进程名为数组索引，最后根据总的CPU使用情况依数值逆序排序，并通过head获得前10项。

31.利用watch监控命令查看输出

# watch -n 5 ls

注：利用此命令可以查看该目录的文件变化, -n 5 为间隔5秒更新一次

32.扫描secure日志文件并收集所需信息,生成入侵检测报告

方法一.扫描他人利用系统认证用户进行暴力破解。

---------------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

AUTHLOG=/var/log/secure

if [ [ -n $1] ];

then

AUTHLOG=$1

echo Using Default Log file : $AUTHLOG

LOG=/tmp/valid.$$.log

grep -v "invalid" $AUTHLOG > $LOG

users=$(grep "Failed password" $LOG | awk '{ print $(NF-5) }'| sort | uniq)

printf "%-5s|%-10s|%-10s|%-13s|%-13s|%-33s|%s\n" "No#" "User" "Attepts" "IP address" "Host_Mapping" "Time range"

ucount=0

ip_list="$(egrep -o "[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+" $LOG | sort | uniq)"

for ip in $ip_list;

grep $ip $LOG > /tmp/temp.$$.log

for user in $users;

grep $user /tmp/temp.$$.log > /tmp/$$.log

cut -c-16 /tmp/$$.log > $$.time

#显示登录时间

tstart=$(head -1 $$.time);

#显示从1970年到该时刻所经历的秒数

start=$(date -d "$tstart" "+%s");

#显示登出时间

tend=$(tail -1 $$.time);

#显示从1970年到该时刻所经历的秒数

end=$(date -d "$tend" "+%s")

#算出登录时间

limit=$(( $end - $start ))

if [ $limit -gt 1 ];

then

let ucount++;

IP=$(egrep -o "[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+" /tmp/$$.log | head -1 );

TIME_RANGE="$tstart --> $tend"

ATTEMPTS=$(cat /tmp/$$.log | wc -l)

HOST=$(host $IP | awk '{print $NF}')

printf "%-5s|%-10s|%-10s|%-13s|%-13s|%-33s|%s\n" "$ucount" "$user" "$ATTEMPTS" "$IP" "$HOST" "$TIME_RANGE";

done

rm /tmp/valid.$$.log /tmp/$$.log $$.time /tmp/temp.$$.log 2> /dev/null

---------------------------

方法二.扫描他人利用系统认证用户或非系统用户进行暴力破解。

---------------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

AUTHLOG=/var/log/secure

if [[ -n $1 ]];

then

AUTHLOG=$1

echo Using Log file : $AUTHLOG

else

echo Using Default Log file : $AUTHLOG

LOG=/tmp/valid.$$.log

grep "Failed password" $AUTHLOG > $LOG

users=$(cat $LOG | awk '{ print $(NF-5) }'| sort | uniq)

printf "%-5s|%-10s|%-10s|%-13s|%-13s|%-33s|%s\n" "No#" "User" "Attepts" "IP address" "Host_Mapping" "Time range"

ucount=0

ip_list="$(egrep -o "[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+" $LOG | sort | uniq)"

for ip in $ip_list;

grep $ip $LOG > /tmp/temp.$$.log

for user in $users;

grep $user /tmp/temp.$$.log > /tmp/$$.log

cut -c-16 /tmp/$$.log > $$.time

#显示登录时间

tstart=$(head -1 $$.time);

#显示从1970年到该时刻所经历的秒数

start=$(date -d "$tstart" "+%s");

#显示登出时间

tend=$(tail -1 $$.time);

#显示从1970年到该时刻所经历的秒数

end=$(date -d "$tend" "+%s")

#算出登录时间

limit=$(( $end - $start ))

if [ $limit -ge 0 ];

then

let ucount++;

IP=$(egrep -o "[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+" /tmp/$$.log | head -1 );

TIME_RANGE="$tstart --> $tend"

ATTEMPTS=$(cat /tmp/$$.log | wc -l)

HOST=$(host $IP | awk '{print $NF}')

printf "%-5s|%-10s|%-10s|%-13s|%-13s|%-33s|%s\n" "$ucount" "$user" "$ATTEMPTS" "$IP" "$HOST" "$TIME_RANGE";

done

rm /tmp/valid.$$.log /tmp/$$.log $$.time /tmp/temp.$$.log 2> /dev/null

---------------------------

33.监视远程磁盘的健康情况

----------------------------

#!/bin/bash

logfile="diskusage.log"

if [[ -n $1 ]]

then

logfile=$1

if [ ! -e $logfile ]

then

printf "%-8s %-14s %-9s %-8s %-6s %-6s %-6s %s\n" "Data" "IP address" "Device" "Capacity" "Used" "Free" "Percent" "Status" > $logfile

IP_LIST="192.168.7.74"

{

for ip in $IP_LIST;

ssh $ip 'df -h' |grep ^/dev/ > /tmp/$$.df

while read line;

cur_date=$(date +%D)

printf "%-8s %-14s " $cur_date $ip

echo $line | awk '{ printf("%-9s %-8s %-6s %-6s %-8s",$1,$2,$3,$4,$5);}'

pusg=$(echo $line | egrep -o "[0-9]+%")

# 参见man bash 找${parameter/pattern/string}

# .${parameter/pattern/string} ${parameter//pattern/string}

# 在这里pattern也是一个模式，parameter展开后最长匹配的部分被string替换。 # 第一种情况只替换首次匹配，第二种情况替换所有匹配。

pusg=${pusg/\%/};

if [ $pusg -lt 80 ];

then

echo SAFE

else

echo ALERT

done < /tmp/$$.df

done

} >> $logfile

----------------------------

34.创建数据库及数据表脚本

-------------------------------

#!/bin/bash

USER="root"

PASS="123456"

DB="test1"

TABLE="test1"

mysql -u $USER -p$PASS < /dev/null

CREATE DATABASE $DB;

EOF

[ $? -eq 0 ] && echo Created $DB || echo $DB already exist

mysql -u $USER -p$PASS $DB < /dev/null

CREATE TABLE $TABLE(

id int,

name varchar(100),

mark int,

dept varchar(4)

);

EOF

[ $? -eq 0 ] && echo Created table $TABLE || echo Table $TABLE already exist

-------------------------------

或（传参）

------------------------------

#!/bin/bash

USER="root"

PASS="123456"

DB="$1"

TABLE="$2"

if [ $# -ne 2 ]; # if传参的个数不等于2

then

echo "please input the db and table name.exp: {sh db table}" && exit 0

elif [ "$1" -gt 0 -o "$2" -gt 0 ] 2>/dev/null ;

then

echo "please input the right name(not number).exp: {sh db table}" && exit 0

mysql -u $USER -p$PASS < /dev/null

CREATE DATABASE $DB;

EOF

[ $? -eq 0 ] && echo Created $DB || echo $DB already exist

mysql -u $USER -p$PASS $DB < /dev/null

CREATE TABLE $TABLE(

id int,

name varchar(100),

mark int,

dept varchar(4)

);

EOF

[ $? -eq 0 ] && echo Created table $TABLE || echo Table $TABLE already exist

------------------------------

35.将数据插入数据表：

-------------------------------

#!/bin/bash

USER="root"

PASS="123456"

if [ $# -ne 1 ];

then

echo $0 DATAFILE

echo

exit 2

data=$1

while read line;

oldIFS=$IFS

IFS=.

values=($line)

values[1]="\"`echo ${values[1]} | tr ' ' '#' `\""

values[3]="\"`echo ${values[3]}`\""

query=`echo $(values[@]) | tr ' #' ', ' `

IFS=$oldIFS

mysql -u $USER -p$PASS students <

INSERT INTO students VALUES($query);

EOF

done < $data

echo Wrote data into DB

-------------------------------

声明: 本文采用 CC BY-NC-SA 3.0 协议进行授权

转载请注明来源：DevOps技术分享

本文链接地址：http://www.showerlee.com/archives/599

[SHELL]shell scripts笔记(1)

showerlee — Tue, 27 Aug 2013 10:57:42 +0000

自己没事总结了点基础的东西，以备不时之需。

一.判断式:

1.判断符号 &&及||

检测test是否存在：

# test -e /haha

注：test是一个判断文件属性的命令，-e参数判断目录是否存在，执行结果不会显示任何信息，但最后我们可以透过$?或&&及||来展现整个结果

例如：

# test -e /haha && echo "exist" ||echo "not exist"

注: -f参数判断是否为文件，-d判断是否为目录

实例：

1).让使用者输入一个文件名，判断这个文件名是否存在，若不存在给予一个filename does not exist的信息，并中断程序。

2).若这个文档存在，则判断他是文档还是目录，结果输出filename is regular file 或 filename is directory

3).判断执行者对这个文件或目录所拥有权限，并输出权限目录：

# vi sh05.sh

--------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

# 判断是否输入字符串:

echo -e "Please input a filename,I will check the filename's type and permission. \n\n"

read -p "Input afilename:"filename

test -z $filename && echo "You must input a filename." && exit 0

# 判断文件是否存在,若不存在则提示并退出

test ! -e $filename && echo "The filename `$filename` do not exist" && exit 0

# 判断文件类型和属性:

test -f $filename && filetype="regulare file"

test -d $filename && filetype="directory"

test -r $filename && perm="readable"

test -w $filename && perm="$perm writable"

test -x $filename && perm="$perm executable"

# 输出信息：

echo "The filename:$filename is a $filetype"

echo "And the permissions are:$perm"

--------------------

2.判断符号[]

判断$HOME变量是否为空:

# [ -z "$HOME" ];echo $?

注: 中括号因为用在很多包括通配符，正则表达式中，所以用在shell判别式时，为了与其他用法区分，必须在括号两端用"空格"间隔。

判断两个变量是否相同

# [ "$HOME" == "$MAIL" ]

实例

1.当执行一个程序时，程序会让用户选择Y或N

2.如果用户输入Y或y时，就显示OK continue

3.如果用户输入n或N时，显示oh,interrupt!

4.如果输入其他字符，就显示 I don't know what fucking your choice is

利用[] && ||实现

# vi sh06.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

read -p "Please input (Y/N):" yn

["$yn" == "Y" -o "$yn" == "y" ] && echo "OK,continue" && exit 0

["$yn" == "N" -o "$yn" == "n" ] && echo "oh,interrupt!" && exit 0

echo "I don't know what fucking your choice is" && exit 0

----------------------

传参：

实例：

1.程序文件名为何？

2.共有几个参数？

3.若参数个数小雨2则告知使用者参数数量太少

4.全部的参数为何？

5.第一个参数为何？

6.第二个参数为何?

# vi sh07.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

echo "The script name is ==> $0"

echo "Total parameter number is ==> $#"

[ "$#" -lt 2 ] && echo "The number of parameter is less than 2. Stop here." && exit 0

echo "Your whole parameter is ==> $@"

echo "The 1st parameter ==> $1"

echo "The 2st parameter ==> $2"

----------------------

条件判断:

利用if...then

sh06修改版：

# vi sh08.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

read -p "Please input (Y/N):" yn

if [ "$yn" == "Y" ] || [ "$yn" == "y" ];then

echo "OK,continue"

exit 0

elif [ "$yn" == "N" ] || [ "$yn" == "n" ]; then

echo "oh,interrupt!"

exit 0

else

echo "I don't know what fucking your choice is"

exit 0

----------------------

实例1：

1.判断$1是否为hello,如果是，显示 hello,how are you?

2.如果没加参数，提示用户必须使用参数

3.如果加入的参数不是hello,就提示用户只能用hello作为参数

# vi sh09.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

if [ "$1" == "hello" ];then

echo "Hello,how are you?"

elif [ "$1" == "" ];then

echo "You must input parameters,example:{$0 someword}"

else

echo "The only parameter is 'hello',example:{$0 hello}"

---------------------

实例2：

判断主机常见21,22,25,80是否开启

# vi sh10.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

PORT=$(netstat -tunl |grep "$1"| sed -n '1p' | awk '{print $4}'| sed 's/^.*://g')

VAR=$(echo "$1" |bc 2>/dev/null)

if [ "$1" == "" ]; then

echo "Please input a port.example:{sh $0 80}"

elif [ "$VAR" != "$1" ];then

echo "Please input the right port.example:{sh $0 80}"

elif [ "$PORT" == "21" ];then

echo "ftp is running in your system"

elif [ "$PORT" == "22" ];then

echo "ssh is running in your system"

elif [ "$PORT" == "25" ];then

echo "smtp is running in your system"

elif [ "$PORT" == "80" ];then

echo "www is running in your system"

else

echo "the port:$1 is not running"

----------------------

利用if...esac判断

sh09修改版：

# vi sh11.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

case $1 in

"hello")

echo "Hello,how are you?"

;;

"")

echo "You must input parameters,example:{sh $0 someword}"

;;

echo "Usage:{sh $0 hello}"

;;

esac

---------------------

实例2:

# vi sh12.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

case $1 in

"one")

echo "Your choice is ONE"

;;

"two")

echo "Your choice is TWO"

;;

"three")

echo "Your choice is "THREE"

;;

echo "Usage $0 {one|two|three}"

esac

---------------------

function功能

实例1：

# vi sh13.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

function printit(){

echo -n "Your choice is" # -n表示不断行在同行显示

}

echo "This program will print your selection!"

case $1 in

"one")

printit;echo $1 | tr 'a-z' 'A-Z' # 将参数做大小写转换

;;

"two")

printit;echo $1 | tr 'a-z' 'A-Z'

;;

"three")

printit;echo $1 | tr 'a-z' 'A-Z'

;;

echo "Usage $0 {one|two|three}"

;;

esac

--------------------------

实例1变种：

# vi sh14.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

function printit(){

echo "Your choice is $1"

}

echo "This program will print your selection!"

case $1 in

"one")

printit 1 # printit 后可接参数

;;

"two")

printit 2

;;

"three")

printit 3

;;

echo "Usage $0 {one|two|three}"

;;

esac

--------------------------

while do done,until do done(不定循环)

# vi sh15.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

while [ "$yn" != "yes" -a "$yn" != "YES" ]

read -p "Please input yes/YES to stop this program:" yn

done

echo "OK,you input the correct answer."

----------------------

# vi sh16.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

until [ "$yn" == "yes" -o "$yn" == "YES" ]

read -p "Please input yes/YES to stop this program:" yn

done

echo "OK,you input the correct answer."

----------------------

计算1+2+...+100=?

# vi sh17.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

s=0

i=0

while [ "$i" != "100" ]

i=$($i+1)

s=$($s+$i)

done

echo "The result of '1+2+3+...+100'=" $s

-----------------------

for...do...done (固定循环)

# vi sh18.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

for animal in dog cat elephant

echo "There are ${animal}s..."

done

---------------------

# vi sh19.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

users=$(cat /etc/passwd | awk 'BEGIN {FS=":"} {print $1}')

for username in $users

id $username

# finger $username

done

---------------------

实例1：

利用for循环ping网内主机状态

# vi sh20.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

network="172.24.30"

for host in $(seq 1 254)

ping -c 1 -w 1 ${network}.${host}&> /dev/null && result=1 || result=0

case "$result" in

"1")

echo "Server ${network}.${host} is UP."

;;

"0")

echo "Server ${network}.${host} is DOWN."

;;

esac

done

-----------------------

实例2:

让用户输入某个文件名，找出该目录内的文件名的权限

# vi sh21.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

read -p "Please input a directory:" dir

if[ "$dir" == "" -o ! -d "$dir" ];then

echo "The $dir is NOT exist in your systemn."

exit 1

filelist=$(ls $dir)

for filename in $filelist

perm=""

test -r "$dir/$filemane" && perm="$perm readable"

test -w "$dir/$filename" && perm="$perm writable"

test -x "$dir/$filename" && perm="$perm executable"

echo "The file $dir/$filename's permission is ${perm}."

done

-----------------------

# vi sh22.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

read -p "Please input a number,I will count for 1+2+..+{your_input}:" nu

s=0

for((i=1;i<=$nu;i=i+1))

s=$(($s+$i))

done

echo "The result of '1+2+3+...+$nu' is ===> $s"

----------------------

debug

# sh -x sh22.sh

习题

建立一个script,当你执行script时，该script可以显示:

1.你目前的身份(whoami)

2.你锁在目录

# vi test01.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

echo -e "Your name is $(whoami)"

echo -e "The current directory is $(pwd)"

---------------------

让用户输入一个数字，程序可以由1+2+3+....一直累加到用户输入的数字为止

# vi test02.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

read -p "Please input a number,I will count for 1+2+...+{your_input}:" nu

s=0

for (( i=1;i<=$nu;i=i+1 ))

s=$(($s+$i))

done

echo "The answser of "1+2+...+$nu =" $s"

---------------------

写一个程序

1.先查看/root/test/logical这个文件是否存在

2.若不存在，则建立一个文档，使用touch建立，建立完成后离开

3.如果存在，判断是否为文件，若为文件则删除后建立一个目录，名为logical,之后离开

4.如果存在，则移除此目录

# vi test02.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

cd /root/test

if [ ! -e logical ];then

touch logical

echo "Just make a file logical"

exit 1

elif [ -e logical ]&&[ -f logical ];then

rm -rf logical && mkdir logical

echo "Just make a directory logical"

exit 1

elif [ -e logical ]&&[ -d logical ];then

rm -rf logical

echo "Just delete a directory logical"

exit 1

-----------------------

写一个程序，将/etc/passwd的第一栏取出，而每一栏都以一行字符串[The 1 account is "root"]来显示，那个1表示行数。

# vi test04.sh

---------------------

#!/bin/bash

PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin

export PATH

var=$(cat /etc/passwd | awk 'BEGIN {FS=":"} {print $1}')

for account in $var

declare -i i=$i+1

echo "The $i account is $account"

done

---------------------

或

----------------------

#!/bin/bash

awk 'BEGIN {FS=":"} {printf "The %s account is %s\n",NR,$1}' /etc/passwd

----------------------

或

----------------------

#!/bin/bash

awk 'BEGIN {FS=":"} {print "The " NR " account is "$1}' /etc/passwd

----------------------

声明: 本文采用 CC BY-NC-SA 3.0 协议进行授权

转载请注明来源：DevOps技术分享

本文链接地址：http://www.showerlee.com/archives/597

[SHELL]正则表达式笔记(1)

showerlee — Tue, 27 Aug 2013 10:56:38 +0000

最近一直在研究shell脚本这块，刚好闲下来整了下自己手头上比较好的资料中的一些范例，以下是我整理的鸟哥私房菜里面正则表达式里面比较基础的一些语法详解，适合新手查阅。

首先先复制一段范例：

# vi regular_express.txt

-------------------------------

"Open Source" is a good mechanism to develop programs.

apple is my favorite food.

Football game is not use feet only.

this dress doesn't fit me.

However, this dress is about $ 3183 dollars.

GNU is free air not free beer.

Her hair is very beauty.

I can't finish the test.

Oh! The soup taste good.

motorcycle is cheap than car.

This window is clear.

the symbol '*' is represented as start.

Oh!My god!

The gd software is a library for drafting programs.

You are the best is mean you are the no. 1.

The world is the same with "glad".

I like dog.

google is the best tools for search keyword.

goooooogle yes!

go! go! Let's go.

# I am VBird

--------------------------------

设置语系为C

#export LANG=C

grep

1.搜寻特定字符串"the"

注: n为显示行号

# grep -n 'the' regular_express.txt

2.反向搜寻特定字符串"the"

# grep -vn 'the' regular_express.txt

3.取得任意大小写"the"的这个字符串

# grep -in 'the' regular_express.txt

4.利用括号 [] 来搜寻集合字符

搜索test或taste这两个单词时，发现他们有共同的't?st',所以可以这么搜寻

# grep -n 't[ae]st' regular_express.txt

这样其实就是在找t[a]st和t[e]st这两个分开的字符

如果搜索有 oo 的字符时，则可以使用：

# grep -n 'oo' regular_express.txt

如果搜索oo时不想搜到 oo 前面有 g 的话，我们可以利用反向选择[^]来达成:

# grep -n '[^g]oo' regular_express.txt

如果搜索oo前面不想有小写字符，则：

# grep -n '[^a-z]oo' regular_express.txt

注: 大写英文/小写英文/数字可以使用 [a-z]/[A-Z]/[0-9]等方式来书写，也可以写在一起

[a-zA-Z0-9]表示要求字符串是数字以及英文

如果我们要取得有数字的那行,则：

# grep -n '[0-9]' regular_express.txt

注：但考虑到语系对编码顺序的影响，因此除了连续编码使用减号[-]外，也可以用[:lower:]代替a-z 以及 [:digit:] 代替0-9 使用

# grep -n '[^[:lower:]]oo' regular_express.txt

# grep -n '[[:digit:]]' regular_express.txt

5.显示行首为'the'的字符串

# grep -n '^the' regular_express.txt

显示行首是小写字符

# grep -n '^[a-z]' regular_express.txt

6.显示行尾为点 . 的那一行

# grep -n '\.$' regular_express.txt

7.显示5-9行数据

# cat -An regular_express.txt |head -n 10 |tail -n 6

8.显示空白行

# grep -n '^$' regular_express.txt

9.找出g??d字符串，起头g结束d的四个字符串

# grep -n 'g..d' regular_express.txt

10. o*代表空字符(就是有没有字符都可以)或者一个到N个o字符，所以grep -n 'o*' regular_express.txt就会把所有行全部打印出来，

11.oo*代表o+空字符或者一个到N个o字符,所以grep -n 'oo*' regular_express.txt就会把o,oo,ooo等的行全部打印出来

12."goo*g"代表gog,goog,gooog...等

# grep -n 'goo*g' regular_express.txt

13.找出含g...g字符串的行

注: .代表任意字符, .*则就代表空字符或者一个到N个任意字符

# grep -n 'g.*g' regular_express.txt

14.找出含有数字的行

# grep -n '[0-9][0-9]*' regular_express.txt

或# grep -n '[0-9]' regular_express.txt

15.找出含两个o的字符串

注:{}因为在shell里有特殊意义，所以需要加跳脱符\来让其失去意义

# grep -n 'o\{2\}' regular_express.txt

找出g后含2到5个o然后以g结尾的字符串

# grep -n 'go\{2,5\}g' regular_express.txt

找出g后含2以上的o然后以g结尾的字符串

# grep -n 'go\{2,\}g' regular_express.txt

总结：

^word 表示带搜寻的字符串(word)在行首

word$ 表示带搜寻的字符串(word)在行尾

. 表示1个任意字符

\ 表示转义字符，在特殊字符前加\会将原本的特殊字符意义去除

* 表示重复0到无穷多个前一个RE(正则表达式)字符

[list] 表示搜索含有list的字符串

[n1-n2] 表示搜索指定的字符串范围,例如[0-9] [a-z] [A-Z]等

[^list] 表示反向字符串的范围,例如[0-9]表示非数字字符，[A-Z]表示非大写字符范围

\{n,m\} 表示找出n到m个前一个RE字符

\{n,\} 表示n个以上的前一个RE字符

egrep总结:

+ 表示重复一个或一个以上的前一个RE字符

范例:egrep 'go+d' regular_express.txt

表示搜寻(god)(good)(goood)...等等字符串，o+代表[一个以上的o]

? 表示重复零个或一个的前一个RE字符

范例:egrep 'go?d' regular_express.txt

表示搜寻(gd)(god)字符串，o?代表[空的或1个o]

注:egrep下'go+d'和'go?d'的结果集合就等于grep下的'go*d'

| 表示用或(or)的方式找出数个字符串

范例:egrep 'gd|good|dog' regular_express.txt

表示搜寻(gd)或(god)或(god)字符串，|代表或

() 表示找出群组字符串

范例:egrep 'g(la|oo)d' regular_express.txt

表示搜寻(glad)或(good)字符串

() +表示找出多个重复群组的判别

范例: echo 'AxyzxyzxyzxyzxyzC'|egrep 'A(xyz)+C'

表示搜寻开头是A结尾是C，中间有一个以上的'xyz'字符串

sed:

插入：

1.将/etc/passwd 的内容列出并打印行号，同时,将2-5行删除显示

# nl /etc/passwd | sed '2,5d'

注: sed是sed -e的简写, 后接单引号

同上删除第2行

# nl /etc/passwd | sed '2d'

同上删除第三行到最后一行

# nl /etc/passwd | sed '3,$d'

2.在第二行后加上一行test

# nl /etc/passwd | sed '2a test'

在第二行前加上一行test

# nl /etc/passwd | sed '2i test'

在第二行后加入两行test

# nl /etc/passwd | sed '2a test \

> test'

替换行:

3.将2-5行内容取代为 No 2-5 number

# nl /etc/passwd | sed '2,5c No 2-5 number'

4 列出/etc/passwd 内第5-7行

# nl /etc/passwd |sed -n '5,7p'

替换字符串:

sed 's/被替换字符串/新字符串/g'

1.获取本机IP的行

# /sbin/ifconfig eth0 |grep 'inet addr'

将IP前面的部分予以删除

# /sbin/ifconfig eth0 |grep 'inet addr'| sed 's/^.*addr://g'

将IP后面的部分删除

# /sbin/ifconfig eth0 |grep 'inet addr'| sed 's/^.*addr://g'| sed 's/Bcast:.*$//g'

-------------------

192.168.100.74

-------------------

2.用grep将关键词MAN所在行取出来

# cat /etc/man.config |grep 'MAN'

删除批注行

# cat /etc/man.config |grep 'MAN'| sed 's/^#.*$//g'

删除空白行

# cat /etc/man.config |grep 'MAN'| sed 's/^#.*$//g'| sed '/^$/d'

3.利用sed将regular_express.txt内每一行若为.的换成!

注：-i参数会直接修改文本，而并非直接输出

# sed -i 's/.*\.$/\!/g' regular_express.txt

4.利用sed在文本最后一行加入 #This is a test

注: $代表最后一行 a代表行后添加

# sed -i '$a #This is a test' regular_express.txt

将selinux配置文件enforcing改成disabled

# sed -i '6,6c SELINUX=disabled' /etc/selinux/config

延伸正规表示法:

# grep -v '^$' regular_express.txt |grep -v '^#'

延伸写法:

# egrep -v '^$'|'^#' regular_express.txt

1. +表示重复一个或一个以上的前一个RE字符

例如：egrep -n 'go+d' regular_express.txt

普通写法: grep -n 'goo*d' regular_express.txt

2. ?表示重复零个或一个前一个RE字符

例如: egrep -n 'go?d' regular_express.txt

3. |表示用或的方式找出数个字符串

例如: egrep -n 'gd|good' regular_express.txt

4. ()表示找出群组字符串

例如: egrep -n 'g(la|oo)d' regular_express.txt

也就是搜寻(glad)或good这两个字符串

5. ()+多个重复群组判别

例如: echo 'AxyzxyzxyzxyzC'|egrep 'A(xyz)+C'

也就是要找开头是A结尾是C 中间有一个以上的'xyz'字符串的意思

awk:

1.用last取出登陆数据前五行

# last -n 5

取出账号与登陆者IP，且账号与IP之间以TAB隔开

# last -n 5 |awk '{print $1 "\t" $3}'

注:$1代表用空格或TAB隔开的第一个字段，以此类推。。

$0代表该行全部字段

# last -n 5 |awk '{print $1 "\t lines:" NR "\t columes:" NF}'

注: NF代表每一行的$0的字段总数

NR代表目前awk所处的是第几行数据

FS代表目标分隔符，默认为空格

2.在/etc/passwd中以:来作为分段字符，则我们要查阅第三栏小于10以下的数据，并只列出账号与第三栏

# cat /etc/passwd | awk '{FS=":"} $3<10 {print $1 "\t \t"$3}'

注：查询结果未显示第一行数据，是因为我们虽然定义了FS=":" 但却只能在第二行生效

想读取第一行就需要BEGIN这个关键词:

# cat /etc/passwd | awk 'BEGIN {FS=":"} $3<10 {print $1 "\t \t"$3}'

df:

比较两个文件的差异:

# diff /etc/rc3.d/ /etc/rc5.d/

-------------------

Only in /etc/rc3.d/: K30spice-vdagentd

Only in /etc/rc5.d/: S70spice-vdagentd

-------------------

实例：

1。统计TCP连接状态

# netstat -na | awk '/^tcp/ {++S[$NF]} END {for(a in S) print a, S[a]}'

/^tcp/

过滤出以tcp开头的行，“^”为正则表达式用法，以...开头，这里是过滤出以tcp开头的行。

S[]

定义了一个名叫S的数组，在awk中，数组下标通常从 1 开始，而不是 0。

当前记录里域个数，默认以空格分隔，如上所示的记录，NF域个数等于

$NF

表示一行的最后一个域的值，如上所示的记录，$NF也就是$6，表示第6个字段的值，也就是SYN_RECV或TIME_WAIT等。

S[$NF]

表示数组元素的值，如上所示的记录，就是S[TIME_WAIT]状态的连接数

++S[$NF]

表示把某个数加一，如上所示的记录，就是把S[TIME_WAIT]状态的连接数加一

结果就是显示S数组中最终的数组值

例：S[TIME_WAIT]=最终值 S[TESTABLISHED]=最终值

END

for(key in S)

遍历S[]数组

print key,”\t”,S[key]

打印数组的键和值，中间用\t制表符分割，显示好一些。

声明: 本文采用 CC BY-NC-SA 3.0 协议进行授权

转载请注明来源：DevOps技术分享

本文链接地址：http://www.showerlee.com/archives/595

[SHELL]备份系统文件并邮件发送

showerlee — Tue, 27 Aug 2013 09:31:52 +0000

1.安装MUTT邮件客户端

# yum install mutt -y

2.创建脚本

# vi /etc/rc.d/mail_to_bak_daily.sh

(版本一)

------------------------------------------------------------

#!/bin/bash

# =========================================================

# 请输入，你想让备份数据放置到哪个独立的目录区

basedir=/backup/daily

# =========================================================

PATH=/bin:/usr/bin:/sbin:/usr/sbin::/usr/local/bin:/usr/local/sbin:/usr/local/mysql/bin;

export PATH

export LANG=C

# 定义数据库信息

user=root

passwd=123456

# 定义mysql备份路径

mysql_db_bak=$basedir/mysql_db_bak/$(date +%F_%H%M)

[ ! -d "$mysql_db_bak" ] && mkdir -p $mysql_db_bak

# 定义www备份路径

www_src_bak=$basedir/www_src_bak/$(date +%F_%H%M)

[ ! -d "$www_src_bak" ] && mkdir -p $www_src_bak

# 定义邮件附件路径

mail_attach_mysql=$mysql_db_bak/wordpress.sql

mail_attach_www=$www_src_bak/www.tar.bz2

# 定义邮件标题

mail_subject="www.example.com_daily_backup"

# 注：这里的标题之间的字符不能有空格，如有空格会按照邮件名发出,例如daily@www.example.com,backup@www.example.com 本例以下划线代替

# 定义邮件内容

mail_content=/tmp/mail_content.txt

mail_code="send MySQL_BAK and WWW_SRC to you at $(date +%F_%H%M)"

# 定义邮件地址

mail_address="test@example.com"

# 1. 备份MySQL (数据库目录在/usr/local/mysql)

mysqldump -u $user -p$passwd --opt --skip-lock-tables --flush-logs --database wordpress > $mysql_db_bak/wordpress.sql

# 2.备份www源代码:

cd /usr/local

tar -jpcf $www_src_bak/www.tar.bz2 www

# 3.邮件正文

cd /tmp

echo $mail_code > $mail_content

# 4.发送附件

yum install mutt -y

cat $mail_content |mutt -s $mail_subject -a $mail_attach_mysql -a $mail_attach_www -- $mail_address

# 5.清除临时文件

cd /tmp

rm -rf $mail_content

---------------------------------------------------------

(版本二) 推荐

注：此版本将附件分开发送，对邮箱同时发送多个大附件有收不到的几率的情况，可按照如下版本重新配置

--------------------------------------------------------

#!/bin/bash

PATH=/bin:/usr/bin:/sbin:/usr/sbin::/usr/local/bin:/usr/local/sbin:/usr/local/mysql/bin;

export PATH

export LANG=C

# 系统文件备份路径

basedir=/backup/daily

# 数据库信息

user=root

passwd=123456

# 定义mysql备份路径

mysql_db_bak=$basedir/mysql_db_bak/$(date +%F_%H%M)

if [ ! -d "$mysql_db_bak" ];

then

mkdir -p $mysql_db_bak

# 定义www备份路径

www_src_bak=$basedir/www_src_bak/$(date +%F_%H%M)

if [ ! -d "$www_src_bak" ];

then

mkdir -p $www_src_bak

# 备份文件

mysql_bak=$mysql_db_bak/wordpress.sql.gz

www_bak=$www_src_bak/www.tar.bz2

# 定义备份文件作为附件的数组

all_bak=($mysql_bak $www_bak)

# 邮件标题

mail_subject="www.showerlee.com_daily_backup"

# 邮件内容

mail_content_mysql="send MySQL_BAK at $(date +%F_%H%M)"

mail_content_www="send WWW_SRC at $(date +%F_%H%M)"

# 定义内容数组

mail_content=("$mail_content_mysql" "$mail_content_www")

# 邮件地址

mail_address="test@example.com"

# 1. 备份MySQL (数据库目录在/usr/local/mysql)

mysqldump -u $user -p$passwd --opt --skip-lock-tables --flush-logs --database wordpress | gzip > $mysql_bak

# 2.备份www源代码:

cd /usr/local

tar -jpcf $www_bak www

# 3.发送附件

yum install mutt -y

for((i=0; i!=${#all_bak[@]}; ++i))

{

echo ${mail_content[i]} | mutt -s $mail_subject $mail_address -a ${all_bak[i]}

}

# 4.清理mutt临时文件

cat /dev/null > ~/sent

--------------------------------------------------------

(版本三)

实现rar分割并附件发送

推荐附件超过50M的用户使用

--------------------------------------------------------

#/bin/bash

PATH=/bin:/usr/bin:/sbin:/usr/sbin::/usr/local/bin:/usr/local/sbin:/usr/local/mysql/bin;

export PATH

export LANG=C

# 系统文件备份路径

basedir=/data/backup/daily

# 数据库信息

user=root

passwd=123456

# 安装rar

rar=$(rar | grep RAR | awk '{print $1}'| sed -n '1p')

if [ $? != 0 ];then

rar=null

sys_version=$(uname -m)

rar_path="/usr/local/rar"

if [ $rar != 'RAR' ];then

if [ $sys_version == 'x86_64' ];then

wget http://www.rarlab.com/rar/rarlinux-x64-4.2.0.tar.gz

tar zxvf rarlinux-x64-4.2.0.tar.gz

mv rar $rar_path

cd $rar_path

make

else

wget http://www.rarlab.com/rar/rarlinux-4.2.0.tar.gz

tar zxvf rarlinux-4.2.0.tar.gz

mv rar $rar_path

cd $rar_path

make

# 定义mysql备份路径

mysql_db_bak=$basedir/mysql_db_bak/$(date +%F_%H%M)

if [ ! -d "$mysql_db_bak" ];

then

mkdir -p $mysql_db_bak

# 定义www备份路径

www_src_bak=$basedir/www_src_bak/$(date +%F_%H%M)

if [ ! -d "$www_src_bak" ];

then

mkdir -p $www_src_bak

# 备份文件

mysql_bak=$mysql_db_bak/test.sql.gz

www_bak=$www_src_bak/www.rar

www_bak_part1=$www_src_bak/www.part1.rar

www_bak_part2=$www_src_bak/www.part2.rar

www_bak_part3=$www_src_bak/www.part3.rar

# 定义附件数组

all_bak=($mysql_bak $www_bak_part1 $www_bak_part2 $www_bak_part3)

# 邮件标题

mail_subject="showerlee.com_and_yanwenbo.cn_daily_backup"

# 邮件内容

mail_content_mysql="send MySQL_BAK at $(date +%F_%H%M)"

mail_content_www_p1="send WWW_SRC rarball part1 at $(date +%F_%H%M)"

mail_content_www_p2="send WWW_SRC rarball part2 at $(date +%F_%H%M)"

mail_content_www_p3="send WWW_SRC rarball part3 at $(date +%F_%H%M)"

# 定义内容数组

mail_content=("$mail_content_mysql" "$mail_content_www_p1" "$mail_content_www_p2" "$mail_content_www_p3")

# 邮件地址

mail_address1="showerlee@vip.qq.com"

mail_address2="kevinywb@vip.qq.com"

# 1. 备份MySQL

mysqldump -u $user -p$passwd --opt --skip-lock-tables --flush-logs --database test | gzip > $mysql_bak

# 2.备份www源代码(分割若干个45m的tar包)

if [ -z $rar ];then

exit 0

cd /data

rar a -v45000k $www_bak www

# 3.发送附件

for((i=0; i!=${#all_bak[@]}; ++i))

{

if [ -f ${all_bak[i]} ]; then

echo ${mail_content[i]} | mutt -s $mail_subject $mail_address1 $mail_address2 -a ${all_bak[i]}

else

echo ${mail_content[i]} | mutt -s $mail_subject $mail_address1 $mail_address2 -a $www_bak

break

}

# 4.清理mutt临时文件

cat /dev/null > ~/sent

# 5.清理1个月前的备份文件

dir=/data/backup/daily/

find $dir -mtime +30 -type d -name "201*" -print |xargs -i rm -rf {} 2>/dev/null

# 6.释放系统缓存

echo 1 > /proc/sys/vm/drop_caches

--------------------------------------------------------

注:如果报如下错误

------------------

postdrop: warning: uid=0: File too large

sendmail: fatal: root(0): message file too big

Error sending message, child exited 75 (Deferred.).

Could not send the message.

------------------

是由于超过系统默认发送附件大小，修改成如下大小即可（2G）

# postconf -e "message_size_limit = 2048000000"

# postconf -e "mailbox_size_limit = 2048000000"

3.执行脚本

# sh /etc/rc.d/mail_to_bak_daily.sh

注：可利用 tail -f /var/log/maillog 查看发送日志

4.测试结果如图：

注：附件较大请耐心等待

声明: 本文采用 CC BY-NC-SA 3.0 协议进行授权

转载请注明来源：DevOps技术分享

本文链接地址：http://www.showerlee.com/archives/570