awk日志分割
awk日志分割
1. awk实现日志按照日期分割
#!/bin/bash
DATE=$(date -d yesterday +%Y-%m-%d)
awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' pay-front.log.$DATE >> pay-front.error.log.$DATE
###参考http://blog.51yip.com/shell/1151.html
###改进例子
##awk '/^2017-05-22/, $1=="2017-05-" {print}' businessUser.log |awk 'BEGIN{RS="2017-05-22"} /'ERROR'|'OutOfMemory'/ {print RS,$0 }'
脚本如下：
#!/bin/bash
#1.将备份在/sumafile/log/backup的日志拷贝到/sumafile/log/Log_segmentation目录下并解压业务日志和删除domain日志
set -x
###每周日删除过滤日志的日志信息
if [[ `date | awk '{print $4}'` == "星期日" ]]; then
rm -rf /sumafile/log/shscript/Log_segmentation.log
fi
##1.1配置环境变量
DATE=$(date -d yesterday "+%Y-%m-%d")
DATE_TODAY=$(date "+%Y-%m-%d")
##1.2拷贝备份日志文件到/sumafile/log/Log_segmentation/$DATE目录下
cp -rf /sumafile/log/backup/$DATE /sumafile/log/Log_segmentation/$DATE
##1.3删除domain日志
###1.3.1删除网关组domain日志及其httpd日志
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw1/glassfishlog
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw1/httplog
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw2/glassfishlog
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw2/httplog
###1.3.2删除平台组domain日志
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-app1/glassfishlog
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-app2/glassfishlog
###1.3.3删除业务组domain日志
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz1/glassfishlog
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz2/glassfishlog
###1.3.4删除核心组domain日志
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-core1/glassfishlog
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-core2/glassfishlog
###1.3.5删除对账组domain日志
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-bdb1/glassfishlog
###1.3.6删除运营组domain日志
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-ope/glassfishlog
###1.3.7删除调度组domain日志
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-sch/glassfishlog
###1.3.8删除连接器组domain日志
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/glassfishlog
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/glassfishlog
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/glassfishlog
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con27/glassfishlog
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con29/glassfishlog
##1.4解压转移业务日志并删除压缩文件
###1.4.1网关组
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-gw1/sumapaylog/${DATE}_idca-gw1_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-gw1/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-gw1/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-gw1/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw1/sumapaylog/
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-gw2/sumapaylog/${DATE}_idca-gw2_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-gw2/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-gw2/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-gw2/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw2/sumapaylog/
###1.4.2平台组
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-app1/sumapaylog/${DATE}_idca-app1_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-app1/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-app1/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-app1/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-app1/sumapaylog/
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-app2/sumapaylog/${DATE}_idca-app2_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-app2/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-app2/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-app2/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-app2/sumapaylog/
###1.4.3业务组
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-biz1/sumapaylog/${DATE}_idca-biz1_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-biz1/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-biz1/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-biz1/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz1/sumapaylog/
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-biz2/sumapaylog/${DATE}_idca-biz2_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-biz2/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-biz2/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-biz2/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz2/sumapaylog/
###1.4.4核心服务器组
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-core1/sumapaylog/${DATE}_idca-core1_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-core1/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-core1/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-core1/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-core1/sumapaylog/
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-core2/sumapaylog/${DATE}_idca-core2_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-core2/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-core2/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-core2/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-core2/sumapaylog/
###1.4.5对账服务组
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-bdb1/sumapaylog/${DATE}_idca-bdb1_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-bdb1/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-bdb1/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-bdb1/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-bdb1/sumapaylog/
###1.4.6运营组
#tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-ope/sumapaylog/${DATE}_idca-ope_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-ope/sumapaylog/
#mv /sumafile/log/Log_segmentation/$DATE/idca-ope/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-ope/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-ope/sumapaylog/
###1.4.7调度组
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-sch/sumapaylog/${DATE}_idca-sch_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-sch/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-sch/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-sch/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-sch/sumapaylog/
###1.4.8连接器组
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-con21/sumapaylog/${DATE}_idca-con21_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-con21/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-con21/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-con21/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/sumapaylog/
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-con22/sumapaylog/${DATE}_idca-con22_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-con22/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-con22/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-con22/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/sumapaylog/
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-con23/sumapaylog/${DATE}_idca-con23_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-con23/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-con23/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-con23/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/sumapaylog/
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-con27/sumapaylog/${DATE}_idca-con27_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-con27/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-con27/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-con27/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con27/sumapaylog/
tar -zxvf /sumafile/log/Log_segmentation/$DATE/idca-con29/sumapaylog/${DATE}_idca-con29_sumapaylog.tar.gz -C /sumafile/log/Log_segmentation/$DATE/idca-con29/sumapaylog/
mv /sumafile/log/Log_segmentation/$DATE/idca-con29/sumapaylog/log/* /sumafile/log/Log_segmentation/$DATE/idca-con29/
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con29/sumapaylog/
##1.5过滤日志并删除原日志
###1.5.1网关组
####1.5.1.1 ica-gw1
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-gw1/businessUser.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-gw1/businessUser.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw1/businessUser.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-gw1/hsbapi.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-gw1/hsbapi.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw1/hsbapi.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-gw1/merchant.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-gw1/merchant.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw1/merchant.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-gw1/website.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-gw1/website.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw1/website.log.${DATE}
####1.5.1.2 idca-gw2
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-gw2/businessUser.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-gw2/businessUser.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw2/businessUser.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-gw2/hsbapi.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-gw2/hsbapi.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw2/hsbapi.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-gw2/merchant.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-gw2/merchant.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw2/merchant.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-gw2/website.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-gw2/website.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-gw2/website.log.${DATE}
###1.5.2平台组
####1.5.2.1 idca-app1
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-app1/finance/finance.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-app1/finance/finance.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-app1/finance/finance.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-app1/front/pay-front.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-app1/front/pay-front.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-app1/front/pay-front.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-app1/front/pay-front-record.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-app1/front/pay-front-record.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-app1/front/pay-front-record.log.${DATE}
####1.5.2.2 idca-app2
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-app2/finance/finance.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-app2/finance/finance.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-app2/finance/finance.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-app2/front/pay-front.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-app2/front/pay-front.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-app2/front/pay-front.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-app2/front/pay-front-record.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-app2/front/pay-front-record.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-app2/front/pay-front-record.log.${DATE}
###1.5.3业务组
####1.5.3.1 idca-biz1
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-biz1/biz/disburse-front-record.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-biz1/biz/disburse-front-record.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz1/biz/disburse-front-record.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-biz1/biz/pay-front-record.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-biz1/biz/pay-front-record.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz1/biz/pay-front-record.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-biz1/biz/withholding.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-biz1/biz/withholding.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz1/biz/withholding.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-biz1/disburse/disburse.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-biz1/disburse/disburse.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz1/disburse/disburse.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-biz1/hsbdepository/hsbdepository.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-biz1/hsbdepository/hsbdepository.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz1/hsbdepository/hsbdepository.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-biz1/pay/pay.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-biz1/pay/pay.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz1/pay/pay.log.${DATE}
####1.5.3.2 idca-biz2
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-biz2/biz/disburse-front-record.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-biz2/biz/disburse-front-record.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz2/biz/disburse-front-record.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-biz2/biz/pay-front-record.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-biz2/biz/pay-front-record.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz2/biz/pay-front-record.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-biz2/biz/withholding.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-biz2/biz/withholding.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz2/biz/withholding.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-biz2/disburse/disburse.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-biz2/disburse/disburse.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz2/disburse/disburse.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-biz2/hsbdepository/hsbdepository.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-biz2/hsbdepository/hsbdepository.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz2/hsbdepository/hsbdepository.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-biz2/pay/pay.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-biz2/pay/pay.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-biz2/pay/pay.log.${DATE}
###1.5.4核心组
####1.5.4.1 idca-core1
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-core1/deadmessage/deadmessage.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-core1/deadmessage/deadmessage.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-core1/deadmessage/deadmessage.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-core1/finance/finance.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-core1/finance/finance.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-core1/finance/finance.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-core1/merchantNotice/merchantNotice.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-core1/merchantNotice/merchantNotice.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-core1/merchantNotice/merchantNotice.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-core1/mq/mq_group_minitor.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-core1/mq/mq_group_minitor.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-core1/mq/mq_group_minitor.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-core1/platform/merchant.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-core1/platform/merchant.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-core1/platform/merchant.log.${DATE}
####1.5.4.2 idca-core2
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-core2/finance/finance.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-core2/finance/finance.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-core2/finance/finance.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-core2/merchantNotice/merchantNotice.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-core2/merchantNotice/merchantNotice.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-core2/merchantNotice/merchantNotice.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-core2/platform/merchant.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-core2/platform/merchant.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-core2/platform/merchant.log.${DATE}
###1.5.5对账组
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-bdb1/finance/bankcheck.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-bdb1/finance/bankcheck.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-bdb1/finance/bankcheck.log
###1.5.6调度组
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-sch/schedual.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-sch/schedual.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-sch/schedual.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-sch/schedual/control.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-sch/schedual/control.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-sch/schedual/control.log
###1.5.7运营组
###1.5.8连接器组
####1.5.8.1 idca-con21
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/pay_sms.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/pay_sms.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/pay_sms.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cdms_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cdms_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cdms_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cfca.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cfca.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cfca.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cfcap_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cfcap_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cfcap_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cfca_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cfca_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cfca_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cmbbank.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cmbbank.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cmbbank.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cmsbbank.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cmsbbank.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cmsbbank.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cmsb_unionpay.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cmsb_unionpay.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/cmsb_unionpay.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/hfb2_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/hfb2_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/hfb2_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/icbc_disburse.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/icbc_disburse.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/icbc_disburse.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/nyfd_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/nyfd_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/nyfd_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/nyf_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/nyf_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/nyf_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/pab_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/pab_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/pab_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/sft3.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/sft3.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/sft3.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/smsw.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/smsw.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/smsw.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/szicbc.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/szicbc.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/szicbc.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/szyl.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/szyl.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/szyl.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/umb.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/umb.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/umb.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/ysb_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/ysb_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/ysb_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/yzf_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/yzf_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/yzf_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/ysepay_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/ysepay_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con21/connector/ysepay_withholding.connector.log
####1.5.8.2 idca-con22
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/pay_sms.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/pay_sms.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/pay_sms.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cdms_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cdms_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cdms_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cfca.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cfca.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cfca.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cfcap_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cfcap_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cfcap_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cfca_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cfca_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cfca_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cmbbank.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cmbbank.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cmbbank.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cmsbbank.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cmsbbank.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cmsbbank.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cmsb_unionpay.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cmsb_unionpay.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/cmsb_unionpay.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/hfb2_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/hfb2_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/hfb2_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/icbc_disburse.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/icbc_disburse.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/icbc_disburse.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/nyfd_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/nyfd_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/nyfd_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/nyf_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/nyf_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/nyf_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/pab_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/pab_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/pab_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/sft3.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/sft3.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/sft3.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/smsw.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/smsw.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/smsw.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/szicbc.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/szicbc.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/szicbc.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/szyl.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/szyl.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/szyl.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/umb.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/umb.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/umb.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/ysb_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/ysb_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/ysb_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/hxbbank.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/hxbbank.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/hxbbank.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/ysepay_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/ysepay_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/ysepay_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/sft2.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/sft2.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con22/connector/sft2.connector.log
####1.5.8.3 idca-con23
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/pay_sms.log.${DATE} | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/pay_sms.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/pay_sms.log.${DATE}
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cdms_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cdms_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cdms_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cfca.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cfca.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cfca.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cfcap_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cfcap_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cfcap_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cfca_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cfca_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cfca_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cmbbank.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cmbbank.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cmbbank.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cmsbbank.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cmsbbank.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cmsbbank.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cmsb_unionpay.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cmsb_unionpay.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cmsb_unionpay.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/hfb2_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/hfb2_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/hfb2_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/icbc_disburse.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/icbc_disburse.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/icbc_disburse.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/nyfd_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/nyfd_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/nyfd_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/nyf_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/nyf_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/nyf_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/pab_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/pab_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/pab_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/sft3.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/sft3.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/sft3.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/smsw.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/smsw.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/smsw.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/szicbc.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/szicbc.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/szicbc.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/szyl.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/szyl.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/szyl.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/umb.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/umb.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/umb.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/ysb_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/ysb_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/ysb_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/yzf_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/yzf_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/yzf_withholding.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cgbbank.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cgbbank.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cgbbank.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cebbank.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cebbank.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/cebbank.connector.log
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/ysepay_withholding.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/ysepay_withholding.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con23/connector/ysepay_withholding.connector.log
#####1.5.8.4 idca-con29
awk '/^'$DATE'/, $1=="'$DATE_TODAY'" {print }' /sumafile/log/Log_segmentation/$DATE/idca-con29/connector/xmmsfastpay.connector.log | awk 'BEGIN{RS="'$DATE'"} /'ERROR'|'OutOfMemory'/ { print RS, $0}' >> /sumafile/log/Log_segmentation/$DATE/idca-con29/connector/xmmsfastpay.connector.error.log.${DATE}
rm -rf /sumafile/log/Log_segmentation/$DATE/idca-con29/connector/xmmsfastpay.connector.log
##1.6压缩文件
cd /sumafile/log/Log_segmentation/$DATE/
zip -r /sumafile/log/temp-analyzer/analyzer-error-log-${DATE}.zip ./*
rm -rf /sumafile/log/Log_segmentation/${DATE}/
awk日志分割的更多相关文章
- Linux日志分割脚本
该脚本的功能是定时分割日志文件 #!/usr/bin/env bash #定时分割清理日志文件 #usage="Usage: logrotate (start|stop) file (lin ...
- nginx 直接在配置文章中设置日志分割
直接在nginx配置文件中,配置日志循环,而不需使用logrotate或配置cron任务.需要使用到$time_iso8601 内嵌变量来获取时间.$time_iso8601格式如下:2015-08- ...
- apache2.4配置访问日志分割并过滤图片CSS等无用内容
相关信息 1.apache日志有访问日志和错误日志,错误日志根据日志级别来输出错误信息,而访问日志根据定义的日志格式来记录访问动作 2.访问日志格式在httpd.conf文件里面定义,在虚拟主机里面引 ...
- Nginx常用日志分割方法
方式一: nginx cronolog日志分割配置文档,根据下面方法,每分钟分割一次NGINX访问日志. 1.nginx日志配置 access_log /var/log/nginx/access.lo ...
- python 跨模块实现按照文件大小，日期实现日志分割，反转
笔者的一个自动化测试平台项目,采用了python作为后端服务器语言.项目基于快速成型目的,写了一个极其简陋的日志记录功能,支持日志记录到文件和支持根据日志级别在终端打印不同颜色的log.但随着测试平台 ...
- Nginx高性能服务器安装、配置、运维 （6） —— Nginx日志及日志分割
七.Nginx日志及日志分割 (1)Nginx日志文件 查看Nginx配置文件: 找到access_log,yum安装默认存储在/var/log/nginx目录下,且默认main格式: main格式定 ...
- Apache日志分割
1.cronolog安装 采用 cronolog 工具进行 apache 日志分割 http://download.chinaunix.net/download.php?id=3457&Res ...
- nginx 日志分割（简单、全面）
Nginx 日志分割 因业务需要做了简单的Nginx 日志分割, 第1章 详细配置如下. #建议在mkdir /home/shell -p 专门写shell 脚本位置 root@localhost ...
- Tomcat 的 catalina.out 日志分割
一.背景 Tomcat 的 catalina.out 日志量不断增加,占用空间较大,且默认是不滚动的.因此,需要对其进行日志分割,并进行清理. 本文选用 Cronolog 对其进行分割. 二.安装 1 ...
随机推荐
- CodeForces 689C【二分】
转自: http://blog.csdn.net/qq_26071477/article/details/51892995 #include<stdio.h> typedef long l ...
- Unity3D中调用外接摄像头，并保存为图片文件
http://bbs.9ria.com/thread-170539-1-1.html 项目要求调用摄像头,并且把图像保存下来,上传到服务器. 这里有几个难点,调用摄像头是很简单的,unity已经提供好 ...
- 3D游戏中人物换装解决方案
换装基本上是每个网游都必须有的一个功能,每种网游的做法都各有不同,有些是换掉整个模型,有些则是通过可以换掉模型的一个部分完成.前者属于整体换,相对简单些:后者则是通过部分替换实现,目前用的比较多,本文 ...
- c# IOCP.ClientEx2.ReadWrite 加断点遭遇System.AccessViolationException 问题
起因: 如果在Debug模式下,在IOCP.ClientEx2.ReadWrite.cs while (0 > (nPackSize = _ipcp.Pack(arg_n64PackId, ar ...
- 【SpringCloud构建微服务系列】分布式链路跟踪Spring Cloud Sleuth
一.背景 随着业务的发展,系统规模越来越大,各微服务直接的调用关系也变得越来越复杂.通常一个由客户端发起的请求在后端系统中会经过多个不同的微服务调用协同产生最后的请求结果,几乎每一个前端请求都会形成一 ...
- 对单片机C语言的一些误用和总结
在学习单片机的时候才真正知道C语言是什么它是来干什么的~但是C语言用到嵌入式只是它小小的一部分他的应用还有很多地方呢,呵呵我们这里就不讨论这个了.我们是不是在写程序的时候错误很多就算编译通过了也达不到 ...
- Log4j2 - 动态生成Appender
功能需求 项目里将User分成了各个区域(domain),这些domain有个标志domainId,现在要求在打印日志的时候,不仅将所有User的日志都打印到日志文件logs/CNTCore.log中 ...
- AKOJ-2010-魔法石
链接:https://oj.ahstu.cc/JudgeOnline/problem.php?id=2010 题意: Vyoung最近收集到一大批魔法石,这些魔法石有两种特性,攻击和防守,不同特性的两 ...
- python入门之实例-用户登录、注册
用户密码存储文件db(其中用户和密码之间用$符合隔开): admin$123456 root$sdfk9f24 chy$654321 代码如下: def login(username,password ...
- 转:在linux中vi 文件里行尾奇怪的^M及解决
Linux编辑器vim中删除行尾的^M 有时候,在 Linux 中使用打开曾在 Windows 中编辑过的文件时,会在行尾看到 ^M 字符.看起来总是感觉很别扭. 删除方法如下: 在 Vim 的命令模 ...