- Official documentation for pytbull v2.1 -

Description

pytbull is an Intrusion Detection/Prevention System (IDS/IPS) Testing Framework for Snort, Suricata and any IDS/IPS that generates an alert file. It can be used to test the detection and blocking capabilities of an IDS/IPS, to compare IDS/IPS, to compare configuration modifications and to check/validate configurations.

The framework is shipped with about 300 tests grouped in 11 testing modules:

  1. badTraffic: Non RFC compliant packets are sent to the server to test how packets are processed.
  2. bruteForce: tests the ability of the server to track brute force attacks (e.g. FTP). Makes use of custom rules on Snort and Suricata.
  3. clientSideAttacks: this module uses a reverse shell to provide the server with instructions to download remote malicious files. This module tests the ability of the IDS/IPS to protect against client-side attacks.
  4. denialOfService: tests the ability of the IDS/IPS to protect against DoS attempts
  5. evasionTechniques: various evasion techniques are used to check if the IDS/IPS can detect them.
  6. fragmentedPackets: various fragmented payloads are sent to server to test its ability to recompose them and detect the attacks.
  7. ipReputation: tests the ability of the server to detect traffic from/to low reputation servers.
  8. normalUsage: Payloads that correspond to a normal usage.
  9. pcapReplay: enables to replay pcap files
  10. shellCodes: send various shellcodes to the server on port 21/tcp to test the ability of the server to detect/reject shellcodes.
  11. testRules: basic rules testing. These attacks are supposed to be detected by the rules sets shipped with the IDS/IPS.
  1. badTraffic:测试如何处理低质流量
  2. bruteForce:测试暴力攻击
  3. clientSideAttacks:测试客户端攻击
  4. denialOfService:测试 DoS 攻击
  5. evasionTechniques:测试各种闪避技术
  6. fragmentedPackets:测试各种碎片攻击
  7. ipReputation:测试服务器的 IP 信誉
  8. normalUsage:测试一般用法
  9. pcapReplay:启用 pcap 文件重放
  10. shellCodes:测试 shell code
  11. testRules:基本规则测试

It is easily configurable and could integrate new modules in the future.

There are basically 5 types of tests:

  1. socket: open a socket on a given port and send the payloads to the remote target on that port.
  2. command: send command to the remote target with the subprocess.call() python function.
  3. scapy: send special crafted payloads based on the Scapy syntax
  4. client side attacks: use a reverse shell on the remote target and send commands to it to make them processed by the server (typically wget commands).
  5. pcap replay: enables to replay traffic based on pcap files

Architecture

Remote mode

In this mode, the IDS is plugged on the span port (or port mirroring) of the core switch and is configured in promiscuous mode. The IDS analyzes all traffic that goes through the core switch. Malicious files can be downloaded either by pytbull or by the server. This mode is called "remote".
 

Local mode

In this mode, files are downloaded on the client pytbull is started from.

IDS mode with attacked server in DMZ

In this configuration, a firewall splits the network into 3 parts (lan, wan, dmz). The IDS is plugged in a span port (or port mirroring) of the switch with its interface configured in promiscuous mode. It will analyze every traffic that is sent to the LAN interface of the firewall.
 

IPS mode

In this configuration, a firewall splits the network into 3 parts (lan, wan, dmz). The IDS is plugged between pytbull and the firewall. To give the IDS a chance to detect the malicious files, pytbull has to download the infected files itself.
 

IPS mode with attacked server in DMZ

In this configuration, a firewall splits the network into 3 parts (lan, wan, dmz). The IDS is plugged between pytbull and the firewall. Malicious files have to be downloaded by pytbull directly to give the IDS a chance to detect them.
 

Installation

Standard installation (client)

Prerequisites

Ensure Python (2.6.5) and following dependencies are installed. On a Debian based Linux distribution, just issue:

$ sudo apt-get install python python-scapy python-feedparser python-cherrypy3

Also install necessary tools (nmap, hping3, nikto, ab, ...). Either install them from sources or from the repositories. From the packages, this can be simply done by issuing:

$ sudo apt-get install nmap hping3 nikto tcpreplay apache2-utils

At last, you will need ncrack to test the bruteForce module:

$ sudo aptitude install build-essential checkinstall libssl-dev libssh-dev
$ wget https://nmap.org/ncrack/dist/ncrack-0.5.tar.gz
$ tar -xzf ncrack-0.5.tar.gz
$ cd ncrack-0.5
$ ./configure
$ make
$ sudo make install

Pytbull

From tar.bz2 (stable release)

Download and uncompress pytbull:

$ cd /usr/local/src/
$ wget https://downloads.sourceforge.net/project/pytbull/pytbull-2.0.tar.bz2
$ bzip2 -cd pytbull-2.0.tar.bz2 | tar xf -
$ sudo mv pytbull/ /opt/
$ cd /opt/python/

There is nothing to install, but some configuration to do. Please refer to the next section.

From Mercurial (development release)

If you wish to obtain the latest development release, install pytbull from Mercurial. As a prerequisite, install Mercurial:

$ sudo apt-get install mercurial

Then get pytbull as follows:

$ cd /opt/
$ sudo hg clone http://pytbull.hg.sourceforge.net:8000/hgroot/pytbull/pytbull

Server

Prerequisites

Install Python (2.6.5). On a Debian based Linux box, just issue:

$ sudo apt-get install python

You will also need to install a FTP server (port 21/tcp), apache2 (port 80/tcp) and SSH (port 22/tcp):

$ sudo apt-get install vsftpd apache2 openssh-server

The configuration file for vsftpd is located in /etc/vsftpd.conf. It is advised to have at least these 2 parameters:

# Allow anonymous FTP? (Disabled by default)
anonymous_enable=NO
# Uncomment this to allow local users to log in.
local_enable=YES

pytbull (server)

You can copy the reverse shell from the server/ directory into the server that hosts the IDS/IPS.

Installation on Backtrack 5

pytbull is already shipped with BackTrack. Just use the dedicated configuration file:

$ sudo ./pytbull -c conf/config.bt5.cfg -t 192.168.1.16

Installation on Mac OS X

Mac OS X is not officially supported. However, I've developed pytbull on my Mac ;-)

  • Install Macports
  • Install python and its necessary bindings:
$ sudo port install python26
$ sudo port select --set python python26
$ sudo port install py26-scapy
$ sudo port install py26-iniparse
$ sudo port install py26-feedparser
  • Install tools:
$ sudo port install nmap
$ sudo port install hping3
$ sudo port install tcpreplay

Configuration file

CLIENT section

CLIENT section
ipaddr The IP address of the client where pytbull is installed.
iface Interface used by pytbull to send the payloads.
useproxy 0 or 1. Only used by the client to connect to googlecode to check if a newer version of Pytbull is available.
proxyhost IP address of the proxy, e.g. 192.168.100.1
proxyport Integer. Proxy port, e.g. 8080
proxyuser Proxy username (used for proxies that require an authentication).
proxypass Proxy password (used for proxies that require an authentication).

PATHS section

PATHS section
urlpdf URL to your third party server (where malicious PDF files are hosted). 
Don't put a trailing slash at the end of the URL
pdfdir Relative path to the place where malicious pdf files will be saved. Default to pdf/malicious
Don't put a trailing slah at the end of the path.
pcapdir Relative path to the place where pcap files are stored. Default: pcap
Don't put a trailing slah at the end of the path.
tempfile Temporary file used by pytbull. Default value: /tmp/pytbull.tmp
alertsfile Path to your remote alerts file (Snort, Suricata, other). Default to /var/log/snort/alert (for Snort)

ENV section

ENV section
sudo Path to the sudo command. Default to /usr/bin/sudo
nmap Path to your nmap. Default to /usr/bin/nmap
nikto Path to your nikto. Default to /pentest/scanners/nikto-2.1.4/nikto.pl
niktoconf Path to your nikto configuration file. Default to /pentest/scanners/nikto-2.1.4/nikto.conf
hping3 Path to your hping3. Default to /usr/sbin/hping3
tcpreplay Path to your tcpreplay. Default to /usr/bin/tcpreplay
localhost Environment variable used in some tests. Default to 127.0.0.1

FTP section

FTP section
ftpproto Method used to grab the alerts file. Possible values: ftp, ftps, sftp. Default: ftp
ftpport Port (TCP) used to grab the alerts file. Default: 21
ftpuser Login to connect to the remote FTP service (Snort/Suricata)
ftppasswd Password to 1connect to the remote FTP service (Snort/Suricata)

TIMING section

TIMING section
sleepbeforegetalerts Integer. Time elapsed (in seconds) before getting the alerts, just after the payload has been sent to the server. Default: 2
sleepbeforenexttest Integer. Time elapsed (in seconds) between 2 tests. Default: 2
sleepbeforetwoftp Integer. Apply to multipleFailedLogins module. Time elapsed (in seconds) between 2 bad login attempts. Default to 2
urltimeout Integer. Apply to all internet connections. Time (in seconds) before considering the resource as inaccessible. Default to 10

SERVER section

SERVER section
reverseshellport Defines the tcp port to use for the reverse shell (used by the clientSideAttacks module). Default value: 12345

TESTS section

TESTS section
clientSideAttacks Client side attacks module. Will check that the reverse shell is running on the remote server (Snort/Suricata). Refer to the clientSideAttacks.py to change the payloads. 
Value=0|1
testRules Test Rules module. Will test alerts based on signature files. Refer to the testRules.py source to change the payloads. 
Value=0|1
badTraffic Bad Traffic module. Will send non RFC compliant packets to the remote target. Refer to the badTraffic.py source to change the payloads. 
Value=0|1
fragmentedPackets Fragmented Packets module. Will fragment attacks on multiple small packets. Refer to the fragmentedPackets.py source to change the payloads. 
Value=0|1
multipleFailedLogins Multiple Failed Logins module. Will basically do a brute force attempt against the remote FTP service. Refer to the multipleFailedLogins.py source to change the payloads. 
Value=0|1
evasionTechniques Evasion Techniques module. Will send obfuscated attacks to the remote target. Refer to the evastionTechniques.py to change the payloads. 
Value=0|1
shellCodes ShellCodes module. Will send malicious hex-encoded payloads to the remote target. Refer to the shellCodes.py source to change the payloads. 
Value=0|1
denialOfService Denial of Service module. Will attempt to flood the server with special packets. Refer to the denialOfService.py source to change the payloads. 
Value=0|1
pcapReplay Pcap replay module. Enables to replay actions from a pcap file. 
Value=0|1

TESTS_PARAMS section

TESTS_PARAMS section
ipreputationnbtests Number of probed IPs for the ipReputation module. 
integer

Usage

If you have selected the clientSideAttacks module (see configuration file section for more information), you will need to start the reverse shell on the server. Following command uses port 34567/tcp:

$ ./pytbull-server.py -p 34567

Since the files are downloaded in the current directory, you can create a pdf/ directory and start pytbull from the parent location:

$ mkdir pdf/
$ cd pdf/
$ ../pytbull-server.py -p 34567

Then start pytbull (on the client side). An example to start pytbull tests against 192.168.100.48, running Snort:

$ sudo ./pytbull -t 192.168.100.48

Notice that you will need to adapt (config.cfg) the port used by the reverse shell if you use the optional parameter -p on remote side.

Errors

SetGen is not defined

While running pytbull, if you have following error:

Traceback (most recent call last):
File "./pytbull.py", line 507, in <module>
oPytbull.doAllTests()
File "./pytbull.py", line 333, in doAllTests
self.doTest( eval( ('%s.%s'+'(self._target).getPayloads()') % (module[1],
module[1][:1].upper()+module[1][1:]) ) )
File "./pytbull.py", line 197, in doTest
eval(payload[2])
File "<string>", line 1, in <module>
File "/usr/lib/pymodules/python2.6/scapy/sendrecv.py", line 235, in send
__gen_send(conf.L3socket(*args, **kargs), x, inter=inter, loop=loop,
count=count,verbose=verbose)
File "/usr/lib/pymodules/python2.6/scapy/sendrecv.py", line 207, in __gen_send
x = SetGen(x)
NameError: global name 'SetGen' is not defined

Just add following line at the beginning of this file: /usr/lib/pymodules/python2.6/scapy/sendrecv.py as follows: (http://trac.secdev.org/scapy/ticket/324)

from base_classes import SetGen

Nmap illegal argument

If you get this error:

Illegal Argument to -P, use -PN, -PO, -PI, -PB, -PE, -PM, -PP, -PA, -PU, -PT,
or -PT80 (or whatever number you want for the TCP probe destination port)
QUITTING!

Replace "-Pn" with "-PN" in the Nmap tests. Nmap has changed the syntax in recent releases.

FTP Error, 550 Failed to open file

If you have this error while all tests passed (BASIC CHECKS):

***ERROR: FTP Error, 550 Failed to open file.
Check your configuration (section FTP in config.cfg).
Also check privileges on remote host.

It means that pytbull is unable to gather the alerts file with the credentials specified in the configuration file.

Check that the alerts file path is correct ([PATHS] section, param "alertsfile") and check that the user (section [FTP], param "ftpuser") is allowed to access the alerts file.

I recommend to manually perform these tests using Filezilla.

Syntax - Write your own tests

Well, want to contribute or just write your own tests? Just that easy...

Using configuration variables

Some commands (sudo, nmap, hping, ...) are specified in the configuration file (config.cfg). You can consider them as environment variables. If you write your own tests, you can call them as follows:

%{VAR}

Where:

  • {VAR} represents the name of the environment variable as defined in the configuration file.

Example:

%sudo% %nmap% -sX -p 80 %target%

Notice that the old syntax still works:

self.config.get('{SECTION}', '{VAR}')

Where:

  • {SECTION} represents the section name in the configuration file (e.g. 'PATHS')
  • {VAR} is the name of the variable

Based on sockets

Syntax:

self.payloads.append([
'{TEST_NAME}',
'socket',
{PORT},
'{PAYLOAD}',
'{PATTERN}'
])

Where:

  • TEST_NAME: String corresponding to the test name. Example: "Simple LFI test"
  • PORT: Integer. TCP port to connect to. Example: 22 (SSH)
  • PAYLOAD: Payload to send. For example: "GET /index.php?page=../../../etc/passwd HTTP/1.1\r\nHost: 127.0.0.1\r\nUser-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.5) Gecko/20041202 Firefox/1.0\r\n\r\n"
  • PATTERN: Pattern for string matching

Example:

self.payloads.append([
"Javascript Obfuscation",
"socket",
80,
"""GET /index.php?page=%sCscript%3Ealert%28%29%3C%2Fscript%3E HTTP/1.1\r\nHost: 127.0.0.1\r\n\r\n""",
""
])

Based on a command

Syntax:

self.payloads.append([
'{TEST_NAME}',
'command',
{COMMAND_ARGS_ARRAY},
'{PATTERN}'
])

Where:

  • TEST_NAME: String corresponding to the test name.
  • COMMAND_ARGS_ARRAY: Array of the command and arguments.
  • PATTERN: Pattern for string matching

Example

self.payloads.append([
"Full SYN Scan",
"command",
[self.config.get('PATHS','sudo'), self.config.get('PATHS','nmap'),
'-sS', '-p-', self._target],
"122:1:1"
])

Based on Scapy

Syntax

self.payloads.append([
'{TEST_NAME}',
'scapy',
'{SCAPY_PAYLOAD}',
'{PATTERN}'
])

Where

  • TEST_NAME: String identifying the test
  • SCAPY_PAYLOAD: String representing the Scapy payload. Example: """sr1(IP(dst="%s")/TCP(dport=1433)/"0"*1000)""" % self._target
  • PATTERN: Pattern for string matching

Example

self.payloads.append([
"Ping of death",
"scapy",
"""send(fragment(IP(dst="%s")/ICMP()/("X"*60000)), verbose=0)""" % self._target,
"123:"
])

Based on pcap

Syntax

self.payloads.append([
'{TEST_NAME}',
'pcap',
'{PCAP_PATH}',
'{PATTERN}'
])

Where

  • TEST_NAME: String identifying the test
  • PCAP_PATH: Path to pcap to be replayed
  • PATTERN: Pattern for string matching

Example:

self.payloads.append([
"test",
"pcap",
"pcap/test.pcap",
"129:15:1"
])

pytbull 手册的更多相关文章

  1. FREERTOS 手册阅读笔记

    郑重声明,版权所有! 转载需说明. FREERTOS堆栈大小的单位是word,不是byte. 根据处理器架构优化系统的任务优先级不能超过32,If the architecture optimized ...

  2. JS魔法堂:不完全国际化&本地化手册 之 理論篇

    前言  最近加入到新项目组负责前端技术预研和选型,其中涉及到一个熟悉又陌生的需求--国际化&本地化.熟悉的是之前的项目也玩过,陌生的是之前的实现仅仅停留在"有"的阶段而已. ...

  3. 转职成为TypeScript程序员的参考手册

    写在前面 作者并没有任何可以作为背书的履历来证明自己写作这份手册的分量. 其内容大都来自于TypeScript官方资料或者搜索引擎获得,期间掺杂少量作者的私见,并会标明. 大部分内容来自于http:/ ...

  4. Redis学习手册(目录)

    为什么自己当初要选择Redis作为数据存储解决方案中的一员呢?现在能想到的原因主要有三.其一,Redis不仅性能高效,而且完全免费.其二,是基于C/C++开发的服务器,这里应该有一定的感情因素吧.最后 ...

  5. JS魔法堂:不完全国际化&本地化手册 之 实战篇

    前言  最近加入到新项目组负责前端技术预研和选型,其中涉及到一个熟悉又陌生的需求--国际化&本地化.熟悉的是之前的项目也玩过,陌生的是之前的实现仅仅停留在"有"的阶段而已. ...

  6. Windows API 函数列表 附帮助手册

    所有Windows API函数列表,为了方便查询,也为了大家查找,所以整理一下贡献出来了. 帮助手册:700多个Windows API的函数手册 免费下载 API之网络函数 API之消息函数 API之 ...

  7. linux命令在线手册

    下面几个网址有一些 Linux命令的在线手册,而且还是中文的,还可以搜索.非常方便 Linux命令手册 Linux命令大全 Linux中文man在线手册 每日一linux命令

  8. Mysql完全手册(笔记二,使用数据与性能优化)

    一.使用数据 1.使用变量 MySQL也可以让我们以用户自定义的变量来存储select查询的结果,以便在将来select查询中使用.它们只会在客户会话期间存在,但是它们提供一个方便有效的方法来连接查询 ...

  9. html javascript css3 php3.2.3离线手册

    各位新年快乐! 愿大家"愿有前程可奔赴,也有岁月可回头"! 发现个离线手册很全的网站,分享大家,也mark自用. http://www.shouce.ren/ 手册网

随机推荐

  1. 1.2.4 Excel快速建立n个文件夹

    1.准备员工信息表,选中名字 2.[设置单元格格式]>[数字]>[自定义]>右侧的[类型]>输入”md ”@>单击[确定] 3.确定后在姓名前会出现md,新建文本文档,将 ...

  2. QT QHttpMultiPart上传图片

    使用get请求或post请求可以传递简单的参数,但要上传图片到服务器,就要多做一些工作了,如下代码片段利用post请求可成功上传图片到服务器: QNetworkRequest request; req ...

  3. centos 使用RPM包安装指定版本的docker-engine

    下面是拿安装docker-engine-1.10.3-1为例: wget https://yum.dockerproject.org/repo/main/centos/7/Packages/docke ...

  4. Caused by: io.protostuff.ProtobufException: Protocol message contained an invalid tag (zero).

    [ERROR] com.xxxx.redis.RedisClientTemplate.getOject(RedisClientTemplate.java:60):http-bio-8080-exec- ...

  5. 报错:org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.

    报错环境: CDH中集成的hive服务,启动报错,所以初始化一下元数据. 配置文件:/etc/hive/conf hive-site.xml 命令目录:/opt/cloudera/parcels/CD ...

  6. 原生js中用Ajax进行get传参

    原生js中用Ajax进行get传参 案例: <!DOCTYPE html> <html> <head> <meta charset="UTF-8&q ...

  7. Python的socket

    第一部分socket的简单示例 服务器部分: """ Description: Author:Nod Date: Record: #------------------- ...

  8. 当一个HTML元素需要添加mouseon、mouseout与click事件,或者mouserenter、mouseleave和click事件时,click事件无法触发

    当一个HTML元素需要添加mouseon.mouseout与click事件,或者mouserenter.mouseleave和click事件时,click事件无法触发 针对上述问题,我遇到的有两种情况 ...

  9. [Oracle,2018-02-07] Oracle 报错:“ORA-02292:违反完整约束条件(XXX.FKXXX)

    报错的原因很清楚,就是你要删除的记录是另外某条记录的外键,解决办法: 1.删除子记录,在删除本记录: 2.暂时禁用此外键(适合在测试后清除所有记录的情况,记得最后要恢复此外键) 解决办法有了,现在最主 ...

  10. ubuntu vsftp

    转自:https://www.cnblogs.com/java-synchronized/p/6935711.html 12点多了,擦!做个码农真不容易呀! 系统:Ubuntu16.04 安装:FTP ...