3.1 FTP - Test

Realization:

Altogether 8 files (for the 10 MBit/s test) or 16 files (for the 100 MBit/s test) of different sizes were transmitted using FTP over IPv4 and IPv6. The test was performed over a 10 MBit/s ethernet LAN connection and over a 100 MBit/s ethernet LAN connection. The source-host for the 10 MBit test was smaug.fh-regensburg.de, running NetBSD 1.6.1. For the 100 MBit test it was yui.fh-regensburg, also running NetBSD 1.6.1.
These computers are hosts on our local network, like as well the destination-host rfhnt8004.fh-regensburg.de. ( Description under point 1)
The ftp-deamon included in NetBSD is implemented with IPv6 support by default.
On rfhnt8004 we installed different operating systems on its scsi-hard discs.

ls-Outputs of the used files

-on smaug:

smaug: /pub/NetBSD/

1: -rw-r--r-- 1 feyrer wheel 167457891 Apr 27 2001 i386-compat_svr4.tgz

smaug: /pub/NetBSD/distfiles/

2: -rw-rw-r-- 1 www cvs 109167758 Feb 12 2002  oo_641_src.tar.bz2
3: -rw-r--r--   1 root    cvs   39952700 Jul 4 2002       ns-src-2.1b9a.tar.gz
4: -rw-r--r--   1 root    cvs   31867608 Jul 1 01:08     mozilla-source-1.4.tar.bz2
5: -rw-r--r--   1 root    cvs   29793828 Jul 30 00:42   MozillaFirebird-source-0.6.1.tar.bz2
6: -rw-r--r--   1 root    cvs   20399831 Mar 19 13:57 emacs-21.3.tar.gz
7: -rw-r--r--   1 root    cvs   14269432 Jun 12 19:31   binutils-2.14.tar.gz
8: -rw-r--r--   1 root    cvs     5879824 Jun  9 22:23     xorp-0.3.tar.gz

-on yui:

1: -rw-rw-r-- 1 jom30197 wheel 1091677580 Oct 1 12:05 1000MB
2: -rw-rw-r-- 1 jom30197 wheel 1310013096 Oct 1 12:10 1200MB
3: -rw-rw-r-- 1 jom30197 wheel 1528348612 Oct 1 12:11 1400MB
4: -rw-rw-r-- 1 jom30197 wheel 1746684128 Oct 1 12:13 1600MB
5: -rw-rw-r-- 1 jom30197 wheel 1965019644 Oct 1 12:16 1800MB
6: -rw-rw-r-- 1 jom30197 wheel 2183355160 Oct 1 12:19 2000MB
7:-rw-rw-r-- 1 jom30197 wheel 218335516 Oct 1 11:59 200MB
8: -rw-rw-r-- 1 jom30197 wheel 327503274 Oct 1 12:01 300MB
9: -rw-rw-r-- 1 jom30197 wheel 436671032 Oct 1 12:00 400MB
10:-rw-rw-r-- 1 jom30197 wheel 655006548 Oct 1 12:02 600MB
11: -rw-rw-r-- 1 jom30197 wheel 873342064 Oct 1 12:04 800MB
12: -rw-r--r-- 1 jom30197 wheel 29793828 Oct 1 11:57 MozillaFirebird-source-0.6.1.tar.bz2
13: -rw-r--r-- 1 jom30197 wheel 14269432 Oct 1 11:58 binutils-2.14.tar.gz
14:-rw-r--r-- 1 jom30197 wheel 20399831 Oct 1 11:57 emacs-21.3.tar.gz
15: -rw-r--r-- 1 jom30197 wheel 167457891 Oct 1 10:29 i386-compat_svr4.tgz
16: -rw-r--r-- 1 jom30197 wheel 31867608 Oct 1 11:56 mozilla-source-1.4.tar.bz2
17: -rw-r--r-- 1 jom30197 wheel 41592248 Oct 1 11:56 ns-src-2.26.tar.gz
18: -rw-rw-r-- 1 jom30197 wheel 109167758 Oct 1 11:36 oo_641_src.tar.bz2
19: -rw-r--r-- 1 jom30197 wheel 5879824 Oct 1 11:59 xorp-0.3.tar.gz


Each of these files was transmitted 10 times and a mean value was computed out of the raised Performance-values.

The fact that the transmissions really used the IPv6 resp. IPv4 Protokoll was checked with the sniffer Ethereal.
Now two screenshots of an v4 and a v6 packet displayed with Ethereal are shown:

Data transmission from smaug to rfhnt8004 via FTP over IPv4:

Data transmission from smaug to rfhnt8004 via FTP over IPv6:

Client software:

The client-ftp software used throughout this test was nc-ftp3.1.5. This famous ftp-client exists for nearly every common operating system and can be used by
shell-scripts because of its non-interactive mode (ncftpget resp. ncftpput). Because it is open software its sources and binaries can be obtained from www.ncftp.com
but it does not support IPv6 by default. We compiled v6 supporting binaries using the patch ncftp-315-v6-20030207.diff from the KAME-project. www.kame.net
For our client side scripting under an UNIX environment we used the shell scripts  FTPTestScrIP6.sh  and  FTPTestScrIP4.sh  .

3.1.1 NetBSD 1.6 --> Microsoft Windows XP

There was no need to compile nc-ftp for Windows because a excellent running and v6 supporting version of this programm can be obtaind from http://win6.jp
We automated the transfer using  batchfiles. (  FTPTestScrIP4WIN.bat.htmlFTPTestScrIP6WIN.bat  )

The following meanvalues were computed out of the exact values: ( FTPPerfOUTIP4Win.txt FTPPerfOutIP6Win.txt  )
 
 
IP v 4      
File     Performance
Name Size in Byte Size in MB in MB / s
i386-compat_svr4.tgz  167457891,00 159,70 1,08
oo_641_src.tar.bz2 109167758,00 104,11 1,02
ns-src-2.1b9a.tar.gz 39952700,00 38,10 1,09
mozilla-source-1.4.tar.bz2 31867608,00 30,39 1,05
MozillaFirebird-source-0.6.1.tar.bz2  29793828,00 28,41 1,07
emacs-21.3.tar.gz 20399831,00 19,45 1,10
binutils-2.14.tar.gz  14269432,00 13,61 1,10
xorp-0.3.tar.gz  5879824,00 5,61 1,26

 
 
IP v 6      
File     Performance
Name Size in Byte Size in MB in MB / s
i386-compat_svr4.tgz  167457891,00 159,70 1,01
oo_641_src.tar.bz2 109167758,00 104,11 1,08
ns-src-2.1b9a.tar.gz 39952700,00 38,10 1,20
mozilla-source-1.4.tar.bz2  31867608,00 30,39 1,20
MozillaFirebird-source-0.6.1.tar.bz2  29793828,00 28,41 1,15
emacs-21.3.tar.gz 20399831,00 19,45 1,19
binutils-2.14.tar.gz  14269432,00 13,61 1,11
xorp-0.3.tar.gz  5879824,00 5,61 1,28

For the exact values of the 100 Mbit /s test refer to : FTPPerfOutIP6WINYUI.html and FTPPerfOutIP4WINYUI.html

IPv6 100 Mbit /s      
File     Performance
Name Size in Byte Size in MB in MB / s
1600MB 1746684128 1669,12 3.50
1400MB 1528348612 1454,08 3.44
1200MB 1310013096 1249,28 3.34
1000MB 1091677580 1044,48 3.25
800MB 873342064 832,88 3.23
600MB 655006548 624,66 3.07
400MB 436671032 416.44 2.81
300MB 327503274 312.33 2.85
200MB 218335516 208.22 2.70
oo_641_src.tar.bz2 109167758 104.11 2.85
ns-src-2.1b9a.tar.gz 41592248 39.67 2.82
mozilla-source-1.4.tar.bz2  31867608 30.39 3.21
MozillaFirebird-source-0.6.1.tar.bz2  29793828 28.41 3.38
emacs-21.3.tar.gz 20399831 19.45 3.80
binutils-2.14.tar.gz  14269432 13.61 4.48
xorp-0.3.tar.gz  5879824 5.61 4.98

 

IPv4 100 Mbit /s      
File     Performance
Name Size in Byte Size in MB in MB / s
1600MB 1746684128 1669,12 3.98
1400MB 1528348612 1454,08 3.93
1200MB 1310013096 1249,28 3.85
1000MB 1091677580 1044,48 3.80
800MB 873342064 832,88 3.83
600MB 655006548 624,66 3.51
400MB 436671032 416.44 3.55
300MB 327503274 312.33 2.85
200MB 218335516 208.22 2.60
oo_641_src.tar.bz2 109167758 104.11 2.54
ns-src-2.1b9a.tar.gz 41592248 39.67 2.46
mozilla-source-1.4.tar.bz2  31867608 30.39 3.04
MozillaFirebird-source-0.6.1.tar.bz2  29793828 28.41 2.94
emacs-21.3.tar.gz 20399831 19.45 3.41
binutils-2.14.tar.gz  14269432 13.61 3.91
xorp-0.3.tar.gz  5879824 5.61 4.49

 

 

3.1.2 NetBSD 1.6 --> SuSE Linux 8.2

The transmission was performed by a shell script ( FTPPerfOutIp6Linux.txtFTPPerfOutIP4Linux.txt   ) which uses ncftpget3.1.5.
To compute the mean values a special shell script was used. ( analyze.sh  )
 
 
IP v 4      
File     Performance
Name Size in Byte Size in MB in MB / s
i386-compat_svr4.tgz  167457891,00 159,70 1,02
oo_641_src.tar.bz2 109167758,00 104,11 1,06
ns-src-2.1b9a.tar.gz 39952700,00 38,10 1,25
mozilla-source-1.4.tar.bz2  31867608,00 30,39 1,23
MozillaFirebird-source-0.6.1.tar.bz2  29793828,00 28,41 1,07
emacs-21.3.tar.gz 20399831,00 19,45 1,08
binutils-2.14.tar.gz  14269432,00 13,61 1,18
xorp-0.3.tar.gz  5879824,00 5,61 1,47

 
 
IP v 6      
File     Performance
Name Size in Byte Size in MB in MB / s
i386-compat_svr4.tgz  167457891,00 159,70 1,11
oo_641_src.tar.bz2 109167758,00 104,11 1,21
ns-src-2.1b9a.tar.gz 39952700,00 38,10 1,33
mozilla-source-1.4.tar.bz2  31867608,00 30,39 1,39
MozillaFirebird-source-0.6.1.tar.bz2  29793828,00 28,41 1,15
emacs-21.3.tar.gz 20399831,00 19,45 1,30
binutils-2.14.tar.gz  14269432,00 13,61 1,33
xorp-0.3.tar.gz  5879824,00 5,61 1,47

For the exact values of the 100 Mbit /s test refer to : FTPPerfOutIP6LINUXYUI.html and FTPPerfOutIP4LINUXYUI.html

IPv6 100 Mbit /s      
File     Performance
Name Size in Byte Size in MB in MB / s
1600MB 1746684128 1669,12 8.29
1400MB 1528348612 1454,08 8.27
1200MB 1310013096 1249,28 8.14
1000MB 1091677580 1044,48 8.43
800MB 873342064 832,88 8.24
600MB 655006548 624,66 8.49
400MB 436671032 416.44 8.38
300MB 327503274 312.33 8.72
200MB 218335516 208.22 9.59
oo_641_src.tar.bz2 109167758 104.11 8.65
ns-src-2.1b9a.tar.gz 41592248 39.67 9.62
mozilla-source-1.4.tar.bz2  31867608 30.39 9.61
MozillaFirebird-source-0.6.1.tar.bz2  29793828 28.41 9.35
emacs-21.3.tar.gz 20399831 19.45 9.59
binutils-2.14.tar.gz  14269432 13.61 9.55
xorp-0.3.tar.gz  5879824 5.61 9.58

 

IPv4 100 Mbit /s      
File     Performance
Name Size in Byte Size in MB in MB / s
1600MB 1746684128 1669,12 8.03
1400MB 1528348612 1454,08 8.26
1200MB 1310013096 1249,28 8.31
1000MB 1091677580 1044,48 8.20
800MB 873342064 832,88 8.05
600MB 655006548 624,66 7.91
400MB 436671032 416.44 8.40
300MB 327503274 312.33 8.08
200MB 218335516 208.22 8.29
oo_641_src.tar.bz2 109167758 104.11 7.89
ns-src-2.1b9a.tar.gz 41592248 39.67 8.73
mozilla-source-1.4.tar.bz2  31867608 30.39 8.47
MozillaFirebird-source-0.6.1.tar.bz2  29793828 28.41 7.68
emacs-21.3.tar.gz 20399831 19.45 8.25
binutils-2.14.tar.gz  14269432 13.61 8.54
xorp-0.3.tar.gz  5879824 5.61 7.93

 


 
 

3.1.3 NetBSD 1.6 --> NetBSD 1.6.1

The shell-scripts mentioned above were used to transmit the files from their source host to rfhnt8004. In this case we worked with ncftp303 because this
is the latest availible version of ncftp in the NetBSD  package-sourcetree. The sourcecode of our ncftp client was patched using the
ncftp-303-v6-20010707.diff patch from KAME. Refer to FTPPerfOutIP4NetBSD and FTPPerfOutIP6NetBSD for the exact values.


 
IPv4 10 Mbit /s      
File     Performance
Name Size in Byte Size in MB in MB / s
i386-compat_svr4.tgz 167457891,00 159,70 1,11
oo_641_src.tar.bz2 109167758,00 104,11 1,16
ns-src-2.1b9a.tar.gz 39952700,00 38,10 1,23
mozilla-source-1.4.tar.bz2  31867608,00 30,39 1,06
MozillaFirebird-source-0.6.1.tar.bz2  29793828,00 28,41 1,26
emacs-21.3.tar.gz 20399831,00 19,45 1,28
binutils-2.14.tar.gz  14269432,00 13,61 1,03
xorp-0.3.tar.gz  5879824,00 5,61 1,34

 
IPv6 10 Mbit /s      
File     Performance
Name Size in Byte Size in MB in MB / s
i386-compat_svr4.tgz  167457891,00 159,70 1,20
oo_641_src.tar.bz2 109167758,00 104,11 1,18
ns-src-2.1b9a.tar.gz 39952700,00 38,10 1,23
mozilla-source-1.4.tar.bz2  31867608,00 30,39 1,32
MozillaFirebird-source-0.6.1.tar.bz2  29793828,00 28,41 1,31
emacs-21.3.tar.gz 20399831,00 19,45 1,32
binutils-2.14.tar.gz  14269432,00 13,61 1,30
xorp-0.3.tar.gz  5879824,00 5,61 0,91

For the exact values of the 100 Mbit /s test refer to : FTPPerfOutIP6BSDYUI.htm and FTPPerfOutIP4BSDYUI.htm

IPv6 100 Mbit /s      
File     Performance
Name Size in Byte Size in MB in MB / s
1600MB 1746684128 1669,12 8,12
1400MB 1528348612 1454,08 8,20
1200MB 1310013096 1249,28 8,29
1000MB 1091677580 1044,48 8,35
800MB 873342064 832,88 8,46
600MB 655006548 624,66 8,52
400MB 436671032 416.44 8.52
300MB 327503274 312.33 8.56
200MB 218335516 208.22 8.62
oo_641_src.tar.bz2 109167758 104.11 8.73
ns-src-2.1b9a.tar.gz 41592248 39.67 8.91
mozilla-source-1.4.tar.bz2  31867608 30.39 8.88
MozillaFirebird-source-0.6.1.tar.bz2  29793828 28.41 8.76
emacs-21.3.tar.gz 20399831 19.45 8.87
binutils-2.14.tar.gz  14269432 13.61 8.92
xorp-0.3.tar.gz  5879824 5.61 8.66

 

IPv4 100 Mbit /s      
File     Performance
Name Size in Byte Size in MB in MB / s
1600MB 1746684128 1669,12 8.22
1400MB 1528348612 1454,08 8.30
1200MB 1310013096 1249,28 8.43
1000MB 1091677580 1044,48 8.49
800MB 873342064 832,88 8.63
600MB 655006548 624,66 8.69
400MB 436671032 416.44 8.70
300MB 327503274 312.33 8.75
200MB 218335516 208.22 8.83
oo_641_src.tar.bz2 109167758 104.11 8.96
ns-src-2.1b9a.tar.gz 41592248 39.67 9.09
mozilla-source-1.4.tar.bz2  31867608 30.39 9.01
MozillaFirebird-source-0.6.1.tar.bz2  29793828 28.41 8.94
emacs-21.3.tar.gz 20399831 19.45 9.05
binutils-2.14.tar.gz  14269432 13.61 8.94
xorp-0.3.tar.gz  5879824 5.61 8.99

 


 

3.1.4 NetBSD --> SuSE Linux 8.2 Kernel 2.6.0 test 9
IPv6 100 Mbit /s      
File     Performance
Name Size in Byte Size in MB in MB / s
1600MB 1746684128 1669,12 8,22
1400MB 1528348612 1454,08 8,27
1200MB 1310013096 1249,28 8,28
1000MB 1091677580 1044,48 8,30
800MB 873342064 832,88 8,15
600MB 655006548 624,66 8,53
400MB 436671032 416.44 8.02
300MB 327503274 312.33 8.86
200MB 218335516 208.22 8.81
oo_641_src.tar.bz2 109167758 104.11 8.65
ns-src-2.1b9a.tar.gz 41592248 39.67 9.17
mozilla-source-1.4.tar.bz2  31867608 30.39 9.30
MozillaFirebird-source-0.6.1.tar.bz2  29793828 28.41 9.41
emacs-21.3.tar.gz 20399831 19.45 9.38
binutils-2.14.tar.gz  14269432 13.61 9.35
xorp-0.3.tar.gz  5879824 5.61 9.38

 

IPv4 100 Mbit /s      
File     Performance
Name Size in Byte Size in MB in MB / s
1600MB 1746684128 1669,12 6.54
1400MB 1528348612 1454,08 7.22
1200MB 1310013096 1249,28 7.28
1000MB 1091677580 1044,48 7.45
800MB 873342064 832,88 8.37
600MB 655006548 624,66 8.41
400MB 436671032 416.44 8.98
300MB 327503274 312.33 8.40
200MB 218335516 208.22 7.91
oo_641_src.tar.bz2 109167758 104.11 8.55
ns-src-2.1b9a.tar.gz 41592248 39.67 9.29
mozilla-source-1.4.tar.bz2  31867608 30.39 9.46
MozillaFirebird-source-0.6.1.tar.bz2  29793828 28.41 9.55
emacs-21.3.tar.gz 20399831 19.45 9.50
binutils-2.14.tar.gz  14269432 13.61 9.64
xorp-0.3.tar.gz  5879824 5.61 9.42

 

 

3.1.5 Summary

The following plots show the FTP Performance of all tested operating systems in one picture:
 


 


 

Conclusion

Considering all previous plots, a few performance effects can be drawn out:

  • Most of the test-series show that the performance throughput gets less as the file size grows. This consideration does not match with the Windows XP plots, where the behaviour is exactly vice versa

  • Microsoft Windows XP is significantly slower than the tested UNIX-like operating systems. This effect is independent of the used IP version, because it is present with IPv4 as well as with IPv6

  • When we compare the performance of the IPv4 stacks with the one of the IPv6 stacks it seems to be that IPv4 is faster than IPv6 in the case of Windows XP and NetBSD but with Linux it behaves vice versa

  • The IPv6 throughput is nearly the same considering Linux and NetBSD. This may result out of the strong cooperation of the KAME and USAGI project which are providing the IPv6 stacks for those operating systems