Table of Contents

Resources

Conference Tutorials

FAST 09

Links

Literary

External Traces

Traces

All the traces below were obtained using the linux tool blktrace. You can use the blkparse and btt contained in the same blktrace package to gather statistics of the traces. In order to obtain statistics from the traces we use btstats, developed in our own lab. blktrace also include a I/O replaying tool called btreplay that we use for our BORG paper.

Developer

Emailing (Thunderbird), Web-browsing (firefox) and development (emacs, gcc, gdb…). I have also done office with LaTeX and probably updates of the operating system.

developer information
===========
luis@developer ~ $ df
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/sda6             39060816  14659588  24401228  38% /
varrun                 1037248       140   1037108   1% /var/run
varlock                1037248         0   1037248   0% /var/lock
udev                   1037248       104   1037144   1% /dev
devshm                 1037248         0   1037248   0% /dev/shm
lrm                    1037248     34696   1002552   4%
/lib/modules/2.6.22-14-generic/volatile
/dev/sda7            117182464  29563424  87619040  26% /home
luis@developer ~ $ cat /sys/block/sda/sda6/start
4000248
luis@developer ~ $ cat /sys/block/sda/sda6/size
78124032
luis@developer ~ $ cat /sys/block/sda/sda7/start
82124343
luis@developer ~ $ cat /sys/block/sda/sda7/size
234372222
luis@developer ~ $ cat /proc/swaps
Filename                                Type            Size    Used
Priority
/dev/sda5                               partition       2000020 32288   -1
luis@developer ~ $ cat /sys/block/sda/sda5/start
126
luis@developer ~ $ cat /sys/block/sda/sda5/size
4000059

Duration: 7 days
File: developer_traces.tar.bz2

SVN Server

SVN and Wiki server.

doomsday information
===============
root@svnserver:~# df
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/sda1             18880388   2396528  15524784  14% /
varrun                  517444        64    517380   1% /var/run
varlock                 517444         0    517444   0% /var/lock
udev                    517444        64    517380   1% /dev
devshm                  517444         0    517444   0% /dev/shm
root@svnserver:~# cat /sys/block/sda/sda1/start
63
root@svnserver:~# cat /sys/block/sda/sda1/size
38363157
root@svnserver:~# cat /proc/swaps
Filename                                Type            Size    Used
Priority
/dev/sda5                               partition       883532  0       -1
root@svnserver:~# cat /sys/block/sda/sda5/start
38363283
root@svnserver:~# cat /sys/block/sda/sda5/size
1767087

Duration: 7 days
File: svnserver_traces.tar.bz2

Web server (CS department)

Collected all static content accessed in our department's during 7 days (http-access.gz). In this period 1137234 requests were issued to the server, totaling 256017 distinct files using approximately 10GB

The block access trace was collected by replaying the access trace to a machine running Apache 1.3 with a Intel Pentium 4 CPU at 2.00GHz, and 512MB RAM. The hard drive is a 20GB MAXTOR 6L020L1. To simulate multiple users we split the trace in 10 pieces each with the same number of request, and issued them concurrently from 10 threads (each thread each issued to requests corresponding to one piece of the trace).

webserver information
===============
root@webserver:~# cat /sys/block/sda/sda1/start
63
root@webserver:~# cat /sys/block/sda/sda1/size
4000122
root@webserver:~# cat /proc/swaps
Filename                                Type            Size    Used   Priority
/dev/sda2                               partition	996020	0	-1
root@webserver:~# cat /sys/block/sda/sda2/start
4000185
root@webserver:~# cat /sys/block/sda/sda2/size
1992060

Duration: 7 days
File: webserver_traces.tar.bz2

480 Hours Trace

The trace contains 480 files. These files were produced by merging all the FIU SRCMap block IO traces (which can be obtained from Storage Networking Industry Association) and then splitting the result into a total of 480 one-hour long files.

There are traces containing block requests with their timestamps and disk id number for each of 8 different disks. The original traces were produced by monitoring the different disks for 20 days.

Each of the 480 file names has the form: “fiu$i_hour$j” where $i and $j would represent day and hour respectively.

Duration: 20 days
File: fiu_hour_traces.tar.gz

More Traces

  1. Block traces with content signature (MD5): I/O Deduplication
  2. Block traces: SRCMap