Table of Contents
Resources
Conference Tutorials
FAST 09
Links
Literary
External Traces
Traces
All the traces below were obtained using the linux tool blktrace. You can use the blkparse and btt contained in the same blktrace package to gather statistics of the traces. In order to obtain statistics from the traces we use btstats, developed in our own lab. blktrace also include a I/O replaying tool called btreplay that we use for our BORG paper.
Developer
Emailing (Thunderbird), Web-browsing (firefox) and development (emacs, gcc, gdb…). I have also done office with LaTeX and probably updates of the operating system.
developer information =========== luis@developer ~ $ df Filesystem 1K-blocks Used Available Use% Mounted on /dev/sda6 39060816 14659588 24401228 38% / varrun 1037248 140 1037108 1% /var/run varlock 1037248 0 1037248 0% /var/lock udev 1037248 104 1037144 1% /dev devshm 1037248 0 1037248 0% /dev/shm lrm 1037248 34696 1002552 4% /lib/modules/2.6.22-14-generic/volatile /dev/sda7 117182464 29563424 87619040 26% /home luis@developer ~ $ cat /sys/block/sda/sda6/start 4000248 luis@developer ~ $ cat /sys/block/sda/sda6/size 78124032 luis@developer ~ $ cat /sys/block/sda/sda7/start 82124343 luis@developer ~ $ cat /sys/block/sda/sda7/size 234372222 luis@developer ~ $ cat /proc/swaps Filename Type Size Used Priority /dev/sda5 partition 2000020 32288 -1 luis@developer ~ $ cat /sys/block/sda/sda5/start 126 luis@developer ~ $ cat /sys/block/sda/sda5/size 4000059
Duration: 7 days
File: developer_traces.tar.bz2
SVN Server
SVN and Wiki server.
doomsday information =============== root@svnserver:~# df Filesystem 1K-blocks Used Available Use% Mounted on /dev/sda1 18880388 2396528 15524784 14% / varrun 517444 64 517380 1% /var/run varlock 517444 0 517444 0% /var/lock udev 517444 64 517380 1% /dev devshm 517444 0 517444 0% /dev/shm root@svnserver:~# cat /sys/block/sda/sda1/start 63 root@svnserver:~# cat /sys/block/sda/sda1/size 38363157 root@svnserver:~# cat /proc/swaps Filename Type Size Used Priority /dev/sda5 partition 883532 0 -1 root@svnserver:~# cat /sys/block/sda/sda5/start 38363283 root@svnserver:~# cat /sys/block/sda/sda5/size 1767087
Duration: 7 days
File: svnserver_traces.tar.bz2
Web server (CS department)
Collected all static content accessed in our department's during 7 days (http-access.gz). In this period 1137234 requests were issued to the server, totaling 256017 distinct files using approximately 10GB
The block access trace was collected by replaying the access trace to a machine running Apache 1.3 with a Intel Pentium 4 CPU at 2.00GHz, and 512MB RAM. The hard drive is a 20GB MAXTOR 6L020L1. To simulate multiple users we split the trace in 10 pieces each with the same number of request, and issued them concurrently from 10 threads (each thread each issued to requests corresponding to one piece of the trace).
webserver information =============== root@webserver:~# cat /sys/block/sda/sda1/start 63 root@webserver:~# cat /sys/block/sda/sda1/size 4000122 root@webserver:~# cat /proc/swaps Filename Type Size Used Priority /dev/sda2 partition 996020 0 -1 root@webserver:~# cat /sys/block/sda/sda2/start 4000185 root@webserver:~# cat /sys/block/sda/sda2/size 1992060
Duration: 7 days
File: webserver_traces.tar.bz2
480 Hours Trace
The trace contains 480 files. These files were produced by merging all the FIU SRCMap block IO traces (which can be obtained from Storage Networking Industry Association) and then splitting the result into a total of 480 one-hour long files.
There are traces containing block requests with their timestamps and disk id number for each of 8 different disks. The original traces were produced by monitoring the different disks for 20 days.
Each of the 480 file names has the form: “fiu$i_hour$j” where $i and $j would represent day and hour respectively.
Duration: 20 days
File: fiu_hour_traces.tar.gz
More Traces
- Block traces with content signature (MD5): I/O Deduplication
- Block traces: SRCMap