PostgreSQL benchmark test by PGBENCH

Mr. Shibuya of Cobalt Users Group did PostgreSQL performance test by PGBENCH with his RaQ2.
pgbench was made by Mr. Ishii who is the chairperson of PostgreSQL Users Group in Japan. "TPC-B" word mean how many transaction proceeded in one second with update action. SELECT mean the transaction without update process.

The result, he reported RaQ2 with enough memory will work enoughly.

Specification info.
  1. The version of software is gbench 1.1.
  2. The number unit is tps(transaction perl second).
  3. On RaQ2J, -B 512 is not available and core dumped. Therefore we cannot try -N 64 option.
  4. PostgreSQL is 6.5.1 (from PostgreSQL master SRPMS with some modify for Cobalt.)
  5. The option of postmaster is "-i -S -D/var/lib/pgsql".
  6. pgbench option is "-t 100". And we modified Makefile.in for RedHat path style.

The result of RaQ2

RaQ2 (MIPS 250MHz/64MB) benchmark result is follows; 
-----
                                                -o '-F'
                TPC-B           SELECT          TPC-B           SELECT
                including       including       including       including
        -c 1    2.745851        116.807556      12.934022       115.203392
        -c 2    2.805204        114.734161      12.164348       113.917014
        -c 4    2.758577        100.623185      11.266745       111.180537
        -c 8    2.795304        112.061784      10.495314       111.325103
        -c 16   2.741845        114.579209       9.017075       112.887139
        -c 32   2.99598         109.127622       6.891455       106.240166
-B 128  -c 1    4.647723        113.779881      21.55696        114.737584
        -c 2    4.540872        113.824757      20.63739        113.656318
        -c 4    4.417501        113.110624      18.410155       113.045029
        -c 8    4.564052        111.642872      14.732966       104.567796
        -c 16   4.215659        114.398847      12.942292       112.504242
        -c 32   3.922157        107.641341       9.736231       107.271255
-B 256  -c 1    5.618374        113.535988      20.990015       115.949154
        -c 2    4.989555        112.551837      20.374489       112.163957
        -c 4    4.810768        111.789549      18.283758       111.750604
        -c 8    4.534496        111.137537      15.89721        109.184177
        -c 16   4.051542        108.473179      12.965722        88.933316
        -c 32   4.196714        106.609723       9.491859       100.575117
-B 384  -c 1    6.186026        116.155081      20.891896       113.897941
        -c 2    5.617777        112.354312      19.922095       112.371545
        -c 4    5.137857        111.314972      17.973185       110.953834
        -c 8    4.725689        108.062488      15.673112       108.792738
        -c 16   4.158867         98.60467       12.738661       108.294294
        -c 32   4.37973         106.278174       9.451862       100.062611

The result of PC/AT

The followins are the result of PC/AT (PentiumII 300MHz/128MB) for comparison. We tried two disks for database building. SCSI (with Adaptec 2940, detail unknown) and IDE. The result is different. For PostgreSQL, CPU and memory is important but HDD I/O performance is also important. 
-----
SCSI
                                                -o '-F'
                TPC-B           SELECT          TPC-B           SELECT
                including       including       including       including
-B 128  -c 1    4.224233        525.41705       103.327774      597.307339
        -c 2    3.939081        573.504658       98.433383      591.00083
        -c 4    3.818235        572.747527       87.978139      573.855982
        -c 8    3.951672        564.970554       76.391371      583.240865
        -c 16   3.865653        542.852247       49.937583      530.634526
        -c 32   3.66036         510.514851       37.142371      505.131026
-B 256  -c 1    4.178958        545.657927       97.903686      580.376316
        -c 2    3.815171        560.942158       84.947874      592.050537
        -c 4    3.742653        579.65638        84.027523      576.024423
        -c 8    3.877193        554.273797       64.134493      565.47213
        -c 16   3.785543        544.220464       46.280888      547.738303
        -c 32   3.686717        504.407735       35.718784      521.800329
-B 384  -c 1    4.230133        622.080111      103.44824       590.688388
        -c 2    3.944239        599.423355       96.273772      602.313486
        -c 4    3.814208        595.963539       55.102172      587.218025
        -c 8    3.926318        574.710992       70.689444      577.730372
        -c 16   3.799712        540.503107       46.591165      533.993527
        -c 32   3.686085        501.673552       37.100382      503.597654

----------
IDE
                                                -o '-F'
                TPC-B           SELECT          TPC-B           SELECT
                including       including       including       including
-B 128  -c 1    5.507099        578.412489      31.885498       594.57274
        -c 2    5.591934        581.824952      31.203799       578.073109
        -c 4    5.58399         577.943648      29.723167       584.160773
        -c 8    5.514413        568.25285       26.540277       562.72166
        -c 16   5.375474        527.548065      23.917821       548.073027
        -c 32   5.108158        519.173314      20.315922       506.16365
-B 256  -c 1    9.743712        602.025213      93.430875       591.796517
        -c 2    9.458404        602.34251       90.275521       586.061695
        -c 4    9.224583        585.600951      77.530814       574.119552
        -c 8    9.066908        563.243834      73.253694       569.184359
        -c 16   8.690469        541.094797      53.105978       523.91663
        -c 32   8.173007        508.719128      39.96206        504.081882
-B 384  -c 1    9.681089        608.905857
        -c 2    9.451947        601.84405
        -c 4    9.215216        590.90392
        -c 8    9.00134         568.901025
        -c 16   8.708274        549.357166
        -c 32   8.165394        508.497793

11 Oct. 1999
This page is administrated by
Cobalt Users Group. (usersgroup@cobaltqube.org)
All rights are reserved.
[BACK]