LRGuru- Sample LoadTest
Report
Conducted By: LoadRunner Guru
System Admin
LoadRunnerGuru.com
Date: 9/21/2008
2
Table of Contents
1. Executive Summary ................................................................... 3
1.1. Objectives ........................................................................ 3
1.2. Analysis Session Summary....................................................... 3
1.3. Conclusions ....................................................................... 4
2. Scenario Configuration ............................................................... 6
2.1. Files................................................................................ 6
2.2. Scheduler Information........................................................... 6
2.3. Scripts ............................................................................. 6
2.4. Run Time Settings................................................................ 6
2.4.1.
Multi+QTWeb .............................................................................................6
3. Users' Influence........................................................................ 7
4. Hits Per Second........................................................................ 8
5. Vuser Load Scheme ................................................................... 9
6. Transaction Response Times........................................................ 10
7. Running Vusers ....................................................................... 11
8. Hits per Second....................................................................... 12
9. Throughput............................................................................ 13
10. Transaction Summary .............................................................. 14
11. Average Transaction Response Time ............................................. 15
12. Page Component Breakdown (Over Time)....................................... 16
13. Time to First Buffer Breakdown (Over Time) ................................... 17
14. Downloaded Component Size (KB)................................................ 18
15. Transaction Response Time (Distribution) ....................................... 19
16. Transaction Performance Summary .............................................. 20
17. Connections Per Second ........................................................... 21
18. Total Transactions per Second .................................................... 22
19. Terminology ......................................................................... 23
19.1. LoadRunner Objects ........................................................... 23
19.2. Graph Information............................................................. 23
3
1. Executive Summary
1.1. Objectives
Add text here
1.2. Analysis Session Summary
Analysis Summary
Scenario Name:
Period: 21/09/2008 16:58:11 - 21/09/2008 17:08:17
Scenario1
Results in Session: c:\LRScripts \result\mkstore10usr10min\mkstore10usr10min.lrr
Duration:
10 minutes and 6 seconds.
Statistics Summary
Maximum Running Vusers:
10
Total Throughput (bytes):
33,849,005
Average Throughput (bytes/second):
55,764
Total Hits:
5,959
Average Hits per Second:
9.817
View HTTP Responses Summary
Scenario Behavior Over Time
The SLA status of the following measurements displayed over time. You can select a specific time range for each
transaction in order to analyze the time range.
Measurement Name
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
00:00:00
00:00:30
00:01:05
00:01:40
00:02:15
00:02:45
00:03:20
00:03:55
00:04:30
00:05:05
00:05:35
00:06:10
00:06:45
00:07:20
00:07:50
00:08:25
00:09:00
00:09:35
Application Under Test Errors
Time Ranges
4
Transaction Summary
Transactions:
Total Passed:
617
Total Failed: Total Stopped:
0
10
Average Response Time
Minimum Average Maximum
Std.
Deviation
90
Percent
Pass Fail Stop
AddCart_Transaction
0.793
1.468
7.665
0.953
1.969
77
0
0
EmptyCart_Transaction
0.419
1.619
7.87
1.512
3.979
70
0
0
GetThere_Transaction
1.47
5.38
16.661
4.446
13.86
80
0
0
MusicVideo_Transaction
16.496
17.3
28.914
1.741
17.319
71
0
5
search_Transaction
23.01
24.801
31.96
1.895
27.056
77
0
3
ShopMore_Transaction
0.393
1.292
11.052
1.575
1.896
76
0
0
UpdateCart_Transaction
0.392
1.492
23.082
2.839
1.438
76
0
1
ViewCart_Transaction
26.501
27.599
34.11
1.464
29.388
70
0
1
vuser_end_Transaction
0
0
0
0
0
10
0
0
vuser_init_Transaction
0
0.029
0.057
0.023
0.057
10
0
0
Transaction Name
SLA Status
Service Level Agreement Legend:
Pass
Fail
No Data
HTTP Responses Summary
HTTP Responses
Total
Per second
HTTP_200
4,825
7.949
HTTP_302
456
0.751
HTTP_404
678
1.117
View Retries per Second graph.
1.3. Conclusions
5
Add text here
6
2. Scenario Configuration
2.1. Files
Name:
Results in Session:
Scenario1
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
Session1.lra
Session Name:
2.2. Scheduler Information
Started On:
Ended On:
Duration:
Load Behavior:
21/09/2008
21/09/2008
16:58:11
17:08:18
Reach target virtual users using automatic ramp up
2.3. Scripts
Script
MKStore1
Type
Multi+QTWeb
File
C:\LRScripts\MKStore1\MKStore1.usr
2.4. Run Time Settings
2.4.1. Multi+QTWeb
Group
Script
MKStore1
MKStore1
Pacing
As soon as
possible
Think Time
Replay as
recorded
Network Speed
Maximum
bandwidth
Browser cache
Yes
7
3. Users' Influence
Displays average transaction response times relative to the number of Vusers running at any
given point during the load test. This graph helps you view the general impact of Vuser load on
performance time and is most useful when analyzing a load test which is run with a gradual
load.
Title:
Graph Type:
Base Graph:
Additional:
Granularity:
Color
Scale
Transaction Response Time Under Load
Correlate
Running Vusers
Average Transaction Response Time
1 Second
Min.
Ave.
Max.
SD
1
AddCart_Transaction
Measurement
0.793
1.468
7.665
0.953
1
EmptyCart_Transaction
0.419
1.619
7.87
1.512
1
GetThere_Transaction
1.47
5.38
16.661
4.446
1
MusicVideo_Transaction
16.496
17.3
28.914
1.741
1
search_Transaction
23.01
24.801
31.96
1.895
1
ShopMore_Transaction
0.393
1.292
11.052
1.575
1
UpdateCart_Transaction
0.392
1.492
23.082
2.839
1
ViewCart_Transaction
26.501
27.599
34.11
1.464
1
vuser_end_Transaction
0.0
0.0
0.0
0.0
1
vuser_init_Transaction
0.0
0.029
0.057
0.023
8
4. Hits Per Second
Displays the number of hits made on the Web server by Vusers during each second of the load
test. This graph helps you evaluate the amount of load Vusers generate, in terms of the number
of hits.
Title:
Current Results:
Filters:
Group By:
Granularity:
Color
Scale
1
Hits per Second
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
None
16 Seconds
Measurement
Hits
Graph Min.
Ave.
Graph Max.
Graph Median
Graph SD
1.5
9.817
20.938
10
5.578
9
5. Vuser Load Scheme
Displays the number of Vusers that executed Vuser scripts, and their status, during each second
of a load test. This graph is useful for determining the Vuser load on your server at any given
moment.
Title:
Current Results:
Filters:
Group By:
Granularity:
Color
Scale
1
Running Vusers
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
Vuser Status = (Run)
16 Seconds
Measurement
Run
Graph Min.
Graph Ave.
Graph Max.
Graph Median
Graph SD
0.0
3.333
10
0.0
4.714
10
6. Transaction Response Times
Displays the average time taken to perform transactions during each second of the load test.
This graph helps you determine whether the performance of the server is within acceptable
minimum and maximum transaction performance time ranges defined for your system.
Title:
Current Results:
Filters:
Group By:
Granularity:
Color
Scale
Average Transaction Response Time
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
Transaction End Status = (Pass), (Include Think Ti
me)
16 Seconds
Min.
Ave.
Max.
SD
1
AddCart_Transaction
Measurement
0.793
1.468
7.665
0.953
1
EmptyCart_Transaction
0.419
1.619
7.87
1.512
1
GetThere_Transaction
1.47
5.38
16.661
4.446
1
MusicVideo_Transaction
16.496
17.3
28.914
1.741
1
search_Transaction
23.01
24.801
31.96
1.895
1
ShopMore_Transaction
0.393
1.292
11.052
1.575
1
UpdateCart_Transact ion
0.392
1.492
23.082
2.839
1
ViewCart_Transaction
26.501
27.599
34.11
1.464
1
vuser_end_Transaction
0.0
0.0
0.0
0.0
1
vuser_init_Transaction
0.0
0.029
0.057
0.023
11
7. Running Vusers
Displays the number of Vusers that executed Vuser scripts, and their status, during each second
of a load test. This graph is useful for determining the Vuser load on your server at any given
moment.
Title:
Current Results:
Filters:
Group By:
Granularity:
Color
Scale
1
Running Vusers
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
Vuser Status = (Run)
16 Seconds
Measurement
Run
Graph Min.
Graph Ave.
Graph Max.
Graph Median
Graph SD
0.0
3.333
10
0.0
4.714
12
8. Hits per Second
Displays the number of hits made on the Web server by Vusers during each second of the load
test. This graph helps you evaluate the amount of load Vusers generate, in terms of the number
of hits.
Title:
Current Results:
Filters:
Group By:
Granularity:
Color
Scale
1
Hits per Second
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
None
16 Seconds
Measurement
Hits
Graph Min.
Ave.
Graph Max.
Graph Median
Graph SD
1.5
9.817
20.938
10
5.578
13
9. Throughput
Displays the amount of throughput (in bytes) on the Web server during the load test.
Throughput represents the amount of data that the Vusers received from the server at any
given second. This graph helps you to evaluate the amount of load Vusers generate, in terms of
server throughput.
Title:
Current Results:
Filters:
Group By:
Granularity:
Color
Scale
1
Throughput
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
None
16 Seconds
Measurement
Throughput
Graph Min.
Ave.
Graph Max.
Graph Median
Graph SD
7507.125
55764.423
108856.5
56354.938
28754.586
14
10. Transaction Summary
Displays the number of transactions that passed, failed, stopped, or ended with errors.
Title:
Current Results:
Filters:
Group By:
Color
Scale
Transaction Summary
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
(Include Think Time)
Measurement
1
Pass
1
Stop
15
11. Average Transaction Response Time
Displays the average time taken to perform transactions during each second of the load test.
This graph helps you determine whether the performance of the server is within acceptable
minimum and maximum transaction performance time ranges defined for your system.
Title:
Current Results:
Filters:
Group By:
Granularity:
Color
Scale
Average Transaction Response Time
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
Transaction End Status = (Pass), (Include Think Ti
me)
16 Seconds
Graph's Min.
Graph's Ave.
Graph's Max.
Graph's Median
Graph's SD
1
AddCart_Transaction
Measurement
1.006
1.381
2.577
1.187
0.414
1
EmptyCart_Transaction
0.437
1.44
3.678
1.108
0.872
1
GetThere_Tr ansaction
1.72
4.718
14.337
2.714
3.892
1
MusicVideo_Transaction
16.496
17.178
18.818
17.024
0.637
1
search_Transaction
23.457
25.248
31.96
24.443
2.355
1
ShopMore_Transaction
0.416
1.283
4.312
0.907
0.92
1
UpdateCart_Transaction
0.716
1.486
5.271
0.867
1.287
1
ViewCart_Transaction
26.664
27.792
34.11
27.467
1.675
1
vuser_end_Transaction
0.0
0.0
0.0
0.0
0.0
1
vuser_init_Transaction
0.029
0.029
0.029
0.029
0.0
16
12. Page Component Breakdown (Over Time)
Displays the average response time (in seconds) for each Web page and its components during
each second of the scenario run.
Title:
Current Results:
Filters:
Group By:
Granularity:
Color
Scale
Page Component Breakdown (Over Time)
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
Component Type = (Page)
16 Seconds
Measurement
Min.
Ave.
Max.
SD
1
store....a.com/search.php (main URL)
0.741
1.601
4.575
1.159
1
store....om/view_cart.php (main URL)
0.544
0.713
0.98
0.159
1
store.na...&action=Search (main URL)
0.356
2.007
9.157
2.743
1
store.na...d.php?ItemID=6 (main URL)
0.883
1.197
1.84
0.326
1
store.na...p?CategoryID=1 (main URL)
0.692
1.197
2.084
0.459
1
store.nabausha.com (main URL)
1.609
4.231
12.084
3.247
1
store.nabausha.com/re.php (main URL)
0.416
1.167
4.508
0.98
1
ypn-js.o...=1222030197875 (main URL)
0.23
0.265
0.335
0.03
17
13. Time to First Buffer Breakdown (Over Time)
Displays each Web page component?s relative server/network time (in seconds) during each
second of the scenario run, for the period of time until the first buffer is successfully received
back from the Web server.
Title:
Current Results:
Filters:
Group By:
Granularity:
Color
Scale
Time to First Buffer Breakdown (Over Time)
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
Component Type = (Page)
16 Seconds
Min.
Ave.
Max.
SD
1
store....a.com/search.php (main URL).[Network Time]
Measurement
0.186
0.337
0.608
0.125
1
store....a.com/search.php (main URL).[Server Time]
0.092
0.183
0.3
0.074
1
store....om/view_cart.php (main URL).[Network Time]
0.121
0.191
0.318
0.057
1
store....om/view_cart.php (main URL).[Server Time]
0.094
0.126
0.174
0.031
1
store.na...&action=Search (main URL).[Network Time]
0.157
1.443
9.269
2.961
1
store.na...&action=Search (main URL).[Server Time]
0.036
0.187
0.729
0.209
1
store.na...d.php?ItemID=6 (main URL).[Network Time]
0.337
0.61
1.135
0.296
1
store.na...d.php?ItemID=6 (main URL).[Server Time]
0.097
0.179
0.485
0.121
1
store.na...p?CategoryID=1 (main URL).[Network Time]
0.187
0.27
0.34
0.049
1
store.na...p?CategoryID=1 (main URL).[Server Time]
0.1
0.162
0.353
0.078
1
store.nabausha.com (main URL).[Network Time]
1.827
4.832
17.243
4.852
1
store.nabausha.com (main URL).[Server Time]
0.12
0.498
2.018
0.593
18
1
store.nabausha.com/re.php (main URL).[Network Time]
0.15
0.41
2.357
0.432
1
store.nabausha.com/re.php (main URL).[Server Time]
0.077
0.278
3.169
0.624
1
ypn-js.o...=1222030197875 (main URL).[Network Time]
0.097
0.113
0.13
0.009
1
ypn-js.o...=1222030197875 (main URL).[Server Time]
0.015
0.027
0.034
0.006
14. Downloaded Component Size (KB)
Displays the size of each Web page component. Note that the size displayed includes both the
size of the component and its header.
Title:
Current Results:
Filters:
Group By:
Color
Scale
1
Downloaded Component Size (KB)
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
Component Type = (Page)
Measurement
store....a.com/search.php (main
URL)
Graph Min.
Graph Ave.
Graph Max.
Graph Median
Graph SD
34.582
34.582
34.582
34.582
0.0
1
store....om/view_cart.php (main
URL)
50.313
50.313
50.313
50.313
0.0
1
store.na...&action=Search (main
URL)
44.855
44.855
44.855
44.855
0.0
1
store.na...d.php?ItemID=6 (main
URL)
46.982
46.982
46.982
46.982
0.0
1
store.na...p?CategoryID=1 (main
URL)
72.364
72.364
72.364
72.364
0.0
1
store.nabausha.com (main URL)
218.796
218.796
218.796
218.796
0.0
1
store.nabausha.com/re.php (main
URL)
63.366
63.366
63.366
63.366
0.0
1
ypn-js.o...=1222030197875 (main
URL)
3.92
3.92
3.92
3.92
0.0
19
15. Transaction Response Time (Distribution)
Displays the number of times a transaction was completed over a distribution of time ranges.
Note that this graph only displays information for a single transaction at a time.
Title:
Current Results:
Filters:
Group By:
Color
Scale
Transaction Response Time (Distribution)
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
Transaction End Status = (Pass)
Measurement
1
AddCart_Transaction
1
EmptyCart_Transaction
1
GetThere_Transaction
1
MusicVideo_Transaction
1
search_Transaction
1
ShopMore_Transaction
1
UpdateCart_Transaction
1
ViewCart_Transaction
1
vuser_end_Transaction
1
vuser_init_Transaction
20
16. Transaction Performance Summary
Displays the minimum, average, and maximum response time for all the transactions in the
load test.
Title:
Current Results:
Filters:
Group By:
Color
Scale
Transaction Performance Summary
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
Transaction End Status = (Pass), (Include Think Ti
me)
Measurement
1
Minimum
1
Average
1
Maximum
21
17. Connections Per Second
Displays the number of Connections per Second
Title:
Current Results:
Filters:
Group By:
Granularity:
Color
Connections Per Second
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
None
16 Seconds
Scale
Measurement
Graph's Min.
Ave.
Graph's Max.
Graph's Median
Graph's SD
1
Connection Shutdowns
0.0
3.992
9
3.688
1.944
1
New Connections
0.0
3.992
7.875
4
1.912
22
18. Total Transactions per Second
Displays the total number of completed transactions (both successful and unsuccessful)
performed during each second of a load test. This graph helps you determine the actual
transaction load on your system at any given moment.
Title:
Current Results:
Filters:
Group By:
Granularity:
Color
Scale
Total Transactions per Second
c:\LRScripts\result\mkstore10usr10min\mkstore10usr
10min.lrr
None
16 Seconds
Graph Min.
Ave.
Graph Max.
Graph Median
Graph SD
1
Pass
Measurement
0.25
1.016
2.313
1
0.562
1
Stop
0.0
0.016
0.667
0.0
0.107
23
19. Terminology
19.1. LoadRunner Objects
Term
Vuser Scripts
Load Test
Run-Time Settings
Scenario
Definition
A Vuser script describes the actions that a Vuser performs during the scenario. Each Vuser executes a Vuser script
during a scenario run. The Vuser scripts include functions that measure and record the performance of your
applications components.
Tests a system's ability to handle a heavy workload. A load test simulates multiple transactions or users
interacting with the computer at the same time and provides reports on response times and system behavior.
Run-Time settings allow you to customize the way a Vuser script is executed. You configure the run-time settings
from the Controller or VuGen before running a scenario. You can view information about the Vuser groups and
scripts that were run in each scenario, as well as the run-time settings for each script in a scenario, in the
Scenario Run-Time Settings dialog box.
A scenario defines the events that occur during each testing session. For example, a scenario defines and controls
the number of users to emulate, the actions that they perform, and the machines on which they run their
emulations.
Scheduler
The Schedule Builder allows you to set the time that the scenario will start running, the duration time of the
scenario or of the Vuser groups within the scenario, and to gradually run and stop the Vusers within the scenario
or within a Vuser group. It also allows you to set the load behavior of Vusers in a scenario.
Session
When you work with the Analysis utility, you work within a session. An Analysis session contains at least one set of
scenario results (lrr file). The Analysis utility processes the scenario result information and generates graphs and
reports. The Analysis stores the display information and layout settings for the active graphs in a file with an .lra
extension. Each session has a session name, result file name, database name, directory path, and type.
Transactions
A transaction represents an action or a set of actions used to measure the performance of the server. You define
transactions within your Vuser script by enclosing the appropriate sections of the script with start and end
transaction statement.
Vusers
Vusers or virtual users are used by LoadRunner as a replacement for human users. When you run a scenario,
Vusers emulate the actions of human users working with your application. A scenario can contain tens, hundreds,
or even thousands of Vusers running concurrently on a single workstation.
19.2. Graph Information
Average
Hits
Term
Definition
Average value of the graph measurement's.
The number of HTTP requests made by Vusers to the Web server.
Maximum
Measurement
Maximum value of the graph measurement's.
This is the type of resource being monitored
Median
Minimum
Middle value of the graph measurement's.
Minimum value of the graph measurement's.
Network Delay
Network Path
The time it takes for a packet of data sent across the network to go to the requested node and return.
The Network Path is the route data travels between the source machine and the destination machine.
Response time
The time taken to perform a transaction.
In order to display all the measurements on a single graph, thus making the graphs easier to read and
analyze, you can change the scale or (granularity) of the x -axis. You can either set measurement scales
manually, view measurement trends for all measurements in the graph, or let Analysis scale them
automatically . The Legend tab indicates the scale factor for each resource.
The square root of the arithmetic mean value of the squares of the deviations from the arithmetic mean.
Scale (or granularity)
Standard Deviation (SD)
Throughput
Throughput is measured in bytes and represents the amount of data that the Vusers received from the
server.
Vuser Load
When you run a scenario, the Vusers generate load or stress on the server. LoadRunner monitors the effect
of this load on the performance of your application.