1. business and industrial
2. business operations
3. management
4. project management

The Management School
Lancaster University
MSc in E-Business & Innovation
(EBIN)
1
SysSel
How To Select Your New Computer System:
Pitfalls & Proven Methods
Slides
See back of booklet.
2
Selected Contact Details & References For System Selection Projects
1. Package, system, supplier and outsourcing
evaluations and selections. Technology/IT
procurement including contract negotiation.
Martin Tate, IT Evaluation
www.itevaluation.co.uk
[email protected]
2. Providers of Prince project management method and
SSADM systems analysis & design method.
[Formerly CCTA.]
The UK Office of Government
Commerce (OGC)
www.ogc.gov.uk
3. Purchasing & Supply Management Model from the
Chartered Institute of Purchasing & Supply
CIPS
www.cips.org
4. Directory of suppliers and software in book and
online form. mi IT software directory.
Computing mi (part of VNU)
www.computingmi.co.uk
5. Commercial service supplying details of potential
systems. Their staff ask for a system profile and send
details from those registered. [Caution this is not
comprehensive, as IT vendors pay to register their
products.]
The Computer Users Information
Service
www.cuis.co.uk
6. Erling S. Andersen, Kristoffer V. Grude and Tor
Haug Goal Directed Project Management: Effective
Techniques and Strategies
Kogan Page (Jun 2004)
ISBN: 0749441860
7. Benjamin B Tregoe & Charles H Kepner The New
Rational Manager: An Updated Edition for a New
World (available via the KT website)
Management text on problem analysis, decision
analysis and situation appraisal. Covers scoring
techniques (including weighted attribute) for formal,
rational decision-making within organisations.
Kepner-Tregoe, Inc (worldwide)
www.kepner-tregoe.com
Kepner Tregoe Ltd (UK)
[email protected]
8. Nathan Hollander Guide to Software Package
Evaluation and Selection: The R2ISC Method
Amacom (Jun 2000)
ISBN: 0814405533
Copyright © 2007 Martin Tate All rights reserved. No part may be reproduced without the prior permission of the publisher.
The Management School - Lancaster University
3
SysSel
Origins & Heritage Of The Method
This section shows the originators of the various aspects of this method. See the prior section
for contact addresses of the organisations mentioned.
3.1
OGC – standards in UK government IT
•
Prince project management, including project board (PB) and project sponsor.
3.2
Kepner/Tregoe – formal decision-making techniques
•
Mandatory requirements.
•
Scoring techniques (part of).
3.3
LBMS – methods & CASE tools (Learmonth Burchett Management Systems Ltd, now
part of Computer Associates).
•
Original Tasklist for LBMS Package Evaluation (method created in 1988).
•
Scoring techniques (part of).
3.4
IT Evaluation – further development/application of method
•
Integration of Responsibility Chart into method.
•
Method of scoping by ‘triage’.
•
Techniques for contacting suppliers for feasibility costings.
•
Techniques for incorporating and presenting best practice to the user before
interviews, including the ‘Aunt Sally’ or ‘Straw Man’ RDD.
•
Creation of scoring definitions.
•
Use of key project documents as attachments to contract.
•
All formats shown, including advanced use of word processor & spreadsheet for
document generation or automation, plus mass email for RFI.
•
Use of PC packages, tablet note-taking, CASE tools, product databases and projectors
(with live models) to aid team productivity and meeting effectiveness. Use of
customer relationship management system for calls, email shots & project history log.
•
Visualisation techniques such as charts to show value for money or fit of shortlist.
•
Links between this evaluation/procurement method and IT service management.
Ref: SysSel-How-To-Select-Your-New-Computer-System.doc
12-Feb-2007
How To Select Your New Computer System: Pitfalls & Proven Methods
Page 2
The Management School - Lancaster University
4
Reference Material – Selected Example Formats
4.1
Example RDD (Table Of Contents)
SysSel
This illustrates one part of the Requirements Definition Document format (RDD). It also
shows some examples of ‘standard’ requirements. These would usually be included in the
RDD, whether or not they were explicitly requested during requirements definition
interviews.
Ref: SysSel-How-To-Select-Your-New-Computer-System.doc
12-Feb-2007
How To Select Your New Computer System: Pitfalls & Proven Methods
Page 3
The Management School - Lancaster University
4.2
SysSel
Example RDD (Prime List of Requirements)
This illustrates the main Requirements Definition Document (RDD) format, and typical
wording of requirements.
Ref: SysSel-How-To-Select-Your-New-Computer-System.doc
12-Feb-2007
How To Select Your New Computer System: Pitfalls & Proven Methods
Page 4
The Management School - Lancaster University
4.3
SysSel
Example RFI
Example of the sort of form emailed to system suppliers, for them to ‘turn round’ - complete
and send back.
Ref: SysSel-How-To-Select-Your-New-Computer-System.doc
12-Feb-2007
How To Select Your New Computer System: Pitfalls & Proven Methods
Page 5
The Management School - Lancaster University
4.4
SysSel
Example Definitions
These record the basis for allocating points. There is one such form per scored requirement.
Ref: SysSel-How-To-Select-Your-New-Computer-System.doc
12-Feb-2007
How To Select Your New Computer System: Pitfalls & Proven Methods
Page 6
The Management School - Lancaster University
4.5
SysSel
Example Scoring Spreadsheet – Format
System + Supplier Evaluation
Shortlist After Responses To Requirements Document
Categ
Requirement Title
Customer/Supp Customer & Supplier Details
Customer/Supp Grouping Contacts
Customer/Supp Hold Company Registration & VAT Numbers
Customer/Supp Contract Quotations Status, Version & Re-Use
Customer/Supp Secure Order Form
Customer/Supp Levels of Bill of Material
Customer/Supp Notice Of New & Changed Tenders
Customer/Supp Customer Contribution & Profitability
Customer/Supp Customer Changes Own Account Information
Customer/Supp Total
Sales/Marketing Customer Price List
Sales/Marketing Telephone Scripts
Sales/Marketing Reports On Main Sales Measures
Sales/Marketing Cost of Campaign
Sales/Marketing Total
Tech & Design Staff-To-Service Expertise Matrix, With Controls
Tech & Design Drill Down & Drill Across
Tech & Design Screen Prints
Tech & Design Archiving & Retrieval
Tech & Design Fax From Desktop
Tech & Design Contribute To ISO 9002
Tech & Design Report Generator
Tech & Design Total
Supplier Consid Soundness Of Supplier
Supplier Consid Reference Sites
Supplier Consid Training Available from Author
Supplier Consid Relationship With 3rd-Party Help Desk
Supplier Consid Relevant Data Migration Experience
Supplier Consid Formal Implementation Method
Supplier Consid Total
Grand Total
Ref: SysSel-How-To-Select-Your-New-Computer-System.doc
12-Feb-2007
Nbr Wgt
5
0081
3
0082
2
0083
1
0084
5
0085
3
0086
4
0087
2
0088
4
0089
0090
0091
0092
0093
4
1
5
2
0094
0095
0096
0097
0098
0099
0100
5
2
5
4
3
4
2
0101
0102
0103
0104
0105
0106
4
3
4
3
4
3
IT Evaluation - A Division Of Decision Evaluation Ltd
Perfect
Package A
Package B
Max MatchA Fit Xtd
Fit % MatchB Fit Xtd
Fit %
15 100%
10
15
3
2
67%
6
6
9
2
67%
2
67%
0
4
6
0
0%
2
67%
0
2
3
0
0%
2
67%
10
15 100%
15
2
67%
3
0
6
9
0
0%
2
67%
8
12 100%
12
2
67%
3
2
4
6
1
33%
2
67%
4
12 100%
12
1
33%
3
45
71
87
52%
82%
8
12
12
2
67%
3
100%
0
3 100%
3
0
0%
3
10
10
15
2
67%
2
67%
4
6 100%
6
2
67%
3
22
31
36
61%
86%
15 100%
10
15
3
2
67%
6 100%
4
6
3
2
67%
5
10
15
1
33%
2
67%
8
8
12
2
67%
2
67%
6
6
9
2
67%
2
67%
8
12 100%
12
2
67%
3
2
4
6
1
33%
2
67%
50
54
75
67%
72%
12 100%
8
12
3
2
67%
9 100%
3
9
3
1
33%
12 100%
4
12
3
1
33%
9 100%
3
9
3
1
33%
0
12 100%
12
0
0%
3
9 100%
3
9
3
1
33%
51
33
52%
63
81%
261
168
64%
189
72%
How To Select Your New Computer System: Pitfalls & Proven Methods
Page 7
The Management School - Lancaster University
4.6
SysSel
Example Scoring Spreadsheet – Notes
Example of scoring mechanism. The list of requirements is extracted from the Requirements Definition Document - usually the Table Of
Contents.
This example shows two systems, but there would be more columns for more candidates. There would also be many more rows, with more
categories and more entries per category.
• Note the weight (Wgt) reflects the importance of the requirement. Recommended range for weight is 1-5.
• The score (Match) reflects the degree of fit - for each candidate system. Recommended range for match is 0-3.
• The multiplication of weight times score magnifies the gap between systems of different capabilities - ‘rewarding’ packages that are
strong in important areas.
Note the column for Perfect score (weight x 3). This is used to calculate & show maximum points. It means the spreadsheet can show fit as
a ‘percentage perfection’ at Requirement, Sub-Total & Grand Total levels. These index numbers become highly significant (usually the most
significant numbers) during decision-making.
Ref: SysSel-How-To-Select-Your-New-Computer-System.doc
12-Feb-2007
How To Select Your New Computer System: Pitfalls & Proven Methods
Page 8
The Management School - Lancaster University
4.7
SysSel
Example Negotiation Agenda
See actions below at General Meeting Notes
System Selection Method - Example Of Negotiation Agenda
Nego
Priority
Ref
Request
Calc
Method
A.
Costs & Terms
0 Must
005
Verify/update scope of supply esp number of users
Scope
0 Must
006
Attachments to contract (A)
Risk
CoPQ
4 Could
007
Attachments to contract (B)
Risk
CoPQ
0 Must
011
Price: software - discuss Supplier supply of Oracle 10G Discount
RDBMS licenses, at attractive rate
0 Must
012
Confirm Microsoft Project interface in standard package Risk
costing
0 Must
013
Project budget: clarify Windows CALs
Avoided
cost
0 Must
014
Price: software - overseas payroll
Risk
0 Must
015
Price: software - 'Possible Reduction For Types Of
User' - see 'CostsV2.doc' p7
Discount
£10,000
0 Must
016
Price: software - user licensing type
0 Must
018
Price: pay for users in blocks as system installed
Lower
license
count
Interest
earned
0 Must
019
Price: pay for modules as system installed
Interest
earned
£500
0 Must
020
Price: software - phased *module* cost - option to buy Discount
*future* modules at agreed price, if buy before Apr 2008
0 Must
021
Cost for extra users (c50-75) in two years after initial
implementation
Discount
Affected Hrs/We
Users
ek/User
Est Value Open
N/a
£2,000
N/a
BATNA
Worst
None
Rework in 24 hours
Yes confirmed no Supplier changes to 'CostsV2.doc' subject to later discussion about Project Reporting Users
Attachments to contract must include: (a) RDD (b) scores (c) linking Delist supplier - must
definitions
agree - requirement
0372
Attachments to contract *may* include: (1) this list updated with
Excluded from contract
agreements (2) demonstration outline
Must agree
Agreed in principle - normally covered in standard
contract 'warranty clause'
Don’t bother
No need
Buy separately
Supplier interested in supplying? Explore, as part of this overall
discussion - may be bonus business - agree version / no of
processors
Formality - confirm Microsoft Project interface is included in standard Pay extra
system & therefore current costing
List price from Oracle
Confirm no changes to AM costing document Monday 17/10/05
Best
10% discount
Agreed Inc Customer Resp'y
Supplier prefer to supply - will be included in bundled
price
Heavy discount - asked - Free
verbal agreement
Yes confirmed - interface included in standard system
(but not Microsoft Project itself)
Reassurance awaited as to whether Customer need Windows CALs Massive cost to buy
to run application
Windows CALs
Subsidised CALs
CBT AM to check
Clarify jurisdictions available & costs per country
Confirm what is available Clearly priced with PLC
discount
CBT PO to check
Clarify facilities available to Project Reporting & Field Service users - Not usable
assess number of main users replaced
Unsuitable
Clearly priced with
discounted user cost
Not feasible - everyone needs document management
so cannot use these reduced-function users
£50,000
Clarify position re concurrent user licensing as option
Named users
Named
Concurrent
Not a pricing option - named users only
£25,000
Year One - possibly BTL users only
In full upfront
In full upfront
Pay just before needed
Year One - no international packs - countries added as needed - see In full upfront
'CostsV2.doc' p7
In full upfront
Pay just before needed
CBT - Supplier UK Financial Year is December - beware
constraints on revenue recognition rules - if conditions or
6 months out cannot count in figures - therefore if
commitment beyond June 2006 Supplier have to book
two projects (Heywood + Dorking) - AM to cost (x + y) >
Extra countries already not priced on a 'buy once' basis pay when needed
£10,000
Discuss future module pricing - not covered in 'CostsV2.doc' p8 assume BTL lead & Dorking gap possible
Same as current deal
See 018
£48,000
Discuss future pricing - see 'CostsV2.doc' p8
No agreement incremental user cost
only
As quoted (already
discounted)
Further discount of 5%
Supplier agreed to extend to 'before Apr 2008' - note
discount already built in to figures for blocks of users normally average £2,400 per user
£37,100
N/a
Undetermined - risks
unexpected costs
No agreement - risk of
monopoly pricing - BTL
need most modules
No agreement calculated risk monopoly
pricing
No CALs needed
When negotiating such an expensive & high-risk purchase, it is best to agree with the others in the negotiation team the concessions you
seek (and are prepared to trade). Many items come from analysing the package scores for deficiencies. Note the small font prevents the
document being read upside-down by the package supplier’s negotiator! The right-hand column records agreements during the meeting.
Ref: SysSel-How-To-Select-Your-New-Computer-System.doc
12-Feb-2007
How To Select Your New Computer System: Pitfalls & Proven Methods
Page 9
The Management School - Lancaster University
Example Responsibility Chart
rd
oa
(S
rs
lie
pp
Su
re
s
wa
ier
pl
rd
up
Ha
S
ge
am
ka
Te
ac
n
/P
io
em
at
st
nt
e
am
Sy
Te
em
n
pl
tio
Im
tia
s
or
go
vis
Ne
Ad
nt
s
gm
or
vis
Mn
Ad
ge
IT
an
s
Ch
ee
iew
rv
te
In
am
Te
n
io
at
er
alu
ag
Ev
an
tM
ec
or
oj
ns
Pr
po
tS
ec
B)
oj
(P
Pr
tB
ec
oj
Pr
)
MT
Authorise project
Determine scope
Study feasibility inc cost
Establish phasing
Study best practice (desk search)
Capture requirements (interviews)
Document requirements (RDD/SoUR)
Weight requirements
Trawl marketplace
Evaluate longlist (RFI)
Review longlisting & select shortlist
Visit shortlist (RDD/SoUR)
Score for fit
Analyse gaps
Review eval & select demos
Demonstrate preferred system(s)
Check reference sites
Negotiate terms
Agree contract
Install system
am
Te
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
X – Executes the work
D – Takes decision solely/ultimately
d – Takes decision jointly
P – Manages progress
T – Transfer of information/knowledge
C – Must be consulted
I – Must be informed eg copy documents
A – Available to advise
S – Provides support eg technique/documentation
nt
gm
Mn
or
ni
Se
Proj Responsibility
4.8
SysSel
D
I
I
I
C
D
C
D
I
I
I
X
X
C
d
D
X
C
I
I
d
C
C
C
d
C
I
C
C
C
I
I
C
I
I
I
C
C
I
I
C
P
P
d
P
P
P
P
P
P
D
A
P
P
P
A
C
X
P
P
C
I
I
I
I
C
C
X
X
T
C
T
S
S
S
X
X
X
S
X
X
S
S
S
T
S
S
S
S
I
T
S
S
S
T
I
I
I
I
C
A
I
I
I
X
C
A
X
A
A
A
A
I
C
C
I
C
C
A
I
X
C
C
C
C
I
I
I
S
This is typical, but an example. Responsibilities will differ on different projects. In a live project, this role/responsibility matrix would be
backed up by a list (or matrix) of people in each group (such as the PB). Alternatively, the columns might be named individuals.
Ref: SysSel-How-To-Select-Your-New-Computer-System.doc
12-Feb-2007
How To Select Your New Computer System: Pitfalls & Proven Methods
Page 10
© 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704
Guest Lecture at EBIN 15-Feb-07
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
How To Select Your
New Computer System:
Pitfalls & Proven Methods
Martin Tate, IT Evaluation
A Division Of Decision Evaluation Ltd
+44 (0) 1772 752704
[email protected]
“Ensuring clients buy IT that fits.”
Impartiality, knowledge, method, reliability & savings on:
• IT system reviews;
• IT strategy;
• IT supplier evaluation & system selection.
Bacup Shoe | Biwater | Bombardier | Broadways Stampings | Business Link | Castrol | Connexions (Careers Service)
Corporate Credit | DaimlerChrysler | Department for Work and Pensions (DWP) | Devil's Guide
Galloway's Society For The Blind | Gateshead MBC | Halo Retail | Homestead CSL | Hotels & GH Association
I Love My | Kelland | Lancashire Fire & Rescue Service | Lancaster University Management School
Learning and Skills Council (LSC) | LEGO | M6 Papers | Nottingham City Council | Pearson | Pinacl Communication
Red Box Design Group | RNIB | Royal & SunAlliance | Svenska Cellulosa Aktiebolaget | Travelodge | Turtle Wax
Context
Business (strategy, objectives, resources)
Business/IT alignment, IT strategy, ecommerce strategy
Programme & project management
Risk
management
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
Scoping
Project
approach
Project
scope
Current items
IT
procurement
Requirements
New system
IT Service
Management
Quality & security management
3
Note slide numbers in lower corner, for questions and reference.
© 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704
Long + shortlist
Acquire
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
Requiremts
Startup
Evaluation Method - Processes
4
Responsibility Chart (RRM)
Proj Responsibility
Proj Responsibility
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
w
ie
l
rd
pp
Ha
a
Suliers
Te
geupp
mn
a
o
ka e S
i
ac war ersTeat
r
/P ard pplin lu
o
u
a
ge
em H agetSatiEv m
na
st
a
kn
am a
Te
ac e
M
Sy
e
/Pm
on
t
T
i
c
emle
at
st p
nt onamje
e
or
i
SIym
em iatn Tero
ns
pl
Im
oitatio P ors po
g
s
r
ot
S
s
isovi t
Neeg
v
N
c
AdAd je
B)
nt t ros
gm n Psor
s (P
Mngm vi
or rd
d
ge n T A
I
vsis oa
an M
Ch e
)
Awdee t B
g
ITrvie jec s SMT
an
te
In ro am ee
Ch
P Te w m (
n e ea
io i
at rv r T
alu te ge t
Ev In na n
m
m
a
nt Mg orTea
jec
ns
roM
oPr ioon
ni ctaStp
Se Pvraojleu (PB) ager
E ard an
o
tB M )
ec t T
oj c SM
Pr oje m (
or
a
Prnt Te ons
p
gm
tS
Mn
or
ec
ni
B)
oj
Se
(P
Pr
rd
oa
)
tB
ec
MT
oj
(S
Pr
am
Te
nt
gm
Mn
or
ni
Se
1X –XExecutes
Authorise
project
the work
– Executes
the
work
D – Takes
decision solely/ultimately
2d –DTakes
Determine
scope
decision jointly
– Takes
decision
solely/ultimately
P – Manages progress
– Takes
decision jointly
3T –dTransfer
Study
feasibility
inc cost
of information/knowledge
C – Must be consulted
– beManages
progress
4I – P
Establish
phasing
Must
informed eg copy
documents
A – Available
to advise of information/knowledge
– Transfer
5S –TProvides
Study
best
practice (desk search)
support
eg technique/documentation
C – Must
be consulted
1 Authorise
project
D
C
C
6
Capture
requirements
(interviews)
I – Must scope
be informed eg copy documents
2 Determine
I
D
C
(RDD/SoUR)
37 Study
feasibility inc
cost
I
C
d
ADocument
– Available
torequirements
advise
4 Establish phasing
I
D
C
– Provides
support eg technique/documentation
8 SWeight
requirements
5 Study best practice (desk search)
I
I
69
requirements
(interviews)
I
C
Trawl
marketplace
1 Capture
Authorise
project
7 Document requirements (RDD/SoUR)
I
C
10
Evaluate
longlist
Determine
scope(RFI)
82 Weight
requirements
X
C
9
Trawl
marketplace
11 Review longlisting & select shortlist I
10 Evaluate longlist (RFI)
I
12 Review
Visit
shortlist
(RDD/SoUR)
11
longlisting
& select
shortlist
X
C
12
shortlistfor
(RDD/SoUR)
I
13 Visit
Score
fit
13 Score for fit
I
14 Analyse
Analyse
14
gaps gaps
I
15 Review eval & select demos
X
C
15
Review
eval
&
select
demos
16 Demonstrate preferred system(s)
C
C
C
17
reference sites preferred system(s)
I
I
16 Check
Demonstrate
18 Negotiate terms
I
I
17 Agree
Check
reference sites
19
contract
d
d
C
20
system
D
C
18 Install
Negotiate
terms
19 Agree contract
20 Install system
Note slide numbers in lower corner, for questions and reference.
P
P
d
P
P
P
P
P
P
D
A
P
P
P
A
C
X
P
P
C
I
I
I
I
DC
C
I
X
X
T
C
T
S
S
S
X
X
X
S
X
X
S
S
S
T
S
S
S
S
I
T
S
S
S
T
C
D
I
C
I
C
C
A
I
I
I
I
I
X
C
A
X
A
A
A
P
P
C
C
I
C
C
A
I
X
C
C
C
C
A
I
I
I
I
S
5
© 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704
System Selection Process - Why
& defensible decision
„ Predictable timescale
„ Thorough end-user involvement
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
„ Rational
• Helps acceptance & change management
„ Driven
by requirements, not ‘politics’
„ More complete facts available before buy
„ Top down approach
„ Understanding of impact
6
Process strengths
„ Management
of risks
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
„ Avoid
poor fit & ‘package’ modifications
„ Informality often loses control
„ Must compare systems to requirements
„ Consultation & control throughout
„ Rigour
deters unscrupulous vendors
„ Strong contract as free by-product
7
Note slide numbers in lower corner, for questions and reference.
© 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704
The Principles That Underpin
of change curve (=> redundancy)
„ Management attention curve
„ Management by exception
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
„ Cost
• Progressive shortlisting / police by exception
„ Stakeholders
„ Model-building
to test requirements
„ Rational decision-making – ‘evidence’
„ Project & management effectiveness
8
Effort/Money
Per Feature
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
Cost Of Change Curve
Analysis
Design
Construction
Testing
--- Project Progress --- >
Installation
9
Note slide numbers in lower corner, for questions and reference.
© 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704
Management Attention Curve
Poor MAC
Decisions: scale & number
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
Effective MAC
10
Levels Of Need
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
•
•
•
•
•
•
Objectives of project & system
Type of Users reached by ICT system
Major business Functions, could be automated by system
Project coverage (beyond ICT processing)
Features of ICT system
Supplier criteria such as support
Objectives
Scope (Coverage)
Users
Functional
Req’ts
System
Features
Project
Supplier
Criteria
11
Note slide numbers in lower corner, for questions and reference.
© 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704
Scoping Process
X
X
X
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X Outside scope
X In X X Just Out
X
X
X
X
X
X
X
X
X
X
X
X
X
12
Procurement Process – Summary
„ Project
start-up
• Scope, finance, phasing
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
„ Interviews
for requirements definition
„ Agree RDD
• Revise Requirements Definition Document
„ Market-place
trawl
• Usually after requirements
„ Shortlisting
• By Request For Information (RFI)
13
Note slide numbers in lower corner, for questions and reference.
© 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704
Process – Summary (B)
„ Evaluation
• Including visits by evaluation team
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
„ Scoring
of candidates
• Possibly internal systems
„ Demonstrations
& reference sites
„ Selection, negotiations & contract
„ Installation
• Post-implementation & benefits reviews
14
Specs!
Cartoon from ‘The Fanatics Guide to Computers’. Copyright © Roland Fiddy, 1991, 1994. Used by permission of Exley Publications Ltd.
Note slide numbers in lower corner, for questions and reference.
© 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704
Scoring To Pick A Winner
Package + Supplier Evaluation
(Gna)
Shortlist After Responses To Requirements Document
Nbr Wgt
0081
5
0082
3
0083
2
0084
1
0085
5
0086
3
0087
4
2
0088
0089
4
Categ
Requirement Title
Customer/Supp Customer & Supplier Details
Customer/Supp Grouping Contacts
Customer/Supp Hold Company Registration & VAT Numbers
Customer/Supp Contract Quotations Status, Version & Re-Use
Customer/Supp Secure Order Form
Customer/Supp Levels of Bill of Material
Customer/Supp Notice Of New & Changed Tenders
Customer/Supp Customer Contribution & Profitability
Customer/Supp Customer Changes Own Account Information
Customer/Supp Total
Sales/Marketing Customer Price List
Sales/Marketing Telephone Scripts
Sales/Marketing Reports On Main Sales Measures
Sales/Marketing Cost of Campaign
Sales/Marketing Total
Tech & Design Staff-To-Service Expertise Matrix, With Controls
Tech & Design Drill Down & Drill Across
Tech & Design Screen Prints
Tech & Design Archiving & Retrieval
Tech & Design Fax From Desktop
Tech & Design Contribute To ISO 9002
Tech & Design Report Generator
Tech & Design Total
Supplier Consid Soundness Of Supplier
Supplier Consid Reference Sites
Supplier Consid Training Available from Author
Supplier Consid Relationship With 3rd-Party Help Desk
Supplier Consid Relevant Data Migration Experience
Supplier Consid Formal Implementation Method
Supplier Consid Total
0090
0091
0092
0093
4
1
5
2
0094
0095
0096
0097
0098
0099
0100
5
2
5
4
3
4
2
0101
0102
0103
0104
0105
0106
4
3
4
3
4
3
IT Evaluation Ltd
Perfect
Package A
Package B
Max MatchA Fit Xtd
Fit % MatchB Fit Xtd
Fit %
15
3
15
100%
2
10
67%
9
2
6
67%
2
6
67%
6
0
0
0%
2
4
67%
3
0
0
0%
2
2
67%
15
2
10
67%
3
15
100%
9
0
0
0%
2
6
67%
12
2
8
67%
3
12
100%
2
4
6
1
33%
2
67%
12
1
4
33%
3
12
100%
87
52%
82%
45
71
12
2
8
67%
3
12
100%
3
0
0
0%
3
3
100%
15
2
10
67%
2
10
67%
6
2
4
67%
3
6
100%
36
61%
86%
22
31
15
3
15
100%
2
10
67%
6
4
6
3
100%
2
67%
15
1
5
33%
2
10
67%
8
8
12
2
67%
2
67%
9
2
6
67%
2
6
67%
12
2
8
67%
3
12
100%
2
4
6
1
33%
2
67%
75
67%
72%
50
54
12
3
12
100%
2
8
67%
9
3
9
100%
1
3
33%
12
3
12
100%
1
4
33%
9
3
9
100%
1
3
33%
0
12
12
0
0%
3
100%
9
3
9
100%
1
3
33%
63
81%
52%
51
33
Grand Total
261
168
Evaluation Products
64%
(E)
Shortlist
Shortlist After Responses To Requirements Document
E-Learning Package Scoring Spreadsheet
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
(A) Requirements/criteria
(A.2)
ToC
for
titles
Categ
Requirement Title
Event Mgmt
Manage resource inc allocation to course present'ns
Event Mgmt
Course venues inc external conference hotels
Event Mgmt
Cancel event registration inc waiting lists & billing
Event Mgmt
Optimise resource usage
Event Mgmt
Student/instructor meals/refreshments/dietary needs
Event Mgmt
Management reports such as division performance
Event Mgmt
Skills matrix - Lecturer/Presenter/Instructor
Event Mgmt
Track student progress inc assignments, test results
Event Mgmt
Pre-course learning pack
Event Mgmt Total
Global
Multiple user time zones on 1 central system
Global
User interaction in their preferred language
Global
Customer downloads courseware in preferred format
Global
Digital rights management (DRM) - piracy protection
Global Total
Tech & Design Define user profiles with personalisation
Tech & Design Comply with AICC, IEEE, IMS & ADL SCORM
Tech & Design Load courseware from tools eg AuthorWare, P'Point
Tech & Design Support downloadable formats inc MP3 & WAV
Tech & Design Support streaming formats inc RM
Tech & Design Integrate with HR systems
Tech & Design Budgets (cross-charge) & revenue targets (ext sales)
Tech & Design Total
Supplier Consid Soundness Of Supplier
Supplier Consid Reference Sites
Supplier Consid Training Available from Author
Supplier Consid Relationship With 3rd-Party Help Desk
Supplier Consid Relevant Data Migration Experience
Supplier Consid Formal Implementation Method
Supplier Consid Total
Grand Total
Nbr Wgt
0081
5
0082
3
0083
2
0084
1
0085
5
0086
3
0087
4
0088
2
0089
4
0090
0091
0092
0093
4
1
5
2
0094
0095
0096
0097
0098
0099
0100
5
2
5
4
3
4
2
0101
0102
0103
0104
0105
0106
4
3
4
3
4
3
IT Evaluation Ltd
Perfect
Package A
Package B
Max MatchA Fit Xtd
Fit % MatchB Fit Xtd
Fit %
15
3
100%
2
67%
15
10
9
2
67%
2
67%
6
6
6
0
0%
2
67%
0
4
3
0
0%
2
67%
0
2
15
2
67%
3
100%
10
15
9
0
0%
2
67%
0
6
12
2
67%
3
100%
8
12
6
1
33%
2
67%
2
4
12
1
33%
3
100%
4
12
87
52%
82%
45
71
12
2
67%
3
100%
8
12
3
0
0%
3
100%
0
3
15
2
67%
2
67%
10
10
6
2
67%
3
100%
4
6
36
61%
86%
22
31
15
3
100%
2
67%
15
10
6
3
100%
2
67%
6
4
15
1
33%
2
67%
5
10
12
2
67%
2
67%
8
8
9
2
67%
2
67%
6
6
12
2
67%
3
100%
8
12
6
1
33%
2
67%
2
4
75
67%
72%
50
54
12
3
100%
2
67%
12
8
9
3
100%
1
33%
9
3
12
3
100%
1
33%
12
4
9
3
100%
1
33%
9
3
12
0
0%
3
100%
0
12
9
3
100%
1
33%
9
3
63
81%
52%
51
33
261
168
64%
72%
(D)
Shortlisting
via RFI
Reverse engineering
to prompt interviewees
Package + Supplier Evaluation
189
189
(C)
Process
for
weighting
[0-5]
72%
(B) List – input to weighting
(H) Scores & weights combined
Name
Appointments: Automatic Letter Confirming Appointment
Issues
Ease of generating letter, including name & address details
Extent of support for picture data
0
1
2
3
Text & code data supported
Text & code data supported
Use additional software to
display image such as
map
Use built-in facility to display
image such as map
(G) Definitions – performance needed for given score – one
sheet per requirement – one entry for each score awarded
(F)
Process
for
scoring
[0-3]
Note A, G & H become attachments to contract
Note slide numbers in lower corner, for questions and reference.
17
Agresso
IFS
Note slide numbers in lower corner, for questions and reference.
250
200
75
25
IT Supplier Considerations
£1,750
IT Technical
Interface
£1,500
Environment
Management Information
£1,250
Financials – CIS
Financials
£1,000
International System Considerations
Perfect
Prj/Contract Mngmt & Acctng PCMA
£750
Document Management
Time Recording
£500
Procurement
£250
Resource Management
Human Resources
Capability Points (Fit)
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
£-
Sales & Marketing
Information
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
© 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704
Shortlisting With Capability/Value
275
Agresso
225
COINS
175
150
CSI SAP
125
100
Diagonal SAP
50
IFS
Ramesys
0
Mid-Point Cost (Software Only, £K)
£2,000
18
After Detailed Evaluation
400
350
300
250
200
150
100
50
0
19
© 12-Feb-07 Decision Evaluation Ltd +44 (0) 1772 752704
The Human/Customer Dimension
„
Not just a ‘buying experience’
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
„
Supports organisational & cultural change
•
•
•
•
•
•
„
Empowering – recognises operational requirements
Structured approach collects ‘invisible’ knowledge
Active listening – captures aspirations at all levels
Intolerant of mis-matched systems – reduces stress
Liberates & motivates staff
Holistic solution creates optimum working environment
Selection not distorted by dominant personalities
• Decision makers get peace-of-mind
• IT gets buy-in
„
Organisation can suceed where others fail
20
References
© Decision Evaluation Ltd, Feb-07 www.itevaluation.co.uk
„ See
Handouts
• GDPM
• NRM
• KT
• CIPS
• OGC (CCTA)
• RISC
23
Note slide numbers in lower corner, for questions and reference.