TOWARDS MANAGING IGE STANDARDS

INITIATIVE FOR GLOBUS IN EUROPE
Steve Crouch, IGE WP3 Leader
TOWARDS MANAGING IGE STANDARDSBASED REQUIREMENTS THROUGH OGF
INITIATIVE FOR GLOBUS IN EUROPE
Introduction
•  IGE aims to address EU community needs for Globus
through
–  Development of Globus solutions
•  e.g. standards-based Globus support
–  Delivery of solutions
•  e.g. through EGI’s UMD
–  Must understand those communities!
•  Need to address different requirement types
–  Technical: Globus, standards
–  Non-technical: legal, licensing, MoUs, SLAs
•  Need for requirements representation
–  Within Globus e.g. core development team
–  Within standards bodies e.g. OGF, OASIS, W3C
•  How to do this: specific WP within IGE for handling and
representing requirements
IGE: The voice of Globus community needs in Europe!
INITIATIVE FOR GLOBUS IN EUROPE
Overview – Handling Requirements through Outreach
•  Two key mechanisms:
–  European Globus Community Forum (EGCF)
–  European Globus Liaison Office (EGLO)
Internal
Development
EGLO
Globus
Representation
EGCF
Coordination /
Requirements
Handling
…
EU Projects
DCI Projects
MoUs /
SLAs /
Roadmaps
Conferences, Projects, Email,
etc.
Globus
…
Standards
Representation
OGF
…
EGI-InSPIRE
EMI
INITIATIVE FOR GLOBUS IN EUROPE
In More Detail…
T2.2
EGLO
OGF
…
T3.3 Standards
Representation
Globus
T3.2 Globus
Representation
WP3
T2.2
EGCF
EU Projects
T3.1Requirements
/ Coordination
EGIInSPIRE
…
T3.5 Negotiate
SLAs with e-Inf.
T3.4 Suitability
Monitoring
T3.6 IGE Comp.
Roadmaps
EMI
EGIInSPIRE
(UMD)
WP4
T4.3 Collaboration
WP2
INITIATIVE FOR GLOBUS IN EUROPE
How to Handle Requirements?
•  One of our first steps (and deliverables)!
•  Requirements need to be (for example):
– 
– 
– 
– 
– 
– 
Captured from community users
Understood within community domain
Categorised as type of requirement
Verified as an outstanding requirement
Delegated for implementation/representation
Either:
•  Represented within appropriate organisations
•  Implemented within IGE’s development activities
–  Progressed in a visible way
–  Validated when resolved – e.g. met quality criteria?
–  Finalised when representation is complete
•  Complex lifecycle – need a well-defined publicly
accessible process!
INITIATIVE FOR GLOBUS IN EUROPE
Requirements Handling Process
•  Process needs to consider
–  Requirements lifecycle
–  Working with other requirements
gathering activities across EU e.g.
EGI-InSPIRE
–  Roles and responsibilities
•  e.g. delegator, delegatee(s)
–  Categorisation of requirement types
and states
–  Identification of appropriate
communication channels
–  Internal interactions e.g. delegation
–  Infrastructure
•  Next WP3 task within IGE!
INITIATIVE FOR GLOBUS IN EUROPE
Handling Standards-based Requirements
•  Number of IGE members active in many
OGF groups
Meta
PGI-WG
standards
IGE
Reqs.
JSDL,
Base
OGSAstandards
BES, …
Interop
GIN-CG
Activities
INITIATIVE FOR GLOBUS IN EUROPE
Use Case Description
• Goal: Computer models of personalized patient specific
healthcare.
• Customers: Scientists participating in the VPH project.
• Molecular Dynamics Simulations
Process:
1st step:
Ensemble Simulations:
2nd step:
Replica
Exchange
Manager
Replica Exchange:
Replica
Exchange
Manager
GridFTP
GridFTP
• Using SAGA for workflow orchestration
• Use of “pilot jobs”
• Minimal data exchange using GridFTP
Resources:
• HPC resources from DEISA and TeraGrid
8
8
INITIATIVE FOR GLOBUS IN EUROPE
PGI-WG Use Case Submission
•  PGI-WG - OGF29: back to use cases
Use Case
Submission
Requirements
Extraction
Collation
Review
Analysis
Specification/
Profiling
•  Process for use case authorship/review
•  Enter IGE’s SAGA/Globus VPH use case…
•  Use case accepted for PGI-WG Use Case v1.0
document
•  EGI Use Case…
–  OGSA-BES/JSDL-based interoperability
•  PGI-WG – future iterations of use cases possible
INITIATIVE FOR GLOBUS IN EUROPE
Timeline
Req. Process
(PM2)
D3.2
EGH
EGCG /
EGLO
Req. Inf.
(PM4)
INITIATIVE FOR GLOBUS IN EUROPE
Requirements Collected from DEISA
•  VPH Project
•  IBM LoadLeveler Batch System
Adaptor for Globus GT5 GRAM
–  already done
–  licensing issues being resolved now
–  actively used at SARA
–  to be installed at FZJ soon
INITIATIVE FOR GLOBUS IN EUROPE
Requirements Collected from EGI
•  Address ‘Capabilities’ in UMD Roadmap
– 
– 
– 
– 
– 
– 
– 
– 
– 
– 
– 
– 
Compute - e.g. HPC Basic Profile, BES, JSDL in GRAM5, GridWay
Compute job scheduling - e.g. GridWay
Database access - e.g. OGSA-DAI
Metadata catalogue - e.g. globusonline
File transfer - e.g. GridFTP
Parallel jobs - e.g. MPI
Instrumentation - some use cases – investigate!
Workflow - e.g. Taverna2 w/ GSI
Authentication - move away from HTTPG to HTTPS
Credential management - e.g. SLCS, TCS, MyProxy
User management - e.g. VOMS provided through EMI
Authorisation - e.g. LCAS/LCMAPS