...
Short name | Operational KPIs | Baseline 30/04/15 | Target 30/04/16 | Measured 30/04/16 | Explanation |
---|---|---|---|---|---|
KPI 1 | International eduroam authentications per month | 31,832,243 | 26,000,000 | 47,339,724 | Counts sucessful successful authentication requests that pases pass ETLR servers, for which time interval are those numbers - what is the start pointper month (monthly traffic) |
KPI 2 | National eduroam authentications per month | 147,726,234 | 117,000,000 | 215,597,792 | Counts successful authentication requests that pases pass (only) FTLR servers, per month (monthly traffic)for which time interval are those numbers - what is the start point |
[1] The target figure for end GN4-1 was set a number of months before the project began and is therefore lower than the baseline. The actual achieved growth exceeds that which would have been predicted with the same methodology of the original predictions.
...
*NRENs and end-users where applicable
...
NREN uptake
In the beginning of GN4-1 there were 44 European NRENs/NROs that were using eduroam service. During GN4-1 two new European NRENs/NROs joined eduroam: Georgia and Ukraine, resulting in 46 NROs from Europe (see monitor.eduroam,org).
NOTE: European NRO != GÉANT participant (e.g. NORDUNET is one GÉANT participant represented by 5 NROs; GEANT org is GÉANT participant and not an NRO; Andorra, Azerbaijan, Georgia, Kazakhstan, Kyrgyzstan and Russia are not GÉANT participants but have European NROs)
All GÉANT participants are using eduroam service.
Usage uptake
The eduroam service continues to see significant growth, both within countries and across borders. Seasonal fluctuations are evident, linking with main academic holiday seasons and new terms, but on a month-to-month comparison, every month saw growth based on the previous year at national and international levels. The start of the academic year 2015-2016 was performed particularly strongly.
Growth of eduroam national roaming authentications : GN3plus and GN4-1 | Growth of eduroam international roaming authentications: GN3plus and GN4-1 |
At
the end of the reporting period, the Another means to track eduroam uptake is to measure usage of eduroam supporting tool CAT had 1281 supported IdPs, over 1000 of which are fully configured. During the period, 1,262,104 downloads were delivered, 1,259,842 of which were end user profiles. do we have numbers at beginning of GN4-1 ?. The tool is used by IdPs (end-users institution) who configure their institution "profile", and ultimately by end-users who download eduroam installers for their device.
GN4-1 start 1. May 2015 | GN4-1 end 30. April 2016 | |
---|---|---|
Number of IdPs in CAT tool | 880 | 1281 |
Number of IdPs fully configured in the CAT tool | 699 | 1093 |
Number of end-user downloads of installers from CAT tool | 1,682.377 * | 3.877.511* |
*measured from the day of release of the CAT tool in GN3plus
Distribution of CAT downloads per type of user device OS |
During GN4-1 two new NROs joined eduroam, Georgia and Ukraine what was the number of NROs in beginning of GN4-1 , and what is the number of geant pariticipants in gn4-1. Who didnt join and why.
Devops Roadmap
*Roadmap should cover cover upto next year, with more details on plans for next quarter
...
Current eduroam devops roadmap is available at the eduroam Devops Roadmap
Snapshot of the roadmap taken for this review on
Miro, can you please provide a roadmap even better at eduroam Devops Roadmap ... We can than put a url to that roadmap here. PDF name eduroam Devops Roadmap-snapshot for GN4-1 service review.pdf
Development Roadmap
*Roadmap should cover next 2-3 years, and show where we are on it
Input needed from JRA3 Ann Harding
...
In GN4-2 JRA3 is responsible for further development of eduroam service. The roadmap was discussed during the Project Management Convention, resulting in the following:
- eduroam as a service - eaas - detailed roadmap
- Overall system design specified – DONE
- Implement first prototype – ONGOING
- finalize first prototype for the service – Dec 2016 [COMMITED]
- launch pilot for the service – Jan 2017 [COMMITED]
-> functional except credential revocation; preliminary UI; see “Pilot Features” - stop the pilot – May 2017 [PLANNED]
- eaas beta version – June 2017 [PLANNED]
-> fully functional, near-final UIs; see “Beta Features” - eaas v1.0 – July 2017 [PLANNED]
- documentation and acceptance testing – Sep 2017 [POSSIBILITY]
- service launch and handover to production – Oct 2017 [POSSIBILITY]
- eduroam user diagnostics
- analyse requirements - Dec 2016
- start development - Jan 2017
- finalize prototype - June 2017
- early adopters release and acceptance testing- July 2017
- service launch - Oct 2017
- radsec scalability
- CAT development
Service availability and incidents
*Including any security breaks
...
Miro please add No security breaks
Usage and scalability issuesMiro please add
...
NO issues we are aware off
Support, operations and devops effort spent and planned Ask Ann to provide numbers from the SA5 budget.
...
Caution: Reporting on spent manpower in GEANT projects is not conceptualised for easy and accurate tracking of spent manpower for different services and for different aspects of work on those services (ie what was spent on development, support or operations). For GN4-1, it comes down on how much individual person claimed under certain task. eduroam development and operations were performed under same task in GN4-1 and therefore its impossible to make such differentiation at this point.
SA5 Task | Spent | Budget | Type of performed work |
---|---|---|---|
T7 - eduroam | 310.850,83 € | 335.333,74 € | eduroam development and operations |
Proposal for additional KPIs related to usage, uptake and costs
Ann, Miro something to add ?
...
Although GN4-2 Technical Annex does not have details on target values for KPIs, we have projected the target based on the current rate of usage growth and expected changes in the market. It is expected that growth of eduroam will be slower than in previous years due to full coverage/use in many organisations, and the potential impact of the abolition of roaming data charges in the EU. Nonetheless, as eduroam delivers more value than simply cost of network access, growth is still expected.
Short name | Operational KPIs | Baseline 30/04/16 | Target | Target M32 of GN4-2 | Explanation | |
---|---|---|---|---|---|---|
KPI 1 | International eduroam authentications per month | 47,339,724 | 43,000,000 | 49,000,000 | 55,000,000 | Counts sucessful successful authentication requests that pases ETLR serversfor which time interval are those numbers - what is the start pointpasses ETLR servers, monthly average |
KPI 2 | National eduroam authentications per month | 215,597,792 | 180,000,000 | 207,000,000 | 228,000,000 | Counts successful authentication requests that pases passes (only) FTLR serversfor which time interval are those numbers - what is the start point, monthly average |
[1] The target figure for end GN4-1 was set a number of months before the project began and is therefore lower than the baseline. The actual achieved growth exceeds that which would have been predicted with the same methodology of the original predictions.
Any Other Issues
...
During the GN4-1 period, eduroam service had following notable tasks performed:
- First level support was migrated to GÉANT OC
- The first draft of eduroam db ver 2.0 spec. was released
- As a basis for eduroam as a service - eaaS service offering, Deliverable D9.3 Service Approach Specification to Small Site eduroam Adoption was released on Feb 2016
- monitor.eduroam.org and www.eduroam.org web sites have been reworked
Miro please add