Evaluation protocol

The impact of AHA-IoT services on the LSP endpoints is evaluated by using quantitative indicators that are corroborated through qualitative insights, especially as concerns the assessment of Sustainability endpoints. 

The evaluation of the expected outcomes needs to take into properly account social and service determinants as independent variables (Age, gender, living, working status, education level, technological level, technology usage, DS and Reference Use Case) that are, a priori, main contributing factors of the changes on endpoints (dependent variables).

As concerns quantitative dependent variables, a shared set of global performance indicators (Global endpoints) has been defined to be measured at DS level at different protocol’s phases (input, intermediate, and exit) through standard data sources (if possible).

Moreover, a Global Self-Perception questionnaire has been set-up as tailored-made instrument, easy to use questionnaire to be used in all the DSs in order to get direct global results, engaging all the participants to all ACTIVAGE panels as one cohort. 

The table below reports the list of Global endpoints used to measure the ACTIVAGE LSP impact of IoT-AHA services. Every endpoint belongs to a specific category of the Triple Win Strategy and it is described by also referring to the relative Data Source, and Data collection timing. As concerns the Data Sources, the protocol foresees the use of validated standard questionnaires plus Qualitative approaches able to support Quantitative analysis in terms of services’ replication and scaling-up.

Variables Data source Data collection timing
QoL
Users’ acceptance EQ-5D-3L[1]  (CarerQ-7D for carers) Input and exit
QoL Global self-perception scale questionnaire Input, intermediate and exit
Social Isolation UCLA Loneliness scale version 3[2] Input and exit
Loneliness Global self-perception scale questionnaire Input, intermediate and exit
Physical activity EQ-5D-3L Input and exit
Physical activity self-perception scale questionnaire Input, intermediate and exit
Sustainability category
Users’ acceptance UT-AUT questionnaire[3] Intermediate and exit
Evolution of IoT usage Intermediate and exit
Cost effectiveness Cost Utility Analysis (and ICER) Final analysis
Innovation and Growth category
Local replication plans No. of local replication plans for AHA-IoT services Final analysis
Synergies among ACTIVAGE members for market growth ACTIVAGE.ORG incorporated Final analysis

[1] https://euroqol.org/eq-5d-instruments/eq-5d-3l-about/

[2]https://fetzer.org/sites/default/files/images/stories/pdf/selfmeasures/Self_Measures_for_Loneliness_and_Interpersonal_Problems_VERSION_3_UCLA_LONELINESS.pdf

[3] Maira Lescevica, Egils Ginters, Riccardo Mazza, “Unified theory of acceptance and use of technology (UTAUT) for market analysis of FP7 CHOReOS products”, Procedia Computer Science 26 ( 2013 ) 51 – 68.