Consultants always bring new ideas and provide their help in implementing new business models. Those models and methods are not good for every kind of business.
Assessing Europe's University-Based Research Expert Group on Assessment of University-Based Research EUR 24187 EN European Research Area Science & society EUROPEAN COMMISSION Research
http://ec. europa. eu/research/research-eu EUROPEAN COMMISSION Assessing Europe's University-Based Research Expert Group on Assessment of University-Based Research RTD.
This is the question experts were asked to answer, following a 2006 Commission Communication on the modernisation of universities1,
However, assessment experts have expressed serious reservations about the methodologies used by global ranking organisations. In particular, doubt has been cast on the possibility of comparing whole universities in other words, 1 In this report,
remit and composition The Expert Group on Assessment of University-based Research was established in July 2008 to identify the parameters to be observed in research assessment as well as analyse major assessment
The Expert Group had 15 members from 12 EU Member States, Australia, a European association and an international organisation.
the experts represented a variety of disciplines, including arts and design, humanities, socioeconomic sciences, and natural sciences. 2 That people from such diverse backgrounds with initially different views on, inter alia, assessment methods and appropriate research outputs and outcomes reached agreement on a number of basic principles and a new approach to AUBR,
Activities undertaken and outcomes reached by the AUBR Expert Group Two major interrelated activities were undertaken:
in order to have the provisional outcomes of their work validated by invited key experts and stakeholder representatives.
3) Strengths and weaknesses of the various indicators used in assessment exercises The Expert Group analysed the different characteristics and dimensions of indicators,
which occurred during the course of the Expert Group's deliberations, had an impact on the Group's discussions.
Members of the Expert Group reviewed practices in their home countries and universities. Outcomes These case studies represent different approaches and objectives.
the Expert Group wishes to make the following general recommendations and, linked to these, propose a new approach to AUBR.
A new approach The Expert Group developed the outline of a multidimensional research assessment matrix.
and attended by some twenty external experts and representatives of stakeholder organisations, and 15 officials from DG Research and other Commission services.
The key objective was to validate the provisional results of the Expert Group's work.
and opportunities presented by the report of the Expert Group should be taken up in the current discussions about the further development of the European Research Area.
These and other recommendations were incorporated into the Expert Group's final report, and specifically into the recommendations to stakeholders set out below.
European and international context for the establishment of the Expert Group on the Assessment of University-based Research (AUBR.
The remit of the Expert Group is explained, and a summary of its activities and findings is presented. 2. 1 University-based Research in the Knowledge Economy Around the world,
In response, the European commission established the Expert Group on the Assessment of University-Based Research to develop a multidimensional methodology to assess the quality of research produced in universities
Activities Undertaken by the Expert Group The Expert Group met on seven occasions between July 2008 and July 2009 at meetings in DG Research, 8, Square de Meeûs, Brussels. The‘core group
fifteen members of the Expert Group plus more than twenty invited key experts and fifteen officials from different parts of the EU Commission was organised in April 2009 to validate the analysis and approach of the Expert Group.
A summary of the workshop's conclusions is contained in Appendix V. The Expert Group undertook a range of activities to inform its deliberations.
The Expert Group concludes, however, that contrary to providing an accurate and useful assessment of research,
the Expert Group Has illustrated 1 the wide range of users and uses of research assessment information;
and underpinned the work of the Expert Group on AUBR. Chapter 4 examines key characteristics of research assessment,
and underpinned the Expert Group's approach to research assessment. This embraces an inclusive definition of research and disciplines,
which are open to authentication and scrutiny by experts. Differences between disciplines or research fields derive from their history and the way in
how much output vis-a-vis funding 35 3. 5 Summary The Expert Group recognizes that new knowledge is divided no longer strictly between basic and applied activity
The Expert Group has adopted the concept of‘knowledge cluster'as the basic unit of assessment.
Discipline specific journal rankings, especially in social sciences and humanities, based on expert opinion in combination with indicators.
Develop appropriate indicators to ensure good ethical practice is promoted without interfering in processes of discovery. 49 4. 10 Summary The Expert Group notes that indicators are chosen as a method of measuring the various aspects of the research process.
The Expert Group recommends that this Matrix be used to form the basis of a full-fledged personalised
In Finland, France, The netherlands and the UK, panels include international experts; in Finland, France and The netherlands, this also involves visits to the university.
the Expert Group has developed a Multidimensional Research Assessment Matrix discussed below. 5. 2 Framework for Research Assessment Assessing university-based research is a complex process.
Indicators provide peer experts with condensed, systematic, verified and‘objective'information on the research performance of the knowledge cluster.
This can only be done by experts. Indicators aid good judgement by supporting or challenging peer assumptions, thereby making the assessment process more transparent.
the names of experts being kept secret (Italy) and uncertainty about the way candidates are evaluated (Spain).
which the Expert Group on Assessment of University-based Research was established by DG Research in 2008.
The Expert Group on Assessment of University-based Research has proposed a Multidimensional Research Assessment Matrix.
This would substantially enhance its user-friendliness. 6. 3 Contribution to Future Research Assessment Exercises The AUBR Expert Group hopes that this report will raise awareness of the principles that need to be observed in assessment of university-based research
the Expert Group has identified a wide range of users who seek and require research assessment information for a variety of different and often conflicting uses;
In sum, the Expert Group hopes that this report will serve as a guide to Users of information on the quality of university-based research,
The Expert Group also hopes that this report will provide inspiration to the European commission and Member State governments to launch initiatives
I. Activities and Membership of Expert Group on Assessment of University-Based Research The members of the Expert Group were selected on the basis of their experience and knowledge of research assessment and higher education,
including a representative of the European Universities Association (EUA), plus two (2) international experts. MACKIEWCZ Wolfgang (Chairperson) HAZELKORN Ellen (Rapporteur) BERGHOFF, Sonja (Rapporteur) BONACCORSI, Andrea BORRELL-DAMIAN, Lidia EMPLIT, Philippe INZELT, Annamaria MARKLUND, Goran
Paloma The Expert Group was coordinated by Adeline Kroll (Scientific Officer, EC DG/RTD Directorate, Unit C4 Universities and Researchers;
Curriculum vitae of Members of the Expert Group MACKIEWCZ Wolfgang (Chairperson. Wolfgang is director of the Language Centre and Honorary Professor of English Philology at the Freie Universität Berlin (FUB.
He chaired the Expert Group on the Humanities in FP7, he is the chair of the Expert Advisory Group FP7 Theme 8 and of the Assessment of University-Based Research Expert Group,
and he was rapporteur of the European commission's High Level Group on Multilingualism. Wolfgang Mackiewicz studied English and German at FUB and at the University of Leeds,
She is a Consultant to the OECD Programme on Institutional Management of Higher education (IMHE), and is associated also with the International Association of Universities (IAU).
Ellen is Rapporteur for the EU Expert Group on Assessment of University-based Research, and a member of National Digital Research Centre (NDRC) Management Board, the Arts, Humanities and Social sciences Foresight Working group Ireland,
She has been the first Hungarian representative in the OECD Working group of the National Experts of Science and Technology Indicators (NESTI) for 12 years.
and Eurostat's indicator work and often assisted at the meetings of OECD's group of national experts of science and technology indicators, NESTI.
and experts groups of the European commission, the High Level Expert Group on Reporting of Intellectual Capital for increasing investment in Research and development among them.
Their importance is assessed through a combination of an objective and truly unique internal monitor based on citation relationships among journals with assessments by experts from the various fields.
rankings of journals based on impact factors do not correspond very well to rankings made by experts on the basis of their perception on the status or quality of these journals.
Normally, expert peer review or input is the basis of the award, election, invitation or appointment.
because the examination of Phd theses and submissions is undertaken by national and international expert peer researchers.
internationally-recognised experts. ERA outcomes will be reported by institution and by discipline, identifying areas that are internationally competitive and emerging areas for further investment.
internationally-recognised experts. Key elements of the ERA methodology are described below. Discipline-specific Indicators are being,
and an on-site visit of a panel of internationally recognised experts of the discipline in question.
a panel of 10 experts is convened by the academic coordinator; each team has to prepare a self evaluation document, based on a common template:
based on the analysis of this compilation, each expert assesses each team on seven indicators, giving a grade for each indicator (between 1 and 10);
Are they sought-after experts in tenure committees, chair appointments, research assessments and are invited they regularly to speak at the most important conferences in the field?
3) expert panels comprised of eminent foreign scholars/scientists; 4) site-visits of one week duration;
http://www. aka. fi/Tiedostot/Tiedostot/Julkaisut/Biotechnology%20in%20finland. pdf The Finnish Higher education Evaluation Council (FINHEEC, an independent expert body nominated by the Ministry
to acquaint foreign researchers (experts serving on evaluation panels) with the research carried out and the researchers working at the university in question.
and editorial assignments), budget and external funding The assessment was conducted by 21 international peer review panels (altogether 148 experts:
Such consequences can be avoided by providing external experts with precise descriptions of the different grades;
In a multi-step assessment process, the institutions were evaluated first by at least two experts independently before each rating was discussed in plenary sessions.
Criteria and data are defined in a discipline-specific manner by experts from the individual fields of research.
In a multi-step assessment process, the institutions were evaluated first by at least two experts independently before each rating was discussed in plenary sessions.
Both expert groups and the steering committee have submitted reports on the pilot study to the Science and Humanities Council.
These were reviewed by internationally appointed panels of experts. The reviews of the Graduate schools and the Clusters were discussed in the‘Expert Commission,
In the design stage of the indicators only non-independent experts were involved. In the preparatory phase of Agreement HEIS'selection criteria for indicators was to reach easily good performance
and single-blind evaluation of products by independent experts. Members of the disciplinary panels established by CIVR used at least 2 independent opinions from international experts,
and reached a consensus agreement on a final grade to be assigned to each products. Grades were aggregated at department level and then at university level.
Each areas was assigned to a Panel, with a Chairman and a number of experts between 5 and 9 units (151 in total),
mainly from the national scientific community, supported by 6, 661 external experts at international level.
Each product was evaluated by at least two experts. Experts rated products on a four grade scale (Excellent, Good, Acceptable,
Unsatisfactory)( the latter being limited, or limitato in Italian language, a rather ambiguous word). Excellent means top 20%;
Full transparency on methods and mandate to the external experts. Experts classify research outputs according to classes of quality,
departments are ranked according to an aggregation of scores on research outputs. Universities receive a score representing the proportion of departments ranked top. 116 Names of experts are kept secret.
CIVR took into account many criticisms and suggestions. Several meetings and official conferences organized by CIVR together with main PROS,
and for every field there is a Committee of six to eight experts from different areas within the field.
/European commission EUR 24187 Assessing Europe's University-Based Research-Expert Group on Assessment of University-Based Research Luxembourg:
In 2008, the European commission, DG Research set up the Expert Group on Assessment of University-Based Research to identify the framework for a new
clinicians acting as consultants to system developers who are qualified really not due to their lack of training in biomedical informatics;
The care they provide is supplemented by 300 senior consultants, who are hospital department heads, 250 diagnostic institutes, 600 private pharmacies and public as well as private hospitals.
consultants and others, is one of the more visible benefits that clinicians seek from such a system.
confirm, or extend the data base with experts from the selected industries like firm representatives, representatives of industry associations and cluster managers.
which entrepreneurs are connected to academic experts or the Lectors and knowledge circles policy of appointing a growing number of lectures
where decision makers regularly meet the dilemmas of experts and learn from each others'practices Awareness and supportive environment How aware of the processes and supportive are:
and experts can help fill these gaps using technology to gather and share information and assets in order to raise awareness, illustrate issues,
as well as volunteers and experts, all from the locality where the Repair Café is located. The platform promotes the Repair Cafés concept,
and constitutes a new form of relationship between laypeople and experts, as well as between peers (expert-expert;
layperson-layperson, etc..In the Opencorporates case an open 64 Interview with Kate Groves, Director of Marketing and Communications, Streetbank. com, 2014 74 data community has been developed
On-and offline forums like Repair Cafés work because everybody can be an expert in something.
and experts) happen in practice. This leads to new models for providing goods and services, intimately linked to 82 people's needs and the capacity of the ICT network,
& intangible assets-Self regulation with simple agreed rules, use of volunteers & experts-Building capacity & skills, collaboration,
The aim of many of the available examples of self-help or patient portals and platforms is to create online communities of complementary audiences in other words, patients, family members, clinical experts and researchers, sometimes even pharmaceutical experts
Initiatives like patient briefcase or DIABETIVA are sure to make health-care experts, bodies and governments reevaluate their policies,
This infographic is the result of a collaboration between the design for learning experts TFE Research and emerging technology strategist Michell Zappa.
-It can be used via the Internet or in paper form (Kurzskalen/short scales) by the public, by professionals and by experts.
pedagogical personnel or experts can monitor and diagnose the development of children. They can choose to document the development of a child for themselves offline
Teachers, games designers and curriculum experts come together in Mission Lab to develop effective learning materials
designers and curriculum experts collaborating in Mission Lab. Teachers, games designers and curriculum experts work together to develop new learning tools centred on gaming and learning.
In MONDEY's case reciprocity works. There are already first insights into the development of children gained
for example in an architectural firm consisting of designers, draftsmen, materials specialists, environmental and energy experts, legal and planning advisors, etc.
The power of the Cop is that different experts cooperate on a day-to-day basis thus building up shared knowledge.
In a network of practice (Nop), a specific type of expert can directly link to similar experts potentially on a global scale,
if appropriate, outside experts. Catalonia 2020 Strategy 16 5. The six priority areas of action ECAT 2020 identifies six priority areas based on
However, as a result of radical downsizing, the majority of experts were fired (others had to quit) and currently NIH has little capacity for strategy preparation.
the science and technology policy experts of regional development agencies started to prepare innovation strategies (often together with specialised consultancy firms).
16 and INNOREG's experts (similarly to experts in other RIAS) could only contribute to the design of the programme by suggesting sectoral priorities that would be taken into account by the otherwise identical calls.
As for a good practice case in terms of policy practice, the lack of evaluation by independent experts makes the selection somewhat biased.
Innostart's experts screened the research results of various HAS-institutes and selected the ones with promising commercialisation opportunities.
including with the assistance of external experts. It also organises trainings, conferences and exhibitions. Cooperation and networking:
France P2p FOUNDATION-Amsterdam, The netherlands PNO CONSULTANTS LIMITED-Cheadle Hulme, UK POLIBIENESTAR, UNIVERSITY OF VALENCIA-Valencia, Spain PURPOSE EUROPE-London, UK
resilient societies and economies, deploying ad hoc networks of citizen experts around client's needs. 16.
and experts that come together around the joint commitment of enabling more sustainable lifestyles. 20. GNUNET https://gnunet. org GNUNET is a framework for secure peer-to-peer networking that does not use any centralised or otherwise trusted services. 21.
This will also be refined further as more authors who were not able to contribute to this book sprint will provide their expert views in the future.
external companies and experts. 3. Obtain Museums today must not only create digital objects themselves, but also obtain the metadata via analogue objects
She is one of the European Museum Academy experts and a member of ICTOP (ICOM Committee Training Personnel.
He is also an associate of the European Expert Network on Culture and an appointed expert on culture and adult education by the European commission.
Horizon 2020 dedicated Expert Advisory Group on Innovation in SMES Consultation on the EU Strategic Work Programme 2016-17 Final Report to the European commission July 2014
Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 ii Contents Executive Summary...
Members of the dedicated Expert Advisory Group on Innovation in SMES...29 Horizon 2020 Expert Advisory Group Innovation in SMES:
Consultation on Next EU Strategic Work Programme 2016-2017 iii Executive Summary Small and medium enterprises (SMES) are vital to the European economy and a key focus
In this Consultation Paper on the next EU Strategic Work Programme 2016-2017, the Expert Advisory Group (EAG) on Innovation in SMES focuses on innovation-driven SMES in all sectors.
Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 iv Key Messages and Recommendations 1) Ensure the strategic evolution of the SME Instrument:
setting up a pool of independent due diligence experts; deploying Phase 1 coaches to support the due diligence process;
and a special expert panel to oversee the process. Rec 4. 5) f. Develop and implement a communications strategy
Despite protracted efforts, public Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 v procurement has yet to become an effective channel in bringing innovative solutions to market.
Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 vi a. In collaboration programmes, prioritise areas with clear SME interest and potential, such as nano, healthcare and ICT;
Rec 6. 4) Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 1 1. Introduction Small and medium enterprises (SMES) are vital to the European economy and a key focus
European commission Report June 2013. http://ec. europa. eu/research/smetechweb/pdf/sme participaton in fp7 june 2013. pdf#view=fit&pagemode=none Horizon 2020 Expert Advisory Group
and EU funding €336m earmarked from COSME All budget figures in current prices Horizon 2020 Expert Advisory Group Innovation in SMES:
Our Consultation Paper The Expert Advisory Group(‘EAG')on Innovation in SMES is one of a series of advisory groups setup by the European commission to advise on priorities for Horizon 2020.
The EAG comprises 19 independent experts drawn from the public and private sectors and civil society (see list of EAG members in Annex 1). As part of its remit,
'Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 4 Box 1:
Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 5 2. Challenges and Trends for Innovation-Driven SMES The innovation environment for SMES is shaped by both long-term global challenges
November 2012. http://files. gereports. com/wp-content/uploads/2012/11/ge-industrial-internet-vision-paper. pdf Horizon 2020 Expert Advisory Group Innovation
and energy solutions that will be difficult to meet with approaches used in US/EU. 5 Wohlers & Caffrey, 2013. http://wohlersassociates. com Horizon 2020 Expert Advisory Group Innovation in SMES:
For innovation-driven SMES, open source and co-creation are Horizon 2020 Expert Advisory Group Innovation in SMES:
Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 9 3. Gaps and Bottlenecks in SME Management of Innovation The strength of SMES lies in their agility, imagination
which is considered superior to Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 10 the standard QWERTY system,
Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 11 Box 2:
Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 12 4. Evolution of the SME Instrument As the flagship SME initiative under H2020, it is essential to consider how the SME Instrument
The Innovation EAG & the Access to Risk Finance Group will address this Horizon 2020 Expert Advisory Group Innovation in SMES:
o Establish a pool of qualified independent due diligence experts to support H2020 Phase 2 funded projects.
however, that such experts are in short supply and will need to be rewarded properly. o Deploy Phase 1 Coaches to support investors.
In addition, we note that these operational measures should supplement Horizon 2020 Expert Advisory Group Innovation in SMES:
establishing a pool of independent due diligence experts; deploying Phase 1 coaches to support the due diligence preparation process;
Furthermore, the Commission should consider the creation of a European Hub for Excellence in high-value coaching services and coaching experts.
4 february 2011,863 882 Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 15 different technologies,
Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 16 o The Commission is advised to consider
and a special expert panel to oversee the process. Managing expectations: acceptance as a badge of success. Around 10-15k applications per annum are expected eventually under Phases 1 & 2,
Develop and implement a communications strategy and professionalized communications campaign for the SME Instrument that addresses the Horizon 2020 Expert Advisory Group Innovation in SMES:
Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 18 5. Policy Actions to Drive Innovation Taking into account the challenges
/pre-commercial-procurement Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 19 between customers/users and suppliers.
Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 20 together suppliers and users to jointly develop innovative research-based solutions,
Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 21 While the need for such linkages is accepted well in policy circles,
IP strategy and IP licensing training for SME advisers, coaches and managers, filling the gap between the elite commercial services and the basic IP training Horizon 2020 Expert Advisory Group Innovation in SMES:
Consultation on Next EU Strategic Work Programme 2016-2017 22 and support currently on offer.
/innovation/files/design/design-for-growth-and-prosperity-report en. pdf Horizon 2020 Expert Advisory Group Innovation in SMES:
Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 24 6. Synergies for SMES in Horizon 2020 Structural limitations need to be addressed in order for SMES to realise their full potential
May 2014. http://ec. europa. eu/research/sme-techweb/pdf/volume i smes in fp7-may2014. pdf Horizon 2020 Expert Advisory Group Innovation in SMES:
For the other challenges, enabling Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 26 technologies like ICT can be relevant to all.
Experts allocated to each theme should have a professional background and practical experience in the area concerned.
Furthermore, most of them are now well Horizon 2020 Expert Advisory Group Innovation in SMES:
pg=publications Horizon 2020 Expert Advisory Group Innovation in SMES: Consultation on Next EU Strategic Work Programme 2016-2017 28 heavily influenced by national/local market conditions,
May 2014. http://ec. europa. eu/research/sme-techweb/pdf/volume i smes in fp7-may2014. pdf Horizon 2020 Expert Advisory Group Innovation in SMES:
Members of the dedicated Expert Advisory Group on Innovation in SMES EAG Chair: Mr Uffe Bundgaard-Jørgensen Investornet EAG Members:
Overtext Web Module V3.0 Alpha
Copyright Semantic-Knowledge, 1994-2011