This is, therefore, an active, messy, highly decentralized learning process, but highly necessary if social innovations are to be discovered practically
-How to support people in lifelong learning to ensure adequate livelihoods in a changing world?
whether it is appropriate to bring together new learning experiences and networks for public sector leaders at European level.
The Transition concept emerged from the work of permaculture11 designer Rob Hopkins with his students of Kinsale Further Education College.
The example we are showcasing here is the famous experience of the Grameen Bank started by university professor Muhammad Yunus in 1976,
After returning from his graduate studies in the US to be a university professor in Bangladesh
Components Analysis PISA Programme for International Student Assessment (OECD) R&d Research and development RMS Residual Mean Square SEM Structural Equation Modelling SII Summary
i) mean years of schooling and (ii) gross enrolment ratio of tertiary students in science, mathematics and engineering.
With the adoption of the European Statistics Code of practice in 2005, the Eurostat quality framework is now quite similar to the IMF's Data Quality Framework (DQAF),
The European Statistics Code of practice (Principles 11-15) focuses on statistical outputs as viewed by users.
where that number is a quantile of Student's t-distribution with degrees of freedom:
the variable (1 2)/(2)= n t has a Student's t-distribution under the null hypothesis (absence of correlation)
In the Composite Learning Index developed by the Canadian Council of Learning (http://www. cclcca. ca/CCL/Reports/CLI/
for example, the social and economic benefits of learning are considered a latent variable since they can be measured only imperfectly by indicators such as crime rate, population health or unemployment rate.
In the Composite Learning Index the aggregation of sub-indices into a composite and the dependence of socioeconomic benefits on learning is captured by the multivariate regression
whereas the disaggregation of learning into social-economic outcomes takes the form of a measurement model.
Note that this complex architecture is used to estimate (recursively) the weights used to compute the Composite Learning Index.
Such policy learning can be enhanced by initiatives that facilitate cross country comparison and benchmarking. A telling example in this respect is PISA.
The use of league tables facilitates this process. It is also evident that analysis-based narratives such as those supported by composite indicators would gain in effectiveness
if citizens'statistical and economic literacy could be increased. Amartya Sen remarks that: the ability to exercise freedom may to a considerable extent, be directly dependent on the education we have received,
The challenge from innovation-based growth in the Globalising Learning Economy, Oxford Press. Feldt L. S.,Woodruffe D. J,
OECD (2004), Learning for Tomorrow's World-First Results from PISA 2003, Programme for International Student Assessment, http://www. pisa. oecd. org/dataoecd/1
which represents the basic education needed to develop cognitive skills (2000) UNIVERSITY%Gross enrolment ratio of tertiary students enrolled in science, mathematics and engineering,
and Neapolitan (2001, Chapmann and Hall), Learning Bayesian networks. OECD PUBLICATIONS, 2, rue André-Pascal, 75775 PARIS CEDEX 16 PRINTED IN FRANCE (30 2008 25 1 P) ISBN 978-92
4 JULY/AUGUST 2012 A Comparison of Smart Grid Technologies and Progresses in Europe and the U s. Marcelo Godoy Simões, Senior Member, IEEE, Robin Roche, Student Member, IEEE
He was distinguished also as an Honorary Professor by the Transylvania University of Brasov, Brasov, Romania
000 members and 424,000 students in 170 countries, helping them to develop successful careers in accounting and business,
who provide high standards of employee learning and development. Through our public interest remit, we promote the appropriate regulation of accounting.
This is evidence of SMES and their advisers'learning, in the sense that more savvy suppliers are daunted not by complexity
A guide to eco-innovation for SMES and business coaches. 16 eco-innovation observatory Learning Resources Business model Generation offers a wide range of resources for entrepreneurs and companies on business model innovation
in Hungary disseminates case study books to help SMES invest in environmental measures that generate economic returns. www. environmental-savings. com Learning Resources Eco-innovate!
increased material and energy productivity and improved their processes. www. thecirculareconomy. org/case studies Learning Resources Eco-innovate!
Develop clear indicators based on the code of conduct to monitor progress. Internal and external communication is also very important at all stages.
and Learning Tool is an online tool to help companies assess their approach to supply chain sustainability,
Learning Resources Eco-innovate production processes Maximising Value: Guidance on implementing materials stewardship in the minerals
and licensing. portal. enterprise-europe-network. ec. europa. eu EUREKA is a European network that supports businesses carrying out R&d. www. eurekanetwork. org/supporting Learning Resources
section=1¤tsection=1& sectionname=Home Learning Resources Figure 7: Eco-design Strategies Wheel Eco-innovate!
and examples. www. defra. gov. uk/environment/economy/products-consumers/green-claims-labels/Learning Resources Eco-innovate products
In order to upskill the business the Creative Director attended a masters degree course in ecoinnovative building technologies and processes.
lead questions Good practice Learning Resources Eco-innovate! A guide to eco-innovation for SMES and business coaches. 56 eco-innovation observatory What is crowdfunding?
and ANI (As Nature Intended)( www. anibrand. com) vegan Barefoot shoes were funded both by Kickstarter (www. kickstarter. com). Learning Resources A Directory of crowdfunding platforms www
the availability of skills should not be seen as limited to improving the attractiveness of Europe to highly qualified European students and researchers;
. 32 Commission Recommendation on the management of intellectual property in knowledge transfer activities and Code of practice for universities and other public research organisations,
A new perspective on learning and innovation, Administrative Science Quarterly, Volume 35, Issue 1, pp. 128-152,
A new perspective on learning and innovation, Administrative Science Quarterly, Volume 35, Issue 1, pp. 128-152.
actio n=display&doc id=5714&userservice id=1&request. id=0 European commission (2008), Recommendation on the management of intellectual property in knowledge transfer activities and Code of practice for universities and other public
Andrea Renda Massimiliano Granieri Senior Research Fellow Professor CEPS University of Foggia andrea. renda@ceps. eu mgranieri@luiss. it Mr. Hasan Alkas
. nl Mr. Bruno van Pottelsberghe Professor Senior Fellow Economics & Management of Innovation ULB and Bruegel bruno. vanpottelsberghe@ulb. ac. be Mrs. Renate Weissenhorn Head of Unit DG ENTR European commission renate
Ph d. Daniela MITRAN Nicolae Titulescu University Athenaeum University Ph d. Student Adrian NICOLAU Bucharest SC Avangarde Technologies Consulting Abstract:
Today, 33 countries have some form of ranking system operated by government and accreditation agencies, higher education, research and commercial organisations,
and status. Students use rankings to choose their potential place of study and research. Public and private stakeholders use rankings to guide their decisions about funding allocations.
What started out as a consumer product aimed at undergraduate domestic students has now become both a manifestation and a driver of global competition and a battle for excellence in itself.
At present, some rankings include metrics on teaching and learning, most are focused on life-science research. Users too have their own specific needs.
For example, a prospective student might look for information on a specific discipline on future employability, or on the fees associated with the university of their choice.
A ranking system of this kind does exist for students, but at the moment only in Germany.
40 4. 6 Self evaluation...40 4. 7 Research Ethics...40 4. 8 Social and Economic Impact and Benefits...
and quality of university-based research is thought to be vitally important for innovation, including social innovation. In the words of the revised Lisbon Strategy (European commission (2005), p. 20), knowledge, meaning R&d, innovation and education, is a key driver of productivity growth.
Specifically, the Group was asked to Identify the various types of users (or potential users) of measurements of the quality of university-based research,
Take stock of the main methodologies for assessing/ranking the quality of university-based research, including existing international assessments/rankings
Self evaluation as a key component in the assessment process; Experiments designed to facilitate the measuring of societal impact;
Moreover, in the absence of comprehensive reliable and comparable cross-national data, rankings cannot be a valid tool to achieve the overarching aim of improving the quality of university-based research across the European union. 17 2 Introduction This chapter outlines the national
students are becoming more conscious of the value of their education and its impact on their career opportunities,
Attention is shifting to mechanisms to assess and benchmark the quality and performance of university teaching and learning,
EU initiatives designed to enhance the quality of university-based research In addition to these and related policy documents,
Mutual Learning on Approaches to Improve the Excellence of Research in Universities, an expert group launched by the Scientific and Technical Research Committee (CREST) in 2007.
The overall objective was to conduct a mutual learning exercise on the scope, objectives and measures of national policies to improve research excellence in universities,
They are operated usually by accreditation or quality assurance agencies, research councils and/or funding councils. There are similar international initiatives:
it emphasizes self evaluation and peer review as a tool of institutional strategic development and improvement. The OECD AHELO (Assessment of Higher education Learning outcomes) project aims to assess learning outcomes on an international scale by establishing the validity of measures which cross cultures and languages. 20 2. 3 Measuring
what Counts Many people think that university rankings provide an easy solution to measuring research performance and quality nationally and internationally.
They usually use a combination of public or institutional data and/or peer or student surveys.
other aspects of higher education, such as teaching and learning, community engagement, and third mission and innovation are ignored.
2) Review main methodologies for assessing/ranking research quality of universities, covering existing international assessments/rankings and other methodologies being developed;
, legal cases, maps, translations or editing of major works within academic standards. Table 1 identifies the primary form of communications for the main discipline groups.
‘Users'include policymakers and government agencies, universities, public or private research organisations (PROS), researchers or graduate students, employers, civil society and the media.
HE management is likely to use the information for publicity purposes help student and academic recruitment, aid research partnerships (with other academic institutions or with public/private organizations),
but they are also the primary professional academic body responsible for the‘accreditation'and valorisation of scientific quality. 28 Individuals Graduate students,
especially international Phd students, are increasingly a keen user of cross-national comparisons, including rankings.
and visiting scholars) o Students most likely Phd students Other Possible Users and Uses, includes:
and return-on-investment. o Benefactors/Philanthropists o Alumni Ministries of Higher education in Developing Countries A growing number of countries use rankings to award scholarships for overseas studies
how much output vis-á-vis funding Quality of academic staff and Phd students Attraction capacity:
recruitment of students, academics and researchers from outside region and internationally HE Executives/Management Policy and planning Strategic positioning Research strategy development/management Investor confidence/value-for-money
and efficiency Quality assurance Publicity Student and academic recruitment Improve and benchmark performance and quality Institutional and discipline/field data re. level of intensity, expertise,
how much output vis-a-vis funding Quality of academic staff and Phd students Attraction capacity: recruitment of students, academics and researchers from outside region and internationally Identification of Partnerships (academic, public/private sector, NGOS, research organisations, etc.
HE Research Groups Strategic positioning Research strategy development/management Investor confidence/value-for-money and efficiency Student and academic recruitment Discipline data re. level of intensity, expertise,
quality and competence benchmarked against peer institutions Quality of academic staff and Phd students Attraction capacity:
recruitment of students, academics and researchers from outside region and internationally Identification of Partnerships (academic, public/private sector, NGOS, research organisations, etc.
GOVERNMENTS AND GOVERNMENT AGENCIES EU and National Governments Define policy and inform decisions about HE system
recruitment of students, academics and researchers from outside region and internationally Quality of academic staff and Phd students Efficiency level:
recruitment of students, academics and researchers from outside region and internationally Efficiency level: how much output vis-a-vis funding Research infrastructure:
recruitment of students, academics and researchers from outside region and internationally Efficiency level: how much output vis-a-vis funding HE Agencies Define policy
recruitment of students, academics and researchers from outside region and internationally Quality of academic staff and Phd students Efficiency level:
quality and competence 32 Student and Academic Recruitment Benchmarking against peer institutions, nationally and worldwide Quality of academic staff and Phd students INDIVIDUALS Academics and Researchers Identify career opportunities Identify research partners Identify best research infrastructure and support for research Institutional and field data re level of intensity,
expertise, quality, competence and sustainability Performance of individual institution benchmarked against peers in field of interest Employment conditions Impact of research on teaching,
Staff/student ratio Institutional research support Students Inform choice of HEI Identify career opportunities Institutional and field data re level of intensity, expertise, quality,
competence and sustainability Performance of individual institution benchmarked against peers in field of interest Research capacity of institution and research team, e g. graduate students/academic ratio, age of Phd students,
and support Graduate career and employment trends Quality of the research infrastructure Staff/student ratio PEER HEIS Identify peer HEIS
quality and competence Peer esteem indicators MINISTRIES OF HIGHER EDUCATION IN DEVELOPING COUNTRIES To help determine which foreign higher education institutions are applicable for overseas scholarships studies.
quality and competence Competitive positioning of institution and researchers Trends in graduate employment and competence Quality of academic staff and Phd students SPONSORS AND PRIVATE INVESTORS Benefactors/Philanthropists
relevance and impact of research activity Quality of academic staff and Phd student Contributor to own brand image Institutional data re level of quality and international competitiveness
and worldwide Quality of academic staff and Phd students Alumni Determine institutional performance vis-a-vis national and international competitors Institutional data re level of quality and international competitiveness
sustainability, relevance and impact of research activity Quality of academic staff and Phd student Reflect pride
and worldwide Quality of academic staff and Phd students PUBLIC OPINION Determine institutional performance vis-a-vis national and international competitors Quality, sustainability, relevance and impact of research activity Student
graduate employment is a proxy for the adequacy of graduates for labour market requirements; budget and research expenditure is a proxy for the quality of the infrastructure;
Usually this evidence is supported by self evaluation or case studies, but more work is required. 4. 3 Unit of Assessment:
Self evaluation benefits from involving researchers in the process of self-knowledge. It encourages them to become involved in helping define‘excellence'and setting the strategy for improvement.
and ensuring professional behaviour between supervisor and research students. Today, completion of an ethical statement or formal ethical approval by a university or national Research Ethics committee is required by most funding organisations,
in addition to self evaluation reports. Economic Benefits, e g. improved productivity; adding to economic growth and wealth creation; enhancing the skills base;
Publishing is vital for progress in science scholarship. Different disciplines produce different types of research outputs.
Employability of Phd graduates Industry employment of Phd graduates can be an indicator of the contribution of research to the highly Used to measure the quality of the graduates,
Harmonise the stage (s) post-graduation at 46 INDICATORS DESCRIPTION PRO/POTENTIALITIES CON/LIMITATIONS WHAT DEVELOPMENT IS REQUIRED educated & skilled workforce. teaching.
SUSTAINABILITY AND SCALE Postgraduate Research Student Load The ratio of research students (or Phd students) per academic staff or per‘Research Active'staff.
as appropriate, research Masters degree completions. Data is verifiable by universities although there can be a time lag.
Self evaluation: Aalto and Helsinki Universities, Finland, and The netherlands include selfevaluation as a key component in the process.
Drive Research Mission Differentiation Research output/bibliometric data Output per research academic Peer review Self evaluation Ratio of research income:
master/phd students Increase Regional/Community Engagement Publications, Policy Reports, etc. End user Reviews Keynote, Media Awards, etc.
cultural and environmental impact/benefits indicators External research income Employability of Phd graduates Number of collaborations and partnerships Encourage International Co-operation Research Output/Bibliometric
& International collaborations Percentage of Research Income from International Sources Number of collaborations and partnerships Increase Multidisciplinary Research Research Output/Bibliometric data with focus on interdisciplinary fields Peer review Self evaluation
Libraries, equipment, postgraduate student numbers, etc,‘Esteem'factors e g. prizes, research income etc. IF you want to use research assessment to DRIVE RESEARCH MISSION DIFFERENTIATION,
teaching income Data on ratio of undergraduate students: master & doctorate research students Peer review Panels Self evaluation Reports
IF you want to use research assessment to INCREASE REGIONAL/COMMUNITY ENGAGEMENT, then what is required is:
Data on employability of Phd graduates; Data on collaborations and partnerships. IF you want to use research assessment to ENCOURAGE INTERNATIONAL COOPERATION,
Self evaluation. 56 6 Conclusion 6. 1 Limitations and Unintended Consequences University-based research has become one of the most critical factors shaping national competitiveness and university reputation.
Some governments, public agencies and universities are drawing immediate and direct links between research assessment and resource allocation or accreditation.
providing better and more transparent information to students, potential students and the public; providing the basis for evidence-based policy-making;
Because the results of research assessment can carry great significance for university, researcher and student reputation and status,
Stakeholder esteem indicators can show how research is viewed by the wider community. 4. Integrate self evaluation as a useful way to include the research community pro-actively in assessing their own contribution,
In sum, the Expert Group hopes that this report will serve as a guide to Users of information on the quality of university-based research,
but at the same time keeping an eye on the other functions of their institution teaching and learning, and community engagement;
Wolfgang is director of the Language Centre and Honorary Professor of English Philology at the Freie Universität Berlin (FUB.
Professor Hazelkorn is the Director of research and Enterprise, and Dean of the Graduate Research School, Dublin Institute of technology, Ireland;
she also leads the Higher education Policy Research Unit. She is a Consultant to the OECD Programme on Institutional Management of Higher education (IMHE),
She is a member of the Executive Committee of the Dean and European Academic Network (DEAN),
Professor Hazelkorn has published articles and books on Irish politics and society; digital technologies, gender, work practices and the cultural industries;
She was responsible for the students'survey till 2006 and from 2002 leader of the CHE Researchranking of German universities.
Andrea is Professor of Economics and Management at the University of Pisa. He is author of papers in the most important journals in economics and policy of science, technology and innovation,
Lidia joined EUA in January 2006 and has been working within the areas of doctoral programmes and researchers'careers, university-industry collaborative research, knowledge transfer and also on the contribution of universities to regional innovation.
Philippe is director of the Service OPERA-Photonics and Professor of Physics at the Université Libre de Bruxelles (ULB), in the Engineering science and Human sciences faculties.
She is member of Economic Advisory Council of Budapest Business school, prime member of doctoral school at the University of Szeged and private professor at Budapest Corvinus University.
Arto is Professor of Russian Language at the University of Helsinki (UH. He has been involved in assessments and evaluations in different capacities.
Arto Mustajoki took his master's degree in German philology and Phd in Russian language at the UH.
Sir Howard was formerly a Professor of Sociology in both the UK and USA and has published a large number of books and articles on social change in rural England.
Alain is currently Directeur de Recherche at the Centre National de la Recherche Scientifique (CNRS, Paris, France), Chair Professor of Chinese Linguistics at the Ecole des Hautes
He has been a corresponding member of the Academia Sinica of Taiwan since 2002, Adjunct Professor at the University of Science and Technology of Hong kong since 2005, Honorary Professor at the University of Beijing since 2007,
Professor Rowley is Deputy Vice-chancellor Research (DVCR) at the University of Technology, Sydney, Australia. Prior to her appointment in 2004, she was the Australian Research Council's Executive director for Humanities and Creative Arts.
and was appointed UNSW Foundation Professor of Contemporary Australian Art and Head of the School of art History and Theory in 1995.
OECD's expert group on Assessing Higher education Learning outcomes, the International Advisory Network of the UK Leadership Foundation for Higher education,
and the Editorial Committee of OECD's Journal of Higher education Management and Policy Mr. Salmi is a graduate of The french Grande Ecole ESSEC.
He also holds a Master's degree In public and International affairs from the University of Pittsburgh (USA) and a Ph d. in Development Studies from the University of Sussex (UK).
Paloma is a Phd in Economics and Professor of Applied Economics at the Autonomous University of Madrid (UAM.
or clinical and classroom practice. It involves an integration of theory and practice to enhance understanding of the issues.
In fields with a moderate ISI coverage, language or national barriers play a much greater role than they do in other domains of science and scholarship.
as appropriate, Research Masters degree Completions Universities and, in some cases, government agencies, collect data for this indicator.
This indicator is focused on quantity, e g. the number of graduates. The quality of Phds is probably not comparable across countries;
Who is counted depends on the type of output e g. the number of Phd graduates should be related to the number of professors
student fees, training, commercialisation and philanthropic donations. Universities collect data for this indicator and self-nominate levels of funding for research from consolidated revenues.
Moreover, it excludes the move towards open science or open source IT software or the embodied expertise of the social sciences. 9. 10.2 EMPLOYABILITY OF PHD GRADUATES Description:
Industry Employment of Phd Graduates Universities track the career destinations of their Phd graduates and alumni via postgraduation Career Destination Surveys and Alumni Databases.
85 support for early career researchers and postgraduate research students; and evidence of scholarly esteem and reputation. citations, number of publications in highly-ranked journals and other relevant indicators to be included In evidence Portfolios to inform expert peer assessments;
scholarships etc) within universities in areas of recognised research strength and strategic fit with university profiles.
each team has to prepare a self evaluation document, based on a common template: 1. Presentation of the team 1. 1. Introduction to the general research topics (2 pages max.
Data collection and self evaluations of departments according to strict rules laid down by the Steering committee. Evaluation, including one-week site visits,
Are the doctoral graduates of the Unit hired by the leading universities across the globe?
Due to the scope of the evaluation the societal impact of teaching as well as the societal impact of the production of Bachelor-and Master-level graduates fell outside the scope of this assessment.
and the staff-student ratio. Future Potential. While it is impossible to assess the future,
and the ability to attract high-quality international doctoral students and researchers played a role here. Other important indicators of future research potential included the ability to secure competitive funding, the capacity to focus the Unit's research on topical issues,
In the latest RAE, each department provided a large self evaluation report following strict guidelines: list of research-active staff, description of the department's research profile (2 pages max.
one section is concered with the evaluation of higher education (including universities) and research institutions as a whole, the second one with the research undertaken in these institutions,
The research rating is distinguished from popular media rankings and league tables by a number of unique characteristics:
lifelong learning; examples of spreading knowledge outside the scientific community. Time-frame: November 2005 December 2007 Costs:
multidimensional system aimed at providing information for students. Its main emphasis is on teaching, where national comparisons are made.
Most prospective students use it as one source of information when deciding on where to study.
The CHE University ranking is designed to help prospective students make an informed choice of study program and university,
publication databases (Web of Science and national databases of scientific-scholarly publications) and a survey conducted among professors.
There are additional costs for the poll conducted among students and for the analyses of publications.
The universities contribute to the exercise by completing the institutional questionnaires and helping with the logistics of the student survey.
Intended consequences The ranking has had some influence on the choice of university made by specific groups of students;
most prospective students use it as one of a number of sources of information when deciding where to study.
Initially, the assessment of research output was distorted by the fact that only publications authored by professors were selected for analysis. This has
and generally improving scientific and academic standards in Germany. Methodology, incl. time-frame, resources, costs, technologies:
1. Graduate schools for the promotion of young researchers 2. Clusters of Excellence for the promotion of top-level research 3. Institutional Strategies for advancing top-level university research.
The reviews of the Graduate schools and the Clusters were discussed in the‘Expert Commission, 'appointed by DFG;
Of these, 90 propsals (39 Graduate schools, 41 Clusters of Excellence and ten Institutional Strategies) were selected for the final round.
of which 92 (44 Graduate schools, 40 Clusters of Excellence, eight Institutional Strategies) reached the final round.
Divided into the three competition categories of Graduate schools, Clusters of Excellence, and Institutional Strategies, and into host institutions, it provides information on the main research topics,
The majority of its readers are graduates. There is some career guidance information provided in the national press and by Guidance Counsellors,
The median Leaving certificate points obtained by honours degree course entrants, weighted by the latest data on the number of students on each course.
The percentage of graduates known to be seeking employment nine months after graduation. Subtracted from 100 to produce the league table score.
Student-staff ratio. Full-time and part-time undergraduate students (weighted), divided by full-time equivalent teaching staff. A ratio of 10:1 as a benchmark for excellence, worthy of 100pts in the league table.
Source: Calculated from: Universities HEA 2007 data; institutes 2006 Department of education and Science data. Completion rates.
Mature/overseas students Those over 23; those not from Republic of ireland. Source: HEA 2007 data, universities only.
Sports facilities Assessment by The Sunday Times in consultation with students unions. From one star (poor) to five stars (excellent.
and students'unions in April/May. Guide published in late September. Resources: One part-time Irish researcher.
which the information is informing student choice. However, because of the absence of good verifiable and comparable data
and Irish Independent provide significant information for prospective students on the application process, comparison between programmes, entry level qualifications,
%will be done following indicators regarding quality of education and research and efficiency in organization. In addition, it stated that academic staff not producing scientific publications in the last two
40%number of students at 2nd year with at least 2/3 of CFU in exams of the 1st year;
20%employment of students after 3 years from graduation; 20%use of internal academic staff for teaching 20%adoption of student satisfaction surveys for the evaluation of teaching activities.
-research (2/3 of total: 50%in proportion to the grade received by the University from CIVR in 2006 30%according to share of EU funding (VI and VII Framework programmes) 20%share of funding from Ministry of Research in competitive grant
nominated by the Ministry of Research, the Secretary general of OECD, the President of Accademia Italiana dei Lincei, the European Research Council and the National Council of University students.
A crucial element is that once every three years research units produce a self evaluation. This case study describes the protocol.
Once every three years, research units produce a self evaluation, alternating between preparation for the external evaluation and serving as an internal mid-term evaluation.
The institute produces a self evaluation every three years, one in preparation of the external review, and he other three years thereafter as a mid-term review.
Previous peer reviews rewards and prizes may also be cited. In the past few years several evaluation committees, mainly in the natural and life sciences, have used the outcomes of extended bibliometric studies carried out by the Centre for Science and Technology Studies (CWTS.
The self evaluation document, the final evaluation report, and the conclusions made by the board together constitute the results of the external evaluation.
The board will report on the results of both the mid-term self evaluation and the external evaluation in its annual report.
There was great concern at that time about the quality of university research in a number of areas, and this mechanism was designed to provide an incentive for teachers
as a consequence, the attractiveness of Swedish research environments in terms of external research funding, research cooperation and talented researcher and student inflow.
Inevitably, the RAE results are converted by the media into league tables for ranking the quality of subject areas and universities.
It is not the intention of the funding bodies to create league tables from the RAE 2008 results but that is the likely consequence through the media.
as many other activities of professors and researchers are showed by their web presence. The Web covers not only formal (e-journals, repositories) but also informal scholarly communication.
Given the expansive range of stakeholders in higher education, including students and their families, academic staff, institutions, governments,
Table 1. SJTU-ARWU Methodology Criteria Indicator Code Weight Quality of education Alumni of an institution winning Nobel prizes and field medals Alumni 10%Quality of Faculty
Instead, the ARWU ranking focuses specifically on the academic outputs (scholarly works and awards for high quality scholarship and research.
The most obvious bias in this ranking is toward research outputs and not teaching quality and student outputs.
Ultimately, however, the quality of universities cannot be measured precisely using imprecise basic numbers. The researchers at SJTU are clear in disclaimers on their website that it would be impossible to have a comprehensive ranking of universities worldwide, because of the huge differences of universities, in the large variety of countries and funding capacities,
One final bias that deserves mention is that related to the use of English as the language of international scholarship.
As citations depend on having access to published scholarship, and the preponderance of published scholarship occurs in English,
an unfortunate outcome of this use of citation is the bias against institutions which operate outside English-language countries or areas.
Using subjective inputs peer reviews from academics and employers and quantitative data, such as the numbers of international students and faculty,
and the influence of the faculty, as represented by research citations, to compare the international stature of institutions,
the WUR intends to meet the needs of consumers (students, academic staff, researchers, policy makers) seeking reliable information about universities around the world.
The expansion from producing national rankings to developing an international one resulted from the recognition that student mobility was on the rise at a time
The competition for international students was going to surge as a result, and these students would need a mechanism to inform their choices for international study.
The WUR was developed specifically to fill this niche consumer market. Methodology incl. time-frame, resources, costs, technologies:
and global presence, with the quality of each determined by a combination of qualitative, subjective inputs peer reviews from academics and employers and quantitative data,
such as the numbers of international students and faculty and the influence of the faculty, as represented by research citations,
339 responses in 2008.10%Faculty Student Ratio Score based on student faculty ratio 20%Citations per Faculty Score based on research performance factored against the size of the research
body 20%International Faculty Score based on proportion of international faculty 5%International Students Score based on proportion of international students 5%Source:
and Accreditation Council of Taiwan to gauge the research productivity of the best universities in the world.
Performance Ranking of Scientific Papers for Research Universities Higher education Evaluation and Accreditation Council of Taiwan Policy Context, incl. circumstances under which the exercise came about:
The features of this performance ranking are that 80%are qualitative indicators (the first time using h-index to reflect on the quality of universities'papers),
At a global level universities increasingly compete to attract the best students and research workers, and the European commission launched the concept of a European Research Area.
from http://www. consilium. europa. eu/uedocs/cms data/docs/pressdata/en/intm/97237. pdf CREST 4th OMC Working group (2009)‘ Mutual learning
Hazelkorn, E. 2008)‘ Learning to Live with League tables and Ranking: The Experience of Institutional Leaders',Higher education Policy, vol. 21, no. 2, pp. 195-215.
League tables and the impact on higher education institutions in England, Circular 2008/14, Bristol: Higher education Funding Council for England.
A Global Survey of University League tables, Canadian Education Report Series, Educational Policy Institute: Toronto. Retrieved 11 august 2009, from http://www. educationalpolicy. org/pdf/World-of-Difference-200602162. pdf. Van Raan, A f. J. 2005)‘ Fatal Attraction:
from http://www. cwts. nl/ranking/Leidenrankingwebsite. html. OECD Feasibility Study for the International Assessment of Higher education Learning outcomes (AHELO), Retrieved 22 july 2009, from http://www. oecd
Higher education Evaluation and Accreditation Council of Taiwan, Retrieved 22 july 2009, from http://ranking. heeact. edu. tw/en-us/2008/page/Background QS World Universities (2008) Retrieved 12 august 2009,
Any assessment of the quality of university-based research will have to take into consideration the multifunctional and diverse nature of universities
While commercial rankings have positive and negative impacts onto the institutions, the students and other users,
Overtext Web Module V3.0 Alpha
Copyright Semantic-Knowledge, 1994-2011