which is based in the Government office for Science based in the Department for Innovation, Universities and Skills.
Innovation in Environmental policy? Integrating the Environment for Sustainability, Edgar Elgar Publishing, London, 2008, pp. 114 133.42 Scottish government, National Planning Framework 2 SEA Annex to the Environmental Report:
and around the notion of Responsible Research and Innovation of nanotechnologies as an opportunity to develop support tools for exploring potential co-evolutions of nanotechnology and governance arrangements.
Co-evolutionary scenarios Selection environment Nanotechnology Responsible development Anticipatory coordination 1. Introduction The path to innovation is journey-like, certainly so for radical innovation.
Trodden more often, the activities along the path will become more predictable (as with incremental innovation.
Retrospective studies of emerging technology applications/products (from disciplines of Management and Sociology of Innovation) reveal that the journeys twist
this complexity increases as we shift from retro-to prospective analysis of potential paths to innovation
(or created) by nanotechnology innovations and how the regulatory, economic and societal landscapes will co-evolve.
not only face the general challenge of prospecting possible pathways for innovation they also are challenged to prospect the changing environments
whether an innovation will move from a hopeful proof-of-principle to a product well embedded in our society.
There is a call for anticipatory governance 1 often phrased as the need for responsible development of nanotechnology or responsible innovation in nanotechnology,
But the potential breakthrough nature of nanotechnologies as enablers of radically new applications may mean a complex reconfiguration of the environments that a nanotechnology innovation may traverse during itslifetime'from concept to well embedded technology in our society.
and around Responsible Research and Innovation of Nanotechnology. 2 That is why it became the subject of a research project
and context-rich scenarios encompasses a trade-off between recognizing the complexity of actual dynamics of innovation
and the need to reduce complexity, without falling back on the linear model of innovation. Such scenarios should highlight both the multilevel/multi-actor dynamics
and pace of the co-evolution. 1 The phraseresponsible innovation'refers to innovation activities in which social aspects,
and in this way responsible innovation is the responsibility of innovation actors, in interaction with various societal actors. 2 This term was created by the author for the purposes of the project,
responsible innovation and including the notion that this umbrella term covers research, product development and embedment.
Responsible (research &) innovation can be read in two ways: one with an emphasis on innovation, which requires some responsibility to be successful/acceptable,
or another with an emphasis on responsible up to and including halting developments along particular R&d
& Social Change 76 (2009) 1222-1239 There is increasing recognition that innovation emergence is a nonlinear process,
and turns in the emergence of a new product 5. Innovation is characterized nonlinear, and by learning processes of actors about artefacts and actants.
and parcel of the actor-network that carries the innovation as well as the broader landscape which overtime shifts.
If we accept that paths to innovation is journey-like for the scenarios we must also recall there may be many potential pathways to innovation 6 and each of the journeys down the pathways could involve forks, setbacks, convergence etc.
the stuff of innovation journeys. However, for breakthrough technologies, the factors that shape the pathways may be evolving too!
albeit small, element in the co-evolution of innovation and the surrounding selection landscape. This is a key aspect of modern FTA-connecting complexities of ongoing innovations (and the conditions
which frame the creation and selection of options) with the real issue of developing strategic agendas and plans that will lead to action.
Some of the implications (including opportunities) of infusing complexity into FTA practices will be discussed. 2. Prospecting innovation:
theory and concepts Recent thinking about innovation adds up to a general idea that technology emergence is a process of innovation and selection shot through with anticipations (c. f. quasi-evolutionary
Evolutionary theories of technical changes emphasise that for innovation one should think of variation and selection (and retention of those selections.
and assessment tools for the analysis and improvement of the societal embedding of innovations. Socrobust emphasised the difference between hot unarticulated, open-ended (fluid/hot) situations and more structured and well articulated, stable (cold) situations 22.
In this section I use three building blocks to construct a framework for prospecting innovation: evolutionary models of technical change;
what they have to offer. 2. 1. Lacunae in evolutionary models of technical change How do innovations come to be selected from a number of possible options;
institutional and social factors in shaping a technology. 4 Braun for example describes the early notions of innovation as being characterised by alinear'view of innovation as an automatic spill over process between basic knowledge
and technological application whilst recent notions regard innovation as being nonlinear and recursive interactions between a variety of actors participating in the quest for innovation. 8. 5 These environments,
& Social Change 76 (2009) 1222-1239 Sociologically inclined innovation scholars have focused on analysing and prospecting innovation/selection activities, studying open-ended situations of emergence,
and other topics. Against this background I propose that there is a clear gap in the literature so far regarding the shifting natures of selection environments
In this project on RRIWE add a further conceptualization using the idea of arenas of innovation and selection
which innovations traverse (including anticipation on further selections). The advantage of this conceptualization is that it allows selection environments
+a mosaic of arenas for innovation and selection At the time of the Constructive TA project, a method of combining ideas of innovation journeys amidst evolving landscapes (coevollutio of innovation/selection processes
Whilst every innovation has its journey, it is dependent on the techno-institutional landscape. This landscape will have different characteristics at different stages of technology/product emergence
It allows the positioning of the complexities inherent to the reality of innovations, paths and landscapes,
Detailing in brief, in this visualization an innovation traverses a complex mosaic of arenas of innovation and selection which are affected by broader aspects.
The arenas for innovation and selection are shown here as bubbles where each arena represents a particular socio-technical configuration carrying
Thus the innovation journey (represented in Fig. 1 as a branching line) is made up of a path to innovation (a pathway represented by the bubbles in the centre of Fig. 1) where the emerging technology itself
and is a combination of technology studies, innovation and management studies, and path dynamics which adds up to a mosaic of arenas,
Unlike the linear model, the emergence of an innovation is predetermined not, it is more reactive and responsive
which evolve with the innovation. This reads like actor-network theory (Callon et al on TEN) and so innovation itself is an outcome of alignment and configuration of actors, artifacts and infrastructures.
In line with Innovation chain+nomenclature one could call this Innovation+.+8 Still the focus of technology developers in their FTA ACTIVITIES, focus on paths (such as roadmapping) rather than journeys.
Robinson and Propp expand this path perspective to a multi-path one. In this paper, we shift discussions to the journeys themselves
& Social Change 76 (2009) 1222-1239 Fig. 1. Innovation chain+as a mosaic of co-evolving arenas of innovation and selection with innovation journeys showing coupling, shifting,
and coevoluution of technologies and the IC+we need some indications of how paths-to-innovation may emerge
and current situation and developed three co-evolutionary scenarios showing plausible playings out of technology innovations
and shape innovation and selection processes? 1228 D. K. R. Robinson/Technological forecasting & Social Change 76 (2009) 1222-1239 Fig. 3. Evolution of governance, 2000 2008.1229 D. K
The proposed codes of conduct were the tip of an iceberg of a larger movement towards responsible innovation,
those of technology developers and promoters they term insiders (that focus on innovation through enactment cycles) and outsiders (who focus on comparing
If van de ven's comment is true Management can't control innovation success only its odds 5 then this implies a shift from deterministic approaches to foresight
responsible (research &) innovation can be read in two ways. One with an emphasis on innovation, which requires some responsibility to be successful/acceptable,
or another with an emphasis on responsible up to and including halting developments along particular R&d lines.
The scenario in Box 3 looks at a specific cluster of innovations in nanoparticle based drug delivery.
By mid 2008 the patchwork of codes of conduct, best practices and measures of responsible innovation remains misaligned,
The patchwork of codes of conduct, best practices and measures of responsible innovation remain misaligned,
The lack of nano specific regulation allowed innovations to proliferate but transition into the clinic became fraught with many other challenges related to user needs and user practices.
of maintaining a patchwork of soft law options to facilitate nanotechnology innovation, positions taken on precaution,
IC+emphasizes the overlapping mosaic of arenas of innovation and selection shape and are shaped by the innovations that pass through them
and so helps in identifying actors and their strategies. This aids the scenario creator, in my case I could place amidst the three scenarios some major stances and strategies of various actors,
foster collaboration between the two main funding agencies the Academy of Finland and the Finnish funding agency for technology and Innovation (Tekes) and promote foresight and innovation activities at large.
relations to emerging societal and industrial needs, with illustrations of future possibilities by way of concrete manifestations (such as innovations).
3) FTA in research and innovation;(4) FTA and equality: new approaches to governance; and (5) FTA in security and sustainability.
Important users of this type of foresight activity are often national research and innovation councils, national research programmes and similar entities involved directly in prioritising public expenditure on research and development (R&d).
Research and innovation councils and programmes play a significant role in the development of science and are a central interface between politics and research.
the funding for research and innovation councils and targeted research programmes is a more dynamic instrument, suitable for interaction with national science and innovation policy.
and objectives for foresight The rationale for carrying out public foresight exercises is often related to the political goal of increasing economical competitiveness by means such as technological or societal innovation.
the concepts of national innovation systems (NIS) and technology innovation systeem (TIS) are important in understanding how new technologies emerge
Furthermore, policies on innovation have been suggested by Johnson and Jacobsson to underpin the system by improving its ability to serve five primary functions:(
and innovation to be linear, whereby innovation is thought to be initiated in pure science and to trickle down through applied research
and industrial development, ending up in new products introduced on to the market. As a consequence of this, there is often focus on the opinions of so-calledelite'scientists and industrialists,
Other understandings of innovation would imply that customers or other societal actors also were included in Delphi surveys.
Today, total public expenditure for energy-related research and innovation has increased to approximately the same level as before,
The council was located in the Danish research Agency under the Ministry of Science, Technology and Innovation,
A third funding source for energy research, a New energy and Environment Research programme, was established also in the period through the Strategic research Council, under the auspices of the Ministry of Science, Technology and Innovation.
For the Danish energy research programme the rationale was to set priorities for Danish energy research and innovation in the light of Danish energy policy.
Technollog and Innovation Partly the Confederation of Danish Industries Advisory Council for Energy Research Energy production companies Energy-technology companies Scientists Interest groupings/NGOS Target groups
innovation-systemorieente The strategy of gaps and weak points: underpinning priorities related to scientific weaknesses compared to the international state-of-the-art The strategy of serving industry:
especially its legitimacy affiliated with innovation and business opportunities and of broader societal needs and improved the discussion on science possibilities to contribute to these.
His main areas of research are technology foresight, strategy in science and innovation, technological innovation, the interaction between industry and science,
His areas of work are systems of innovation and governance of research and innovation in the fields of eco-innovation and energy innovation.
Prepared by Optima Ltd, VDI/VDE-Innovation and Technik Gmbh, EC Contract Ref. PP-CT-M-2004-0004.
demand, users and innovation, eds. R. Coombs, K. Green, V. Walsh, and A. Richards. Cheltenham:
National systems of innovation. Towards a theory of innovation and interactive learning. London: Pinter. March, J. G. 1988. Decisions and organizations.
Progress, innovation and cohesion. Strategy for Denmark in the global economy Summary. Copenhagen: The Prime minister's Office. http://www. globalisering. dk/page. dsp?
In an opening section, the general contours of science, technology and innovation (STI) policy in Luxembourg are traced, with a view to contextualising the FNR Foresight experience.
Luxembourg lacked a public science, technology and innovation infrastructure. R&d carried out in Luxembourg was largely the preserve of the private sector particularly the steel industry and even today,
Early public investments in R&d and innovation were influenced by private sector activities and largely sought to support them.
These included the founding of Luxinnovation in 1984, an agency for supporting innovation; and the establishment of several public research centres in 1987, with the primary aim of supporting technological innovation in firms.
However, with increased recognition of the role of research and innovation in contributing towards the future development of the country,
etc. and structuura priorities concerned with issues such as research infrastructures, higher education teaching programmes, innovation promotion initiatives, venture capital markets,
National priorities National priorities (Research areas)( Research domains) Innovation in services Business service design and innovation Fostering the economic and legal environment for Innovation performance and development of the financial systems
Many senior scientific personnel from the private sector used the exercise to underline the need for high quality public research as a prerequisite for innovation and mutually rewarding cooperation between both sectors. 7. Conclusions For those familiar with running foresight exercises
policy impact 1. Introduction In 2006, the City of Vienna initiated a far-reaching and open strategy process on the orientation of its future research, technology and innovation (RTI) policy.
By then, Vienna is aiming to be among Europe's leading metropolitan areas in research, technology and innovation,
and its key characteristtics The concluding section will synthesise some of the most interesting insights that could be gained from the experience of the project. 2. Framework for the impact assessment of foresight processes1 2. 1. Changing insights into processes of innovation and policy making
which were characterised by a focus on shaping framework conditions that are conducive to innovation. Thishands off'approach has evolved subsequently into
technology and innovation, which not only deals with framework conditions, but also with the institutional and structural settings of innovation systems (Dosi 1988;
in order to keep pace with the international developments in science, technology and innovation, with new employment patterns and with the need to further upgrade research and innovation performance.
technology and innovation options among players, creating debate Awareness of the systemic character of change processes Foresight skills are developed in a wider circle Dialogues in new combinations of experts and stakeholders and a shared understanding
and innovation thatwas blessed by the highest political levels. In fact, when the research programme was started at the end of 2004,
In other words, while on the one hand these four themes mirrored major concerns of the city in relation to research and innovation, they also mirrored the main competencies and institutions by
and innovation area in the CENTROPE region, there were no participants invited from across the border.
and objectives for optimising the process of research and innovation with the help of RTI policy measures as available to the City of Vienna and embedded in the other policy levels (national and European) exerting an influence on the research and innovation scene
1) Making effective use of the potential for research, technology and innovation by creating adequate conditions for young people, irrespective of their origins,
Options for translating these goals into specific measures can be conceived along the lines of the main determinants of innovation ranging from push factors in the area of science (e g.
In addition, the development of a number of new avenues of research and innovation is being promoted.
4) Vienna as a hothouse for research and innovation facilitating new developments: Further improvement of working conditions for scientists and creative individuals is called for by providing local networks as breeding grounds for invention and creativity.
5) A European location for research and innovation Vienna as a hub for international networks:
In this context, Vienna's network-based location of research and innovation will be strengthened further. 4. 4. Implementation the schedule for 2008 and beyond Based on the objectives,
such as promoting innovation in the service sector, encouraging research cooperation and gender mainstreaming. The newbusiness promotion principles were introduced at the beginning of 2008 already.
In terms of its informing function, it certainly contributed to giving research and innovation more prominence and visibility in the context of urban policy.
technology and innovation among different players that are primarily dealing with other issues. While still being distributed very much among different municipal departments,
The complexity of research and innovation became apparent to many participants and the benefits Downloaded by University of Bucharest at 05:10 03 december 2014 964 K. M. Weber et al. of
The suggestion to foster innovation-oriented procurement in the city is an obvious example where established boundaries would need to be crossed
and innovation performing and facilitating actors outside the local government, but hardly any specific action has been started firmly yet that would build explicitly on the strategy.
as well as between local government and other research and innovation actors. 5. 3. Ultimate, long-term impacts Integrating suitable new actors in the community dealing with research and innovation is one of the key long-term impacts expected from foresight exercises.
Identifyingnew'actors is less the key point than integrating the known actors (e g. from neighbouring policy areas) into the debates about research and innovation.
it is rather unlikely that it will lead to the emergence of a more forward-looking culture in innovation and research organisations.
A second reason must be seen in the early involvement of key actors in researchaan innovation-related organisations of the City of Vienna.
For instance, the panel members were recruited mainly from the prevailing key organisations in research and innovation
Third, the structural and organisational rigidities of urban research and innovation poliic that will need to be overcome for establishing novel types
Notes on contributors Matthias Weber is Head of Research, Technology and Innovation (RTI) Policy Unit at Austrian Institute of technology (AIT) invienna.
Between 2006 and 2008 hewas leading a research programme on regional innovation patterns and policy in cooperation with the City of Vienna.
Wiener Strategie für Forschung, Technologie und Innovation. Executive version, City of Vienna, November 2007. City of Vienna. 2007b.
Wiener Strategie für Forschung, Technologie und Innovation. Long version, City of Vienna, November 2007. Dosi, G. 1988.
Systems of innovations: technologies, institutions and organizations. London: Pinter. Eriksson, E. A, . and M. Weber. 2008.
The Oxford handbook of innovation. Oxford: Oxford university Press. Forsociety. 2007. Self-evaluation tool for foresight project managers. http://www. eranet-forsociety. net (accessed 19 november 2007.
Innovation as a systemic phenomenon: rethinking the role of policy. Enterprise&innovation Management Studies 1, no. 1: 73 102.
The case of stakeholder image construction in a municipal vision project Stefanie Jenssen a a Centre for technology, innovation and culture (TIK), University of Oslo, Norway Published online:
The case of stakeholder image construction in a municipal vision project Stefanie Jenssen*Centre for technology, innovation and culture (TIK), University of Oslo, Norway The article addresses the theme of foresight and equality in the area of stakeholder participation
science and innovation. 7 Expectations embrace both the possiblle probable and the highly unlikely, and thus address the uncertainty of the future.
Innovation and Culture, University of Oslo, Norway and writing her Phd on values and uncertainty in foresight informing research policy priorities.
knowledge flows and the coordination of innovation. http://www. iesam. csic. es/proyecto/formwp1. pdf (accessed September 2009).
These involve an innovation that needs a power supply for remote settings. We have investigated already technologies
and technology managers would naturally pursue empirical means to manage R&d and its transition into effective innovations.
J. Watts, A l. Porter, Innovation forecasting, Technological forecasting and Social Change 56 (1997) 25 47.4 N c. Newman, A l. Porter, J. Yang, Information professionals:
and the Finnish funding agency for technology and Innovation (Tekes) to carry out Finnsight 2015, a joint foresight exercise that would provide inputs to this strategy,
Typically, these objectives include attempts (1) to prepare priorities in the research and innovation (R&i) system,
for instance by improving the stakeholders'understanding of the R&i system or by fostering collaboration processes within innovation networks (cf.
the national foresight exercise of the Academy of Finland and the Finnish funding agency for technology and Innovation (Tekes), which served to inform albeit indirectly the development of the national strategy and the attendant implementation of several Strategic Centres of Excellence in Science and Technology.
the Finnish Agency for Technology and Innovation (Tekes) has catalysed extensive consultation processes with researchers and industrialists in its strategy developmmen (Salo and Salmenkaita 2002;
and Technology policy Council of Finland (STPC) should develop by the end June 2006 a national strategy for establishing Strategic Centres of Excellence in Research and Innovation.
1) Learning and learning society (2) Services and service innovations (3) Well-being and health (4) Environment and energy (5) Infrastructures and security (6) Bio-expertise
Serviic and service innovations) had rather new and evocative titles. These panels were motivated by the growing importance of multifaceted phenomena which,
however, did not necessarily link to well-established fields of scientific inquiry or innovation activity.
it was imperative to achieve a proper balance in addressing the Downloaded by University of Bucharest at 05:11 03 december 2014 Axes of balance in foresight 991 intertwined components of research (of key concern to the Academy of Finland and innovation
for instance by way of innovations,(iv) through what measures the development of the focus area could be promoted best.
life control and social innovations 2. Services and service innovations Business competence in services Culture and adventure services Renewal of public services 3. Well-being and health Physical exercise and nutrition research Mental health
Technology and Innovation was an important part. This opportune timing gave possibilities for instrumental use,
with the aim of promoting technological breakthroughs and innovations in all industrial sectors and services. See http://www. tekes. fi/en/community/Home/351/Home/473 for details. 4. The funding decisions of the Academy of Finland are taken by external scholars (usually university professors) who serve on its councils
Nordic Innovation Centre. http://www. nordicinnovation. net/img/nordic foresight forum final report. pdf (accessed 20 september 2009. Ansoff, I. 1975.
Systems of innovation: technologies, institutions and organizations. London: Pinter. Eriksson, E. A. and K. M. Weber. 2008.
insights from the fostering of innovation ideas. Technological forecasting and Social Change 74, no. 5: 608 26.
Innovation as a systemic phenomenon: rethinking the role of policy. Enterprise&innovation Management Studies 1, no. 1: 73 102.
Science, technology, innovation. Helsinki: Ministry of Education. http://www. minedu. fi/export/sites/default/OPM/Tiede/tutkimus-ja innovaationeuvosto/TTN/julkaisut/liitteet/Review 2006. pdf?
and policymakers in the domain of research and innovation gravitates towards a concept that in its construction already includes the participation of both communities.
higher education and innovation. From a forward looking perspective, special emphasis should be given to the combination of quantitative
The conference will seek to understand further how far the institutionalisation (i e. embeddedness) of FTA supports both the achievement of measurable impacts and the strengthening of interaction s between research, higher education and innovation.
Economic, social and sustainability challenges have created a new and more demanding agenda for research and innovation policymakers and strategists.
& Policy Studies (ST3PS), University of Twente, School of management and Governance, Institute of Innovation and Governance Studies (IGS), Capitool 15, P o box 217,7500 AE Enschede, The netherlands 1
. Introduction The paper presents an approach at improving the impact of foresight by systematically taking into account the characteristics of the targeted research and innovation (R&i) domains when designing a Foresight exercise.
Available online 19 november 2010 A b s T R A c T Thepaperpresentsanapproachatimprovingtheimpact offoresightbysystematicallytaking into account the characteristics of the targeted research and innovation (R&i) domains when designing a Foresight exercise.
In particular it is suggested that the capability of Foresight to function as a systemic innovation policy instrument for enhancing innovation
and learning capability could be improved substantially by tailoring the Foresight approach to the targeted innovation arena. 2010 Elsevier Ltd.
+31 053 489 3353/3350.5 PRIME=Policies for Research and Innovation in the Move towards the European research area, European Network of Excellence (2004 2009;
i e. directed at a certain innovation area. The need to tailor policy instruments to the characteristics of the targeted field is grounded well in insights from research on the dynamics of innovation and knowledge generation.
Innovation studies have pointed out how the dynamics of innovation systems are structured by the nature of the governing technological regimes that in turn co-evolve with socioeconomic and institutional framework conditions.
The sectoral systems of innovation approach which is focussing on the characteristics of knowledge production has been complemented by analysis of the properties of application domains
In all these approaches to characterising innovation regimes the knowledge base plays a crucial role.Central to the systems approach is the view that the key resource of a firm,
The characteristics of the knowledge base such as complexity, diversity and observability are used as key factors for generating innovation typologies 17,18. 6 Forlearn project and Forlearn online guide coordinated by DG JRC-IPTS;
/Futures 43 (2011) 232 242 233 All these results point to the fact that diverse innovation areas need diverse governance tools
Recently also political science approaches have been advocating the idea that innovation in the environment of the political system needs a corresponding increase in complexity of the political system or
in other words, the building of new institutions that are able to govern these innovations effectively 19.
the funding and the strategic orientation of research and innovation have become a multilevel and multi-actor arrangement (e g. 21,22).
and innovation, borne by PROS, universities and firms, which employ researchers, manage infrastructures; they produce,
and innovation areas develop across and beyond inherited national environments. This choice does not mean that the national and regional levels are not to be taken into consideration.
programming and performing is driven partly by the content and the dynamics of research activities and by the innovation patterns and interactions of different thematic fields or sectors(Knowledge dynamics''.
expecting one general type of Knowledge dynamics (reaching from science to innovation) and one unique set of appropriate supportive public policies.
The generation of socio-technical scenarios in a stakeholder dialogue may well create a more reliable ground for transferring research results into successful nano-innovations.
and innovation area considered its fieldspeccifi Knowledge dynamics and (b) the institutional arrangement was described as interacting strategic orientation,
This may be due to a lack of sensitivity towards the dynamics of the innovation and production realmcompared to the academic knowledge production.
and innovation field does not exclude the exploration of radical changes in these dynamics. To sum up
navigating the complex landscape of policy strategies, Technological forecasting and Social Change 75 (4)( 2008) 462 482.10 B.-A°.Lundvall (Ed.),National systems of Innovation:
Human Choice and Climate change, vol. 2, Batelle Press, WASHINGTON DC, 1998.16 K. Smith, Innovation as a systemic phenomenon:
rethinking the role of policy, Enterprise and Innovation Management Studies 1 (1)( 2000) 73 102.17 O. Marsili, The Anatomy and Evolution of Industries:
20 N. Brown, B. Rappert, A. Webster, Foresight as a Tool for the Management of Knowledge Flows and Innovation (FORMAKIN.
La Recherche et l'innovation en France, Odile Jacob, Paris, 2007.25 R. Smits, S. Kuhlmann, The rise of systemic instruments in innovation policy, International
insights from the fostering of innovation ideas, Technological forecasting and Social Change 74 (5)( 2007) 608 626.28 J. Irvine, B. R. Martin, Foresight in Science:
) 817 830.37 M. L. Tushman, C a. O'reilly, Winning through Innovation: A Practical Guide to Leading Organizational Change and Renewal, Harvard Business school Press, Boston, 1997.38 T. Ko nno la, G. C. Unruh, J. Carrillo
Overtext Web Module V3.0 Alpha
Copyright Semantic-Knowledge, 1994-2011