- (2016). Radical or incremental Where does R&D policy hit?. Research Policy, 45(4), 869–883.
Paper not yet in RePEc: Add citation now
Aiello, F., Albanese, G., & Piselli, P. (2019). Good value for public money? The case of R&D policy. Journal of Policy Modeling.
- Ali-Yrkkö, J., Kotiranta, A. & Ylhäinen, I. (2017). Katsaus yritysten kasvuun ja sitä koskeviin politiikkatoimiin. Etla Raportti No 79.
Paper not yet in RePEc: Add citation now
- Ali-Yrkkö, J. & Pajarinen, M. (2019). Tutkimus- ja kehitystoiminnan kansainvälistyminen. Etla Raportti No 88.
Paper not yet in RePEc: Add citation now
- Altman, N. & Krzywinski, M. (2017). Points of significance: interpreting P values. Nature.
Paper not yet in RePEc: Add citation now
- Antonelli, C. (2019). Knowledge exhaustibility public support to business R&D and the additionality constraint. The Journal of Technology Transfer, 1–15.
Paper not yet in RePEc: Add citation now
- Antonioli, D. & Marzucchi, A. (2012). Evaluating the additionality of innovation policy. A review focused on the behavioural dimension. World Review of Science, Technology and Sustainable Development, 9(2), 124– 148.
Paper not yet in RePEc: Add citation now
- Arrow, K.J. (1951). An extension of the basic theorems of classical welfare economics. Stanford University, Stanford, United States. Cowles Commission Paper, New Series, No. 54.
Paper not yet in RePEc: Add citation now
- Arrow, K.J. (1972). Economic welfare and the allocation of resources for invention. In Readings in industrial economics, 219–236. Palgrave, London.
Paper not yet in RePEc: Add citation now
Autio, E. & Rannikko, H. (2016). Retaining winners Can policy boost high-growth entrepreneurship?. Research policy, 45(1), 42–55.
Autio, E., Kanninen, S., & Gustafsson, R. (2008). Firstand Second-Order Additionality and Learning Outcomes in Collaborative R&D Programs. Research Policy, 37(1), 59–76. Endnotes These two are not mutually exclusive in terms of policy instruments, because both views stress the need to use e.g. direct R&D support. The key dividing issue here is the scope of interventions, and the impacts the different roles foster.
Autio, E., Kenney, M., Mustar, P., Siegel, D., & Wright, M. (2014). Entrepreneurial innovation The importance of context. Research Policy, 43(7), 1097–1108.
Becker, B. (2015). Public R&D policies and private R&D investment A survey of the empirical evidence. Journal of Economic Surveys, 29(5), 917–942.
BeÌrubeÌ, C. & Mohnen, P. (2009). Are firms that receive R&D subsidies more innovative?. Canadian Journal of Economics/Revue canadienne d’eÌconomique, 42(1), 206–225.
BorraÌs, S. & Laatsit, M. (2019). Towards system oriented innovation policy evaluation? Evidence from EU28 member states. Research Policy, 48(1), 312–321.
Branstetter, L.G. & Sakakibara, M. (2002). When do research consortia work well and why? Evidence from Japanese panel data. American Economic Review, 92(1), 143–159.
Bronzini, R. & Iachini, E. (2014). Are incentives for R&D effective? Evidence from a regression discontinuity approach. American Economic Journal Economic Policy, 6(4), 100–134.
Bronzini, R. & Piselli, P. (2016). The impact of R&D subsidies on firm innovation. Research Policy, 45(2), 442–457.
Choi, J. & Lee, J. (2017). Repairing the R&D market failure Public R&D subsidy and the composition of private R&D. Research Policy, 46(8), 1465–1478.
Clarysse, B., Wright, M., & Mustar, P. (2009). Behavioural additionality of R&D subsidies A learning perspective.
Cunningham, P., Edler, J., Flanagan, K. & Laredo P. (2016), ‘The Innovation Policy Mix’, in J. Edler P. Cunningham A. Gök P. Shapira (eds), Handbook of Innovation Policy Impact , Cheltenham, Edward Elgar, 505–542.
Czarnitzki, D. & Lopes-Bento, C. (2013). Value for money? New microeconometric evidence on public R&D grants in Flanders. Research Policy, 42(1), 76–89.
Czarnitzki, D., Hanel, P., & Rosa, J.M. (2011). Evaluating the impact of R&D tax credits on innovation A microeconometric study on Canadian firms. Research Policy, 40(2), 217–229.
Czarnitzki, D., Kraft, K., & Thorwarth, S. (2009). The knowledge production of ‘R’and ‘D’. Economics Letters, 105(1), 141–143.
David, P.A., Hall, B.H., & Toole, A.A. (2000). Is public R&D a complement or substitute for private R&D? A review of the econometric evidence. Research policy, 29(4-5), 497–529.
Dechezleprêtre, A., Einiö, E., Martin, R., Nguyen, K. T., & Van Reenen, J. (2016). Do tax incentives for research increase firm innovation? An RD design for R&D (No. w22405). National Bureau of Economic Research.
Dimos, C. & Pugh, G. (2016). The effectiveness of R&D subsidies A meta-regression analysis of the evaluation literature. Research Policy, 45(4), 797–815.
Edler, J. & Fagerberg, J. (2017). Innovation policy what, why, and how. Oxford Review of Economic Policy, 33(1), 2–23.
Einiö, E. (2014). R&D subsidies and company performance: Evidence from geographic variation in government funding based on the ERDF population-density rule. Review of Economics and Statistics, 96(4), 710–728.
- European Commission (2017). The economic rationale for public research & innovation funding and its impact. Brussels European Commission. Directorate-General for Research and Innovation.
Paper not yet in RePEc: Add citation now
Fagerberg, J. (2017). Innovation policy Rationales, lessons and challenges. Journal of Economic Surveys, 31(2), 497–512.
Flanagan, K. & Uyarra, E. (2016). Four dangers in innovation policy studies – and how to avoid them. Industry and Innovation, 23(2), 177–188.
- For instance, Edler & Fagerberg (2017: 12) list 17 different innovation policy instruments.
Paper not yet in RePEc: Add citation now
- For more about how to improve outcome measurement in policy formulation and evaluation context, see e.g. Janger et al. (2017) for European policy framework discussion.
Paper not yet in RePEc: Add citation now
- For reviews, see Ylhäinen et al. (2016); Dimos & Pugh (2016); Becker (2015); Zuniga-Vicente et al. (2014).
Paper not yet in RePEc: Add citation now
Freel, M., Liu, R., & Rammer, C. (2019). The export additionality of innovation policy. Industrial and Corporate Change.
Gök, A. & Edler, J. (2012). The use of behavioural additionality evaluation in innovation policy making. Research Evaluation, 21(4), 306–318.
Griliches, Z. (1979). Issues in assessing the contribution of research and development to productivity growth. Bell Journal of economics, 10(1), 92–116. Chicago.
Guerzoni, M., & Raiteri, E. (2015). Demand-side vs. supply-side technology policies – Hidden treatment and new empirical evidence on the policy mix. Research Policy, 44(3), 726–747.
- Guide Jr, V. D. R., & Ketokivi, M. (2015). Notes from the Editors: Redefining some methodological criteria for the journal. Journal of Operations Management, 37(1), v-viii.
Paper not yet in RePEc: Add citation now
Guo, D., Guo, Y., & Jiang, K. (2016). Government-subsidized R&D and firm innovation Evidence from China.
Hall, B. H., Mairesse, J., & Mohnen, P. (2010). Measuring the Returns to R&D. In Handbook of the Economics of Innovation, Vol. 2, 1033–1082. North-Holland.
Hud, M. & Hussinger, K. (2015). The impact of R&D subsidies during the crisis. [Article]. Research Policy, 44(10), 1844–1855.
Hünermund, P. & Czarnitzki, D. (2019). Estimating the causal effect of R&D subsidies in a pan-European program. Research Policy, 48(1), 115–124.
Hyvärinen, J., & Rautiainen, A.M. (2007). Measuring additionality and systemic impacts of public research and development funding – the case of TEKES, Finland. Research evaluation, 16(3), 205–215.
- Innovation Promotion Rationales and Impacts – A Review Georghiou, L., Edler, J., Uyarra, E., & Yeow, J. (2014). Policy instruments for public procurement of innovationChoice, design and assessment. Technological Forecasting and Social Change, 86, 1–12.
Paper not yet in RePEc: Add citation now
Janger, J., Schubert, T., Andries, P., Rammer, C., & Hoskens, M. (2017). The EU 2020 innovation indicator A step forward in measuring innovation outputs and outcomes?. Research Policy, 46(1), 30–42.
- Ketokivi, M., & McIntosh, C.N. (2017). Addressing the endogeneity dilemma in operations management research: Theoretical, empirical, and pragmatic considerations. Journal of Operations Management, 52, 1–14.
Paper not yet in RePEc: Add citation now
Kivimaa, P., & Kern, F. (2016). Creative destruction or mere niche support? Innovation policy mixes for sustainability transitions. Research Policy, 45(1), 205–217.
Klette, T.J., Møen, J., & Griliches, Z. (2000). Do subsidies to commercial R&D reduce market failures? Microeconometric evaluation studies. Research policy, 29(4–5), 471–495.
Knockaert, M., Deschryvere, M., & Lecluyse, L. (2019). The relationship between organizational interdependence and additionality obtained from innovation ecosystem participation. Science and Public Policy.
- LareÌdo, P., Köhler, C., & Rammer, C. (2016). The impact of fiscal incentives for R&D. Handbook of Innovation Policy Impact, Cheltenham, Edward Elgar, 18–53.
Paper not yet in RePEc: Add citation now
- Laukkanen, M. & Maliranta, M. (2019). Yritystuet ja kilpailukyky. Valtioneuvoston selvitys- ja tutkimustoiminnan julkaisusarja 2019:33. Valtioneuvoston kanslia, Helsinki 2019.
Paper not yet in RePEc: Add citation now
Levin, R.C., Klevorick, A.K., Nelson, R.R., Winter, S.G., Gilbert, R., & Griliches, Z. (1987). Appropriating the returns from industrial research and development. Brookings papers on economic activity, 1987(3), 783–831.
Maliranta, M., Määttänen, N. & Pajarinen, M. (2016). Firm Subsidies, Wages and Labor Mobility. Etla Reports No 60.
Marino, M., Lhuillery, S., Parrotta, P., & Sala, D. (2016). Additionality or crowding-out? An overall evaluation of public R&D subsidy on private R&D expenditure.
Mazzucato, M. (2016). From market fixing to market -creating a new framework for innovation policy. Industry and Innovation, 23(2), 140–156.
- More detailed econometric measurement discussion of the returns from R&D, see e.g. Hall et al. (2010).
Paper not yet in RePEc: Add citation now
Moretti, E., & Wilson, D.J. (2014). State incentives for innovation, star scientists and jobs Evidence from biotech. Journal of Urban Economics, 79, 20–38.
Mulligan, K., Lenihan, H., & Doran, J. (2019). More subsidies, more innovation? Evaluating whether a mix of subsidies from regional, national and EU sources crowds out firm-level innovation. Regional Studies, Regional Science, 6 (1), 130–138.
- OECD (2017). OECD Reviews of Innovation Policy: Finland 2017, OECD Publishing, Paris.
Paper not yet in RePEc: Add citation now
- Radicic et al. (2018) provide literature overview of how public support influences cooperative behavior. Earlier studies include e.g. Antonioli et al. (2012) and Gök & Edler (2012). It should be noted that this was very recent study at the time of the synthesis work and we did not yet have full access to the study results. We were able to view the main results, but we were not able to conduct full review on the quality of the study. Trade journal data: Experts have written about the innovations and this signifies their importance.
Paper not yet in RePEc: Add citation now
Radicic, D., Pugh, G., & Douglas, D. (2018). Promoting cooperation in innovation ecosystems: evidence from European traditional manufacturing SMEs. Small Business Economics, 1–27.
Rao, N. (2016). Do tax credits stimulate R&D spending? The effect of the R&D tax credit in its first decade. Journal of Public Economics, 140, 1–12.
- Related close to this topic, see also Valtiovarainministeriö (2019) & Maliranta et al. (2016).
Paper not yet in RePEc: Add citation now
- See Ylhäinen et al. (2016: 42–44) for extensive list of literature concerning the Finnish context.
Paper not yet in RePEc: Add citation now
- Solow, R.M. (1957). Technical change and the aggregate production function. The review of Economics and Statistics, 312–320.
Paper not yet in RePEc: Add citation now
Takalo, T., Tanayama, T., & Toivanen, O. (2013). Estimating the benefits of targeted R&D subsidies. Review of Economics and Statistics, 95(1), 255–272.
Takalo, T., Tanayama, T., & Toivanen, O. (2017). Welfare effects of R&D support policies. Bank of Finland Research Discussion Paper, (30).
- The typology might be problematic in a sense that non-significant (statistically) is not the same as no association or unclear effect (Altman & Krzywinski, 2017; Wasserstein & Lazar, 2016).
Paper not yet in RePEc: Add citation now
- There are also few studies that extend beyond private investment counterfactuals and try to estimate economic welfare effects (Takalo et al., 2013; Takalo et al., 2017).
Paper not yet in RePEc: Add citation now
- They use this term as broad category for all not privately funded R&D, and acknowledge that this measure is highly oversimplifying (van Elk et al., 2019: 55–56). ETLA Raportti | ETLA Report | No 99 Beck, M., Lopes-Bento, C., & Schenker-Wicki, A.
Paper not yet in RePEc: Add citation now
Torregrosa-Hetland, S., Pelkonen, A., Oksanen, J., & Kander, A. (2019). The prevalence of publicly stimulated innovations. A comparison of Finland and Sweden, 1970–2013. Research Policy.
- Valtioneuvoston selvitys- ja tutkimustoiminnan julkaisusarja 57/2016. Valtioneuvoston kanslia.
Paper not yet in RePEc: Add citation now
- Valtiovarainministeriö (2019). Tuottavuuden tila Suomessa. Miksi sen kasvu pysähtyi, käynnistyykö se uudelleen. Valtionvarainministeriön julkaisuja. 2019:21.
Paper not yet in RePEc: Add citation now
van Elk, R., ter Weel, B., van der Wiel, K., & Wouterse, B. (2019). Estimating the Returns to Public R&D Investments Evidence from Production Function Models. De Economist, 1–43.
Vanino, E., Roper, S., & Becker, B. (2019). Knowledge to money: Assessing the business performance effects of publicly-funded R&D grants. Research Policy.
Veugelers, R. (2015). Mixing and matching research and innovation policies in EU countries (No. 2015/16). Bruegel Working Paper.
Wanzenböck, I., Scherngell, T., & Fischer, M.M. (2013). How do firm characteristics affect behavioural additionalities of public R&D subsidies? Evidence for the Austrian transport sector. Technovation, 33(2–3), 66–77.
Wasserstein, R.L., & Lazar, N.A. (2016). The ASA’s statement on p-values: context, process, and purpose. The American Statistician, 70(2), 129–133.
Wirsich, A., Kock, A., Strumann, C., & Schultz, C. (2016). Effects of university–industry collaboration on technological newness of firms. Journal of Product Innovation Management, 33(6), 708–725.
- Ylhäinen, I., Rouvinen, P., & Kuusi, T. (2016). Katsaus yksityisen t&k-toiminnan ja sen julkisen rahoituksen vaikuttavuuteen.
Paper not yet in RePEc: Add citation now
ZuÌñiga-Vicente, J.AÌ., Alonso-Borrego, C., Forcadell, F.J., & GalaÌn, J.I. (2014). Assessing the effect of public subsidies on firm R&D investment a survey. Journal of Economic Surveys, 28(1), 36–67.