CSB Working Paper, 2017, 6: The Implementation of Social Policy: A Factorial Survey Approach

The implementation of social policies has a multidimensional character. We present an experimental method (factorial survey) by means of which one can gather data from a large number of respondents from several agencies and across countries. A concrete research example involves a survey among Belgian social assistance case managers, who were asked to predict the likelihood of experimentally varied hypothetical clients being sanctioned. The data had a multi-level structure (3=organisation [n=79];…

The implementation of social policies has a multidimensional character. We present an experimental method (factorial survey) by means of which one can gather data from a large number of respondents from several agencies and across countries. A concrete research example involves a survey among Belgian social assistance case managers, who were asked to predict the likelihood of experimentally varied hypothetical clients being sanctioned. The data had a multi-level structure (3=organisation [n=79]; 2=respondent [n=594]; and 1=client descriptions [n=4855]).

We empirically show how the method is useful for studies on issues such as conditionality (client level), discretion (social worker and organisation level), decentralisation (municipality/region level) and international policymaking (country level). Our recommendations for the use of factorial surveys with regard to social policy implementation research are: asking for expected and not for preferred treatment, adding a questionnaire about respondents and their organisation, stratified sampling of respondents and using multi-level techniques for analysis.