How to explain conversation analysis to quantitative researchers

There are many aspects of EM/CA research that may be difficult to explain to researchers and teams more used to dealing with quantitative methods and data. This page is a list of tips and resources to help explain CA/EM methods in multi-methods research contexts.

FAQs

Here are some of the questions frequently asked of EM/CA researchers in multi-methods contexts and some useful tips for formulating answers, and links to further reading and resources.

General questions

General points to bear in mind

• Stress that qualitative research is descriptive and specific in nature.
• Bear in mind vocabulary differences. For sociometrics and quantitative research paradigms 'data' are the controlled and already processed 'measurements', tables and statistical results, which are then interpreted. In these terms EM/CA transcripts are not 'data', but seem uncontrolled, messy: 'just talk'.
• Clarify that quality standards of dependability and content validity cannot be transferred easily across paradigms.

More detailed/philosophical discussion points

• What do 'validity' and 'verifiability' mean in an EM/CA context?
  • Helpful points/ideas include: Verstehen (Weber, Schutz) and how to distinguish between participants' concerns and scientists' concerns (Schutz, Garfinkel) and between the "natural attitude" and the "scientific attitude" towards the social world (Husserl, Schutz), between notions of Formal Analysis (FA) and "praxeological validity" (Garfinkel).
  • See Graham Button, (1991), "Ethnomethodology and the human sciences", Cambridge, Cambridge University Press. for relevant discussions.

Practical suggestions / boundaries for multi-methods teamwork

If asked to provide data protocols, cross-coder verification for transcripts or other data processing formalities associated with quantitative/coding-based research methods, rather than refuse, it can be more practical to comply to some extent:

1. Have someone else transcribe some small portion of the same recording, then adjudicate any discrepancies and have a 'formally' validated transcript.
2. Initiate a debate about the difference between paradigms and practicalities of research methods (using resources described here).

If requested to cross-validate analytic results, it is probably best to focus on making the case that this approach does not necessarily make sense for EM/CA methods.

Answering the question of how much data is required & collections

• There was a good thread on Twitter about this: https://twitter.com/i/moments/edit/900684578066759680

On data/transcript issues

• How can EM/CA researchers guarantee that transcripts are an accurate representation of the recordings?
  • eg: in some research contexts, inter-transcriber agreement might require that 5% of the data is transcribed a second time, and compare versions of the transcript.

Possible answers

• CA's 'quality control' is rooted in having data sessions and discussion amongst colleagues.
• Silverman suggests (in Interpreting Qualitative Data 1993 p 149) that as the transcript follows standard conventions (which you can append) this ensures proper documentation. Re CA, he suggests that "we should not delude ourselves into seeking a perfect transcript" as this is illusory. You need a transcript which is adequate for the task in hand, ie. the level of analysis and the kind of techniques you are using. Wherever possible the data should be subjected to group data sessions which he compares to inter-rater comparison.

FAQs on data analysis

• How can EM/CA researchers guarantee that the analysis is independently repeatable?
  • eg: can a independent party repeat the analysis on the video, to see if they come up with the same results?

Possible answers

• Samples are not intended to be representative of a population, examples used in extracts are illustrative for reader to understand the phenomenon in question, not results in and of themselves.

Recommended Reading

On data collection

• Lorenza Mondada, (2013), "[Mondada2013c| The Conversation Analytic Approach to Data Collection]", In The Handbook of Conversation Analysis (Jack Sidnell, Tanya Stivers, eds.), Wiley-Blackwell, no. 698, pp. 32–56.

On reliability / validity / representativeness / transcription

• Peräkylä, A. (2004). Reliability and validity in research based on naturally occurring social interaction. In D. Silverman (Ed.), Qualitative research: Theory, method and practice (2nd ed., pp. 283-304). London: Sage. (or the 3rd edition)
• Roberts, F., & Robinson, J. D. (2004). Inter-observer agreement on first-stage conversation analytic transcription. Human Communication Research, 30(3), 376-410.
• Jack Bilmes, " Preference and the conversation analytic endeavor," (Journal of Pragmatics, 64, 2014: 52-71).
• Lynch, M. (1993). "Scientific Practice and Ordinary Action: Ethnomethodology and social studies of science." Cambridge, MA: Cambridge University Press.
• Alexa Hepburn, Galina B. Bolden, (2012), "The Conversation Analytic Approach to Transcription", In The Handbook of Conversation Analysis (Jack Sidnell, Tanya Stivers, eds.), John Wiley & Sons, Ltd, pp. 57–76.
• Jacobs, S. (1987). Commentary on Zimmerman: Evidence and inference in conversation analysis. Communication Yearbook, 11, 433-443.
• Jacobs, S. (1990). On the especially nice fit between qualitative analysis and the known properties of conversation. Communications Monographs, 57(3), 243-249.
• Robinson, J. D. (2007). The role of numbers and statistics within conversation analysis. Communication Methods and Measures, 1, 65-75.

On generalisation / synthesis / systematic review

• Parry, R. H., & Land, V. (2013). Systematically reviewing and synthesizing evidence from conversation analytic and related discursive research to inform healthcare communication practice and policy: an illustrated guide. BMC medical research methodology, 13(1), 69.
• Emanuel A Schegloff, (1993), "Reflections on Quantification in the Study of Conversation", Research on Language and Social Interaction, vol. 26, no. 1, pp. 99–128.
• Lorenza Mondada's and Galina Bolden & Alexa Hepburn's chapters in Jack Sidnell, Tanya Stivers, (2013), " The Handbook of Conversation Analysis", Malden, MA, Wiley-Blackwell.
• Pomerantz, Anita. (1990) Conversation Analytic Claims. Communication Monographs 57: 231-235.

In relation to specific disciplines

• J. P. de Ruiter, Saul Albert, (2017), "An Appeal for a Methodological Fusion of Conversation Analysis and Experimental Psychology", Research on Language and Social Interaction, vol. 50, no. 1, pp. 90-107.
• John Heritage, Tanya Stivers, (2012), "Conversation Analysis and Sociology", In The Handbook of Conversation Analysis (Jack Sidnell, Tanya Stivers, eds.), John Wiley & Sons, Ltd, pp. 657–673.
• Wayne A. Beach, (2012), "Conversation Analysis and Communication", In The Handbook of Conversation Analysis (Jack Sidnell, Tanya Stivers, eds.), John Wiley & Sons, Ltd, pp. 674–687.
• Ignasi Clemente, (2012), "Conversation Analysis and Anthropology", In The Handbook of Conversation Analysis (Jack Sidnell, Tanya Stivers, eds.), John Wiley & Sons, Ltd, pp. 688–700.
• Jonathan Potter, Derek Edwards, (2012), "Conversation Analysis and Psychology", In The Handbook of Conversation Analysis (Jack Sidnell, Tanya Stivers, eds.), John Wiley & Sons, Ltd, pp. 701–725.
• Barbara A. Fox, Sandra A. Thompson, Cecilia E. Ford, Elizabeth Couper-Kuhlen, (2012), "Conversation Analysis and Linguistics", In The Handbook of Conversation Analysis (Jack Sidnell, Tanya Stivers, eds.), John Wiley & Sons, Ltd, pp. 726–740.

Related links / resources

• @Dirkvl, however, points to Stand Up and Be Counted: Why social science should stop using the qualitative/quantitative dichotomy
• Two blog posts: Conversation Analysis for Geeks - a 5 minute presentation of CA for computer science nerds, and a related post on 3 recurrent complaints about Conversation Analysis I have experienced in my quantitatively oriented cognitive science department --SaulAlbert (talk) 12:54, 4 December 2014 (CET)
• See also a great ROLSI blog about how to use analogies by Ruth Parry: https://rolsi.net/2019/06/21/guest-blog-ruth-parry-on-how-to-use-analogies-to-introduce-ca-to-new-audiences/
• Elizabeth Stokoe, Charles Antaki, Mike Bracher, Leanne Chrisostomou, Elle Henderson, Danielle Jones, and Simon Stewart on "The Softness of Hard Data": https://elizabeth-stokoe.medium.com/the-softness-of-hard-data-475743d8a2f2

Credits

This page is based on an original thread thread initiated by Mario Veen on the Languse mailing list, and responses by Ruth Parry, Israel Berger, Galina Bolden, Jacob Bilmes, Mats Andrén, Dennis Day, Sima Sadeghi, Julie Wilkes, Christian Nelson, Emo Gotsbachner, R.E.sanders, David Woods, Jeffrey Robinson, Saul Albert and Rebecca Barnes (see the threaded list of replies in the list archives).