In terms of research paradigms, “social research” can be divided into “quantitative research” and “qualitative research”, usually the former focusing on collecting numerical data and the latter focusing on collecting data of words (Robson, 2011, p. 5). Thus being aware of different theoretical approaches, researchers become reflexive, creative, and capable of reinvention and evolution (Robson, 2011, p. 41). Also according to Robson, the kind of research “refers to applied research projects which are typically small in scale and modest in scope”, is termed as “real world research” (Robson, 2011, p. 3).
It usually solves “problems and issues of direct relevance to people’s lives” (Robson, 2011, p. 4). And the research under review, which applies strategies into real programs (Palethorpe & Wilson, 2011, p. 420), seems to be this kind of research. In this assignment, I am going to evaluate the article under review from the aspects of strengths and weaknesses, and relate the analysis to the broader issues of research. Strengths Firstly, to some extent, this article is formally logical and well-organized by using subheadings and questions like “How do trainers support learners who undertake challenging tasks? (Palethorpe & Wilson, 2011, p. 427). Realizing the “GAP” (Shon, 2012, p. 3) in literature that few attention has been paid to positive effect of stress in real cases (Palethorpe & Wilson, 2011, p. 420), the researchers formed their research questions, presented their “RAT” (Shon, 2012, p. 3) and then came the research design and research method, “multi-strategy design” (Robson, 2011, p. 6) and “triangulation” (Cohen, 2007, p. 141) respectively. Seen from the perspective of the research design, it is closely related to previous literature and theory, and tries to answer research questions by adopting certain research methods.
Finally, with the conclusion indicating that the theoretical strategies are in accordance with the comfort-stretch-panic model in previous literature and recommending further studies (Palethorpe & Wilson, 2011, p. 435). Secondly, as a social research, it is of great value to have a “scientific attitude”: “systematically, sceptically and ethically” (Robson, 2011, p. 15). Specifically, by saying “systematically”, I mean this research is well prepared and arranged by two experienced trainer and consultant, with “over six years’ experience of providing consultancy in training” (Palethorpe & Wilson, 2011, p. 38) and “more than 30 years’ experience in education and training” (Palethorpe & Wilson, 2011, p. 420) separately. So they both have a clear understanding of what, how and why they are doing in the research. They made a detailed exposition of literature, including “theoretical solutions to debilitating learner anxiety” (Palethorpe & Wilson, 2011, p. 421) and “practical measures that a trainer can take to prepare learners for challenging tasks” (Palethorpe & Wilson, 2011, p. 427) and designed the questionnaires in research utilizing the strategies in literature.
Such a coherent process of research design is sufficient for the first aspect of “scientific attitude”. And by saying “sceptically”, I mean the researchers have recognized its limitations of using a small sample of 30 potential participants and the absence of trainees’ feedback and thus recommended future work of considering the “individual personal differences and how these impact differential responses to stressful situations” (Palethorpe & Wilson, 2011, p. 435), thus “subjecting ideas to possible disconfirmation” (Robson, 2011, p. 5). And finally, “ethically” is represented during the questionnaires, which “were sent only to those who indicated availability to help with the research” (Palethorpe & Wilson, 2011, p. 428). The third part of advantages focuses on research method. Combining strategies of survey and interview, it is obvious that this research mainly conducts qualitative research method. However, it can also be called“triangulation” because of the close connection among literature, survey and interviews.
According to Cohen, “triangulation” may be defined as “the use of two or more methods of data collection in the study of some aspect of human behavior” (Cohen, 2007, p. 141). It is often used to mean “bringing different kinds of evidence to bear on a problem” (Esterberg, 2002, p. 176). Here in the article under review, by saying “triangulation”, the researchers adopted the approach of triangulating literature, survey and interview. According to different literatures, there are many types of triangulation and each has its own characteristics, of which “theoretical triangulation” (Cohen, 2007, p. 42) and “methodology triangulation” (Cohen, 2007, p. 142) are reflected in this research. According to Cohen, the former “draws upon alternative or competing theories in preference to utilizing one viewpoint only” and the other “uses either the same method on different occasions, or different methods on the same object of study” (Cohen, 2007, p. 142). Sometimes different theories and results from conducting different methods lead to conflict conclusions, it does not mean the research is wrong, it may indicates the necessary of further study and research in wider field.
So by adopting different types of triangulation, researchers feel more confident of their findings and enhance validity (Cohen, 2007, p. 141). Similar with triangulation, there are also variable kinds of validity. The type I will focus on is “concurrent validity” because it is the type enhanced in the article I am evaluating. How does the triangulation ensuring “concurrent validity” (Cohen, 2007, p. 140) is the main concern of this part. “Concurrent validity” is a variation of “criterion-related validity” (Cohen, 2007, p. 40), also called “criterion validity” by Perri and Bellamy, implying “whether the measures are in line with other measures of the same content that are generally accepted as valid in the wider research community” (Perri 6& Bellamy, 2012, p. 92). “To demonstrate this form of validity the data gathered from using one instrument must correlate highly with data gathered from using another instrument” (Cohen, 2007, p. 140). To be specific, in this article under review, the data is collected both from survey and interview with the guidance of a large amount of literature, applying “theoretical riangulation” and “methodology triangulation”, thus the concurrent validity is relatively ensured. As Lancy indicates, “using multiple data sources also allows one to fill in gaps that would occur if we relied on only one source” (Lancy, 1993, p. 20). Last but not the least, the research draws on the advantages of its research designs. According to Robson, social research design can be separated into “fixed design” and “flexible design” (Robson, 2011, p. 5). And the key to distinguish these two designs is whether the procedure and focus of research is fixed or not (Robson, 2011, p. ). However, it should be noticed that there overlaps between them. For example, one specific fixed-designed research could be flexible influenced by qualitative data. So for those using both qualitative and quantitative data, there come “multi-strategy designs” (Robson, 2011, p. 6). Here by saying “multi-strategy”, which has “substantial collection of both qualitative and quantitative data in different phases or aspects of the same project” (Robson, 2011, p. 6), I do not mean that it contradicts the qualitative research method.
It means a research design of combining qualitative and quantitative elements when conducting the qualitative research method. In a narrow sense, the method used in this article should not be called as “multi-strategy” because the qualitative elements account for a larger proportion. However, the researchers take advantages of using both elements. For example, though “there is tendency for people to over-choose the middle option” (Thomas, 2011, p. 178), the quantitative approach of “five-point Likert scale” (Palethorpe & Wilson, 2011, p. 29) does help the researchers from the trouble of getting specific data from the abstract description. And for the analysis, evaluation and interpretation of data and sample, this paper uses “descriptive statistics (methods used to summarize or describe our observations)” (Rowntree, 2000, p. 19) to summarize the sample of research and indicates that future study is needed for “inferential statistics”, which “is concerned with generalizing from a sample, to make estimates and inferences about a wider population” (Rowntree, 2000, p. 1). By using “opportunistic purposive sampling”, the researchers regarded respondents as representatives of “a diverse group of trainers from across the UK with male and female trainers aged between 26-55 years” (Palethorpe & Wilson, 2011, p. 428), one might hold the opinion that using “mechanical methods” (Rowntree, 2000, p. 24) of selecting randomly is a safe way to make a unbiased representative sample, however, “it is conceivable that you could use random methods and still end up with a biased sample” (Rowntree, 2000, p. 25).
So considering the rich experience of the researchers, the “opportunistic purposive sampling” is a better choice to avoid the less representativeness of random sampling. Weaknesses However, there are some reservations. Firstly, when analyzing the effectiveness of different strategies, it seems that the researchers have not thought about “control variable”. According to David and Sutton, “control variable” means “a variable that influences the relationship between the independent and dependent variables” (David & Sutton, 2011, p. 11). Though it is a term in mathematical notation, I would suggest using it and adopting control groups in each training program. Otherwise the variables such as the difference of trainees, trainers and training environment among different programs might influence the validity of data. Maybe this limitation is hard for researchers to avoid because of the fact that the training is not conducted by the researchers themselves. The data are indirectly collected as comments/feedbacks from different trainers.
Thus to some extent, it is really hard to make sure the validity of data in this research since there are so many variables. Moreover, even after adopting control groups and comparing data from several groups in one particular training program, the validity of data is easily to be influenced by uncontrollable variables. Taking interviews for example, uncontrollable variables could be “characteristics of the interviewers”, “interactions of interviewer/respondent characteristics” and privacy concerns of the respondents (Robson, 2011, p. 241).
Although the researchers have tried to do the best by adopting “semi-structured interview” (Thomas, 2011, p. 164), indicating that “11 respondents were interviewed in a ‘guided’ unstructured format in which participants were allowed a considerable degree of latitude to express their opinions within the interview framework” (Palethorpe & Wilson, 2011, p. 429), they have not excluded the influence of the “framework”. So it is rather difficult for the researchers to ensure the validity of data and to precisely achieve the research purpose.
And another influence about the validity the researchers might not consider well is the representativeness of the sample. Considering that the research mainly focus on “questionnaire-based surveys” (“Internet surveys” and “interview surveys” specifically) (Robson, 2011, p. 240), which ignores “the characteristics of non-respondents” (Robson, 2011, p. 240), it is doubtable to say that “the sample of respondents is representative” (Robson, 2011, p. 240).
Maybe it is more persuasive to say that “our statistical methodology enables us to collect samples that are likely to be as representative as possible” (Rowntree, 2000, p. 23) rather than “the respondents represented a diverse group of trainers from across the UK with male and female trainers aged between 26-55 years” (Palethorpe & Wilson, 2011, p. 428). Conclusion To sum up, this assignment evaluates the strengths and weaknesses of the article under review in the framework of different methodology and methods.
Within the article, by comparing the positive aspects and problematic areas, it is relatively persuasive for the authors to claim their findings. And the contributions they made by putting the theories into practice are highly appreciated since it is a real world research. References: 1. Allison, P. (2012). The source of knowledge: Course introduction [Vedio]. United Kingdom: The University of Edinburgh. 2. Cohen, L. , Manion, L. , & Morrison, K. (2007). Research methods in education. (6th ed. ). London & New York: Routledge. 3.
David, M. , & Sutton, C. D. (2011). Social research: An Introduction. (2nd ed. ). New Delhi: SAGE. 4. Esterberg, K. G. (2002). Qualitative methods in social research. United States: The McGraw-Hill Companies, Inc. 5. Lancy, D. F. (1993). Qualitative research in education: An introduction to the major tradition. New York: Longman. 6. Palethorpe, R. , & Wilson, J. P. (2011). Learning in the panic zone: Strategies for managing learner anxiety. Journal of European Industrial Training, 35(5), 420-438. 7. Perri 6, & Bellamy, C. (2012).
Principles of methodology: Research design in social science. Croydon: SAGE. 8. Robson, C. (2011). Real world research. (3rd ed. ). Cornwall: John Wiley&Sons Ltd. 9. Rowntree, D. (2000). Statistics without tears: An introduction for non-mathematicians. London: Penguin Group. 10. Shon, P. C. H. (2012). How to read journal articles in the social sciences. London: SAGE. 11. Thomas, G. (2011). How to do your research project. London: SAGE. Self Assessment document When you submit your assignment for this course you also need to include a self assessment document.
This is a student version of the mark sheet and must include at least one sentence under each of the headings. Do not suggest a grade for your assignment! POSTGRADUATE ASSIGNMENT SELF ASSESSMENT DOCUMENT Course title: The sources of knowledge Year: 2012 Matriculation number: s1262299 1. Knowledge and Understanding of Concepts [Has the student understood the methodological concepts used (or not) by the authors in the papers? ] Yes, I understand the methodological concepts used by the authors in the paper under review by evaluating it from different perspectives in a balanced view. . Knowledge and Use of the Literature [Has the student shown evidence of reading core and supplementary texts? ] Yes, I have shown evidence of reading core and supplementary texts by citing their opinion. 3. Critical Reflection on Theory and Practice [Has the student explained and critically evaluated the pros and cons of the methodology (theory) and methods (practice) the papers analysed? ] Yes, I have explained and evaluated the pros and cons of the methodology and methods the paper analysed in a balanced view.
And I have tried to judge on the basis of what the authors set out to achieve and consider the space they have, thus not being too critical. 4. Constructing Academic Discourse [Has the student structured the assignment effectively, adopted an appropriately academic style and tone? Spelling? Vocabulary? Grammar? Format? Fluency? ] Yes, I have structured my assignment effectively and adopted an appropriately academic style and tone. I have checked it to make sure of the correctness of the spelling, vocabulary, grammar, format and fluency. All of the above four areas receive equal weighting
