Module 2 – Task 2
|
I declare that:
This assignment is entirely my own work based on my personal study and/or research.
1) Hattie (2003), whose work was influential in the development of the American National Board of Professional Teaching Standards I introduced you to in the previous module, used evidence from interview, observation, transcripts, surveys and artefacts to assess the 16 dimensions that distinguished expert from experienced teachers. The data from these multiple sources was synthesised into a numeric single score on each dimension. DimensionsInter-rater correlation Challenge .87 Classroom climate .88 Deep representations .79 Deep understanding and accomplishment .84 Improvisation .95 Monitor learning and provide Feedback .87 Multidimensional perception .88 Passion .90 Problem solving .83 Respect .81 Sensitivity to context .62 Test Hypotheses .37 Use of knowledge .72 |
2) In Lizzio and Wilson’s (2005) second study, they constructed a questionnaire to investigate “students’ perceptions of learning group functioning” p381. |
3) Lizzio and Wilson (2005) say that “Both factors evidenced high levels of internal consistency. For Factor 1, Cronbach’s α= was .95; for Factor 2, Cronbach’s α= :87.” (p383) |
The next three questions (4, 5 & 6) are based on the following information.
|
4) In order to address the research questions “what approaches to feedback do unit convenors currently use, and what factors shape their decisions about the approach to feedback they employ”, I intend to interview convenors of all units in Education’s postgraduate program. |
5) In order to address the research questions “what forms of feedback do students value, and in what ways do they use it to improve their learning” I want to interview a sample of students from the Department’s Master’s programs. |
6) In order to address the question of “what students think about the quality of feedback they receive in each unit” I want to send a questionnaire to all students in every unit in the Department’s Postgraduate programs. I need your help in designing a section of this questionnaire, and I want this section to be based entirely on numeric rating scale items.
Rae, A., M. & Cochrane, D., K. (2008). Listening to students: How to make written assessment feedback useful. Active Learning in Higher Education, 9, pp.217-230. |
7) Stipek and Byler (2004) argue that |
8) A group of researchers are interested in examining the attitudes of Early Childhood teachers to the Early Years Learning Framework. |
9) Name the form of sampling Lizzio and Wilson (2005) employ in their study 2 (NB don’t forget to tell me the reasons for your choice). What are the advantages and disadvantages of this form of sampling? |
10) Describe the difference between internal validity and external validity as applied to quantitative research. |
11) Qualitative researchers have a different conception of "validity" than that which is typically applied to quantitative research. Outline the major concepts relating to the "validity" of a qualitative study and briefly discuss the strategies used to maximise it. |
Question | Learning outcome | 4th Edition | 5th Edition | 6th Edition |
1 | Understands that reliability is a necessary but not sufficient characteristic of a good quantitative measurement and can identify and explain the different means of assessing it [K6.1]. | Ch 6 pp 138-143 | Ch 7;165-172 | Ch 7; pp 163-170 Identifying a good test or assessment procedure. |
2 | Understands that measurement validity is a necessary but not sufficient characteristic of a good quantitative measurement and can identify and explain the different means of assessing it [K6.2]. | Ch 6 pp 143-149 | Ch 7; 165-166, 172-177 | Ch 7; pp 170-176 Validity |
3 | Understands that reliability is a necessary but not sufficient characteristic of a good quantitative measurement and can identify and explain the different means of assessing it [K6.1]. | Ch 6 pp 138-143 | Ch 7;165-172 | Ch 7; pp 163-170 Identifying a good test or assessment procedure. |
4 | Understands the characteristics, strengths and weaknesses of the various types of qualitative interview techniques [K5.3]. | Ch 8; 202-204 | Ch 9; 233-234 | Ch 9; pp 235-238 Qualitative interviews |
5 | Understands the characteristics of the various types of sampling techniques used in qualitative research paradigms and the contexts, purposes and research questions for which they are appropriate [K4.3]. | Ch 9; 235-239 | Ch 10; 269-255 | Ch 10; pp 272-275 Sampling in qualitative research |
6 | Can employ the principles of questionnaire construction to construct an instrument consisting of summated rating scales [K5.1]. | Ch 7 pp 161-192 | Ch 8; 190-222 | Ch 8; pp 189-218 How to construct a questionnaire |
7 | Understands the general purpose of observational methods, their strengths and weaknesses and how they can be used to complement self-report techniques [K5.4]. | Ch 8, pp 206-208 | Ch 9; 236-241 | Ch 9; pp 240-243 Observation |
8 | Understands the characteristics of the various types of probability sampling techniques used in quantitative research paradigms, their strengths and weaknesses and the purposes for which they are chosen [K4.1]. | Ch 9 pp 219-229 | Ch10; 251-265 | Ch10; pp 255-267 Random sampling techniques |
9 | Understands the characteristics of the various types of non-random sampling techniques, their pitfalls and reasons why they are often chosen by researchers [K4.2]. | Ch 9 pp 230-232 | Ch 10; 263-265 | Ch 10; pp 267-269 Nonrandom sampling techniques |
10 | Understands the concepts of the internal and the external validity of a quantitative study and can explain the difference between them [K6.3]. | Ch 10 pp247-260 | Ch11; 281-295 | Ch11; pp 285-296 Internal validity External validity |
11 | Understands that qualitative researchers have a different understanding of the concept of validity and can outline the strategies used to maximise it [K6.4]. | Ch 10 pp264-273 | Ch 11; 299-308 | Ch 11; pp 298-306 Research validity in qualitative research |
Module 2 – Task 2 answer
|
I declare that
Question 1 |
Inter-rater correlation is gathered from the classroom, which helped the researcher to understand the viewpoint of the students. Trained observers are appointed for collection of data and they visited classrooms. Collected data are recorded in the database, which helped the researcher for further analysis. Transcripts of the lesson are collected and detailed observations are done for the selected students. The interview process took place for teachers and student for better analysis of data. Scores are evaluated through independent tasks and the reliability of mean inter-rater is 0.79 (Hattie, 2003). It can be seen that these correlations form relatable data and the researcher can gather information on this collected data. This process signifies consistency level in collected data and the higher it is, the higher the chances of consistency. Observations are done and this finds the reliability level. From the observed lesson, it was coded on the deep and surface level. Benchmarking was done to understand the level of common understanding and consistency (Hattie, 2003). Therefore, it can be seen from the research that the reliability of these data is high. |
Question 2 |
The researcher has prepared questionnaires which helps in the survey process. This questionnaire is done in order to prepare and evaluate the learning outcomes. As per the research of Lizzio & Wilson (2005), set of questionnaires are based on first and second-year students. This method is applied in the first study and the answer is obtained from the students. This has helped the research to reach a conclusion and specific responses are gathered. In the second study the researcher has used and collected responses from students and factor analysis are done (Lizzio & Wilson, 2005). These two methods of measurement suggest that the researcher has adopted two methods, which are best suitable. Factor analysis helps to understand the related elements, which affect the mentality of the students. Understanding the factors that are responsible for moulding perspective is very important. The research may have used interviews process that can help to understand the perspective of the students. This method also emphasises the perspective of the students and this can increase the reliability of data. |
Question 3 |
Cronbach's alpha is a type of reliability test which is used to measure the internal consistency of the factors. It is measured on the expected correlation and provides information on internal consistency. The thumb rule of the process is if the result of the test of Cronbach's alpha is more than 0.07 then it is reliable. If the results of the test are lower than 0.60 then the reliability of the tests reduces to a significant level. In the first factor, the Cronbach's alphas are 0.95, which means there is the existence of a high level of consistency. The research has used this reliability test to increase the factor's consistency level. In the second factor, the Cronbach's alpha is 0.87, which means there is also a high level of internal consistency exists. This means both the factors are reliable in nature and it can help the researcher to understand the potential of data. All the time of gather statistical data it is very important to maintain internal consistency to make the data reliable. Therefore, it can be seen it is very important while interpreting statistical data. |
Question 4 |
Open-ended interviews can be done to understand the perspective of the students. This way the students can respond to the questions more prominently and share their views. In order to know the perspective of the students to understand their take on feedback, it is important to hear their views (Rae & Cochrane, 2008). Students can talk freely in the open-ended interview process rather than close-ended questions. In close-ended questions, options are given which restricts the actual response of the students. However, the open-ended question can help the students to share their views and perspective on specific items. It is important to be careful while conducting the research as a selection of interview questions is very important. It can be seen that many students do not use feedback to improve their performance. Very fewer students use feedback to improve their overall performance. In order to explore this complex process, proper selection of the interview method is needed. |
Question 5 |
In order to understand the perspective of students regarding usage of feedbacks to improve their performance sampling strategies have to be applied (Jonsson, 2013). In this case, probability sampling can help the researcher in this qualitative study. This sampling strategy helps the process of collection of data. Probability sampling includes choosing students on a random basis. This can help the researcher to gather views of the random students and analyse the same. Simple random sampling is a part of the probability sampling process and this can help the researcher to collect samples from students. Many types of sampling strategies are available but simple random sampling is best suitable in this research. This sampling strategy also helps the researcher to make less error and data collection process becomes easy. Out of stratified random sampling, systematic and cluster sampling, simple random sampling is the best method, which is less time consuming and easy. Therefore, it is advised to the researcher to use this simple random sampling in the data collection process. |
Question 6 | ||
a) Gathering feedback is very important for the researcher in order to understand the views and perspective of the participants. Quality of feedback can be accessed through the usage of scale. This can help to rate the quality of feedbacks and helps the researcher to understand research results. Construction of the questionnaire helps the researcher to understand the perspective of the participants. Through this interview process, their perspective can become clearer. This process of conducting research increases the validity of the instruments. | ||
b) List the questions (stem, scale, and anchors, etc) but please don’t format them, i.e. no tabs between – “1(strongly agree) 2, 3, 4, 5(strongly disagree)” is fine. | ||
# | Stem | Scale/Anchors |
1 | What form of feedback should be used? | Strongly agree |
2 | How to improve learning process? | Agree |
3 | What is quality feedback ? | Agree |
c) Engaging in the research process helps the researcher to make the data more reliable. The numerical scale helps to gather information and the quality of the feedbacks are assessed. Quality feedback helps the researcher to increase the reliability and validity of the research results. |
Question 7 |
Qualitative observational measurements are used in the research, which is helping the research to understand specific approaches. Validated questions need to be answered in order to develop this perspective. Different studies have examined the effect of instructional strategies. These stages help to understand the full concept of skills. Reading and experimental skill of the students are examined in this process which helps to understand the skill concept. As per the view of Stipek & Byler (2004), children aged from 4-7 years need to develop the skills of reading and mathematical skills. Management practices and social management helps to understand the perspective and concept of this skill. The sound relationship needs to be established which can improve the process of skill enhancement. Most of the times it is realised that teacher uses repetition and practice strategy to improve the skills among children. It is important to focus on the instructional process and evaluate the strategies accordingly. Open-ended conversation can help to understand the perspective of the student and helps to develop in primary skills. |
Question 8 |
The researcher believes that in order to implement strategies the perspective of the teachers needs to be understood. It is important to understand the attitude of the teachers and understand their views. Principles and practices followed by the teachers need to be assessed in order to amp their effectiveness. The framework of this practice gives guidance to the researcher and this helps in gaining academic views. In order to understand the perspective of the teachers the researcher has planned to conduct research based on the teachers. This includes teachers from the various backgrounds and helps in gathering appropriate information. This is done via data collection and sampling techniques are applied in this context. The procedure of optimal sampling helps the research to understand and gather information based on teachers. Different centres of childcare can give information about early childhood teachers. This helps the researcher to understand the views and perspective of teachers. |
Question 9 |
The researchers have used the questionnaire form while conducting the second study. Questionnaires have been used for the first and second year’s students, which help the research to obtain their perspective (Lizzio & Wilson, 2005). Simple random sampling has been used in this research, which has helped the researcher to gather information from a various number of students. Advantages and disadvantages of the sampling method have been discussed below- Advantages
|
Question 10 |
A difference exists between internal and external validity in terms of quantitative research. Internal validity refers to the results and it is based on attribute variable and independent variable. This process does not require any rival explanation, which helps the research to understand the internal validity of the research. This quality of research design helps the researcher to understand the results in a clearer way. However, the external validity process offers the extension that research results can be generalised from the original copy. This helps the researcher to understand the generalised structure, which is followed in the research paper and does the research accordingly. This technique is s generalised technique of observation and helps the research to obtain specific results. The threat, which is included in external and internal validity, is that the researcher tends to find out the cause and effect relationship among variables. Therefore, these methods help the research to understand the perspective of data validity and maintain consistency. |
Question 11 |
Qualitative research is interpretive and subjective in nature. Findings from qualitative research are that the research results are more likely to gain validation. It is very important for the researcher to increase the validity and reliability of the research so it can be used further. Validity mainly refers to the process of correctness and accuracy of the findings. This helps the research outcome to be more robust in nature and the researcher can convince other people about validity. In order to increase the validity of the research results, the research needs to increase the trustworthiness of data. Crosschecking sources and information may help to increase the validity process. The validity of data helps the research to understand the correctness of data by evaluation results. Overall research purpose can be gained through increase in validity of data. |