1-12 of 12 results for dept:"National Assessment Agency"
Librarians' tools
- Search time
- 0.235 seconds
- Solr query time
- 0.002 seconds
- Search query
- dept:"National Assessment Agency"
- We searched for
- department_t:"National Assessment Agency" OR department_ses:44605 OR answeringDept_ses:44605
Type
House
Session
Year
Department
Member
Primary member
Answering member
Legislative stage
Legislation
Subject
Publisher
Deposited by
Department for Children, Schools and Families; National Assessment Agency
Type
Deposited papers
Author
Department for Children, Schools and Families; National Assessment Agency
Committed on
9 October 2008
Originated on
24 September 2008
Received on
10 October 2008
Subjects
Assessments; Curriculum; Administrative delays; Qualifications and Curriculum Authority; National curriculum tests; Standards; Schools; National Assessment Agency
Date
9 October 2008
Reference
DEP2008-2346
House
House of Commons
Deposited by
Department for Children, Schools and Families; National Assessment Agency
Type
Deposited papers
Author
Department for Children, Schools and Families; National Assessment Agency
Committed on
21 July 2008
Originated on
21 July 2008
Received on
30 July 2008
Subjects
Assessments; National Assessment Agency
Date
21 July 2008
Reference
DEP2008-2112
House
House of Commons
(3) what steps are being taken to ensure the system for administering Key Stage 2 SATs is fit for purpose for teaching staff and pupils.
(3) what steps are being taken to ensure the system for administering Key Stage 2 SATs is fit for purpose for teaching staff and pupils.
Asked by
Rosie Cooper
(Labour)
Answered by
Lord Knight of Weymouth
(Labour)
Answering body
Department for Children, Schools and Families
Type
Written questions
Status
Answered
Tabled on
18 June 2008
For answer on
20 June 2008
Answered on
24 June 2008
The National Curriculum tests for key stage 2 took place on 12-16 May. The National Assessment Agency (NAA) administers those tests on behalf of the Qualifications and Curriculum Authority. Delivery of the national curriculum tests is always challenging in view of the scale and timing of the task and it is unfortunate that this year's exercise has encountered difficulties. As usual during the test delivery period, we are in regular contact with the NAA and I take a close interest in the progress of test delivery, I have asked David Gee, Managing Director of the NAA, to write to my hon. Friend. A copy of his letter has been placed in the Library.Letter from David Gee, dated 20 June 2008:"The National Assessment Agency is responsible for overseeing the safe delivery of the National Curriculum Tests. The tests at KS2 and KS3 are sat by over 1.1 million pupils.""To remove the risk of error in the marking of pupils work it is important that an accurate record of pupil attendance for each test is recorded. For many years this has been a paper process which given the scale of the tests brings with it inevitable errors that require correcting, For the 2008 test cycle a new contractor ETS was appointed and one of the many improvements they offered was to move the recording of pupil attendance online.""Schools were provided with a copy of the most recent pupil records as collected from school census data and were required to annotate against each pupil which tests were actually sat. Some pupils move schools during the year and so there was the additional facility to edit the records.""A new website provided by ETS delivered this service On the first day of the KS2 test week the website unfortunately suffered technological problems for three hours. While key stage 2 schools had a period of 10 days to submit their entries an estimated 745 schools out of approximately 16,000 were impacted by the website being not available during this time.""Help line service for schools is provided by ETS throughout the test period. During the time of system outage the ETS helpline did experience a high number of calls as schools reported this issue. The volume of calls caused callers to be held in a queue and ETS have acknowledged and apologised for this frustration. Staffing of the helpline has been increased in response to this issue to give greater capacity.""As in previous years the NAA will be conducting a review in to the delivery performance of the tests including consulting with schools, markers and other stakeholders to ensure good practice and necessary improvements are captured and acted upon"
Subjects
Assessments; National curriculum tests
Date
24 June 2008
Reference
478 c276-7W;478 c278W; 213110
House
House of Commons
(2) what steps are being taken to ensure helplines are accessible to schools and teaching staff during the period of Key Stage 2 SATs;
(2) what steps are being taken to ensure helplines are accessible to schools and teaching staff during the period of Key Stage 2 SATs;
Asked by
Rosie Cooper
(Labour)
Answered by
Lord Knight of Weymouth
(Labour)
Answering body
Department for Children, Schools and Families
Type
Written questions
Status
Answered
Tabled on
18 June 2008
For answer on
20 June 2008
Answered on
24 June 2008
The National Curriculum tests for key stage 2 took place on 12-16 May. The National Assessment Agency (NAA) administers those tests on behalf of the Qualifications and Curriculum Authority. Delivery of the national curriculum tests is always challenging in view of the scale and timing of the task and it is unfortunate that this year's exercise has encountered difficulties. As usual during the test delivery period, we are in regular contact with the NAA and I take a close interest in the progress of test delivery, I have asked David Gee, Managing Director of the NAA, to write to my hon. Friend. A copy of his letter has been placed in the Library.Letter from David Gee, dated 20 June 2008:"The National Assessment Agency is responsible for overseeing the safe delivery of the National Curriculum Tests. The tests at KS2 and KS3 are sat by over 1.1 million pupils.""To remove the risk of error in the marking of pupils work it is important that an accurate record of pupil attendance for each test is recorded. For many years this has been a paper process which given the scale of the tests brings with it inevitable errors that require correcting, For the 2008 test cycle a new contractor ETS was appointed and one of the many improvements they offered was to move the recording of pupil attendance online.""Schools were provided with a copy of the most recent pupil records as collected from school census data and were required to annotate against each pupil which tests were actually sat. Some pupils move schools during the year and so there was the additional facility to edit the records.""A new website provided by ETS delivered this service On the first day of the KS2 test week the website unfortunately suffered technological problems for three hours. While key stage 2 schools had a period of 10 days to submit their entries an estimated 745 schools out of approximately 16,000 were impacted by the website being not available during this time.""Help line service for schools is provided by ETS throughout the test period. During the time of system outage the ETS helpline did experience a high number of calls as schools reported this issue. The volume of calls caused callers to be held in a queue and ETS have acknowledged and apologised for this frustration. Staffing of the helpline has been increased in response to this issue to give greater capacity.""As in previous years the NAA will be conducting a review in to the delivery performance of the tests including consulting with schools, markers and other stakeholders to ensure good practice and necessary improvements are captured and acted upon"
Subjects
Assessments; National curriculum tests
Date
24 June 2008
Reference
213109; 478 c276-7W;478 c278W
House
House of Commons
To ask the Secretary of State for Children, Schools and Families (1) what steps are being taken to resolve systemic problems encountered by schools attempting to register Key Stage 2 SAT pupils online;
To ask the Secretary of State for Children, Schools and Families (1) what steps are being taken to resolve systemic problems encountered by schools attempting to register Key Stage 2 SAT pupils online;
Asked by
Rosie Cooper
(Labour)
Answered by
Lord Knight of Weymouth
(Labour)
Answering body
Department for Children, Schools and Families
Type
Written questions
Status
Answered
Tabled on
18 June 2008
For answer on
20 June 2008
Answered on
24 June 2008
The National Curriculum tests for key stage 2 took place on 12-16 May. The National Assessment Agency (NAA) administers those tests on behalf of the Qualifications and Curriculum Authority. Delivery of the national curriculum tests is always challenging in view of the scale and timing of the task and it is unfortunate that this year's exercise has encountered difficulties. As usual during the test delivery period, we are in regular contact with the NAA and I take a close interest in the progress of test delivery, I have asked David Gee, Managing Director of the NAA, to write to my hon. Friend. A copy of his letter has been placed in the Library.Letter from David Gee, dated 20 June 2008:"The National Assessment Agency is responsible for overseeing the safe delivery of the National Curriculum Tests. The tests at KS2 and KS3 are sat by over 1.1 million pupils.""To remove the risk of error in the marking of pupils work it is important that an accurate record of pupil attendance for each test is recorded. For many years this has been a paper process which given the scale of the tests brings with it inevitable errors that require correcting, For the 2008 test cycle a new contractor ETS was appointed and one of the many improvements they offered was to move the recording of pupil attendance online.""Schools were provided with a copy of the most recent pupil records as collected from school census data and were required to annotate against each pupil which tests were actually sat. Some pupils move schools during the year and so there was the additional facility to edit the records.""A new website provided by ETS delivered this service On the first day of the KS2 test week the website unfortunately suffered technological problems for three hours. While key stage 2 schools had a period of 10 days to submit their entries an estimated 745 schools out of approximately 16,000 were impacted by the website being not available during this time.""Help line service for schools is provided by ETS throughout the test period. During the time of system outage the ETS helpline did experience a high number of calls as schools reported this issue. The volume of calls caused callers to be held in a queue and ETS have acknowledged and apologised for this frustration. Staffing of the helpline has been increased in response to this issue to give greater capacity.""As in previous years the NAA will be conducting a review in to the delivery performance of the tests including consulting with schools, markers and other stakeholders to ensure good practice and necessary improvements are captured and acted upon"
Subjects
Assessments; National curriculum tests
Date
24 June 2008
Reference
213108; 478 c276-7W;478 c278W
House
House of Commons
To ask the Secretary of State for Children, Schools and Families if he will make it his policy to compensate markers who have experienced delays in receiving SAT papers and consequently not received payment for work.
To ask the Secretary of State for Children, Schools and Families if he will make it his policy to compensate markers who have experienced delays in receiving SAT papers and consequently not received payment for work.
Asked by
Lindsay Hoyle
(Labour)
Answered by
Lord Knight of Weymouth
(Labour)
Answering body
Department for Children, Schools and Families
Type
Written questions
Status
Answered
Tabled on
6 June 2008
For answer on
10 June 2008
Answered on
11 June 2008
The administration of national curriculum tests is a function of the Qualifications and Curriculum Authority that is delivered independently of Government. The National Assessment Agency (NAA) administers the tests on their behalf. I have therefore asked David Gee, Managing Director of the NAA, to write to the hon. Member. A copy of his letter has been placed in the Library.Letter from David Gee, dated 11 June 2008:"I have been asked to write to you in response to your parliamentary question about payments to markers of national curriculum tests.""As part of the contract for delivering national curriculum tests for key stages 2 and 3, the test operations agency, ETS Europe, is required to arrange for the accurate marking of all test papers. ETS Europe is meeting this requirement by directly contracting individuals to undertake marking work. The contract of employment, which is subject to UK law, is a private matter between individual markers and their employer. As such, any issues relating to the contract of employment, such as compensatory payments, are private matters and not matters of Government policy."
Subjects
Assessments; National curriculum tests
Date
11 June 2008
Reference
477 c370W; 210211
House
House of Commons
To ask the Secretary of State for Children, Schools and Families how many of those who applied to mark Key Stage 3 examinations failed the markers' standardisation test in (a) 2007 and (b) 2008.
To ask the Secretary of State for Children, Schools and Families how many of those who applied to mark Key Stage 3 examinations failed the markers' standardisation test in (a) 2007 and (b) 2008.
Asked by
Lord Gove
(Conservative)
Answered by
Lord Knight of Weymouth
(Labour)
Answering body
Department for Children, Schools and Families
Type
Written questions
Status
Answered
Tabled on
4 June 2008
For answer on
6 June 2008
Answered on
11 June 2008
The administration of national curriculum tests, as part of the process for maintaining standards, is a function of the Qualifications and Curriculum Authority that is delivered independently of Government. The National Assessment Agency (NAA) administers the tests on their behalf. I have therefore asked David Gee, Managing Director of the NAA, to write to the hon. Member. A copy of his letter has been placed in the Library.Letter from David Gee, dated 9 June 2008:"I have been asked to write to you in response to your parliamentary question about the standardisation process for markers of national curriculum tests for key stage 3.""The standardisation quality check has changed in purpose and application from 2007 to 2008. The failure rates quoted below are therefore not comparable.""In 2007, 72 markers out of 9,816 failed the standardisation check. That check was designed to test a marker's consistency in applying the mark scheme and, alongside a sample of live marking, was evaluated by a marking supervisor. The evaluation of the live sample was subject to the variation of individual judgement. These quality measures constituted a major part of the marking quality control process and took place early in the marking period.""In 2008, 81 out of 9,991 failed standardisation. The check this year is designed to test a marker's consistency in applying the mark scheme and to identify where support is needed to improve consistent application of the mark scheme. Markers receive feedback and mentoring support from their supervisors, as necessary, throughout the marking period. In addition this year every marker is subject to similar checks, against a national standard, at regular intervals throughout the marking period."
Subjects
Assessments; National curriculum tests
Date
11 June 2008
Reference
477 c369W; 209823
House
House of Commons
To ask the Secretary of State for Children, Schools and Families what evaluation criteria are applied to those organisations tendering for contracts to administer Key Stage tests; and what assessment his Department had of the extent to which Educational Testing Service met these criteria.
To ask the Secretary of State for Children, Schools and Families what evaluation criteria are applied to those organisations tendering for contracts to administer Key Stage tests; and what assessment his Department had of the extent to which Educational Testing Service met these criteria.
Asked by
Lord Gove
(Conservative)
Answered by
Lord Knight of Weymouth
(Labour)
Answering body
Department for Children, Schools and Families
Type
Written questions
Status
Answered
Tabled on
4 June 2008
For answer on
6 June 2008
Answered on
11 June 2008
The procurement and award of contracts for national curriculum assessment delivery is the responsibility of the Qualifications and Curriculum Authority (QCA). They carry out this function independently of Government. I am satisfied that the QCA carried out their responsibilities in relation to the contract for test delivery services with all due diligence. I have asked David Gee, Managing Director of the National Assessment Agency, to write to the hon. Member. A copy of his letter will be placed in the Library.Letter from David Gee, dated 9 June 2008:"I have been asked to write to you in response to your parliamentary question about the evaluation criteria used in assessing tenders for the national curriculum tests delivery contract.""The evaluation criteria were included in the Invitation to Tender (Section 8), an extract of which is below:""Service Delivery""The supplier's ability to deliver the services to time and quality;""The agreed level of quality and security to which the Service will be delivered (including ensuring quality of marking);""The supplier's capabilities and operation of a programme management, governance regime and relationship management approach;""Efficiency, Impact and Value""Assessment of the impact of burden on schools of implementing the identified solution;""The supplier's proposals for innovative delivery of the Service;""The supplier's proposals for delivering efficiency and ongoing cost reduction; and""Costs (suppliers should note that costs submitted will be evaluated on a line-by-line basis in the response to the pricing model).""Risk and Issue Management""Ability to identify, assume and manage risk (including an outline of the steps the supplier will take to mitigate risk), attitude to risk faking, confidence in managing risk and ability to minimise the commercial impact of risk."
Subjects
Assessments; National curriculum tests
Date
11 June 2008
Reference
477 c368-9W; 209821
House
House of Commons
(2) what due diligence was carried out by his Department in checking the commercial record and reputation of the company Educational Testing Service before the 2007 contract for Key Stage testing was awarded.
(2) what due diligence was carried out by his Department in checking the commercial record and reputation of the company Educational Testing Service before the 2007 contract for Key Stage testing was awarded.
Asked by
Lord Gove
(Conservative)
Answered by
Lord Knight of Weymouth
(Labour)
Answering body
Department for Children, Schools and Families
Type
Written questions
Status
Answered
Tabled on
4 June 2008
For answer on
6 June 2008
Answered on
11 June 2008
The procurement and award of contracts for national curriculum assessment delivery services is the responsibility of the Qualifications and Curriculum Authority (QCA). They carry out this function independently of Government.I am satisfied that they have carried out their responsibilities in relation to the contract with ETS Europe with all due diligence. The QCA Board, on which my Department has an observer, received the report on the conduct of the procurement for this contract which has successfully passed Office for Government Commerce (OGC) scrutiny. I have asked David Gee, managing director of the National Assessment Agency, to write to the hon. Member setting out the checks that were made. A copy will be placed in the Library.Letter from David Gee, dated 9 June 2008:"I have been asked to write to you in response to your parliamentary questions about the due diligence carried out by the QCA prior to the Board's decision to select ETS Europe as our delivery partner for national curriculum assessment.""An independent expert consultancy conducted a complete and thorough financial due diligence exercise on Education Testing Services. Their recommendation was that ETS was in a fit and proper financial state to be awarded the contract.""All tenderers were required to identify referees. These referees were approached independently for an in-depth interview covering key aspects of the tenderer's record of delivery and reputation. The QCA's examination of ETS's referees gave us full confidence in appointing ETS as our delivery partner for national curriculum assessment services."
Subjects
National curriculum tests; Educational Testing Service
Date
11 June 2008
Reference
477 c371-2W; 209826
House
House of Commons
To ask the Secretary of State for Children, Schools and Families (1) what due diligence was carried out by the Qualifications and Curriculum Authority regarding the commercial record and reputation of the company Educational Testing Service before the 2007 contract for standard assessment tests was agreed;
To ask the Secretary of State for Children, Schools and Families (1) what due diligence was carried out by the Qualifications and Curriculum Authority regarding the commercial record and reputation of the company Educational Testing Service before the 2007 contract for standard assessment tests was agreed;
Asked by
Lord Gove
(Conservative)
Answered by
Lord Knight of Weymouth
(Labour)
Answering body
Department for Children, Schools and Families
Type
Written questions
Status
Answered
Tabled on
4 June 2008
For answer on
6 June 2008
Answered on
11 June 2008
The procurement and award of contracts for national curriculum assessment delivery services is the responsibility of the Qualifications and Curriculum Authority (QCA). They carry out this function independently of Government.I am satisfied that they have carried out their responsibilities in relation to the contract with ETS Europe with all due diligence. The QCA Board, on which my Department has an observer, received the report on the conduct of the procurement for this contract which has successfully passed Office for Government Commerce (OGC) scrutiny. I have asked David Gee, managing director of the National Assessment Agency, to write to the hon. Member setting out the checks that were made. A copy will be placed in the Library.Letter from David Gee, dated 9 June 2008:"I have been asked to write to you in response to your parliamentary questions about the due diligence carried out by the QCA prior to the Board's decision to select ETS Europe as our delivery partner for national curriculum assessment.""An independent expert consultancy conducted a complete and thorough financial due diligence exercise on Education Testing Services. Their recommendation was that ETS was in a fit and proper financial state to be awarded the contract.""All tenderers were required to identify referees. These referees were approached independently for an in-depth interview covering key aspects of the tenderer's record of delivery and reputation. The QCA's examination of ETS's referees gave us full confidence in appointing ETS as our delivery partner for national curriculum assessment services."
Subjects
National curriculum tests; Educational Testing Service
Date
11 June 2008
Reference
477 c371-2W; 209819
House
House of Commons
To ask the Secretary of State for Children, Schools and Families (1) what margin of error was permitted by markers passing the standardisation test to mark (a) Key Stage 2 and (b) Key Stage 3 national tests in (i) science, (ii) mathematics and (iii) English in each year since 2005;...
To ask the Secretary of State for Children, Schools and Families (1) what margin of error was permitted by markers passing the standardisation test to mark (a) Key Stage 2 and (b) Key Stage 3 national tests in (i) science, (ii) mathematics and (iii) English in each year since 2005;...
Asked by
David Laws
(Liberal Democrat)
Answered by
Lord Knight of Weymouth
(Labour)
Answering body
Department for Children, Schools and Families
Type
Written questions
Status
Answered
Tabled on
21 May 2008
For answer on
2 June 2008
Answered on
5 June 2008
The National Assessment Agency (NAA) is responsible for the standardisation of markers for National Curriculum tests. I have therefore asked David Gee, Managing Director, NAA, to write to you in response to your questions. A copy of his letter has been placed in the Library.Letter from David Gee, dated 29 May 2008:"Further to your two parliamentary questions to the Secretary of State the National Assessment Agency (NAA) has been asked to place this letter in the House of Commons library as a formal response.""Marker Standardisation & Mentoring""The process for the standardisation of markers for National Curriculum Tests has changed in 2008 and therefore there are differences in the way the margin of errors are recorded for the period from 2005 - 2007 and 2008. These are defined in the table enclosed.""From 2005 - 2007 standardisation and the first sample, submitted at the same time, were the main method for detecting markers who were unable to consistently apply the mark scheme. The second sample, two-thirds of the way through the process, was a final check, but it was rare for a marker to be stopped at this stage. This manual process involved supervising markers checking the marking of those in their team and was very dependent on the individual consistency of the team leaders.""From 2008, the introduction of the online standardisation and benchmarking processes means that monitoring of markers has become an ongoing process and poor marking can be identified and corrected at several stages throughout the marking activity. The procedures have been designed to detect those markers that are unable to consistently apply the mark scheme and stop them. It also allows team leaders to identify where markers may require mentoring support to improve their marking to ensure that all markers consistently apply the mark scheme.""The online system for standardisation and benchmarking allows ETS, the test delivery agency, to monitor all markers against an agreed national standard set of scripts at all points in the process; monitoring both marking quality, through benchmarking, and marking progress on a daily basis. This will highlight were additional support may be necessary.""Team leaders should provide feedback on the standardisation papers completed to all markers in their team. Any markers who failed their first attempt at standardisation will receive mentoring ""before a second attempt is made. For those markers who have passed standardisation, feedback should take place either before marking starts or very early in the process. Higher priority is given to those markers who have only just managed to pass standardisation. If after mentoring, a marker fails the second attempt at standardisation or benchmarking, the marker is stopped and removed from marking.""If you are interested further I would be delighted to meet with you once this years tests are completed to give you a full briefing on the work of the NAA in all areas of assessment and school support.""Please contact my office if you would like to arrange this."
| Standardisation and Sampling Metrics 2005 to 2007¹ | ||||
|---|---|---|---|---|
| 2005 to 2007¹ | ||||
| Absolute mark difference allowed | ||||
| Key stage | Subject | Number of scripts in sample | Discretional second sample | Compulsory second sample |
| 2 | English reading | 10 | 6-7 | 8+ |
| English writing | 10 | 13-22 | 23+ | |
| Mathematics | 10 | 16-19 | 20+ | |
| Science | 10 | 11-23 | 24+ | |
| 3 | English reading | 10 | 13-22 | 23+ |
| English writing | 10 | 24-33 | 34+ | |
| Mathematics | 10 | 10-19 | 20+ | |
| Science | 10 | 19-30 | 31+ | |
| ¹ Data derived from 2007 NCT Policy Document. |
| Standardisation and benchmarking metrics 2008 | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| 2008 Standardisation | 2008 Benchmarking (current 27 May) and may be subject to further tightening. Benchmarking is conducted typically every 90 scripts | ||||||||
| Key Stage | Subject | Number of scripts in sample | Percentage exact agreement | Percentage adjacent | Percentage discrepant | Number of scripts in sample | Percentage exact agreement | Percentage adjacent | Percentage discrepant |
| 2 | English | 5 reading and 10 writing | 80 | 20 | 6 | 90 | 10 | ||
| Mathematics | 5 | 90 | 0 | 10 | 4 | 97 | 0 | 3 | |
| Science | 5 | 90 | 0 | 10 | 4 | 95 | 0 | 5 | |
| 3 | English reading | 10 | 80 | 20 | 6 | 85 | 15 | ||
| English writing | 10 | 80 | 20 | 6 | 90 | 10 | |||
| Mathematics | 6 | 90 | 0 | 10 | 4 | 97 | 0 | 3 | |
| Science | 6 | 90 | 0 | 10 | 4 | 93 | 0 | 7 |
Subjects
Assessments; National curriculum tests
Date
5 June 2008
Reference
476 c1158-60W; 207868
House
House of Commons
(2) what requirement there is to provide feedback to markers from their standardisation tests before marking papers; and if he will make a statement.
(2) what requirement there is to provide feedback to markers from their standardisation tests before marking papers; and if he will make a statement.
Asked by
David Laws
(Liberal Democrat)
Answered by
Lord Knight of Weymouth
(Labour)
Answering body
Department for Children, Schools and Families
Type
Written questions
Status
Answered
Tabled on
21 May 2008
For answer on
2 June 2008
Answered on
5 June 2008
The National Assessment Agency (NAA) is responsible for the standardisation of markers for National Curriculum tests. I have therefore asked David Gee, Managing Director, NAA, to write to you in response to your questions. A copy of his letter has been placed in the Library.Letter from David Gee, dated 29 May 2008:"Further to your two parliamentary questions to the Secretary of State the National Assessment Agency (NAA) has been asked to place this letter in the House of Commons library as a formal response.""Marker Standardisation & Mentoring""The process for the standardisation of markers for National Curriculum Tests has changed in 2008 and therefore there are differences in the way the margin of errors are recorded for the period from 2005 - 2007 and 2008. These are defined in the table enclosed.""From 2005 - 2007 standardisation and the first sample, submitted at the same time, were the main method for detecting markers who were unable to consistently apply the mark scheme. The second sample, two-thirds of the way through the process, was a final check, but it was rare for a marker to be stopped at this stage. This manual process involved supervising markers checking the marking of those in their team and was very dependent on the individual consistency of the team leaders.""From 2008, the introduction of the online standardisation and benchmarking processes means that monitoring of markers has become an ongoing process and poor marking can be identified and corrected at several stages throughout the marking activity. The procedures have been designed to detect those markers that are unable to consistently apply the mark scheme and stop them. It also allows team leaders to identify where markers may require mentoring support to improve their marking to ensure that all markers consistently apply the mark scheme.""The online system for standardisation and benchmarking allows ETS, the test delivery agency, to monitor all markers against an agreed national standard set of scripts at all points in the process; monitoring both marking quality, through benchmarking, and marking progress on a daily basis. This will highlight were additional support may be necessary.""Team leaders should provide feedback on the standardisation papers completed to all markers in their team. Any markers who failed their first attempt at standardisation will receive mentoring ""before a second attempt is made. For those markers who have passed standardisation, feedback should take place either before marking starts or very early in the process. Higher priority is given to those markers who have only just managed to pass standardisation. If after mentoring, a marker fails the second attempt at standardisation or benchmarking, the marker is stopped and removed from marking.""If you are interested further I would be delighted to meet with you once this years tests are completed to give you a full briefing on the work of the NAA in all areas of assessment and school support.""Please contact my office if you would like to arrange this."
| Standardisation and Sampling Metrics 2005 to 2007¹ | ||||
|---|---|---|---|---|
| 2005 to 2007¹ | ||||
| Absolute mark difference allowed | ||||
| Key stage | Subject | Number of scripts in sample | Discretional second sample | Compulsory second sample |
| 2 | English reading | 10 | 6-7 | 8+ |
| English writing | 10 | 13-22 | 23+ | |
| Mathematics | 10 | 16-19 | 20+ | |
| Science | 10 | 11-23 | 24+ | |
| 3 | English reading | 10 | 13-22 | 23+ |
| English writing | 10 | 24-33 | 34+ | |
| Mathematics | 10 | 10-19 | 20+ | |
| Science | 10 | 19-30 | 31+ | |
| ¹ Data derived from 2007 NCT Policy Document. |
| Standardisation and benchmarking metrics 2008 | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| 2008 Standardisation | 2008 Benchmarking (current 27 May) and may be subject to further tightening. Benchmarking is conducted typically every 90 scripts | ||||||||
| Key Stage | Subject | Number of scripts in sample | Percentage exact agreement | Percentage adjacent | Percentage discrepant | Number of scripts in sample | Percentage exact agreement | Percentage adjacent | Percentage discrepant |
| 2 | English | 5 reading and 10 writing | 80 | 20 | 6 | 90 | 10 | ||
| Mathematics | 5 | 90 | 0 | 10 | 4 | 97 | 0 | 3 | |
| Science | 5 | 90 | 0 | 10 | 4 | 95 | 0 | 5 | |
| 3 | English reading | 10 | 80 | 20 | 6 | 85 | 15 | ||
| English writing | 10 | 80 | 20 | 6 | 90 | 10 | |||
| Mathematics | 6 | 90 | 0 | 10 | 4 | 97 | 0 | 3 | |
| Science | 6 | 90 | 0 | 10 | 4 | 93 | 0 | 7 |
Subjects
Assessments; National curriculum tests
Date
5 June 2008
Reference
476 c1158-60W; 207869
House
House of Commons