Craig 'N' Dave LTD

    Appendix B – Explanation of Engine and Mappers

    Follow

     

     

     

    Fundamental to Assessment Expert is the concept of its underlying Analytics Engine and Course Types.

    We recognise that within any single institution there is likely to be variety of assessment models depending on the Key Stage or course Students are undertaking.  Assessment Expert allows you huge amounts of flexibility in how judgements you capture against Criteria are both analysed and presented.

    This section will explain the difference between an Analytics Engines and a Course Type and will explain the various ones available and when you can set them.

    Currently any Teacher can set the institution wide Analytics Engine.

    Access the admin settings by choosing “System Management” from the top right corner, it drops down from the person portrait as shown here:

    Once selected they will be taken to the System Management page:

    From here you should choose “Configure Institution”.

     

    This will bring up the Configure Institution screen.

     

    Here you can choose your institution wide Analytics Engine and also the Grade Heading.

    Analytics Engines will be described below under section B.1

    The Grade Heading currently has two options “Grade” or “Level”.  This is the language which will be used and displayed throughout the system, for example, on data entry screens or analysis screens and Analytics.

    You can also change the Analytics Engines at a Course level through Course Builder.

    Note any changes you make here will override your institution wide settings.

    B.1 Analytics Engine

    The analytics engine is the piece of software which interprets all of the assessment judgements you make against Criteria and comes up with the end of Module grades and Current grades seen throughout the Assessment Expert system.

    There are currently two Analytics Engines available:

    • Default
    • A80

    For most institutions we anticipate the Default Analytics Engine will be adequate for calculating Student’s achievement.

    Note: If your institution has a fundamentally different method it uses to calculate achievement we will be happy to create you your own custom Analytics Engine to match your exact requirements.  This comes at an additional one off cost.  Please contact us for more information.

    Default

    This engine takes the best 30 assessment judgements a Student has achieved. The analytics works off the best 30 assessments only when calculating a grade as it assumes we want to assess the best of what a Student is able to demonstrate and understand not the worst.  In addition the philosophy of this engine is that that we want to base our calculated judgements on the best of what Students can do, not simply provide you with a life time average view.

    It then counts how many of those judgements occur at the various grade / level bands.

    It chooses the band which has the highest number of entries and assigns the Student this as their Current Grade.

    It then looks at the fine grading for all statements within this band and assigns an appropriate fine grading to the Current Grade.

    In the example below the system would calculate a Current Grade of A+.

    This analytics engine is intelligent, in that if a Student has the highest number of judgements in a low band, yet has achieved a lot of judgements across a number of higher bands then it will spot this and award an appropriate adjusted “Current Grade”.

    In the example below the system would calculate a Current Grade of B+.

    A80

    The A80 Analytics Engine (which stands for Achieve 80%) requires Students to achieve at least 80% of the Criteria at secure or better to be awarded that band.

    A Student MUST achieve at least 80% of the Criteria in the lowest band (in this case Emerging) before moving onto the next.  As long as at least 80% of the Criteria in a band have been achieved the engine will then move up to the next band and assess that one.  It will keep going until it finds a band where the 80% threshold has failed to be met.  This is then used to calculate the Current grade for that Student.

    This is shown in the screen shot below:

    B.2 Course Types

    Where the Analytics Engines are actually responsible for interpreting all of the assessment judgements you make against Criteria and calculating grades, the Course Types are the visual labels you chose to use to group your assessment Criteria against.  These will appear throughout the system on screens such as Assessment Entry, Analytics and Heatmaps.

    There are currently eight Course Types available which should cover most assessment models:

    • Traditional Levels (U-Exceptional)
    • Traditional GCSE (U-A*)
    • A80 (Emerging – 9)
    • Sliding Scales (F-A*)
    • Slide Scales (9-1)
    • Standard GCSE (9-1)
    • Standard A Level (A*-E)
    • Standard Voc KS5 (Pass-Dist*)

    For most institutions we anticipate these should cover most assessment models you would need.

    Note: If your institution has a different Course Type it would like us to add to the system then please let us know and we can add it to the system.  This comes at an additional one off cost.  Please contact us for more information.

    Traditional Levels (U-Exceptional)

    This mapper is based on traditional GCSE grades and covers 9 bands as follows:

    Band 9

    Exceptional Progress

    Band 8

    A

    Band 7

    B

    Band 6

    C

    Band 5

    D

    Band 4

    E

    Band 3

    F

    Band 2

    G

    Band 1

    U

     

    Traditional GCSE (U-A*)

    This mapper is based on traditional GCSE grades and covers 9 bands as follows:

    Band 9

    A*

    Band 8

    A

    Band 7

    B

    Band 6

    C

    Band 5

    D

    Band 4

    E

    Band 3

    F

    Band 2

    G

    Band 1

    U

     

    A80 (Emerging - 9)

    NOTE: This mapper is specially designed to work in conjunction with the matching A80 Analytics Engine.  As such if you try using it with the Default engine you will see some unusual results.

     

    This mapper is based on the new GCSE grading system and covers 11 bands as follows:

    Band 11

    9

    Band 10

    8

    Band 9

    7

    Band 8

    6

    Band 7

    5

    Band 6

    4

    Band 5

    3

    Band 4

    2

    Band 3

    1

    Band 2

    Developing

    Band 1

    Emerging

     

    Sliding GCSE Scales (F-A*)

    This mapper uses a sliding scale system based on traditional GCSE grades.  It is designed to span a typical three-year assessment model used at key stage 3 (years 7-9).  The concept here is that Students are working on broadly developing the same set of knowledge and skills during these three years.  However, the Criteria which they achieve in year 7 should not be awarded the same grade if they demonstrated them in year 8 or 9.

    e.g. A Criteria you assess at band 5 using this mapper would award a Grade B for a year 7 Student in Assessment Expert.  The exact same Criteria in the system would award / display as a grade C for a year 8 and a grade D for a year 9.

    This mapper covers 9 bands as follows:

    Band 9

    A* grade of working for a Yr7         ○    A* grade at Yr8      ○    A* grade at Yr9           

    Band 8

    A* grade of working for a Yr7         ○    A* grade at Yr8      ○    A grade at Yr9

    Band 7

    A* grade of working for a Yr7         ○    A grade at Yr8         ○    B grade at Yr9

    Band 6

    A   grade of working for a Yr7         ○    B grade at Yr8         ○    C grade at Yr9

    Band 5

    B   grade of working for a Yr7          ○    C grade at Yr8         ○    D grade at Yr9

    Band 4

    C   grade of working for a Yr7          ○    D grade at Yr8         ○    E grade at Yr9

    Band 3

    D   grade of working for a Yr7         ○    E grade at Yr8          ○    F grade at Yr9

    Band 2

    E   grade of working for a Yr7          ○    F grade at Yr8          ○    U grade at Yr9

    Band 1

    F   grade of working for a Yr7          ○    U grade at Yr8         ○    U grade at Yr9

     

    Sliding Scales (9-1)

    This mapper uses a sliding scale system based on the new GCSE grading system.  It is designed to span a typical three-year assessment model used at key stage 3 (years 7-9).  The concept here is that Students are working on broadly developing the same set of knowledge and skills during these three years.  However, the Criteria which they achieve in year 7 should not be awarded the same grade if they demonstrated them in year 8 or 9.

    e.g. A Criteria you assess at band 5 using this mapper would award a Grade B for a year 7 Student in Assessment Expert.  The exact same Criteria in the system would award / display as a grade C for a year 8 and a grade D for a year 9.

    This mapper covers 12 bands as follows:

    Band 12

    9+ grade of working for a Yr7         ○    9+ grade at Yr8       ○    9 grade at Yr9              

    Band 11

    9+ grade of working for a Yr7         ○    9 grade at Yr8          ○    8 grade at Yr9

    Band 10

    9 grade of working for a Yr7            ○    8 grade at Yr8          ○    7 grade at Yr9

    Band 9

    8 grade of working for a Yr7            ○    7 grade at Yr8          ○    6 grade at Yr9

    Band 8

    7 grade of working for a Yr7            ○    6 grade at Yr8          ○    5 grade at Yr9

    Band 7

    6 grade of working for a Yr7            ○    5 grade at Yr8          ○    4 grade at Yr9

    Band 6

    5 grade of working for a Yr7            ○    4 grade at Yr8          ○    3 grade at Yr9

    Band 5

    4 grade of working for a Yr7            ○    3 grade at Yr8          ○    2 grade at Yr9

    Band 4

    3 grade of working for a Yr7            ○    2 grade at Yr8          ○    1 grade at Yr9

    Band 3

    2 grade of working for a Yr7            ○    1 grade at Yr8          ○    P grade at Yr9

    Band 2

    1   grade of working for a Yr7          ○    P grade at Yr8         ○    U grade at Yr9

    Band 1

    P   grade of working for a Yr7          ○    U grade at Yr8         ○    U grade at Yr9

     

    Standard GCSE (9-1)

    This mapper is based on the new GCSE grading system and covers 9 bands as follows:

    Band 9

    9

    Band 8

    8

    Band 7

    7

    Band 6

    6

    Band 5

    5

    Band 4

    4

    Band 3

    3

    Band 2

    2

    Band 1

    1

     

    Standard A Level (A*-E)

    This mapper is based on traditional A Level grades and covers 6 bands as follows:

    Band 6

    A*

    Band 5

    A

    Band 4

    B

    Band 3

    C

    Band 2

    D

    Band 1

    E

     

    Standard Voc KS5 (Pass-Dist*)

    This mapper is based on the grades used by many vocational courses in England and Wales at KS4 and KS5 and covers 4 bands as follows:

    Band 4

    Distinction*

    Band 3

    Distinction

    Band 2

    Merit

    Band 1

    Pass

    Was this article helpful?
    0 out of 0 found this helpful

    Comments

    Powered by Zendesk