VET Quality Framework audit report Business Success Group ... report - ICA11 - FINAL.pdfICA40311 Certificate IV in Web-Based Technologies ICA40411 Certificate IV in Information Technology

Audit report - Continuing VET standards_v1.4_18-06-2012 Uncontrolled when printed 1

VET Quality Framework audit report Business Success Group Pty Ltd – Initial audit ICA11 Information and Communications Technology Training Package

AUDIT DETAILS

Date/s of site visit/s 21-23 August 2012

Site/s visited Bowen Hills

Standards audited Essential Standards for Continuing Registration 15.2, 15.3, 15.4, 15.5, 16.3, 16.4

FOCUS OF AUDIT

Code Qualification / Accredited course name Mode(s) of delivery &/or assessment

ICA20111 Certificate II in Information, Digital Media and Technology

Blended online and workplace delivery and assessment

ICA30105 Certificate III in Information Technology

ICA30111 Certificate III in Information, Digital Media and Technology

ICA40111 Certificate IV in Information Technology

ICA40211 Certificate IV in Information Technology Support

ICA40311 Certificate IV in Web-Based Technologies

ICA40411 Certificate IV in Information Technology Networking

ICA40811 Certificate IV in Digital Media Technologies

ICA41011 Certificate IV in Computer Systems Technology

ICA50111 Diploma of Information Technology

ICA50511 Diploma of Database Design and Development

ICA50611 Diploma of Website Development

ICA50911 Diploma of Digital Media Technologies

INTERVIEWEES

Staff (name and position)

Name Position Program (qualification, course, etc)

Ms Belinda Cunningham Training Manager N/A

AUDIT SUMMARY OF VET QUALITY FRAMEWORK REQUIREMENTS

VET QUALITY FRAMEWORK COMPONENT STATUS*

Standards for NVR Registered Training Organisations 2011 - Essential Standards for Continuing Registration

15 The NVR registered training organisation provides quality training and assessment across all of its operations

C NC NA

16 The NVR registered training organisation adheres to principles of access and equity and maximises outcome for its clients

C NC NA

*STATUS: Status of audit findings when audit was conducted C = Compliant NC = Not Compliant NA = Not audited


Audit Findings

At the time of audit, the organisation withdrew the following qualifications from its scope of registration:

ICA10105 Certificate I in Information Technology

ICA10111 Certificate I in Information Technology

ICA20105 Certificate II in Information Technology

ICA40105 Certificate IV in Information Technology (General)

ICA40205 Certificate IV in Information Technology (Support)

ICA40405 Certificate IV in Information Technology (Networking)

ICA40805 Certificate IV in Information Technology (Multimedia)

ICA50105 Diploma of Information Technology (General) Consequently, these were removed from the focus of the audit. ICA20111 Certificate II in Information, Digital Media and Technology ICA30105 Certificate III in Information Technology ICA30111 Certificate III in Information, Digital Media and Technology The organisation provided evidence to support it has access to training resources that meet the requirements of the training package for the above listed qualifications. For these qualifications, the organisation also provided evidence to confirm it has mechanisms in place to engage employers and other relevant parties in the development, delivery and monitoring of training and assessment. These mechanisms included a detailed supervisor’s report and training plan which required endorsement from the employer or direct supervisor. ICA30105 Certificate III in Information Technology ICAICT409A Develop macros and templates for clients using standard products For the above listed unit, the organisation provided evidence to demonstrate its assessment tools and processes meet the requirements of the Standards.

Application submitted 13 September 2012: The application for amendment to scope was to remove the following qualifications relevant to the audit scope within this audit report:

ICA40111 Certificate IV in Information Technology

ICA40311 Certificate IV in Web-Based Technologies

ICA40411 Certificate IV in Information Technology Networking

ICA41011 Certificate IV in Computer Systems Technology

ICA50111 Diploma of Information Technology

ICA50511 Diploma of Database Design and Development

ICA50611 Diploma of Website Development. Relevant qualifications within the non-compliance reporting will be notated with an asterix. Where an * (asterix) is noted against a qualification, rectification will not be required.

SNR 15 The NVR registered training organisation provides quality training and assessment across all of its operations

STRATEGIES ICA20111 Certificate II in Information, Digital Media and Technology ICA30105 Certificate III in Information Technology ICA30111 Certificate III in Information, Digital Media and Technology ICA40111 Certificate IV in Information Technology* ICA40211 Certificate IV in Information Technology Support ICA40311 Certificate IV in Web-Based Technologies* ICA40411 Certificate IV in Information Technology Networking* ICA40811 Certificate IV in Digital Media Technologies ICA41011 Certificate IV in Computer Systems Technology* ICA50111 Diploma of Information Technology* ICA50511 Diploma of Database Design and Development* ICA50611 Diploma of Website Development* ICA50911 Diploma of Digital Media Technologies Letters of support and an overarching and generic statement within the strategies for training and assessment were


provided as evidence of industry consultation. This evidence did not demonstrate that the strategies for training and assessment had been developed through effective consultation with industry. Discussions with the organisation indicated significant engagement with industry has occurred and is ongoing; however, at that time, no further evidence was available to confirm this advice. In addition, the organisation was not able to articulate how the engagement with industry had informed the actual development of, or improvement to, the strategies provided. ICA20111 Certificate II in Information, Digital Media and Technology The evidence gathering techniques identified in the strategy documentation did not align to the assessment tools provided at audit. ICA30105 Certificate III in Information Technology The strategy document provided did not list the most current versions of the units as listed on training.gov.au. In addition, the units listed in the strategy did not align to the units identified in the organisation’s course information on its website. The strategy identified entry requirements that listed pre-requisite units. The qualification’s packing rules have specific entry requirements which are quite distinct from the pre-requisite unit requirements at the unit level. The information in the strategy did not clearly distinguish these two as separate requirements. ICA30111 Certificate III in Information, Digital Media and Technology Packaging information relevant to the number of required electives did not meet the qualification packaging rules. The evidence gathering techniques identified in the strategy documentation did not align to the assessment tools provided at audit. In addition, the units listed in the strategy did not align to the units identified in the organisation’s course information on its website. ICA40111 Certificate IV in Information Technology* ICA40211 Certificate IV in Information Technology Support ICA40311 Certificate IV in Web-Based Technologies* ICA40411 Certificate IV in Information Technology Networking* ICA40811 Certificate IV in Digital Media Technologies ICA41011 Certificate IV in Computer Systems Technology* ICA50111 Diploma of Information Technology* ICA50511 Diploma of Database Design and Development* ICA50611 Diploma of Website Development* ICA50911 Diploma of Digital Media Technologies The organisation’s training and assessment strategy documentation included Unit Evidence Sheets for each unit listed in the overarching strategy document for all other qualifications analysed at audit. These sheets formed an integral part of the strategy documentation outlining, the specific training resources to be used, the evidence gathering techniques to be applied and the clustering arrangements of delivery and assessment. For the above listed qualifications, the Unit Evidence Sheets had not yet been developed. Consequently, in their absence it could not be determined that the strategies for training and assessment for the above listed qualifications met training package requirements. Furthermore, the absence of the unit evidence sheets rendered the overall strategies incomplete. TRAINING RESOURCES ICA40111 Certificate IV in Information Technology* ICA40211 Certificate IV in Information Technology Support ICA40311 Certificate IV in Web-Based Technologies* ICA40411 Certificate IV in Information Technology Networking* ICA40811 Certificate IV in Digital Media Technologies ICA41011 Certificate IV in Computer Systems Technology* ICA50111 Diploma of Information Technology* ICA50511 Diploma of Database Design and Development* ICA50611 Diploma of Website Development* ICA50911 Diploma of Digital Media Technologies The organisation provided advice at audit that it had not yet developed resources to deliver training for the above listed qualifications. The lead auditor advised the organisation that this would be noted as a non-compliance and that


rectification evidence would be required. ASSESSMENT ICA30105 Certificate III in Information Technology ICAICT306A Migrate to new technology ICA30111 Certificate III in Information, Digital Media and Technology ICAICT303A Connect internal hardware components Analysis of the assessment tools and instruments for the above listed units of competency identified significant gaps in the assessment of all required knowledge and skills and the critical aspects of evidence. In addition, the gaps identified were found to impact on the sufficiency of evidence gathered to support a valid and reliable judgement of competency in accordance with the principles of assessment. For ICAICT303A Connect internal hardware components it was also noted that practical assessment relied solely on evidence gathered by the workplace supervisor with no observation by the assessor themselves of the learner’s skills. The tool provided listed a number of skills to be verified by the workplace supervisor as having been demonstrated by the learner in the workplace. The workplace observation checklist did not:

provide sufficient information to the workplace supervisor as to the conditions under which the evidence was to be gathered for validity and reliability

detail the minimum level of expected performance to be demonstrated for each of the listed skills/behaviours The absence of the above listed information within the tool would heavily impact on the validity, sufficiency and reliability of the evidence gathered by this tool. As such, it was unclear how a valid and reliable judgement could be made by an assessor in the absence of their own observations. ICA20111 Certificate II in Information, Digital Media and Technology ICAICT205A Design basic organisational documents using computing packages ICASAS202A Apply problem-solving techniques to routine IT malfunctions ICA30111 Certificate III in Information, Digital Media and Technology ICANWK304A Administer network peripherals ICA40111 Certificate IV in Information Technology* BSBCRT401A Articulate, present and debate ideas ICANWK405A Build a small wireless local area network ICA40211 Certificate IV in Information Technology Support ICAICT401A Determine and confirm client business requirements ICANWK401A Install and manage a server ICA40311 Certificate IV in Web-Based Technologies* ICAWEB401A Design and website to meet technical requirements ICAWEB425A Apply structured query language to extract and manipulate data ICA40411 Certificate IV in Information Technology Networking* ICANWK403A Manage network and data integrity ICANWK406A Install, configure and test network security ICA40811 Certificate IV in Digital Media Technologies CUFDIG401A Author interactive media ICAWEB407A Conduct operational acceptance tests of websites ICA41011 Certificate IV in Computer Systems Technology* ICANWK404A Install, operate and troubleshoot a small enterprise branch network ICASAS426A Locate and troubleshoot IT equipment, system and software faults ICA50111 Diploma of Information Technology* ICAICT509A Gather data to identify business requirements ICANWK505A Design, build and test a network server ICA50511 Diploma of Database Design and Development* ICADBS502A Design a database ICAPRG505A Build advanced user interface ICA50611 Diploma of Website Development* ICAWEB503A Create web-based programs ICAWEB509A Use site server tools for transaction management ICA50911 Diploma of Digital Media Technologies ICAGAM504A Manage interactive media production CUFDIG507A Design digital simulations The organisation provided advice at audit that it had not yet developed assessment resources for the above listed


qualifications, and consequently, the above listed units. The lead auditor advised the organisation that this would be noted as a non-compliance and that rectification evidence would be required.

SNR 16 The NVR registered training organisation adheres to principles of access and equity and maximises outcome for its clients

PRE-ENROLMENT INFORMATION ICA20111 Certificate II in Information, Digital Media and Technology ICA30105 Certificate III in Information Technology ICA30111 Certificate III in Information, Digital Media and Technology ICA40111 Certificate IV in Information Technology* ICA40211 Certificate IV in Information Technology Support ICA40311 Certificate IV in Web-Based Technologies* ICA40411 Certificate IV in Information Technology Networking* ICA40811 Certificate IV in Digital Media Technologies ICA41011 Certificate IV in Computer Systems Technology* ICA50111 Diploma of Information Technology* ICA50511 Diploma of Database Design and Development* ICA50611 Diploma of Website Development* ICA50911 Diploma of Digital Media Technologies For the above listed qualifications please also refer to the Systems report for non-compliances relating to this Standard with regard course information that is provided clients prior to enrolment. EMPLOYER ENGAGEMENT ICA40111 Certificate IV in Information Technology* ICA40211 Certificate IV in Information Technology Support ICA40311 Certificate IV in Web-Based Technologies* ICA40411 Certificate IV in Information Technology Networking* ICA40811 Certificate IV in Digital Media Technologies ICA41011 Certificate IV in Computer Systems Technology* ICA50111 Diploma of Information Technology* ICA50511 Diploma of Database Design and Development* ICA50611 Diploma of Website Development* ICA50911 Diploma of Digital Media Technologies The organisation provided advice at audit that it had not yet developed resources for the above listed qualifications. Consequently, it could not be confirmed that the organisation has sufficient mechanisms in place to ensure it engages employers and other relevant parties in the development, delivery and monitoring of training and assessment.

Rectification requirements – evidence of rectification to be submitted within 20 working days


STRATEGIES ICA20111 Certificate II in Information, Digital Media and Technology ICA30105 Certificate III in Information Technology ICA30111 Certificate III in Information, Digital Media and Technology ICA40211 Certificate IV in Information Technology Support ICA40811 Certificate IV in Digital Media Technologies ICA50911 Diploma of Digital Media Technologies The organisation is required to provide evidence that its strategies for training and assessment for the above listed qualifications have been developed through effective consultation with industry. ICA20111 Certificate II in Information, Digital Media and Technology The organisation is required to provide evidence that the evidence gathering techniques outlined in the strategies for training and assessment are consistent with the actual assessment tools provided at audit. ICA30105 Certificate III in Information Technology The organisation is required to provide evidence it has amended information within the strategy for the above listed qualification to ensure pre-entry requirements at the qualification level are clearly distinguished from the information regarding the pre-requisite units for units listed within the strategy. In addition, the strategy is to list the most current versions of all units listed within the strategy document.


ICA30111 Certificate III in Information, Digital Media and Technology The organisation is required to provide a strategy for training and assessment that includes packaging information for electives that complies with the requirements of the training package for this qualification. The strategy is to include information regarding the evidence gathering techniques that align with its assessment tools. The organisation is required to provide evidence to demonstrate that information relating to the units to be delivered aligns with its course information. ICA40211 Certificate IV in Information Technology Support ICA40811 Certificate IV in Digital Media Technologies ICA50911 Diploma of Digital Media Technologies For each of the above listed qualifications, the organisation is required to provide evidence that it has unit evidence sheets for each core and elective unit of competency listed within the strategies for all the above listed qualifications. The evidence provided must demonstrate that the organisations strategies for training and assessment for the above listed qualifications meet training package requirements. RESOURCES ICA40211 Certificate IV in Information Technology Support ICA40811 Certificate IV in Digital Media Technologies ICA50911 Diploma of Digital Media Technologies The organisation is required to provide evidence it has training materials and resources that are consistent with the requirements of the training package and its own training and assessment strategies. The evidence provided is to demonstrate and confirm that these materials have been developed through effective consultation with industry. ASSESSMENT ICA30105 Certificate III in Information Technology ICAICT306A Migrate to new technology ICA30111 Certificate III in Information, Digital Media and Technology ICAICT303A Connect internal hardware components The organisation is required to provide amended assessment tools for the above listed units to demonstrate that assessment, including Recognition of Prior Learning (RPL):

meets the requirements of the relevant training package

is conducted in accordance with the principles of assessment and the rules of evidence. For ICAICT303A Connect internal hardware components, the organisation is required to provide evidence that a judgement of competence for the practical aspects of the unit meet the requirements of the rules of evidence and principles of assessment. ICA20111 Certificate II in Information, Digital Media and Technology ICAICT205A Design basic organisational documents using computing packages ICASAS202A Apply problem-solving techniques to routine IT malfunctions ICA30111 Certificate III in Information, Digital Media and Technology ICANWK304A Administer network peripherals ICA40211 Certificate IV in Information Technology Support ICAICT401A Determine and confirm client business requirements ICANWK401A Install and manage a server ICA40811 Certificate IV in Digital Media Technologies CUFDIG401A Author interactive media ICAWEB407A Conduct operational acceptance tests of websites ICA50911 Diploma of Digital Media Technologies ICAGAM504A Manage interactive media production CUFDIG507A Design digital simulations For each of the above listed units of competency, the organisation is required to provide a full suite of assessment tools to demonstrate assessment, including Recognition of Prior Learning (RPL):

meets the requirements of the relevant training package

is conducted in accordance with the principles of assessment and the rules of evidence

meets workplace and, where relevant, regulatory requirements

is systematically validated.

SNR 16 The NVR registered training organisation adheres to principles of access and equity and maximises outcome for


its clients

PRE-ENROLMENT INFORMATION ICA20111 Certificate II in Information, Digital Media and Technology ICA30105 Certificate III in Information Technology ICA30111 Certificate III in Information, Digital Media and Technology ICA40111 Certificate IV in Information Technology ICA40211 Certificate IV in Information Technology Support ICA40811 Certificate IV in Digital Media Technologies ICA50911 Diploma of Digital Media Technologies Evidence rectifying non-compliances articulated in the Systems Report will rectify this non-compliance. EMPLOYER ENGAGEMENT ICA40211 Certificate IV in Information Technology Support ICA40811 Certificate IV in Digital Media Technologies ICA50911 Diploma of Digital Media Technologies For the above listed qualifications, the organisation is required to provide evidence to demonstrate that it has mechanisms in place that ensure employers and other parties who contribute to each learner’s training and assessment are engaged in the development, delivery and monitoring of training and assessment.

Analysis of rectification evidence received 19 October 2012


STRATEGIES ICA20111 Certificate II in Information, Digital Media and Technology ICA30105 Certificate III in Information Technology ICA30111 Certificate III in Information, Digital Media and Technology ICA40211 Certificate IV in Information Technology Support ICA40811 Certificate IV in Digital Media Technologies ICA50911 Diploma of Digital Media Technologies The organisation provided completed industry logs of consultation with various small businesses as evidence that it had developed its strategies through effective consultation with industry. ICA20111 Certificate II in Information, Digital Media and Technology Analysis of the strategy for training and assessment and the assessment tools provided for the units sampled confirmed alignment between the two. ICA30105 Certificate III in Information Technology The organisation provided an amended strategy for the above listed qualification that now makes a clear distinction between pre-entry requirements at the qualification level and the pre-requisite units at the unit of competency level. The strategy also now listed the most current versions of all packaged units. ICA30111 Certificate III in Information, Digital Media and Technology The organisation provided an amended strategy that includes now includes packaging information for electives that complies with the requirements of the training package for this qualification. The strategy included information regarding the evidence gathering techniques that aligned with the assessment tools provided. The units nominated within the strategy also aligned with its course information. ICA40211 Certificate IV in Information Technology Support ICA40811 Certificate IV in Digital Media Technologies ICA50911 Diploma of Digital Media Technologies As the organisation intends to delivery these qualifications via the eLearning platform, it provided Assessment Summary Sheets in lieu of Unit Evidence Sheets, which was consistent with its processes for this delivery model. The strategies provided for the above listed qualifications listed ‘observation’ as an evidence gathering technique for units listed within the qualifications. The student workbooks and assessor guides for the units sampled within each qualification also referenced observation as a form of assessment for trainees only. However, no tools for observation were provided for any of the units sampled. Consequently, it could not be confirmed that the evidence gathering techniques referenced in the strategy in their entirety align to the assessment tools used. Furthermore, the strategy did not identify observation to be only applicable to trainees as specified in the workbooks


and assessor guides. Submission of 5 November 2012: The organisation provided amended strategies that aligned to assessment tools provided and identified observation assessment as being applicable to trainees only. RESOURCES ICA40211 Certificate IV in Information Technology Support ICA40811 Certificate IV in Digital Media Technologies ICA50911 Diploma of Digital Media Technologies The organisation did not provide evidence it has training materials and resources that are consistent with the requirements of the training package and its own training and assessment strategies. Submission of 5 November 2012: The organisation provided links to its online training resources. This resources were also referenced in its strategies for training and assessment and in the learning management system that is accessed by students for training and assessment purposes. ASSESSMENT ICA30105 Certificate III in Information Technology ICAU3019B Migrate to new technology (ICAICT306A was superseded and evidence was provided against the current unit) ICA30111 Certificate III in Information, Digital Media and Technology ICAICT303A Connect internal hardware components The organisation provided amended assessment tools that included additional tasks and activities that now ensure assessment meets the requirements of the relevant training package. For ICAICT303A, the practical assessment tool had been significantly expanded to ensure valid, reliable and sufficient evidence was gathered to support a judgement of competence in the absence of an assessor’s direct observations. The evidence provided for the above listed units included supporting marking guides for all tasks and activities to ensure the principles of assessment and rules of evidence had been met. NOTE: Prior to receipt of the audit report, the organisation provided advice to the auditor that it had amended its strategies due to review by a newly appointed trainer and assessor in consultation with an industry stakeholder. As a result the organisation had removed the following units from the corresponding strategies:

ICA40211 Certificate IV in Information Technology Support o ICANWK401A Install and manage a server

ICA40811 Certificate IV in Digital Media Technologies o ICAWEB407A Conduct operational acceptance tests of websites

The auditor approved substitution of these units as follows:

ICA40211 Certificate IV in Information Technology Support o ICASAS504A Develop and conduct client acceptance test

ICA40811 Certificate IV in Digital Media Technologies o ICAGAM413A Design and create 3-D digital models

In an oversight, these unit substitutions were not included in the report that was sent to the organisation; however they are now duly itemised below. ICA20111 Certificate II in Information, Digital Media and Technology ICAICT205A Design basic organisational documents using computing packages ICASAS202A Apply problem-solving techniques to routine IT malfunctions The organisation provided evidence that the above listed units are to be assessed in a clustered arrangement via the online medium. Assessment tasks consisted of:

A theory question bank requiring medium length responses to case studies and project tasks

Project, case study and scenario based practical tasks that are to be completed as a portfolio of evidence

Workplace observation tasks The assessment tasks and activities met the requirements of the units of competency and were consistent with the


evidence gathering techniques outlined in the strategy for training and assessment. However, the workplace observation tools did not articulate the specific activity that they must undertake to allow them to demonstrate the observable behaviours outlined in the observation tool. Moreover, there is no guidance to other the learner, workplace supervisor or assessor as to what would be considered to be the minimum benchmark performance to be considered to have satisfactorily demonstrated each of the tasks. Submission of 5 November 2012: The organisation provided an amended workplace observation tool that outlined the tasks required to be undertaken by the learner and guidance to both the learner, the workplace supervisor and the assessor as to the minimum level of performance required to be demonstrate to be deemed to have satisfactorily completed each task. ICA30111 Certificate III in Information, Digital Media and Technology ICANWK304A Administer network peripheral The organisation provided evidence of the following assessment tasks:

A theory question bank requiring medium length responses to case studies and project tasks

Project, case study and scenario based practical tasks that are to be completed as a portfolio of evidence

Workplace observation tasks with supporting recording tools

A workplace supervisor observation checklist. The assessment tasks and activities met the requirements of the unit of competency and were consistent with the evidence gathering techniques outlined in the strategy for training and assessment. However, the workplace observation tools did not articulate the specific activity that they must undertake to allow them to demonstrate the observable behaviours outlined in the observation tool. Moreover, there is no guidance to other the learner, workplace supervisor or assessor as to what would be considered to be the minimum benchmark performance to be considered to have satisfactorily demonstrated each of the tasks. Submission of 5 November 2012: The organisation provided an amended workplace observation tool that outlined the tasks required to be undertaken by the learner and guidance to both the learner, the workplace supervisor and the assessor as to the minimum level of performance required to be demonstrate to be deemed to have satisfactorily completed each task. ICA40211 Certificate IV in Information Technology Support ICAICT401A Determine and confirm client business requirements ICASAS504A Develop and conduct client acceptance test The organisation provided evidence of the following assessment tasks both of the units listed above:

Online question banks consisting of complex multiple choice responses

Practical workplace activities with corresponding recording tools and templates

Practical project tasks requiring the learner to compile a portfolio of evidence. The assessment tasks and activities met the requirements of the unit of competency and were consistent with the evidence gathering techniques outlined in the strategy for training and assessment. ICA40811 Certificate IV in Digital Media Technologies CUFDIG401A Author interactive media The organisation provided an eLearning Student Workbook, an eLearning Assessor Guide and an eLearning Assessment Summary. Assessment for this unit of competency consisted of:

eight online knowledge questions with multiple choice responses

a workplace activity task requiring a learner to develop an E Learning Assessment for a client

a project task requiring a learner to design and document an eLearning Course. All tasks were supported by benchmark criteria. Analysis of the tools identified significant gaps in the assessment in of all unit requirements and the online knowledge questions did not elicit the responses that could be considered to be consistent the outcomes expected at AQF Level IV. In addition, the assessor’s guide, learner workbook and strategy identified observation as a form of assessment for


trainees. However, no such tool was provided. Submission of 5 November 2012: The organisation provided a suite of amended assessment tools for the above listed unit, including a tool to support observation assessment for trainees. Analysis of the tools confirmed that assessment now meets training package requirements, the principles of assessment and rules of evidence. ICAGAM413A Design and create 3-D digital models The organisation provided an eLearning Student Workbook, an eLearning Assessor Guide and an eLearning Assessment Summary. Assessment for this unit of competency consisted of:


a workplace activity task requiring a learner to create 3D Virtul World Products and submit a screen shot of the finished product as evidence

a project task requiring a learner to design and document a 3D Virtul World Office for an existing website and incorporate the products from the workplace task into the project.

All tasks were supported by benchmark criteria. Analysis of the tools identified significant gaps in the assessment in of all unit requirements and the online knowledge questions did not elicit the responses that could be considered to be consistent the outcomes expected at AQF Level IV. In addition, the assessor’s guide, learner workbook and strategy identified observation as a form of assessment for trainees. However, no such tool was provided. Submission of 5 November 2012: The organisation provided a suite of amended assessment tools for the above listed unit, including a tool to support observation assessment for trainees. Analysis of the tools confirmed that assessment now meets training package requirements, the principles of assessment and rules of evidence. ICA50911 Diploma of Digital Media Technologies ICAGAM504A Manage interactive media production The organisation provided an eLearning Student Workbook, an eLearning Assessor Guide and an eLearning Assessment Summary. Assessment consisted of:


a workplace activity requiring a learner to undertake 7 tasks associated with managing the design of Machinama production with the submission of a portfolio of evidence to demonstrate completion of the tasks

a project requiring the learner to undertake 7 tasks associated with managing the production of a client’s Machinama with the submission of a portfolio of evidence to demonstrate completion of the tasks.

The online question bank and responses did not require responses from a candidate that would be consistent with the knowledge expected at the AQF Level IV. The assessor guide only included a series of screen dumps as examples of completed work. There was no guidance to assessors as to how to assess the evidence submitted by the learner to confirm that competence had been demonstrated. As an example only, Task 2 of both the Workplace Activity and the Project was identified as follows:

2. Observe and describe workplace culture, corporate image, lines of reporting and communication. Attach a PDF document with screenshot as evidence.

There was no information whatsoever in the assessor guide as to how the information presented to the assessor could be analysed to establish a learner had demonstrated a specific knowledge or skill requirement. The screenshots attached in the assessor guide as exemplars appeared to be finished products with no alignment at all to the instruction iterated above. Although the organisation provided a matrix demonstrating how each task covered the units requirements, an absence of assessment instructions or guidance to the assessor as to how submitted evidence would support that the unit requirements had been addressed by the learner made it difficult to confirm the relevance of the assessment tasks to


the unit at all. Again as an example only, there did not appear to be any tasks requiring the learner demonstrate their ability to refer decisions to a higher project authority for review and endorsement; to resolve basic hardware, software and other technical issues associated with game production; to balance talent, experience and budget; or to meet project deadlines. The organisation provided a matrix which mapped the assessment tools to the unit requirements. The matrix and assessment instructions referenced unit requirements as being covered by “OBS”, however no such tool was provided. Furthermore, a review of the tools against the matrix was unable to confirm that the referenced requirements were actually being assessed by the corresponding tasks. Overall, it was not demonstrated that assessment met the required knowledge and skills, and gathered all the critical aspects for assessment and evidence required to demonstrate competency in this unit. Submission of 5 November 2012: The organisation submitted a suite of amended assessment tools, including a workplace observation project. The tools included tasks that would gather evidence against all unit requirements. The tools included instructions to learners and assessors as to the tasks that were to be completed and the evidence that was to be submitted. There was also information to assessors as to the minimum expected information in completed assessments so as to enable valid and reliable judgments of competence. CUFDIG507A Design digital simulations The organisation provided an eLearning Student Workbook, an eLearning Assessor Guide and an eLearning Assessment Summary. Assessment consisted of:


a workplace activity requiring a learner to undertake 6 tasks associated with the design of a 3D Virtul World Simulations for a client with the submission of a portfolio of evidence to demonstrate completion of the tasks

a project requiring the learner to undertake 7 tasks associated with the design and documentation of a 3D Virtul World Office to add to a clients real world office with the submission of a portfolio of evidence to demonstrate completion of the tasks.

The online question bank and responses did not require responses from a candidate that would be consistent with the knowledge expected at the AQF Level IV. The only benchmark criteria for both the workplace activity and project tasks were screen dumps of virtual offices with no other information relevant to the tasks outlined within the tools. Consequently, it was impossible to determine how assessment would confirm a learner’s competence against all the requirements of the unit. The organisation provided a matrix which mapped the assessment tools to the unit requirements. The matrix and assessment instructions referenced unit requirements as being covered by “OBS”, however no such tool was provided. Furthermore, a review of the tools against the matrix was unable to confirm that the referenced requirements were actually being assessed by the corresponding tasks. The organisation provided a matrix which mapped the assessment tools to the unit requirements. The matrix and assessment instructions referenced unit requirements as being covered by “OBS”, however no such tool was provided. Furthermore, a review of the tools against the matrix was unable to confirm that the referenced requirements were actually being assessed by the corresponding tasks. FOR BOTH UNITS Due to an absence of sufficient assessment instructions to the assessor; a lack of benchmark criteria relevant to the assessment tasks provided; and a lack of assessment developed to the appropriate AQF Level, the organisation has not demonstrated that assessment for this qualification meets the requirements of the training package. Submission of 5 November 2012: The organisation submitted a suite of amended assessment tools, including a workplace observation project. The tools included tasks that would gather evidence against all unit requirements. The tools included instructions to learners and assessors as to the tasks that were to be completed and the evidence that was to be submitted. There was also information to assessors as to the minimum expected information in completed assessments so as to enable valid and


reliable judgments of competence. The organisation also advised the online assessment questions were for the purposes of formative assessment and knowledge requirements were also being assessed elsewhere in the complement of assessment tasks. Analysis of the tools confirmed this to be the case.

SNR 16 The NVR registered training organisation adheres to principles of access and equity and maximises outcome for its clients

PRE-ENROLMENT INFORMATION ICA20111 Certificate II in Information, Digital Media and Technology ICA30105 Certificate III in Information Technology ICA30111 Certificate III in Information, Digital Media and Technology ICA40111 Certificate IV in Information Technology ICA40211 Certificate IV in Information Technology Support ICA40811 Certificate IV in Digital Media Technologies ICA50911 Diploma of Digital Media Technologies Refer to Systems Report. EMPLOYER ENGAGEMENT ICA40211 Certificate IV in Information Technology Support ICA40811 Certificate IV in Digital Media Technologies ICA50911 Diploma of Digital Media Technologies The organisation provided a training plan, pre-sign up checklist and assessment summary as evidence of its mechanisms for engaging employers and other parties in the development, delivery and monitoring of training and assessment. The evidence provided was sufficient to demonstrate how it engages third parties in the development and monitoring of training and assessment. However, the organisation did not provide the observation tools referenced in its student workbooks and supervisor/assessor guides. Consequently, it couldn’t be confirmed that it has developed a sufficient mechanism for engaging third parties in the delivery of training and assessment. Submission of 5 November 2012: The organisation submitted the referenced observation tools and supervisor/assessor guides to support that it has developed sufficient mechanisms for engaging third parties in the delivery of training and assessment.

Documents

VET Quality Framework audit report Business Success Group ... report - ICA11 - FINAL.pdfICA40311 Certificate IV in Web-Based Technologies ICA40411 Certificate IV in Information Technology