Integrated Exam Database v10.4b

Integrated Exam Database v10.4b A tutorial on the basic use of the Integrated Exam Database v.10.4b for Test Construction

Contents I.

Introduction .......................................................................................................................... 1

II.

Technical Requirements..................................................................................................... 2

III. How to change the default username and password ..................................................... 3 IV. How to set the Course Topics & Subtopics ................................................................... 10 V.

How to set the Course Reference(s) .............................................................................. 12

VI. How to use the Exam Database ...................................................................................... 14 1. Comprehensive Test Bank............................................................................................... 17 2. Automated Table of Specifications (TOS) ..................................................................... 27 3. Integrated Item Analysis ................................................................................................... 32 End User Agreement (EUA) .................................................................................................... 38

DOWNLOAD LINKS: Intergrated Exam Database (iEDB) Tutorial https://drive.google.com/file/d/0BxD3szyiMW6-XzRFS253akUyWEk/view?usp=sharing

Intergrated Exam Database (v10.4b) https://drive.google.com/file/d/0BxD3szyiMW6-U1lhVjJWWVJRQzQ/view?usp=sharing

I. Introduction The beta version of the Physical Therapy Exam Database was developed as an upgrade of the basic test bank originally developed for the Health Related Sciences Department of the University of Perpetual Help System Laguna in 2004. After the workshop on “Test Analysis, Table of Specifications, and OBE Syllabus by Dr. Karen Tamayo, held on October 29-30, 2014 at the UPHSL, the program was modified to included two additional modules – the Automated Table of Specifications (TOS) module and the Integrated Item Analysis module. Designed to address issues on lengthy periods involved with the preparation of the Table of Specifications, and Item Analysis, this program simplifies the task by automatically generating both. Users simply need to encode the questions and the program does the automated task of generating the table of specifications. Item analysis also requires input of post test data after which the results are likewise automatically generated. By reducing the time needed to prepare the table of specifications and item analysis, faculty members are given more opportunity to focus on making competent questions for their respective exams. The basic test bank has also been upgraded to include an integrated test construction guide to facilitate classification of exam items based on Bloom’s Taxonomy. The application runs on a complex algorithm that assist in test construction by automatically classifying typed questions according to the 6 Cognitive levels of Bloom’s Taxonomy. The current beta version is a working prototype and is still under development for final release.

jot,ptrp,mscpd

Integrated Exam Database A tutorial on the basic use of the Integrated Exam Database v.10.4b for Test Construction by:jot,ptrp,mscpd

Saturday, September 23, 2017; 8:39 PM Page 1

II. Technical Requirements

PT Exam Database V10.4b • Comprehensive Test Bank • Automated Table of Specifications (TOS) • Integrated Item Analysis

   Microsoft® Office , the Access logo, and the Visual Basic for Applications logo are registered trademarks of Microsoft Corporation Created by jot,ptrp,mscpd. e-mail: [email protected]

Operating System:  Windows XP, 7, 8, 8.1, & 10 Recommended - Windows 8.1 or 10 Software:  MS Office – Access 2003 or higher Recommended – Access 2010 or higher Hardware:  Pentium Dual Core  2GB RAM  Intel HD Graphics (Resolution 1366x768)  500GB HDD Recommended:  Pentium Quad Core or Higher  8GB RAM  GeForce GT940M (Resolution 1366x768)  1 TB SSD



III. How to change the default username and password

The program runs on Microsoft Office Access, so make sure you have Access installed on your PC. Version 2003 and higher will do.

  

Next copy the application to your PC. It cannot run properly from the CD and needs to be copied onto the PC. There is no need to install the application, it will be run by Microsoft Access. Double click the file to start the application.



 


A security check will appear Click “Open” to proceed



For Office 2013 or 2016 users, a security prompt will initially block the program from running.



If this happens, close the EUA form to see the Microsoft Access security prompt.





In order to run the application, click on “Enable Content” to allow Microsoft Access to continue.



This procedure will only be done once, when the program is initially used. Subsequent use will no longer require further security checks.



A security prompt only occurs for unregistered programming scripts or source codes done by independent programmers.



A thorough scan using Defender or any anti-virus will validate the application to be clean.



After clicking “Enable Content” in the previous security prompt, the application can now proceed.




An “End User Agreement (EUA) will appear. It is advised that you read the agreement before proceeding. If you agree with the provisions of the EUA, proceed by clicking on the checkbox. Next click “Agree” to proceed.





 




Make sure you fill up the required parameters as this will only appear once. The name of the College, address, and contact number will be used as heading for the entire program so make sure that these are also specified. Next click “Close”.


 

  


The data you entered will be reflected as the heading of the program and in all printouts. Next proceed by clicking “Admin Log In”.

On the next screen click the drop-down selector and select the default account name “admin”. Next enter the default password “admin” Click “OK” to proceed


 


A security prompt will appear to verify if you wish to proceed in modifying or adding an admin account. Click “OK” to proceed.


 

  




You will be required to re-input the account name and password in order to verify and proceed. Click “OK” when done.

Once inside the Admin Registration interface, change the default user name and password to your preferred parameters to secure the app. Make sure you remember the password as this will be case sensitive. If you want to authorize another admin account simply select the next button on the navigation keys, then type in the username and password you want to authorize. Click “Close” when done.


IV. How to set the Course Topics & Subtopics



On the main navigation interface click “Set Course Topics/Subtopics”

   




On the Exam topics prompt, specify the required course/subject. Refer to your course syllabus for the topics. Next specify the topic and subtopics Click forward on the navigation bar to move to the next slot and specify the next topic. Repeat the same procedure until all topics in the syllabus are included.


    


To write the topic outline for another course/subject, click next on the course navigation bar. Repeat the same steps until the topic outline from the course syllabus is completed. Please note that this only needs to be done once for each course/subject. Click “Close” when done.


V. How to set the Course Reference(s)



On the main navigation interface click the “Set Course Reference(s)” button.

  


At the Exam References prompt, type in the course/subject. Next set the reference details by typing in the needed parameters such as author, title, editions, etc. Click the next button on the reference navigation bar to add another reference.


  


To specify the reference for another course/subject click on the next button on the course/subject navigation bar. Next do the same procedure and specify the reference(s) for the course/subject. Click “Close” after you finish encoding the course references.


VI. How to use the Exam Database








To create an exam, begin by setting the exam details. Click the “Set Exam Details” button on the main navigation page.

At the Exam Parameters prompt, type in all the required test information or particulars such as the school year, semester, grading period, etc.









If you need to create a new exam, click the next button on the Exam parameters navigation bar and do the same process by specifying the test particulars. Click “Close” when done.

Next, click the “Enter Exam Database” button to proceed.


 


Now that you have entered the main Exam Database interface you can begin test construction. This application consists of 3 program modules which include the following:  Comprehensive Test Bank  Automated Table of Specifications  Integrated Item Analysis


1. Comprehensive Test Bank

 The Test Bank Module can be operated using the buttons at the top portion of the navigation pane.  Click each button to use the specific features of the test bank.

 The first feature is the test construction guide which provides users with a quick guide on Bloom’s Taxonomy. The six levels of the cognitive domain include itemized key terms and line of questioning.  Click each tab to view the key terms for each cognitive level.



 Aside from the test construction guide, the test bank module also includes a feature that automatically classifies typed questions based on the itemized key terms of Bloom’s Taxonomy.  To use this feature, click the automated test item classifier indicated by the arrow.

 Type the item number on the space provided.  Next type in the question and the options or choices on the indicated areas.  Specify the correct answer by clicking on the answer selector.



 All identified key terms in the question are classified accordingly and will appear in the test construction guide sub-interface.  If multiple key terms are detected, the highest identified cognitive level is used by the program to classify the question.

 Next click the Topic drop-down button to view the exam topics encoded earlier based on the course syllabus.



 To change the exam format, use the format selector button to set the question format to either short….

 …or long for questions involving lengthy options or choices.



 Next click the reference drop-down button to view the available references encoded earlier based on the course syllabus.  Specify the source of the typed question by selecting the corresponding reference.

 It is advised that a rationale or a short explanation on the solution to the problem be included in the space provided.  This can be opened by clicking the rationale button indicated by the arrow.



 To type in the next question, click the next button on the navigation bar at the bottom left of the exam database interface or at the right of the question box.  Repeat the process until you finish encoding the entire exam.

 To preview the exam, click the “Preview Exam Questions” button on the menu/navigation pane.  Click the enlarge button on the top right portion of the prompt to maximize the preview.  Next right click on any part of the preview and select “Print”.



 At the print options prompt, click the properties button.  Depending on the installed printer, set your desired print settings such as the document size.

 To save a soft copy of your exam, right click on any part of the preview and select “export”.  Another drop-down menu will appear. From this, select the “PDF or XPS” option.



 At the save prompt, type the file name.  Select “PDF” at the “Save as type” option.  Next click “Publish” to save the file.

 To preview the exam with the corresponding answers, click the “Preview Answer Key Button”.  Right click on any part of the preview and select “print” as needed.



 To save a soft copy of the file, right click on any part of the preview and select “Export” then select “PDF or XPS”  Specify the file name and click “publish” to export the file.

 The search function can be used to search specific items in the test bank.  To use this function click the “Search Test Bank” button, and type the search term or phrase, in the “Find What” field.  Click the ”Match” drop-down menu and select “Any Part of field”  To begin the search click the “Find Next” button.



 To use the delete function, click the “Delete Selected Question” button.  A security prompt will appear to confirm if you really want to proceed deleting the entry.  Click “yes” to confirm or “no” to cancel.



2. Automated Table of Specifications (TOS)

 The second module of the Exam Database is the Automated TOS.  This feature automatically generates the Table of Specifications or TOS with a single click of a button, eliminating hours of workload through automation.

 Unlike the usual practice of preparing the TOS first, this feature requires that the exam is first encoded before the TOS can be generated.  However, as with most seasoned faculty, making the exam with a draft outline of the number of test items per topic should suffice as guide while making the exam.  The advantage of using this feature is that it allows for accurate classification & percentage computation of test items, including automatic tabulation which eliminates hours of clerical work through automation. Integrated Exam Database A tutorial on the basic use of the Integrated Exam Database v.10.4b for Test Construction by:jot,ptrp,mscpd


 To use this feature, simply click the “TOS-Bloom’s Taxonomy” button.  There will be a delay of 2-3 seconds as the program generates the Table of Specifications

 To view the pages of the TOS, you can navigate by clicking the next button on the navigation bar at the bottom left of the preview screen.



 An error will appear for items which were unsuccessfully classified by the program.  This usually happens when a typed question lacks the required key terms in Bloom’s Taxonomy.  To correct this error, click “OK” at the prompt then go back and revise the question to include any of the required key terms in Bloom’s Taxonomy so that the program can classify the item.

 Once the needed corrections are made, you can generate your TOS and check for errors again.  If no errors are found, you can proceed to printing your TOS.  The same option on exporting a soft copy of the TOS in PDF format can also be done similar to the process presented previously on printing and exporting.



 To print the TOS, right click on any part of the preview and select “print”.

 To modify the print settings, click the “properties” button at the prompt.  Next, set the desired parameters in the printer properties setting.



 To save a soft copy of the TOS, right click on any part of the preview screen and select “Export”.  Next, select the “PDF or XPS” option.

 Next, type the desired file name of the TOS.  Then set the file format to “PDF” and click “publish” to save the file.



3. Integrated Item Analysis

 The third program module of the application is the Integrated Item Analysis.  This feature allows for the unique integration of item analysis in the same test bank that stores exam questions, and essentially provides objective proof of the validity and reliability of the exam item.

 This feature uses statistically proven item analysis formulas to establish the reliability of questions by determining the difficulty and discrimination indices.  It also automatically interprets the statistical figures and gives the corresponding verbal interpretation of the indices.



 To use this feature, click the “Enter Item Analysis Data” indicated by the red arrow.  The bottom portion of the screen will change to show the item analysis interface.  The answer to each question is automatically highlighted by a box.

 Using the data obtained from scanned answer sheets using the Scantron/Opscan, encode the upper 27% and lower 27% of the class in each of the boxes provided under each option of choice.  The Difficulty and discrimination indices will be reflected at the bottom once all data have been entered.



 Item Analysis is computed and interpreted based on the following indices.  To view the standard index ratings click the “View Item Analysis Index” button indicated by the arrow.

 After encoding all the needed data, click the “Preview Categorized Items” button to generate the Item Analysis Report.  Similar to the Automated TOS feature, the Item Analysis Report eliminates hours of workload on the faculty through automation.  This provides a quick, easy, and accurate way of making the item analysis report.



 It eliminates the clerical work of tediously copying individual test questions and manually typing the individual item analysis required for each test item.  As an added feature, the program also generates a General Exam Index (GEI) which rates the entire exam from the average item analysis of all test items.  This provides a quick and easy view of how the exam faired to the examinees and whether it was successful or not.

 To print the Item Analysis Report use the same procedure previously presented on printing and exporting.  To do this, right click on any part of the Preview screen then select “print”.



 At the print settings prompt, click “properties”.  Next, set the desired print settings and print as needed.

 To save a soft copy of the file, right click on any part of the preview screen, then select “Export”.  Then click the “PDF or XPS” option.



 When the save prompt appears, type in the file name you want and select “PDF” on the “Save as Type” option.  To save the file, click the “Publish” button.



End User Agreement (EUA) This application was developed with Microsoft Access as a compact means of keeping faculty exam records in a single application. The system which includes 3 program modules on (1) computer assisted test construction, (2) automated table of specifications, and (3) an integrated item analysis, is still a prototype and is currently undergoing further development. Future updates may include a more comprehensive automation on computer assisted test construction, where a more sensitive classification of exam items on Bloom’s Taxonomy can be automatically done using an expanded algorithm that the current one being used. Please note that the current version is made for personal use by individual faculty, and as such only includes minimal security features compared to the planned corporate version with online features. For queries or suggestions on the application, please email [email protected].

jot,ptrp,mscpd

DOWNLOAD LINKS: Intergrated Exam Database (iEDB) Tutorial https://drive.google.com/file/d/0BxD3szyiMW6-XzRFS253akUyWEk/view?usp=sharing

Intergrated Exam Database (v10.4b) https://drive.google.com/file/d/0BxD3szyiMW6-U1lhVjJWWVJRQzQ/view?usp=sharing Integrated Exam Database A tutorial on the basic use of the Integrated Exam Database v.10.4b for Test Construction by:jot,ptrp,mscpd
