A Generic Tool For Generating And Assessing Problems Automatically Using Spreadsheets

Ppaer—A Generic Tool for Generating and Assessing Problems Automatically using Spreadsheets
A Generic Tool for Generating and Assessing Problems
Automatically using Spreadsheets
https://doi.org/10.3991/ijet.v13i10.7689
M. A. Rafart Serra, A. Bikfalvi!!", #$%&'()*+%#$%,'-.
Universitat de Girona, Girona, Spain
andrea.bikfalvi@udg.edu
Abstract—A myriad of higher education degrees including science, engi-
neering, business and economics could integrate activities using spreadsheet in-
to the teaching-learning process. In the present article, we aim to introduce and
describe a new tool that generates, individually assigns, corrects, provides feed-
back and grades exercises and activities using spreadsheets all completely au-
tomatically. The system’s versatility means it can be applied in a range of areas
of knowledge and subjects including mathematics, statistics, physics, account-
ing and economics, among others. It is usable for both formative and summa-
tive assessment based on students’ answers, providing them with the corre-
sponding feed-back and/or the resultant grades. The proposed solution has been
developed and implemented at the University of Girona (Spain) and forms part
a wider family of tools that aim to contribute to the continuous improvement of
higher education.
Keywords—automatic grading, automatic feed-back, Excel, spreadsheets,
formative assessment, summative assessment, higher education
1 Introduction
Most university-employed teaching and research staff would agree that one thing
that remains unchanged in education is constant transformation. Radical or incremen-
tal, it affects both content and format, continuously challenging educators to adapt to
new generations of students and novel contexts. The reality of twenty-first century
teaching practices is that it is not a matter of ‘if’ but of ‘how’ technology moderates
the teaching-learning process. Assuredly there remain some sceptics, but most adopt
and adapt to Information and Communication Technologies (ICT) irrespective of the
subject or the educational level targeted. The proliferation of devices and connectivity
and how they invade all areas of life makes the field of education irresistible to this
propagation and concepts like active learning, problem-based teaching and higher-
order cognitive thinking take on new meaning in the digital age.
Current higher education practice means that most universities dispose of global
virtual learning environments based on some type of Learning Management System
(LMS) that facilitates course management, provide access to study materials and as-
signments and establishes communication channels, among other uses. An important
feature of this environment is Computer Based Assessment, a system from where
iJET ‒ Vol. 13, No. 10, 2018 23

effective assessment, be it summative and/or formative, is carried out. Too often, this
assessment consists of typical questionnaires and quizzes with well-delimited answer
options, where the novelty is simply the digitalization of a conventional/traditional
assessment. For higher-order cognitive thinking involving analysis, evaluation and
synthesis, assessing the degree to which a student has acquired a certain competence
requires more sophisticated solutions and rather more complex activities and assess-
ment procedures in terms of volume, depth and accuracy. Multiple ways of solving
and several correct answer scenarios are often part of this process. Manual correction
is time-consuming and there is a high risk of error on the part of the instructor, espe-
cially where large numbers of students are involved and if the course requirements
mean multiple assessments per student. Typical examples are correcting a computer
program, designing a circuit, a mathematical, statistical or physics problem, a busi-
ness balance sheet and a diagram. A generic e-learning tool able to correct and assess
these types of activities would be ideal within this context.
With this objective in mind, the University of Girona (Spain) has developed the
web-based e-learning platform known as ACME, an acronym meaning Continuous
Evaluation and Educational Improvement [1]. The ACME platform is an LMS de-
signed to generate, assign and correct complex exercises automatically. When an
activity is set up by a teacher, some exercises are selected from a repository and the
system assigns individualized versions of them to the student workbook. The student
receives the exercise, resolves the problem and sends the answer to the system, which
then proceeds to correct it and provide feed-back. The platform is configured in spe-
cific modules for correcting exercises corresponding to different knowledge fields,
such as mathematics [2], programming [3], database design [4] and diagrams [5], to
mention just a few. Generating and correcting exercises in these subjects first requires
that different types of exercises are set up, an essential step due to the different user
interfaces and/or correcting tools needed. For example, for mathematics exercises a
textbox is used to enter the solution (a mathematical expression) and symbolic com-
putation software is used to correct it, and for inorganic chemistry and database sub-
jects, a specific interface is used to enter the solution and a specific correction code is
applied. The platform has a web environment for exercise management, which guides
the user through the process.
Repeated requests from teachers of very diverse disciplines, including physics and
business and finance, who all had in common student activities using spreadsheets,
obviated the need to develop a module building on spreadsheet exercises. A series of
tools have thus been developed that aim to correct and assess spreadsheets automati-
cally, none of which, however, contain all the features available in the tool described
in this paper.
The aim of the present paper is to describe the process and resulting tool for indi-
vidually generating and assigning activities to be carried out on Excel spreadsheets,
correcting, providing feed-back, assessing and grading these activities all automatical-
ly. This spreadsheet solution has been developed gradually: previous versions have
been implemented in a variety of subjects, always functioning within the framework
of the ACME platform. The new module developed is known as
24 http://www.i-jet.org

ACME_Spreadsheet1
. Its usefulness lies in how it addresses teaching, self-regulated
learning and tasks for assessment.
Regarding teaching, once the instructor has explained the theoretical and concep-
tual aspects of a subject, students use ACME_Spreadsheet for solving individually
configured and assigned exercises with the instructor present to provide assistance
and clarify pending issues. In this way, instructors can fairly assess what aspects have
not been understood. ACME_Spreadsheet can also be used by students to practice and
self-learn subject content. In this case, the teacher assigns problems to be solved by
the student and the ACME_Spreadsheet returns opportune feed-back. Last, in terms of
assessment, it provides the student with the numerical grade corresponding to the
submitted solution.
In Section 2, the literature in the field of systems that aim to correct spreadsheets
automatically is reviewed. The system requirements are highlighted in Section 3, how
the system functions in terms of generating and correcting exercises is described from
the perspective of both teachers and students in Section 4 and the architecture of the
proposed model is presented in Section 5. Last, the results are discussed and conclu-
sions drawn with the implications for the main stakeholders involved in Section 6.
2 Literature review
Approaching the core theme of this article, it is pertinent to highlight the im-
portance of using spreadsheets in education, including the main benefits and draw-
backs, as stated by the literature. Previous published experience of spreadsheet educa-
tion in business subjects is also reviewed to determine the value proposition of the
authors’ contribution.
Spreadsheet is one of the generic software packages most used in companies: Thus
the importance and relevance of university students being skilled in its design [6] and
use. Moreover, spreadsheets have long been used in education to teach a variety of
subjects and there is a large body of scientific literature, including the publications
authored by [7], [8], [9], [10], [11] and [12] that attest to how they are used to facili-
tate learning in mathematics, statistics, economics and physical sciences. Given their
importance and potential, several specific solutions already exist for correcting stu-
dent responses using spreadsheets. Thus, while the idea of using spreadsheets in edu-
cation is not new, ACME-Spreadsheet differs from other approaches, mainly in the
technical setup of the system, the value chain covered by the solution – from exercise
design to feed-back and grading – and the low level of computing skills needed for
the teacher to set up the subject. The inherent definition that spreadsheets are a group
of applications that allow for tabulated information management and calculations
facilitates their natural integration into engineering education. This, complemented by
today’s data-driven world and the data management and analysis skills demanded by
most employers [12], makes it mandatory for higher education institutions to address
this subject.
1
Interested readers can request a guest user through the form available at http://acme.udg.edu/en/prova-
ho.php
iJET ‒ Vol. 13, No. 10, 2018 25

As already mentioned, using spreadsheets in engineering education is aligned with
a specific goal: to be as employable as possible. In this sense, the cross-cutting ability
to use spreadsheets is often a required skill irrespective of the job position, geograph-
ical context and candidate’s academic background, the latter being where and when
this skill is supposedly acquired. In the field of engineering and other technical stud-
ies, the benefits of using spreadsheets are multiple. The inspiring work of [7] reviews
the historical development of spreadsheets, tracing their origins to the demands of
finance and accounting and later spreading into engineering education to reach to-
day’s status quo of omnipresence and multiple differentiated applications adapted to
the needs of the different engineering sub-fields as the result of a series of characteris-
tics described by [7:893] as follows: utilising spreadsheets in engineering education
not only makes completing tasks more efficient, but also often achieves a higher de-
gree of accuracy than do humans.
Both academic practice and research in this field has intensified over the last dec-
ade or so. Solutions have been sophisticated and have spread throughout the academic
community. Practice shows their presence during the entire higher education lifespan
starting with spreadsheet literacy for first-year undergraduates to later mastery of
spreadsheet skills, thus generating future professional competence. Within this con-
text, most educators take on an active role in developing these skills among their
learner audience, even though the aim of many may not be to convert the experience
into a publishable article. Nonetheless, solutions published in the international aca-
demic literature do exist and the ones that are most relevant to this article are high-
lighted below, aligned with the description of the solution as provided by its author:
• [13]: Innovative approach for automated grading, especially for complex assign-
ments.
• [14]: Innovative approach based on Excel files to develop individualized problem-
solving tasks for assignments. It is marked automatically and provides tailored
feed-back on the problem-solving process and outcome.
• [15]: Interactive spreadsheets with immediate feedback regarding the accuracy of
solutions.
• [16]: Individualised spreadsheet assignment with instant feedback on progress,
either textual or numerical (i.e. a mark) or both.
• [17]: Using Excel macros to create assignment questions where numbers or data
sets used in the questions are randomly generated and the students' answers graded
automatically.
• [18]: Spreadsheet-based tool to generate a personalised assignment.
• [19]: An individualised, interactive, formative assessment. Students can, at their
discretion and without instructor intervention, immediately receive feedback and
assistance related to their individualised question.
• [20]: The design and successful delivery of an effective application of spreadsheets
and the practice of modelling and analysing basic business concerns.
• [21]: E-learning system that allows for manual and automatically generated exer-
cises and automatically marks the students’ solutions without the intervention of a
lecturer.

• [22]: Individualised assignments utilising interactive spreadsheets with a unique
automated feedback and marking package.
• [23]: Creating and marking individualised coursework questions.
• [24]: Development of a programme that ensures independent learning and practice
through a technique of ‘individualised accounting questions.’
• [25]: Development of an automatic grading system to assess spreadsheet and data-
base skills.
• [26]: Spreadsheet activities using VBA programming to automatically generate
feedback, calculate grades and conditionally progress.
• [27]: Automated grading system for Excel based modelling assignments.
Table 1 is a tabulated way to characterise and compare existing solutions. The col-
umns represent the criteria to be considered when analysing existing solutions, except
for the first column which is the number corresponding to the paper/authors in the
reference list. Columns take a value of " when the feature applies and # otherwise.
Table 1. A review of selected publications on spreadsheets activities
Paper
Personalized
exercises
Feed-
back
Automatic
grading
Correction
multi-sheets
Integrated
in LMS
Web-
based
Program-
ing skills
Generic
Specific
13 # " " # # # " S
14 " " " " # # " S
15 # " # # # # # S
16 " " " # # # " S
17 " " " # # # " S
18 " # # # # " # S
19 " " " # " " # G
20 # # # # # # # S
21 " " " # # " # S
22 " " " # # # " G
23 " # " # # # # S
24 " " " # # # # S
25 # " " # " " " S
26 # " " # # # " G
27 # " " # # # " G
Note: G – generic, S – specific subject
In summary, most of these solutions have probably been designed and are being
used for very specific tasks and so they do not allow for an exhaustive coverage of
subjects. Others have the handicap of needing specific software. Most of the com-
pared tools require programming knowledge to adequately prepare exercises. The
majority correct a single sheet, while in practice complex solutions require a variety
of sheets organised in different workbooks. Since none of the existing solutions satis-
fied our needs, we opted for designing and developing a new tool that could be inte-
grated into the already existing ACME platform. Not all the features considered are
essential, but they are all the possible requirements the solution should address.
iJET ‒ Vol. 13, No. 10, 2018 27

3 System requirements
As already stated, the system described in the present contribution is part of a wid-
er family of tools that make up the ACME platform and share a common target,
namely the continuous improvement of the teaching/learning process.
The requirements specifically related to the ACME_Spreadsheets are described be-
low.
• Generic: the module is designed to be generic in the sense that it can manage any
activity through which a student and/or a teacher can capture the results obtained in
an Excel spreadsheet and/or workbook.
• Simultaneous multi-sheet correction: as it is usual to work with multiple spread-
sheets of the same workbook, the requirement set was that the solution should be
able to simultaneously read and correct multiple sheets of the same workbook, an
important consequence of which is that complex exercises can be solved and the
results obtained on one sheet can be an input for another.
• Open values: To cover a wide range of activities, the system must support different
scenarios where data entry could be: i) input data originating from an exercise, ii)
experimental values obtained in a lab or a bibliographic search, or iii) a formula to
obtain the input data.
• Individualised activities for students: To create a varied spectrum of exercises and
possibly contribute to reducing plagiarism, the system requires that activities gen-
erated by the platform are different, the visible result of which is that each student
can have their own individualized activity
• Maximum freedom for the student: To empower students to proceed with their own
solutions, the spreadsheet module must allow for intermediary calculations, anno-
tations, etc. The system will not search to match the formula entered by the student
and the one set as correct by the teacher, but will check for result coincidence.
• Transparency: Students must be informed at all times and the system must provide
them with details about what content, or which cell, in the spreadsheet is the cur-
rent object of correction and/or assessment.
• Communication: Where the activity is set as a formative one, the system must
provide valuable feed-back corresponding to the erroneous cell. Where the activity
is a summative one, the solution must compute and communicate a mark according
to the correctness of the solution.
• Teacher-friendly: Creating a new activity must be as easy as possible for the teach-
er. Being a cross-cutting solution, this requirement avoids the need for program-
ming skills, so teachers with basic user-level Excel skills can manage the entire
process from activity planning to final assessment.
• Integrated: The educator must be able to manage the module on a platform that
supports regular teaching activities, which translates into a system requirement of
total integration into an LMS such as Moodle, the LMS used in our university.
Moodle is a free, open-source learning management system developed on pedagog-
ical principles and used for blended learning, distance education and other e-
learning projects with the aim of integrating on-line content and activities. Full in-

tegration into Moodle has the advantage of being a one-stop-shop for students and
teachers alike, optimising work tasks for both collectives.
With the ACME platform already available, the easiest way to proceed with the
newly developed module was for students to visualise the ACME_Spreadsheet activi-
ty through the web browser and then download the Excel workbook for completion
according to the specifications provided in the exercise statement. The student’s an-
swers are then uploaded into the solution file on the ACME platform, where they are
assessed with feed-back and marks are assigned as per the configuration. This proce-
dure ensures that ACME and Moodle are both used to their full potential, since they
already have a student subject management system that solves all these issues with the
inherent advantages. Another option considered but later abandoned was to develop
each activity individually using an Excel sheet with VBA macros to provide feed-
back and grading. This would have meant programming specific macros for each
activity, thus over-complicating the design and construction of each activity, as well
as losing the centralised management for students. A graphical representation of the
system architecture is depicted in Figure 1.
Fig. 1. The architecture of the ACME system
iJET ‒ Vol. 13, No. 10, 2018 29

4 System use
This section aims to describe how ACME works. The spreadsheet activity in a
classroom setting is described from a double perspective, placing the emphasis on the
two main stakeholders involved, namely the teacher (Section 4.1) and the student
(Section 4.2).
4.1 Teacher perspective
The spreadsheet activity in teacher mode is described step-by-step in the illustra-
tion in Figure 2.
Fig. 2. A process view of teacher mode
The teacher must first create some exercises, for which ACME has a specific activ-
ity editor. Figure 3 illustrates how to edit a problem statement in ACME_Spreadsheet.
A typical problem involving calculating the breakeven point for multiple products (A,
B and C) is shown and will be used throughout the paper to illustrate how the system
works. This editor is the element responsible for facilitating the task of generating
individualised exercises automatically.
Once the teacher has created a spreadsheet activity, it is automatically saved in the
open repository of ACME and is available for any teacher to use, accessed either
through the Moodle platform or directly from ACME. Further configuration elements
relate to selecting whether the activity is a test for self-assessment and trials, or if it is
an assessment item/exam, in either case setting the timing of the planned activity. The
system, completely automatically and randomly, takes the different problem state-
ments and substitutes the parameters marked with values from a parameters list. Once
the activity is assigned to the student’s exercise book it can be visualised and the
student Excel workbook is ready to download. Each student receives a different exer-
cise from their peers, either with the same problem statement but different parameters,
or with a different problem statement and different parameters. Students proceed with
the exercises and teachers have a series of tools to simultaneously monitor and track
their activity. At any time, the following details are available: exercises solved, errors
committed, statistics, timing, etc. The student can communicate with the teacher by
means of the ACME platform to resolve any questions.

Fig. 3. Activity editor
4.2 Student perspective
Figure 4 shows the process followed by the student as a system user:
Fig. 4. Student process view
To proceed in the ACME work environment, the student must log in and access the
assigned exercise book. The activity described in this article must be solved using
spreadsheets after visualising and selecting the exercise needing to be completed.
Once selected, the student can visualise the problem statement and the Excel work-
book is ready for download, as shown in Figure 5.
Once the activity is assigned to the student’s workbook, the problem statement can
be visualized in the ACME platform, the student can download the workbook and
proceed to complete the activity with the required sections/questions. On completion,
the student selects the file (see the Browse button in Figure 5) and sends it to the sys-
tem to be corrected, receiving immediate corresponding feed-back. If it is a summa-
tive assessment, the student will also receive the equivalent mark, and if it is a forma-
tive assessment, the student can resend solutions until the final correct one is found or
they have exhausted the number of trials set by the teacher when configuring the ex-
ercise.
iJET ‒ Vol. 13, No. 10, 2018 31

Fig. 5. Student view of problem statement
5 The architecture of a spreadsheet exercise
This section aims to describe the architecture of the ACME_Spreadsheet, distin-
guishing between an ACME baseline exercise (Section 5.1) and a specific
ACME_spreadsheet exercise (Section 5.2 to Section 5.5).
5.1 An ACME baseline exercise structure
The structure of a baseline exercise on the ACME platform consists of a series of
elements described below.
Heading: Containing the metadata of the exercise, serving to classify it.
Problem statement or the statements that define the exercise: Each exercise can
have one or more different formulations that may even refer to the same exercise
without affecting the way to solve it. A series of #Px tags (where x = 1,2,3 ... n) ap-
pear in the problem statement indicating the point where the parameter values are to
be substituted (see Figure 3).
Parameters’ values: They can be from a predetermined list of values or they can be
calculated. Values can be numbers, text, a mathematical expression or formula, data

files, code files or images. When an exercise is assigned, each #Px marking is substi-
tuted by a parameter value.
Correction code: This code varies according to the type of exercise. It can be a
code written by the teacher, for example a mathematics type code, or it can be a
standard code known only to the teacher who has prepared the exercise, in which case
the teacher should only indicate the typology (for example, spreadsheet type). This
code captures the solution submitted by the student and the values of the correspond-
ing parameters, verifies if the solution is correct or not and provides relevant feed-
back.
Attachments: These can have different functions and can take the form of graphs or
images that can be shown in the problem statement or a data file the student can
download.
The new system typology described in this paper aims to correct exercises where
the solution provided by students is a spreadsheet. The procedure to correct this type
of exercise follows a matching approach and consists of comparing the workbook sent
by the student with the solution workbook created by the teacher. Consequently, the
teacher must create a solution for the exercise together with a template to indicate
where the student must place the results to be corrected. The spreadsheet exercises
follow the generic structure of an ACME exercise and include a heading, statements,
parameter values and 4 attachments, which are the 4 Excel workbooks briefly de-
scribed below for which the same example as the one described in Section 4.1 is used.
5.2 Student Excel Workbook
The Student Excel workbook is an empty template that is downloaded by the stu-
dent from the exercise book. It can contain one or more spreadsheets for completion
and is the only workbook that is accessible to the student. Figure 6 shows how the
cells appear to the user.
• Cells with labels: These cells inform about what is represented in each
row/column.
• Yellow cells: These cells (for example, A3:C7, B12:B14, F12:F14) are to be com-
pleted by students with the parameters corresponding to the exercise. There is the
option of not enabling yellow cells, in which case the student must create their own
information, entering a value to be able to proceed with the calculations required to
find the solution.
• Pink cells: The student enters the experimental values that they themselves should
have generated or found into these cells (for example, F3:F7). The template must
explicitly highlight these values. The position of the values on the spreadsheet
must coincide with the position of the cells marked by the teacher as ‘EXP’ in the
solution spreadsheet.
iJET ‒ Vol. 13, No. 10, 2018 33

Fig. 6. Student Excel workbook exemplified
• Green cells: These cells (for example, B17:B18, F17:F18, B21:E24) will be read
and corrected automatically by the system. It is mandatory that these values appear
and are visible. Their positions in the spreadsheet correspond to the same colouring
legend in the solution spreadsheet created by the teacher.
• Blank/White cells: The student can use these cells to generate intermediate calcula-
tions or they can be left blank. Other spreadsheets can also be used to organise any
intermediary solutions needed to find the final one.
5.3 Solution Excel Workbook
The solution Excel Workbook contains the correct solution for the exercise, which
can be formulated in one or more spreadsheets. Cells can contain a series of data (see
Figure 7).

Fig. 7. Solution Excel workbook exemplified
• Cells with labels: These cells have a guiding function and facilitate reading and
understanding.
• Yellow cells: The system will substitute these cells with the parameter values corre-
sponding to each student when the exercise is corrected. The teacher must mark
them with #Px (x = 1, 2, 3 ... n) to indicate where the parameters that need to be
substituted are. These cells will be referenced in formulas to calculate the solution.
• Pink cells: These cells contain experimental data provided by the student. The
teacher should mark them as ‘EXP’ in the solution Excel workbook. The system
will substitute these cells with the inputs provided by the student when the work-
book is corrected. Optionally, the system can check if the values provided by the
student fall into a predefined range of values defined by the teacher.
• Green cells: The automatic correction system compares these cells with the corre-
sponding ones in the student spreadsheet and feed-back will be generated by them
if these values do not match. The teacher must provide the required formulas to ob-
tain the results based on the parameter values and the experimental data provided
by the student. These cells can contain formulas (see for example F17 and F18,
Figure 7) or they can capture calculations in other spreadsheets (for example
B21:E24 in Figure 7). The main advantage of using a separate spreadsheet is that
the teacher can thereby create an extensive exercise with several questions where
all the calculations are in this spreadsheet. Based on this, several questions can be
derived to form a subset of the different questions and calculations. When assign-
ing the exercises to students, the teacher selects some of the derivative problems
and the system assigns them to each student. The varied questions, problem state-
ments and parameters make it possible for each student to have an individual exer-
cise with a distinct appearance and content from the others, helping to reduce or
eliminate plagiarism.
iJET ‒ Vol. 13, No. 10, 2018 35

• Blank/White cells: These cells can be used by the teacher to generate intermediary
calculations if applicable or they can be left blank. Other spreadsheets can also be
used to organise data and calculations where necessary.
5.4 Feedback Excel Workbook
The feedback Excel workbook showed partially in Figure 8 is a non-compulsory
spreadsheet. Each cell contains the error message that is sent to the student when there
is an incorrect answer. When this spreadsheet is non-existent, the system sends the
alert message ‘incorrect cell’ indicating the column and row, for example B17. In a
formative assessment this spreadsheet serves to indicate what is expected in the cell
with the corresponding explicit message needed to guide the student. The position of
these cells must match with that of the cells in the spreadsheet created by the teacher,
which will be further compared with the one provided by the student.
Fig. 8. Partial capture of the feedback Excel workbook
5.5 Mark Excel Workbook
The mark Excel workbook captured in Figure 9 is another optional file. There is a
value in each cell when the solution is generated (for example, B21:E24). When using
the activity with a summative assessment in mind, the system subsequently calculates
the corresponding grade. For formative assessment purposes, the system can test the
coincidence of the student generated solution with the correct solution without gener-
ating a mark (‘READ’, for example B14, F14). A third option is that a cell is neither
read nor scored (see B13). As in the previous case (see Feedback workbook in Figure
8), the position of these cells must match the position of those in the teacher provided
solution workbook.
Once the teacher has prepared the problem statement, the list of parameters and the
4 Excel workbooks the baseline exercise is saved in the data base. The next step is to
assign the problem statement to a student exercise book.

Fig. 9. Partial capture of the mark Excel workbook exemplified
6 Discussion and conclusions
While plenty of solutions with some functionalities of spreadsheet activities exist,
the one described in the present article has a multi-stakeholder integrative approach
that stands out due to the following characteristics and advantages.
Individualised exercises: The system can generate an individual exercise for each
student. An exercise can include various problem statements and parameters, resulting
in a unique combination that ultimately appears as an individual exercise for each
user.
Flexibility and freedom: The correction is performed in a series of specific cells
highlighted in the student spreadsheet. In all other areas of the spreadsheet the student
can proceed with the intermediary calculations considered necessary to generate the
final solution. Students are thus empowered to proceed with their own solution and
there are no restrictions, for example, on writing a specific, exact formula in a certain
cell.
Complex: The system allows multiple spreadsheets in a workbook to be corrected.
As the results are often organised in different spreadsheets, with some output data
generated by a calculation in a spreadsheet serving as input in another spreadsheet,
this feature allows for planning and carrying out a series of complex activities.
User-friendly: Creating a new exercise is easy and requires no programming skills.
Basic, user-level spreadsheet knowledge is sufficient to plan and generate an activity
once the functioning and structure of this type of activity is known.
Multi-disciplinary: The system is prepared to respond to any spreadsheet-based ac-
tivity irrespective of the knowledge field. Currently, activities are in the field of math-
ematics, statistics, accounts, physics, mechanics and business, among others.
Integrated: All activities on the ACME platform are integrated into the generic
Moodle platform, meaning that all activities can be created and managed from there.
iJET ‒ Vol. 13, No. 10, 2018 37

Formative assessment: Activities can be used for a formative assessment since the
system generates feed-back for students. Each cell configured to be corrected pro-
vides feed-back that is valuable to guide the student towards the correct solution.
Summative assessment: Activities can also be used for a summative assessment.
When configured as such the system returns a numeric mark between 0 and 10 ac-
cording to the value that the teacher has previously marked in each cell.
Going beyond these technical characteristics the solution is well perceived and
welcomed by students. In publication [28], the authors discuss the spreadsheet activity
from a rather pedagogical perspective, contributing with data related to grades and
subjective perception of a previous version of the system.
Complementary to these positive aspects, like all innovative solutions our proposal
has a series of technical limitations. First, the system does not allow dynamic table
equivalent to be used because data in the spreadsheet can be tabulated in table format,
but the dynamic table function is not usable. Second, files other than Microsoft Excel
files generated by other spreadsheet editors are not supported by the system, but since
Microsoft Excel is one of the most used applications this shortcoming is minor. The
pedagogical limitations are related to a series of aspects categorized as preparation,
simulation, functionality and perception. First, the use of ACME_Spreadsheet module
implies a series of preparatory steps taken by the teacher in terms of ideating the
‘what’ and ‘how’ the student should learn, the ‘what’ and ‘how’ the student should be
taught and from this what can be parametrized and systematised through automatiza-
tion. Second, the teacher needs to foresee a variety of scenarios in relation to all the
parameters of the exercise and its solution. Third, managing a novel technical applica-
tion by a teacher always has a certain failure probability in some aspect that adds
stress and tension to the scenario. Last, even if all the previous steps are executed
successfully, there remains the uncertainty of how it will be perceived by students and
the effort-reward balance.
Weighed against these limitations, which are also avenues for future development,
and terms of the experience of using ACME_Spreadsheet once all the necessary steps
according to the requirements are taken, the system is easy to use and the academic
results are positive. Moreover, a conditional progressive approach is also planned to
be applied to solutions wherein once a problem is solved in a first stage the problem
passes to a second stage, which is activated only if and when the previous step has
been correctly completed.
7 Acknowledgment
The authors are grateful for the financial support from the University of Girona
(Spain) MPCUdG2016/093 and MPCUdG2016/024. This work has also been funded
in part by grants from the Spanish Government (No. TIN2016-75866-C3-3-R) and
from the Catalan Government (No. 2017-SGR-1101).

8 References
[1] Soler J, Prados F, Poch J, Boada I. ACME: an E-learning Platform Including Desirable
Features for Engineering Courses. Formación Universitaria, 2016, vol. 5(3), pp. 3–16.
https://doi.org/10.4067/S0718-50062012000300002
[2] Poch J, Boada I, Soler J, Prados F. Automatic creation and correction of mathematical
problems. International Journal Engineering Education, 2016, vol. 32(1), pp. 150–162.
[3] Boada I, Soler J, Prados F, Poch J. A teaching/learning support tool for introductory pro-
gramming courses. International Conference on Information Technology Based Higher
Education and Training: ITHET 2004, pp. 604–609.
[4] Soler J, Boada I, Prados F, Poch J, Fabregat R. A Web-Based E-Learning Tool for Data-
base Design Courses. International Journal Engineering Education, 2011, vol. 27(1), pp.
61–69.
[5] Soler J, Boada I, Prados F, Poch J, Fabregat R. A formative assessment tool for conceptual
database design using UML class diagram. International Journal of emerging technologies
in Learning, 2010, vol. 5(3), pp. 27–33.
[6] Frownfelter- Lohrke C. Teaching good Excel design and skills: A three spreadsheet as-
signment project. Journal of Accounting Education, 2017, vol. 39, pp. 68–83.
https://doi.org/10.1016/j.jaccedu.2016.12.001
[7] Oke SA. Spreadsheet Applications in Engineering Education: A Review. International
Journal Engineering Education, 2004, vol. 20(6), pp. 893–901.
[8] Kanyarusoke KE, Uziak J. Spreadsheets: The ideal tool for distance learning in engineer-
ing education. Computer Applications in Engineering Education, 2011, vol. 19(2), pp.
216–223. https://doi.org/10.1002/cae.20235
[9] Ibrahim D. Using the excel spreadsheet in teaching science subjects. Procedia – Social and
Behavioral Sciences, 2009, vol. 1(1), pp. 309–312. https://doi.org/10.1016/j.sbspro.
2009.01.058
[10] Duller C. Teaching Statistics with Excel A Big Challenge for Students and Lecturers. Aus-
trian journal of statistics, 2008, vol. 37(2), pp. 195–206. https://doi.org/10.17713/ajs.v37
i2.300
[11] Ahmed R. Spreadsheet Software as a Teaching and Learning Tool: Perspectives from an
Undergraduate Financial Modelling Subject. Journal of Review of Higher Education and
Self Learning, 2008, vol. 1(1), pp. 54–75.
[12] Mays T. Using spreadsheets to develop applied skills in a business math course: Student
feedback and perceived learning. Spreadsheets in Education, 2015, vol. 8(3), pp. 1–16.
[13] Matthews K, Janicki T, He L, Patterson L. Implementation of an Automated Grading Sys-
tem with an Adaptive Learning Component to Affect Student Feedback and Response
Time. Journal of Information Systems Education, 2012, vol. 23(1), pp. 71–83.
[14] Bertheussen BA. Power to business professors: Automatic grading of problem-solving
tasks in a spreadsheet. Journal of Accounting Education, 2014, vol. 32(1), pp. 76–87.
[15] Lehman MW, Herring CE. Creating interactive spreadsheets to provide immediate feed-
back. Journal of Accounting Education, 2003, vol. 21(4), pp. 327–337.
[16] Blayney P, Freeman M. Automated formative feedback and summative assessment using
individualised spreadsheet assignments. Australasian Journal of Educational Technology,
2004, vol. 20(2), pp. 209–231. https://doi.org/10.14742/ajet.1360
iJET ‒ Vol. 13, No. 10, 2018 39

[17] Tsai W, Wardell DG. Creating Individualized Data Sets for Student Exercises Using Mi-
crosoft Excel and Visual Basic. INFORMS Transactions on Education, 2006, vol. 7(1), pp.
136–148. https://doi.org/10.1287/ited.7.1.136
[18] Hunt N. Individualized Statistics Coursework Using Spreadsheets. Teaching Statistics,
2007, vol. 29(2), pp. 38-43. https://doi.org/10.1111/j.1467-9639.2007.00254.x
[19] Blayney P, Freeman M. Individualised interactive formative assessments to promote inde-
pendent learning. Journal of Accounting Education, 2008, vol. 26(3), pp. 155–165.
[20] Leong T-Y, Cheong M. Teaching Business Modeling Using Spreadsheets. INFORMS
Transactions on Education, 2008, vol. 9(1), pp. 20–34. https://doi.org/10.1287/ited.
1080.0015
[21] Siepermann M, Siepermann C. Automatically Generated and Marked E-Learning Exercis-
es for Logistics Cost Accounting. International Journal of Economics and Management
Engineering, 2008, vol. 2(2), pp. 105–109.
[22] Hamilton IR. Automating formative and summative feedback for individualised assign-
ments. Campus-Wide Information Systems, 2009, vol. 26(5), pp. 355–364.
https://doi.org/10.1108/10650740911004787
[23] Rosser M. Using Excel to Individualise Basic Mathematics Assignments. Computers in
Higher Education Economics Review, 2011, vol. 20, pp. 13–20.
[24] Nnadi M, Rosser M. The ‘Individualised Accounting Questions’ Technique: Using Excel
to Generate Quantitative Exercises for Large Classes with Unique Individual Answers.
Accounting Education, 2014, vol. 23(3), pp. 193-202. https://doi.org/10.1080/09639
284.2014.894771
[25] Kovacic ZJ, Green JS. Automatic Grading of Spreadsheet and Database Skills. Journal of
Information Technology Education, 2012, vol. (11), pp. 53–70.
[26] Juster TC. Spreadsheet Activities with Conditional Progression and Automatically Gener-
ated Feedback and Grades. Spreadsheets in Education, 2013, vol. 6(1), art. 4.
[27] McNeil CR. Excel Modeling Assignments and Automatic Grading. Journal of Financial
Education, 2015, vol. 41(3), pp. 86–97.
[28] Rafart MA, Bikfalvi A, Soler J, Prados F, Poch J. Improving the learning experience of
business subjects in engineering studies using automatic spreadsheet correctors. Journal of
Technology and Science Education, 2017, vol. 7(2), 203-220. https://doi.org/10.3926/
jotse.252
9 Authors
M. Assumpció Rafart is a teacher and researcher in the Department of Business
Administration and Product Design at the University of Girona. Her research interests
are focused on innovation in teaching using e-learning, web-based tools for teaching
business subjects engineering students.
Andrea Bikfalvi is teaching and research staff in the Department of Business Ad-
ministration and Product Design at the University of Girona. Her main research inter-
est is in holistic approaches of innovation in all types of organizations –mainly, but
not limited to- public administration, private enterprises and education.
Josep Soler is an Associate Professor in Computer Science at the University of Gi-
rona (UdG). He is a member of the Graphics & Imaging Laboratory from the UdG.
His research is focused on the application of web-based tools in computer science

courses.
Jordi Poch is an Associate Professor of the Department of Applied Mathematics at
the University of Girona. His main research interest include mathematical modelling,
and the development and application of new tools to support teaching. He has been
principal investigator of several projects of e-learning.
Article submitted 12 September 2017. Resubmitted 06 and 12 February 2018. Final acceptance 14
March 2018. Final version published as submitted by the authors.
iJET ‒ Vol. 13, No. 10, 2018 41

A Generic Tool For Generating And Assessing Problems Automatically Using Spreadsheets

More Related Content

Similar to A Generic Tool For Generating And Assessing Problems Automatically Using Spreadsheets (20)

More from Tony Lisko (20)

Recently uploaded (20)

A Generic Tool For Generating And Assessing Problems Automatically Using Spreadsheets