ATS2020 Work package 2: Technology and Tools
Essential Partners: CPI (Cyprus Pedagogical Institute Latsia, Nicosia), INNOVE (Foundation of INNOVE, Talinn, Estonia), H2 Learning Limited, Dublin, Ireland, UTA (University of Tampere)
Assessment and/with Technology and Tools: Bibliography for ATS2020
- Bauer, Reinhard, and Peter Baumgartner. 2012. Showcase of Learning. Towards a Pattern Language for Working with electronic Portfolios in higher Education. In: ACM Journal, Vol V. https://www.ph-online.ac.at/ph-wien/voe_main2.getVollText?pDocumentNr=408045&pCurrPk=4032
- Bright, Steven. 2014. 14.3. Portfolios and assessment. In: Mahara 1.9 User Manual. http://manual.mahara.org/en/1.9/tips/assessment.html
Brown, Maury Elizabeth, and Daniel L. Hocutt. "Learning to use, useful for learning: a usability study of Google apps for education." Journal of Usability Studies 10, no. 4 (2015): 160-181. http://scholarship.richmond.edu/cgi/viewcontent.cgi?article=1061&context=spcs-faculty-publications
- Bubas, Goran, Ana Coric and Tihomir Orehovacki. 2012. The integration and assessment of students' artefacts created with diverse Web 2.0 applications. In: Int. Journal of Knowledge Engineering and Soft Data Paradigms, Vol 3, No 3/4. http://www.inderscience.com/storage/f119124810576321.pdf
- Burke, Dervla. 2015 (?). OneNote - Assessment - Coláiste Bhaile Chláir. https://www.microsoft.com/en-ie/pil-networkireland/onenote-assessment.aspx
- Djaghloul Younes, Muriel Foulonneau, and Raynald Jadoul. 2012. From informal knowledge to High-Quality e-Assessment process: the OAT Semantic Approach. 15th International Conference on Interactive Collaborative Learning and 41st International Conference on Engineering Pedagogy, September 26-28, 2012. Austria. (http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6402219)
- Dyer, Kathy. 2013. 22 Easy Formative Assessment Techniques for Measuring Student Learning - See more at: https://www.nwea.org/blog/2013/22-easy-formative-assessment-techniques-for-measuring-student-learning
- Education and Training 2020 Work programme. 2012. Thematic Working Group 'Assessment of Key Competences' Literature review, Glossary and examples. http://ec.europa.eu/education/policy/school/doc/keyreview_en.pdf
- Eksamikeskus. 2011. What is EIS? https://www.youtube.com/watch?v=RK7Pbm8sX7c
- Ertl, Bernhard, Katharina Ebner and Kathy Kikis-Papadakis. 2010. “Evaluation of E-Learning.” International Journal of Knowledge Society Research, 1(3): 31-43.
- Ghoneim, Andrea; Ertl, Bernhard. 2016. Implementation of ePortfolios in Lower Secondary Schools. Experiences in the Framework of the Project EUfolio. EU classroom ePortfolios with a Focus on Teacher Training. In: Reflecting Education. Vol. 10, No. 1, October 2016, pp. 55-69. http://www.reflectingeducation.net/index.php/reflecting/issue/view/15
- Ghoneim, Andrea (ed.) 2015. EUfolio Quality Assurance Plan for Assessment Operations and Guidance Materials for Participants. http://mahara.eufolio.eu/view/view.php?id=10272
- Gülbahar, Yasemin, Christian Rapp, and Jennifer Erlemann. 2014. “Social Media Toolkit. Supporting Instructors to Create Social and Unbound Learning Spaces in Higher Education”. In: Rummler, Klaus (Ed.). Medien in der Wissenschaft. Lernräume gestalten - Bildungskontexte vielfältig denken. (599-607). Münster: Waxmann. https://www.waxmann.com/fileadmin/media/zusatztexte/3142Volltext.pdf
- Heeren, Bastiaan, and Johan Jeuring. 2014. "Feedback services for stepwise exercises." Science of Computer Programming 88 (2014): 110-129. (http://www.sciencedirect.com/science/article/pii/S0167642314000884)
- Henrick, Gavin. 2010. Some examples of Mahara usage. Presentation at IMOOT 2010. WWW: http://www.slideshare.net/ghenrick/a-case-studies-presentation
- Herber, Erich and Andrea Ghoneim (eds.) 2013/2015. EPortfolio for EUfolio. Generic functional Specification. http://mahara.eufolio.eu/view/view.php?id=10270
- Himpsl, Klaus, and Peter Baumgartner. 2009. “Evaluation of E-Portfolio Software.” International Journal of Emerging Technologies in Learning (iJET)4 (1): 16-22. doi:10.3991%2Fijet.v4i1.831; also available at: http://peter.baumgartner.name/wp-content/uploads/2013/08/Himpsl_Baumgartner_2009_Evaluation-of-E-Portfolio-Software.pdf
- Hoeppner, Kristina. 2014. Mahara: ePortfolios For Moodle Users. (Lecture recording from iMoot 2014). https://www.youtube.com/watch?v=59jzvY42iJ8.
- Jenson, Jill D. 2011. Promoting Self-regulation and Critical Reflection Through Writing. Students Use of Electronic Portfolio. In: International Journal of ePortfolio, Bd. 1, Nr. 1, 49-60.
- JISC. 2008/updated 2015. Guide: Assessing e-portfolios: https://www.jisc.ac.uk/guides/e-portfolios/assessing-e-portfolios
- JISC. 2012. Electronic management of assessment. http://www.jisc.ac.uk/guides/electronic-assessment-management
- Kalwaney, Sonia S. 2015. Bringing the teaching portfolio to the 21st century with OneNote. https://blogs.office.com/2015/10/13/bringing-the-teaching-portfolio-to-the-21st-century-with-onenote/
- McQuillan, James. 2016.
OpenID Connect authentication plugin. In: Mahara Newsletter. April 2016. https://mahara.org/newsletter
- Microsoft in Education. 2014. Office 365 for Education. User Scenario: Using SharePoint and Office 365 for class projects and returning/marking assignments. http://www.schoolnet.org.za/PILP/office365/sharepoint-education5-submissions.html
- Microsoft Teacher Academy. 2015. OneNote. The Ultimate Collaboration Tool. (Online Course). https://mva.microsoft.com/en-US/training-courses/teacher-academy-the-ultimate-collaboration-tool-an-introduction-to-onenote-11414?l=PLqIASQGB_2604668935
- Narciss, Susanne. 2013. "Designing and Evaluating Tutoring Feedback Strategies for digital learning environments on the basis of the Interactive Tutoring Feedback Model." Digital Education Review 23 (2013): 7-26. http://www.phil.uni-passau.de/fileadmin/dokumente/lehrstuehle/narciss/Narciss__S.__2013_._Designing_and_Evaluating_Tutoring_Feedback_Strategies.pdf
- Narciss, Susanne. 2011. Feedback strategies. In N. Seel (Ed.), Encyclopedia of the Sciences of LearningNew York: Springer Science & Business Media, LLC
- Narciss, Susanne, Körndle, Hermann & Dresel, Markus. 2011. Self-evaluation accuracy and satisfaction with performance: Are there affective costs or benefits of positive self-evaluation bias? International Journal of Educational Research, 50(4), 230-240.
- Narciss, Susanne, Sergey Sosnovsky, and Eric Andres. 2014. "Adapting Tutoring Feedback Strategies to Motivation." In Open Learning and Teaching in Educational Communities, pp. 288-301.
- OneNote Team/Steffi Svendsen. 2015. Our secret weapon—OneNote for sharing, collaborating and assessing. https://blogs.office.com/2015/05/01/our-secret-weapon-onenote-for-sharing-collaborating-and-assessing/
- PISA. 2015. PISA 2015 Computer Platform Development. Available online: http://www.oecd.org/pisa/pisaproducts/PISA-2015-computer-platform.pdf
- PISA. 2015. Survey of Adult Skills Technical Report. Chapter 5: Development of the Cognitive Items. Available online: http://www.oecd.org/site/piaac/Technical%20Report_Part%202.pdf
- Proske, Antje, Narciss, Susanne & McNamara, Danielle S. 2012. Computer-based scaffolding to facilitate students' development of expertise in academic writing. Journal of Research in Reading, 35(2), 136-152.
- Rabizaite, Edita. 2016. OneNoteClass Notebook as an ePortfolio. In: Office Blogs. Education. https://blogs.office.com/2016/04/20/onenote-class-notebook-as-an-e-portfolio/ (posted , on April 20, 2016)
- Ras, Eric, Valérie Maquil, Muriel Foulonneau, and Thibaud Latour. 2013. Empirical studies on a tangible user interface for technology-based assessment: Insights and emerging challenges, in special CAA 2012 Issue: Pedagogy and Technology: Harmony and Tensions International Journal of e-Assessment, 3, 1. Available online: http://www.taotesting.com/wp-content/uploads/2014/09/Article-IJEA-2013.pdf
- Rupnik Vec, Tanja & Ludmila Novak (2015). ePortfolio as a Tool for Formative Assessment of Knowledge and Skills. Available online at: http://issuu.com/eknjiga/docs/eportfolio-of-student.
- Sairanen, Heikki, Mikko Vuorinen, and Jarmo Viteli. 2014. Collecting and Using Data to Develop Digital Learning culture at School. http://blogs.helsinki.fi/tepe-2013/files/2013/12/Sairanen_Vuorinen_Viteli_Collecting-and-Using-data-to-Develop-Digital-Learning-Culture-at-School.pdf
- Sairanen, Heikki, Mikko Vuorinen, and Jarmo Viteli. 2014. ICT skills of new teachers in Finnish School. In: J. Viteli & M. Leikomaa (Eds.), Proceedings of EdMedia: World Conference on Educational Media and Technology 2014 (pp. 217-222). Association for the Advancement of Computing in Education (AACE).
- Scottish Qualifications Authority. 2014. E-assessment: Guide to Effective Practice. http://www.e-assessment.com/wp-content/uploads/2014/08/e-assessment_-_guide_to_effective_practice_full_version.pdf
- Tutill, Claire. 2015. Simplify marking and assessment with OneNote - a case study of St Andrew's College, New Zealand. http://blogs.technet.com/b/nzedu/archive/2015/03/25/simplify-marking-and-assessment-with-onenote-a-case-study-of-st-andrew-39-s-college-new-zealand.aspx
- Waller, Daniela, Helmut Gollner, and Felix Mödritscher. 2014. Subversiv und multimethodisch: Erfolgreiche Initialisierung einer E-Portfolio-Plattform im Hochschulbereich. In: Evaluierung offener Lernszenarien. Tagungsband zum 13. E-Learning Tag der FH JOANNEUM am 17.9.2014. (pp. 117-126). https://cdn.fh-joanneum.at/media/sites/1/2016/04/Tagungsband_ELT2014.pdf
Preliminary Bibliography for ATS2020 Deliverables 2.1 (Functional Specification) and 2.2 (Tools and Technology Review). Last edit + last access to quoted URLs: 2016-04-20 (Andrea Ghoneim). URLs in brackets point at resources with restricted availablilty (subject to licensing of publishers)
Grading Soft Skills (GRASS) is a 3-year research project financially supported by EU (project reference number: 543029-LLP-1-2013-1-RS-KA3-KA3MP), focusing on representing soft skills of learners of various ages and at different levels of education in a quantitative, measurable way, so that these skills can become the subject of formal validation and recognition: https://sites.google.com/site/llpgrassproject/home
FASTECH - Feedback and Assessment for Students with Technology. JISC funded project run under the Assessment and Feedback programme: Strand A on Institutional Change: (JISC5/11): http://jiscdesignstudio.pbworks.com/w/page/51251270/FASTECH%20Project. Unfortunately, many links of the website of the project (which ended in 2013) are broken. Still recommended: Check out the pages on Changing Assessment and Feedback practice and the "Transforming assessment and feedback case study"!
http://impact-eu.net: IT based Methodology for Promoting, Assessing and validating Competence oriented learning and Training (IMPACT). The project website contains to date (May 2016) mainly content related to Validation...
MENTEP: Mentoring Technology-enhanced pedagogy: http://mentep.eun.org/
SELFIE: Self-reflection tool for digitally capable schools: https://ec.europa.eu/jrc/en/digcomporg/selfie-tool
Internal pages (for project partners/logged-in users)
- Landing page for project partners ("Welcome to Mahara for ATS2020")
- ATS2020 Piloting: Registration issues
- Documentation of the online meetings held on development issues of EIS (test item bank/database created by INNOVE).
- EIS test administration guidelines, via the page "ATS2020 Student's Test with EIS".
Tools, Platforms, and bases for learner-centered, assessment-based work in classroom. Andrea's ATS2020 blog RSS
Assessment of Transversal Skills 2020: an Erasmus + Project under Key Action 3: Support for Policy Reform
Coordination: CPI, Cyprus - Duration: March 2015 - February 2018
Happy New Year!
This is the finish of the ATS2020 project. We piloted the Assessment of Transversal Skills for students of lower secondary schools across Europe. Now we are looking forward to sharing our results and learnings with you through our final conference. On February 2, 2018 we will have a full-day event at the Flemish Parliament in Brussels, entitled "Transversal Skills for the 21st Century". Please check out the programme at the ATS2020 website and register (no fee)!
WP2 of ATS2020, the one on Technology and Tools for formative (and partly summative) assessment, is documented here, in this Mahara collection. However, we like to emphasize that we will be also On site in Brussels with "Workshop 1: ePortfolios: Pedagogical Contexts and Choosing an ePortfolio Platform" (by Nicolas Kanaris and Andrea Ghoneim) and with a poster on Patterns of Formative Assessment for ePortfolio Learning. The poster and the underlying document is available as Deliverable 2.1.5 via this Mahara Collection. Isabell Grundschober of Danube University Krems, who is the main author/editor of the Pattern Collection will present the poster in the framework of the school showcase at the Flemish Parliament.
Hoping to see you there!
IES Rosalia de Castro is a school participating in the ATS2020 pilot in Santiago the Compostela. As we had our partner meeting in Santiago, we had the chance to be welcomed in the school on Thursday, October 6, and, more than that, the students had prepared presentations for us.
Some of the presentations focused on a comparison between Mahara and Google Classroom. The positive points of Mahara were – among others – that is is responding fast and convinces by a high level of interactivity. Having said that, students would like to have better possibilities to find/compare information and to have the chance to work without connection and then to synchronize their data.
Students find Google Classrooms more intuitive to use and find it more „efficient“ because all the work is done in one place.
One of their teachers, Alberto Sacido Romero, who also coordinates ATS2020 work at IES Rosalia de Castro, is using Google Classroom since September 2014 – being one of the first users. A smaller ATS2020 group visits him later in the afternoon for a special session.
He shows us how a class is set up and how Google Classroom looks from the teacher's view. It is indeed easy to handle and rich in features in the same time. Especially the functions for searching and the way information is structured, is convincing. However: How could students make their own ePortfolio with it? The can simply showcase and contextualize their best artefacts with the Google tools Blogger and/or Google sites. The students' blog SCQinfo (http://blogs.prensaescuela.es/scqinfo/) can be an example for an eProtfolio of a class. A last question form the visitors: With Blogger, you have to have your ePortfolio published right away: Don't teachers and students miss different privacy options? Alberto doesn't feel that his students have something to hide when it comes to blogging - „on the other hand, they have a lot to show“. We thank Alberto, his fellow teachers and especially the students of IES Rosalia de Castro for an inspiring visit!
ALEKS (Assessment and LEarning in Knowledge Spaces) is an adaptive learning assistant developed by McGrawHill Education. This blogpost, however, is neither a recommendation nor a review. I came across ALEKS via an article in SLATE.
On the basis of adaptive questioning, ALEKS recommends students which steps to take next. The outcome: a classroom with students working individually, on different tasks and lessons. The teacher is their learning companion.
To quote a representative of McGraw-Hill:
“Unlike some younger tech startups, we don’t think the goal is to replace the teacher,” says Laster, the company’s chief digital officer. “We think education is inherently social, and that students need to learn from well-trained and well-versed teachers. But we also know that that time together, shoulder-to-shoulder, is more and more costly, and more and more precious.” (http://www.slate.com/articles/technology/technology/2015/10/adaptive_learning_software_is_replacing_textbooks_and_upending_american.html)
What ALEKS obviously cannot do yet, either, is to help the students to determine their own learning goals. As it looks to me, ALEKS recommends them learning units on the basis of the outcomes of a small test. Such tests are still better to assess knowledge than skills. And even if skills can be assessed (ATS2020 made an attempt to assess skills in its Pilot Evaluation, basing on the Estonian Testing System EIS), and tailormade lessons on the basis of such an assessment are displayed for every student, the process lacks an important milestone: the autonomous learning path of the student.
If the student is not actively involved into setting his/her learning goals, s/he will always wait for an algorithm to show her/him the way to a solution of a problem. Active learners who become lifelong learners have to be more self-directed when it comes to learning.
However, this doesn't mean that adaptive learning tools like ALEKS should be banned from the classroom. They could open spaces for individualised, learner-centered work in the classroom. And they can always give us ideas about what is possible when artificial intelligence serves as an assistant in the classroom.
Mahara for ATS2020 is now upgraded to version 17.04. A presentation was added to the page "ATS2020 User Support - Guides for Tools" to show some new features of Mahara 17.04. Further guidance material will follow, we also plan webinars for project partners and ATS2020 teachers and trainers in Autumn 2017.
ATS2020 furthermore can proudly point at the fact that part of the Mahara Upgrade was programmed for the ATS2020 project. We even got a "Thank you" card for our contribution which you can find as an attachment to this blog entry. Programming work for Mahara/ATS2020 was done by Gregor Anzelj, and we like to thank him here, again.
Padlet's motto is that it is the easiest way for online collaboration. That's true, indeed. There is hardly any other tool that makes it so easy to start without much of a registration procedure - or, actually, if you use it for brainstorming, without any registration procedure at all.
Even if you (as a teacher) create a Padlet Wall for your students' brainstorming activities, it hardly takes you more than 30 seconds. If you still feel like having an explanation or seeing more ideas what you can do with Padlet in the classroom, you could consult the Padlet Blog Entry of HPS Digital (the blog is run by the admin of Hopkinton Public Schools).
Padlet also offers a plan for schools, including better (classroom) management, the possibility of creating ePortfolios, a controlled environment and more security. There are also some video tutorials online showing the procedure of creating an ePortfolio with Padlet. Here is an example :-)
As an incurable Mahara-lover, I appreciate the possibility to create Padlets and to embed them into Mahara views. Padlets can be embedded in many environments.
The ATS2020 Partner Meeting in March 2017 was able to welcome Riina Vuorikari from the JCR to work with us on Learning Analytics. Basis for the workshop, held at CARNET in Zagreb, was the JRC Report Research Evidence on the Use of Learning Analytics. Implications for Education Policy.
"Students should know that analytics are there to support them, not as a form of surveillance. They should add their own data, be able to correct the process." (p.35)
"A shift towards student reflection, formative assessment and the development of skills and competences will move analytics away from a focus on current measurable outcomes and towards support for the holistic process of learning. This will need to be done in the context of both formal and informal learning." (p.39)
The report shows the state of the art of implementation of Learning Analytics, case studies and an inventory of Learning Analytics tools. It is a great basis for thinking about how Learning Analytics can be used - and to refelct about their purpose.
The ATS2020 Resources Portal does not only help Project Partners to share their resources, it is also open to teachers, students, parents who are interested in learner-centered, assessment-based learning. The Portal which was opened at http://resources.ats2020.eu/, contains guides for the project's main learning environments, Mahara and Office 365/OneNote Class Notebook. It also offers some resources on assessment with ePortfolios - including a MOOC. A very valuable pool within the Portal is the collection of Learning Designs which can be browsed by subject or filtered, focusing on the transversal skills which are in the Focus of ATS2020: Information Literacy, Autonomous Learning, Creativity and Innovation, and Communication and Collaboration. The learning designs do already contain scaffolding tools for assessment - by the learner him-/herself, by Peers and by the teacher. While the selection of resources already looks impressive today, it can be expected that this ePortfolio of Assessment of Transversal Skills will grow further as the project proceeds, and stopping by at http://resources.ats2020.eu frequently will always be rewarded by new content.
Authentic assessment can be something that prepares students for real life. I just found an example in the blog of Desire to Learn. There, Marsha Bayless, educator at a business school, shows, How Authentic Assessment Can Help Students Prepare for the Real World. She uses videos as an assignment. Subject of the video assignment can be an interview - as the students might have IRL if they apply for an internship.
Even though ATS2020 students are too young to apply for internships, there might be other scenarios in which you can imagine authentic assessments: show collaboration skills in a video of a school event a group of students has organized, demonstrate digital literacy by offering a guided tour through a webquest/search scenario done with screencasting software, podcasting a discussion and thus delivering a proof of communication skills etc.
The same tools (video, audio recording, ...) can BTW serve as tools for (peer) feedback or formative assessment - and they can easily handed over to the peer by attaching them to a short written comment. The audio and video files are in the same time artefacts which can be embedded or collected in your ePortfolio.
While experimenting with the Rubrics plugin for Mahara, I came across the presentation of Makoto Miyazaki at Mahara HUI 2015 in Auckland, NZ. In "Rubric plugin: Assessment for/of Learning in Mahara" he talks about outcomes based course design, learning and reflection and assessment for/of learning. He draws eye-catching pictures to support his ideas which can be used well to illustrate processes of reflective learning, feedback and grading/assessment of learning.
Brendan Cawley of Coláiste Pobail Setanta school in Dublin, Ireland shows Assessment for Learning Using OneNote Class Notebooks in Microsoft's Office blogs (published in May 2016). He lets readers participate in the school's learning journey. For the assessment process, students are guided by learning objectives and can assess themselves using a checklist and Bloom's taxonomy.
The examples can serve as a guideline for the ATS2020 assessment process, keeping in mind, however, that learning outcomes are based in our model on negotiations between students (who set their own goals) and teachers (who outline the curricular learning targets and assist students in setting their goals). Rubrics will be elaborated on basis of the ATS2020 framework of transversal skills. Of course, ATS2020 teachers are not confined to the use of rubrics. Tools of self and peer assessment - as well as for formative assessment by the teacher can be checklists (like the one in Brendan Cawley's example), questionnaires, reflection stems, and many more.
Some Belgian schools of the ATS2020 project are using it as an ePortfolio space to develop and assess transversal Skills: SeeSaw. SeeSaw is a digital portfolio management system that is easy to use and allows to capture student learning in its full multimedial bandwith. Tama Trotti, K-12 teacher describes in a blogpost on Emerging EdTech (2015) SeeSaw as a tool for "curation of student work that could be easily handled by students, accessible for parents, and alleviate storage issues with bulky notebooks". She points out how excited her students are to document and reflect their own work, and explains the benefits of peer-to-peer interaction and of parents who stay updated about their kid's learning journey via the SeeSaw ePortfolio.
The licence issue should be kept in mind, however:
"Seesaw is free for teachers and parents. However, if a school would like to have a student’s portfolio move with them from year to year, there is a fee for this and you will need to contact Seesaw directly for more information. If parents would like to continue to keep their student’s portfolio there is a storage fee for that as well and parents can sign up directly with Seesaw." (Trotti 2015)
SeeSaw features look very convincing: Besides the multimedia capture of student learning and a good management interface for teachers, there are multiple ways of communicating - even with other classrooms (which can be at any school worldwide, eg. a partner school). SeeSaw Plus offers an assessment tool which looks very convenient for teachers. It has to be tested whether this tool is inline with the learner-centered approach of formative feedback, though.
I'm looking forward to try it out myself and to hear about the experience of the ATS2020 partners!