ATS2020 Work package 2: Technology and Tools
WP Lead: DUK (Danube University Krems)
Essential Partners: CPI (Cyprus Pedagogical Institute Latsia, Nicosia), INNOVE (Foundation of INNOVE, Talinn, Estonia), H2 Learning Limited, Dublin, Ireland, UTA (University of Tampere)
ATS2020 Tools and technology model
the presentation of the ATS2020 tools and technology plan for the pilot (and thus for assessment) was available here until 10 May 2016. With the "opening" of an own ePortfolio page devoted to D.2.2 (Tools and Technology for student-centered learning and assessment), the presentation was edited to reflect recent discussions and added to the page devoted to D.2.2
Assessment and/with Technology and Tools: Bibliography for ATS2020
- Bauer, Reinhard, and Peter Baumgartner. 2012. Showcase of Learning. Towards a Pattern Language for Working with electronic Portfolios in higher Education. In: ACM Journal, Vol V. https://www.ph-online.ac.at/ph-wien/voe_main2.getVollText?pDocumentNr=408045&pCurrPk=4032
- Bright, Steven. 2014. 14.3. Portfolios and assessment. In: Mahara 1.9 User Manual. http://manual.mahara.org/en/1.9/tips/assessment.html
Brown, Maury Elizabeth, and Daniel L. Hocutt. "Learning to use, useful for learning: a usability study of Google apps for education." Journal of Usability Studies 10, no. 4 (2015): 160-181. http://scholarship.richmond.edu/cgi/viewcontent.cgi?article=1061&context=spcs-faculty-publications
- Bubas, Goran, Ana Coric and Tihomir Orehovacki. 2012. The integration and assessment of students' artefacts created with diverse Web 2.0 applications. In: Int. Journal of Knowledge Engineering and Soft Data Paradigms, Vol 3, No 3/4. http://www.inderscience.com/storage/f119124810576321.pdf
- Burke, Dervla. 2015 (?). OneNote - Assessment - Coláiste Bhaile Chláir. https://www.microsoft.com/en-ie/pil-networkireland/onenote-assessment.aspx
- Djaghloul Younes, Muriel Foulonneau, and Raynald Jadoul. 2012. From informal knowledge to High-Quality e-Assessment process: the OAT Semantic Approach. 15th International Conference on Interactive Collaborative Learning and 41st International Conference on Engineering Pedagogy, September 26-28, 2012. Austria. (http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6402219)
- Dyer, Kathy. 2013. 22 Easy Formative Assessment Techniques for Measuring Student Learning - See more at: https://www.nwea.org/blog/2013/22-easy-formative-assessment-techniques-for-measuring-student-learning
- Education and Training 2020 Work programme. 2012. Thematic Working Group 'Assessment of Key Competences' Literature review, Glossary and examples. http://ec.europa.eu/education/policy/school/doc/keyreview_en.pdf
- Eksamikeskus. 2011. What is EIS? https://www.youtube.com/watch?v=RK7Pbm8sX7c
- Ertl, Bernhard, Katharina Ebner and Kathy Kikis-Papadakis. 2010. “Evaluation of E-Learning.” International Journal of Knowledge Society Research, 1(3): 31-43.
- Ghoneim, Andrea; Ertl, Bernhard. 2016. Implementation of ePortfolios in Lower Secondary Schools. Experiences in the Framework of the Project EUfolio. EU classroom ePortfolios with a Focus on Teacher Training. In: Reflecting Education. Vol. 10, No. 1, October 2016, pp. 55-69. http://www.reflectingeducation.net/index.php/reflecting/issue/view/15
- Ghoneim, Andrea (ed.) 2015. EUfolio Quality Assurance Plan for Assessment Operations and Guidance Materials for Participants. http://mahara.eufolio.eu/view/view.php?id=10272
- Gülbahar, Yasemin, Christian Rapp, and Jennifer Erlemann. 2014. “Social Media Toolkit. Supporting Instructors to Create Social and Unbound Learning Spaces in Higher Education”. In: Rummler, Klaus (Ed.). Medien in der Wissenschaft. Lernräume gestalten - Bildungskontexte vielfältig denken. (599-607). Münster: Waxmann. https://www.waxmann.com/fileadmin/media/zusatztexte/3142Volltext.pdf
- Heeren, Bastiaan, and Johan Jeuring. 2014. "Feedback services for stepwise exercises." Science of Computer Programming 88 (2014): 110-129. (http://www.sciencedirect.com/science/article/pii/S0167642314000884)
- Henrick, Gavin. 2010. Some examples of Mahara usage. Presentation at IMOOT 2010. WWW: http://www.slideshare.net/ghenrick/a-case-studies-presentation
- Herber, Erich and Andrea Ghoneim (eds.) 2013/2015. EPortfolio for EUfolio. Generic functional Specification. http://mahara.eufolio.eu/view/view.php?id=10270
- Himpsl, Klaus, and Peter Baumgartner. 2009. “Evaluation of E-Portfolio Software.” International Journal of Emerging Technologies in Learning (iJET)4 (1): 16-22. doi:10.3991%2Fijet.v4i1.831; also available at: http://peter.baumgartner.name/wp-content/uploads/2013/08/Himpsl_Baumgartner_2009_Evaluation-of-E-Portfolio-Software.pdf
- Hoeppner, Kristina. 2014. Mahara: ePortfolios For Moodle Users. (Lecture recording from iMoot 2014). https://www.youtube.com/watch?v=59jzvY42iJ8.
- Jenson, Jill D. 2011. Promoting Self-regulation and Critical Reflection Through Writing. Students Use of Electronic Portfolio. In: International Journal of ePortfolio, Bd. 1, Nr. 1, 49-60.
- JISC. 2008/updated 2015. Guide: Assessing e-portfolios: https://www.jisc.ac.uk/guides/e-portfolios/assessing-e-portfolios
- JISC. 2012. Electronic management of assessment. http://www.jisc.ac.uk/guides/electronic-assessment-management
- Kalwaney, Sonia S. 2015. Bringing the teaching portfolio to the 21st century with OneNote. https://blogs.office.com/2015/10/13/bringing-the-teaching-portfolio-to-the-21st-century-with-onenote/
- McQuillan, James. 2016.
OpenID Connect authentication plugin. In: Mahara Newsletter. April 2016. https://mahara.org/newsletter
- Microsoft in Education. 2014. Office 365 for Education. User Scenario: Using SharePoint and Office 365 for class projects and returning/marking assignments. http://www.schoolnet.org.za/PILP/office365/sharepoint-education5-submissions.html
- Microsoft Teacher Academy. 2015. OneNote. The Ultimate Collaboration Tool. (Online Course). https://mva.microsoft.com/en-US/training-courses/teacher-academy-the-ultimate-collaboration-tool-an-introduction-to-onenote-11414?l=PLqIASQGB_2604668935
- Narciss, Susanne. 2013. "Designing and Evaluating Tutoring Feedback Strategies for digital learning environments on the basis of the Interactive Tutoring Feedback Model." Digital Education Review 23 (2013): 7-26. http://www.phil.uni-passau.de/fileadmin/dokumente/lehrstuehle/narciss/Narciss__S.__2013_._Designing_and_Evaluating_Tutoring_Feedback_Strategies.pdf
- Narciss, Susanne. 2011. Feedback strategies. In N. Seel (Ed.), Encyclopedia of the Sciences of LearningNew York: Springer Science & Business Media, LLC
- Narciss, Susanne, Körndle, Hermann & Dresel, Markus. 2011. Self-evaluation accuracy and satisfaction with performance: Are there affective costs or benefits of positive self-evaluation bias? International Journal of Educational Research, 50(4), 230-240.
- Narciss, Susanne, Sergey Sosnovsky, and Eric Andres. 2014. "Adapting Tutoring Feedback Strategies to Motivation." In Open Learning and Teaching in Educational Communities, pp. 288-301.
- OneNote Team/Steffi Svendsen. 2015. Our secret weapon—OneNote for sharing, collaborating and assessing. https://blogs.office.com/2015/05/01/our-secret-weapon-onenote-for-sharing-collaborating-and-assessing/
- PISA. 2015. PISA 2015 Computer Platform Development. Available online: http://www.oecd.org/pisa/pisaproducts/PISA-2015-computer-platform.pdf
- PISA. 2015. Survey of Adult Skills Technical Report. Chapter 5: Development of the Cognitive Items. Available online: http://www.oecd.org/site/piaac/Technical%20Report_Part%202.pdf
- Proske, Antje, Narciss, Susanne & McNamara, Danielle S. 2012. Computer-based scaffolding to facilitate students' development of expertise in academic writing. Journal of Research in Reading, 35(2), 136-152.
- Rabizaite, Edita. 2016. OneNoteClass Notebook as an ePortfolio. In: Office Blogs. Education. https://blogs.office.com/2016/04/20/onenote-class-notebook-as-an-e-portfolio/ (posted , on April 20, 2016)
- Ras, Eric, Valérie Maquil, Muriel Foulonneau, and Thibaud Latour. 2013. Empirical studies on a tangible user interface for technology-based assessment: Insights and emerging challenges, in special CAA 2012 Issue: Pedagogy and Technology: Harmony and Tensions International Journal of e-Assessment, 3, 1. Available online: http://www.taotesting.com/wp-content/uploads/2014/09/Article-IJEA-2013.pdf
- Rupnik Vec, Tanja & Ludmila Novak (2015). ePortfolio as a Tool for Formative Assessment of Knowledge and Skills. Available online at: http://issuu.com/eknjiga/docs/eportfolio-of-student.
- Sairanen, Heikki, Mikko Vuorinen, and Jarmo Viteli. 2014. Collecting and Using Data to Develop Digital Learning culture at School. http://blogs.helsinki.fi/tepe-2013/files/2013/12/Sairanen_Vuorinen_Viteli_Collecting-and-Using-data-to-Develop-Digital-Learning-Culture-at-School.pdf
- Sairanen, Heikki, Mikko Vuorinen, and Jarmo Viteli. 2014. ICT skills of new teachers in Finnish School. In: J. Viteli & M. Leikomaa (Eds.), Proceedings of EdMedia: World Conference on Educational Media and Technology 2014 (pp. 217-222). Association for the Advancement of Computing in Education (AACE).
- Scottish Qualifications Authority. 2014. E-assessment: Guide to Effective Practice. http://www.e-assessment.com/wp-content/uploads/2014/08/e-assessment_-_guide_to_effective_practice_full_version.pdf
- Tutill, Claire. 2015. Simplify marking and assessment with OneNote - a case study of St Andrew's College, New Zealand. http://blogs.technet.com/b/nzedu/archive/2015/03/25/simplify-marking-and-assessment-with-onenote-a-case-study-of-st-andrew-39-s-college-new-zealand.aspx
- Waller, Daniela, Helmut Gollner, and Felix Mödritscher. 2014. Subversiv und multimethodisch: Erfolgreiche Initialisierung einer E-Portfolio-Plattform im Hochschulbereich. In: Evaluierung offener Lernszenarien. Tagungsband zum 13. E-Learning Tag der FH JOANNEUM am 17.9.2014. (pp. 117-126). http://www.fh-joanneum.at/global/show_document.asp?id=aaaaaaaaaajlwqa&download=1
Preliminary Bibliography for ATS2020 Deliverables 2.1 (Functional Specification) and 2.2 (Tools and Technology Review). Last edit + last access to quoted URLs: 2016-04-20 (Andrea Ghoneim). URLs in brackets point at resources with restricted availablilty (subject to licensing of publishers)
Grading Soft Skills (GRASS) is a 3-year research project financially supported by EU (project reference number: 543029-LLP-1-2013-1-RS-KA3-KA3MP), focusing on representing soft skills of learners of various ages and at different levels of education in a quantitative, measurable way, so that these skills can become the subject of formal validation and recognition: https://sites.google.com/site/llpgrassproject/home
FASTECH - Feedback and Assessment for Students with Technology. JISC funded project run under the Assessment and Feedback programme: Strand A on Institutional Change: (JISC5/11): http://jiscdesignstudio.pbworks.com/w/page/51251270/FASTECH%20Project. Unfortunately, many links of the website of the project (which ended in 2013) are broken. Still recommended: Check out the pages on Changing Assessment and Feedback practice and the "Transforming assessment and feedback case study"!
http://impact-eu.net: IT based Methodology for Promoting, Assessing and validating Competence oriented learning and Training (IMPACT). The project website contains to date (May 2016) mainly content related to Validation...
Andrea's ATS2020 blog RSS
Assessment of Transversal Skills 2020: an Erasmus + Project under Key Action 3: Support for Policy Reform
Coordination: CPI, Cyprus - Duration: March 2015 - February 2018
Padlet's motto is that it is the easiest way for online collaboration. That's true, indeed. There is hardly any other tool that makes it so easy to start without much of a registration procedure - or, actually, if you use it for brainstorming, without any registration procedure at all.
Even if you (as a teacher) create a Padlet Wall for your students' brainstorming activities, it hardly takes you more than 30 seconds. If you still feel like having an explanation or seeing more ideas what you can do with Padlet in the classroom, you could consult the Padlet Blog Entry of HPS Digital (the blog is run by the admin of Hopkinton Public Schools).
Padlet also offers a plan for schools, including better (classroom) management, the possibility of creating ePortfolios, a controlled environment and more security. There are also some video tutorials online showing the procedure of creating an ePortfolio with Padlet. Here is an example :-)
As an incurable Mahara-lover, I appreciate the possibility to create Padlets and to embed them into Mahara views. Padlets can be embedded in many environments.
The ATS2020 Partner Meeting in March 2017 was able to welcome Riina Vuorikari from the JCR to work with us on Learning Analytics. Basis for the workshop, held at CARNET in Zagreb, was the JRC Report Research Evidence on the Use of Learning Analytics. Implications for Education Policy.
"Students should know that analytics are there to support them, not as a form of surveillance. They should add their own data, be able to correct the process." (p.35)
"A shift towards student reflection, formative assessment and the development of skills and competences will move analytics away from a focus on current measurable outcomes and towards support for the holistic process of learning. This will need to be done in the context of both formal and informal learning." (p.39)
The report shows the state of the art of implementation of Learning Analytics, case studies and an inventory of Learning Analytics tools. It is a great basis for thinking about how Learning Analytics can be used - and to refelct about their purpose.
The ATS2020 Resources Portal does not only help Project Partners to share their resources, it is also open to teachers, students, parents who are interested in learner-centered, assessment-based learning. The Portal which was opened at http://resources.ats2020.eu/, contains guides for the project's main learning environments, Mahara and Office 365/OneNote Class Notebook. It also offers some resources on assessment with ePortfolios - including a MOOC. A very valuable pool within the Portal is the collection of Learning Designs which can be browsed by subject or filtered, focusing on the transversal skills which are in the Focus of ATS2020: Information Literacy, Autonomous Learning, Creativity and Innovation, and Communication and Collaboration. The learning designs do already contain scaffolding tools for assessment - by the learner him-/herself, by Peers and by the teacher. While the selection of resources already looks impressive today, it can be expected that this ePortfolio of Assessment of Transversal Skills will grow further as the project proceeds, and stopping by at http://resources.ats2020.eu frequently will always be rewarded by new content.
Authentic assessment can be something that prepares students for real life. I just found an example in the blog of Desire to Learn. There, Marsha Bayless, educator at a business school, shows, How Authentic Assessment Can Help Students Prepare for the Real World. She uses videos as an assignment. Subject of the video assignment can be an interview - as the students might have IRL if they apply for an internship.
Even though ATS2020 students are too young to apply for internships, there might be other scenarios in which you can imagine authentic assessments: show collaboration skills in a video of a school event a group of students has organized, demonstrate digital literacy by offering a guided tour through a webquest/search scenario done with screencasting software, podcasting a discussion and thus delivering a proof of communication skills etc.
The same tools (video, audio recording, ...) can BTW serve as tools for (peer) feedback or formative assessment - and they can easily handed over to the peer by attaching them to a short written comment. The audio and video files are in the same time artefacts which can be embedded or collected in your ePortfolio.
While experimenting with the Rubrics plugin for Mahara, I came across the presentation of Makoto Miyazaki at Mahara HUI 2015 in Auckland, NZ. In "Rubric plugin: Assessment for/of Learning in Mahara" he talks about outcomes based course design, learning and reflection and assessment for/of learning. He draws eye-catching pictures to support his ideas which can be used well to illustrate processes of reflective learning, feedback and grading/assessment of learning.
Brendan Cawley of Coláiste Pobail Setanta school in Dublin, Ireland shows Assessment for Learning Using OneNote Class Notebooks in Microsoft's Office blogs (published in May 2016). He lets readers participate in the school's learning journey. For the assessment process, students are guided by learning objectives and can assess themselves using a checklist and Bloom's taxonomy.
The examples can serve as a guideline for the ATS2020 assessment process, keeping in mind, however, that learning outcomes are based in our model on negotiations between students (who set their own goals) and teachers (who outline the curricular learning targets and assist students in setting their goals). Rubrics will be elaborated on basis of the ATS2020 framework of transversal skills. Of course, ATS2020 teachers are not confined to the use of rubrics. Tools of self and peer assessment - as well as for formative assessment by the teacher can be checklists (like the one in Brendan Cawley's example), questionnaires, reflection stems, and many more.
Some Belgian schools of the ATS2020 project are using it as an ePortfolio space to develop and assess transversal Skills: SeeSaw. SeeSaw is a digital portfolio management system that is easy to use and allows to capture student learning in its full multimedial bandwith. Tama Trotti, K-12 teacher describes in a blogpost on Emerging EdTech (2015) SeeSaw as a tool for "curation of student work that could be easily handled by students, accessible for parents, and alleviate storage issues with bulky notebooks". She points out how excited her students are to document and reflect their own work, and explains the benefits of peer-to-peer interaction and of parents who stay updated about their kid's learning journey via the SeeSaw ePortfolio.
The licence issue should be kept in mind, however:
"Seesaw is free for teachers and parents. However, if a school would like to have a student’s portfolio move with them from year to year, there is a fee for this and you will need to contact Seesaw directly for more information. If parents would like to continue to keep their student’s portfolio there is a storage fee for that as well and parents can sign up directly with Seesaw." (Trotti 2015)
SeeSaw features look very convincing: Besides the multimedia capture of student learning and a good management interface for teachers, there are multiple ways of communicating - even with other classrooms (which can be at any school worldwide, eg. a partner school). SeeSaw Plus offers an assessment tool which looks very convenient for teachers. It has to be tested whether this tool is inline with the learner-centered approach of formative feedback, though.
I'm looking forward to try it out myself and to hear about the experience of the ATS2020 partners!
The guides for ATS2020 tools are partly available as OER - so please feel free to use the guidance materials on the project's main ePortfolio platforms, Mahara and Office 365/OneNote Class Notebook. They are collected and displayed here. The guidance materials - presentation slides, screencasts, webinar recordings - were elaborated and made available along with train-the-trainer workshops and do also reflect user's questions. The last guide added is "Assessment with Mahara". For Office 365/OneNote Class Notebook a range of further guiding material is available for ATS2020 project participants, only. On the page ATS2020 User Support - Guides for Tools" you can find the table of contents and how to find them via Sharepoint.
I found a TedX-video of Helen Barrett, the "grandmother" of ePortfolios. I'll blog about it as soon as I find the time, in the meantime I "conservate" the link to the video here: https://www.youtube.com/watch?v=ckcSegrwjkA
The "TechCoaches" of Dearborn Schools blog about "Helping Dearborn teachers integrate technology to transform learning". In March 2016 one of the topics was the implementation of Mahara ePortfolios in a K12 classroom (this corresponds to the ATS2020 student's age). The blog shows that teachers made an instruction for their students on Google docs. Students worked themselves through these instructions in class. They had a green and a red cup on their table and could "display" the red one in order to get help from the teacher. Students who were done with their first ePortfolio steps would walk around to help their classmates who were not done yet. Videos illustrate the implementation and the first ePortfolio exercise (taking 3 photos to show what they connect with "Earth Science").
The blog article Ms. Pas & Ms. Masiarczyk help students begin their ePortfolio journeys is a great example, taken directly from practice!
Question to the practitioners in classrooms: Is it really necessary to emphasize so much on the rules for using one's own devices when doing such an exercise?
Edita Rabizaite, ATS2020 partner and known personally to many of us from the ATS2020 trainers' workshop in Krems, contributed to the MS Office blogs with a post on "OneNote Class Notebook as an ePortfolio" (posted April 20, 2016). As her didactic settings for creating ePortfolios within OneNote Class Notebook are quite similar to the ones used in EUfolio and ATS2020, her blogpost is almost a perfect guideline how work with Office 365/OneNote Class notebook could look like for ATS2020 pilot classes. She illustrates her work with graphics - and thus makes everyone eager to start trying out her/his own teaching and learning experience with OneNote Class Notebook!