Assessment of writing mediated by a digital platform: a space for the development of literacy?

Davi Rodrigues,
Fabiana Biondo

Abstract

Currently, the integration of digital technologies into student writing assessment processes has become increasingly common, discussed, and/or encouraged in the academic and educational context. During the year 2021, all High School public schools in the city of Campo Grande - MS had access to an online and private platform that combines human feedback and artificial intelligence (AI) for the assessment of their students' textual productions. Due to its widespread use and consequent relevance in the context of this research, this paper aims to analyze this platform in terms of its proposal for writing assessment in an attempt to understand its potential and problems for the development of work aimed at multiliteracy pedagogy. The methodology used was qualitative and interpretive, respectively, and was based on the analysis of the following publicly available materials: a live program produced by the MS Department of Education, public information available on the platform's official website and social media, and information contained in a video archived on the Vimeo platform. The analysis showed that the platform adopts a process of assessing textual production based on a structural perspective of language and aligned with the autonomous literacy perspective, denoting an instrumentalist and neoliberal character of education.

References

BRASIL. Ministério da Saúde. Conselho Nacional de Saúde. Resolução no 510, de 7 de abril de 2016. Trata sobre as diretrizes e normas regulamentadoras de pesquisa em ciências humanas e sociais. Diário Oficial da União, Brasília, DF, 24 mai. 2016. Disponível em: https://www.in.gov.br/materia/-/asset_publisher/Kujrw0TZC2Mb/content/id/22917581. Acesso em: 18 set. 2023.

CHEN, Chi-Fen Emily.; CHENG, Wei-Yuan Eugene. Beyond the design of automated writing valuation: Pedagogical practices and perceived learning effectiveness in efl writing classes. Language Learning & Technology. jun. 2008, vol. 12, n. 2, p. 94-112. Disponível em: https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/77d263c9-dfcf-4382-b179-7002b43cd5ef/content. Acesso em: 06 out. 2023.

COPE, B.; KALANTZIS, M. 'Design' in Principle and Practice: A Reconsideration of the Terms of Design Engagement. The Design Journal. vol. 14, n. 1, 2011, p. 45-63. Disponível em: https://newlearningonline.com/_uploads/Design_in_Principle_and_Practice_A_Reconsidera.pdf. Acesso em: 25 out. 2023.

COPE, Bill; KALANTZIS, Mary; MCCARTHEY, Sarah; VOJAK, Colleen; KLINE, Sonia. Technology-Mediated Writing Assessments: Principles and Processes. BLAIR, K. L.; SELFE, C. L. (Orgs.). Computer and composition. Vol. 28, n. 2, 2011a. p. 79-97. Disponível em: https://www.sciencedirect.com/science/article/abs/pii/S8755461511000284. Acesso em: 9 jul. 2021.

COPE, Bill; KALANTZIS, Mary; MCCARTHEY, Sarah; VOJAK, Colleen; KLINE, Sonia. New Spaces and Old Places: An Analysis of Writing Assessment Software. BLAIR, Kristine L.; SELFE, Cynthia L.; HAWISHER, Gail E. (Orgs.). Computer and composition. Vol. 28, n. 2, 2011b. p. 97-111. Disponível em: https://newlearningonline.com/_uploads/WritingAssessmentTechs.pdf. Acesso em: 9 jul. 2021.

DENZIN, Norman Kent; LINCOLN, Yvonna. Sessions. Introduction: the discipline and practice of qualitative research. In: DENZIN, Norman Kent; LINCOLN, Yvonna Sessions. The sage handbook of qualitative research. Thousands Oaks: Sage Publication Ltd, 2000.

DOLZ, Joaquim; NOVERRAZ, Michèle; SCHNEUWLY, Bernard. Sequências didáticas para o oral e a escrita: apresentação de um procedimento. In: SCHNEUWLY, B.; DOLZ, J. Gêneros orais e escritos na escola. Trad. de Roxane Rojo e Glaís Sales Cordeiro. Campinas-SP: Mercado de Letras, 2004. Disponível em: https://edisciplinas.usp.br/pluginfile.php/5794503/mod_resource/content/1/DOLZ%3B%20NOVERRAZ%3B%20SCHNEUWLY.%20Sequ%C3%AAncias%20Did%C3%A1ticas%20para%20o%20oral%20e%20para%20a%20escrita%20apresenta%C3%A7%C3%A3o%20de%20um%20procedimento.pdf. Acesso em: 16 out. 2023.

DUBOC, Ana Paula. Letramento crítico nas brechas da sala de línguas estrangeiras. In:

TAKAKI, N. H.; MACIEL, R. F. (Orgs.). Letramentos em terra de Paulo Freire. Campinas: Pontes Editores, 2017, p. 209-229.

EDUCAÇÃO MS. Encontro de Ambientação - Programa Letrus. Youtube, 31 ago. 2021. Disponível em: https://www.youtube.com/watch?v=o6RGA257pRg&t=211s. Acesso em: 03 out. 2023.

GRUPO NOVA LONDRES. Uma Pedagogia dos Multiletramentos: Projetando Futuros Sociais. Tradução de Deise Nancy de Morais, Gabriela Claudino Grande, Rafaela Salemme Bolsarin Biazotti, Roziane Keila Grando. Revista Linguagem em Foco, v. 13, n. 2, 2021. p. 101-145. Disponível em: https://revistas.uece.br/index.php/linguagememfoco/article/view/5578/4503. Acesso em: 14 jun. 2023.

KALANTZIS, Mary; COPE, Bill; PINHEIRO, Petrilson. Letramentos. 1 ed. Campinas: Unicamp, 2020, p. 15-32, 171-179, 369-393.

LETRUS. Ferramenta da plataforma Letrus. 28 ago. 2020. Facebook: Letrus. Disponível em: https://www.facebook.com/watch/?v=1001440630285902. Acesso em: 03 out. 2023.

LETRUS. [Letrus] Para estudantes: Correção EM. Vimeo. 2021a. Disponível em: https://vimeo.com/527539117/81ca531c20?share=copy. Acesso em: 06 out. 2023.

LETRUS. Thread sobre níveis. 26 abr. 2021b. Twitter: @letrus_. Disponível em: https://twitter.com/letrus_/status/1386692052826705925?s=20. Acesso em: 06 out. 2023.

MOITA LOPES, Luiz Paulo da. Introdução. Fotografias da Linguística Aplicada brasileira na modernidade recente. In: MOITA LOPES, L. P. (org.). Linguística Aplicada na modernidade recente: Festschrift para Antonieta Celani. São Paulo: Parábola Editorial, 2013. p. 15-37.

RODRIGUES, Davi; MAIA, Iasmin. Neoliberalismo em cena: letramento como agregador de valor a um produto educacional. No prelo.

ROJO, Roxane. Letramentos Múltiplos: Escola e inclusão social. São Paulo: Parábola Editorial, 2009.

STREET, Brian. What's "new" in New Literacy Studies? critical approaches to literacy in theory and practice. Current Issues in Comparative Education. vol. 5, 2003. p. 77-91. Disponível em: https://www.tc.columbia.edu/cice/pdf/25734_5_2_Street.pdf. Acesso em: 25 out. 2023.

TAHRIRI, Abdorreza; SALAVATIZADEH, Masumeh. The effect of blended online automated feedback and teacher feedback on efl learners’ essay writing ability and perception. Journal of Teaching Language Skills. 2020, DOI: 10.22099/jtls.2021.38753.2899. Disponível em: https://tesl.shirazu.ac.ir/article_5968_96763fa4ea957e96c02008be3b2d6f53.pdf. Acesso em: 06 out. 2023.

VETROMILLE-CASTRO, Rafael. Língua como instrumento, língua para o poder: Reflexões sobre o papel do professor, tecnologias digitais e desenvolvimento linguístico. In: TAKAKI, N. H; MONTE MÓR, W. (Orgs.). Construções de sentido e letramento crítico na área de línguas/linguagens. Campinas, SP: Pontes Editores, 2017, p. 195-219.

VYGOTSKY, Lev Semenovich. Pensamento e linguagem. 2001. Disponível em: http://www.ebooksbrasil.org/adobeebook/vigo.pdf. Acesso em: 06 out. 2023.