heterosemiotic units which integrate various semiotic systems and subsystems
(multimodal and polycode). The algorithm is tested in four heterosemiotic units
of text and image, speech and gesture, multi-discourse and multistylistic unities.
The algorithm is a six-step procedure, it defines the type and character of the
unit, its parametric activity, parametric synchronization and resonance, and finally diagnoses the typicality of the unit representatives. The study proves that
despite the differences within the heterosemiotic units structure, the developed
algorithm is productive and can be applied to distinguish the more and less typical unit representatives.
The study develops the algorithm of typicality analysis within
heterosemiotic units which integrate various semiotic systems and subsystems
(multimodal and polycode). The algorithm is tested in four heterosemiotic units
of text and image, speech and gesture, multi-discourse and multistylistic unities.
The algorithm is a six-step procedure, it defines the type and character of the
unit, its parametric activity, parametric synchronization and resonance, and finally diagnoses the typicality of the unit representatives. The study proves that
despite the differences within the heterosemiotic units structure, the developed
algorithm is productive and can be applied to distinguish the more and less typical unit representatives.
Список литературы
Bakhtin M. M. Voprosy literatury i estetiki [Issues of Literature and Aesthetics]. Moscow, 1975. (in Russ.)
Bochaver S. Yu. Transformatsiya dramaticheskogo teksta v kontse XIX –
nachale XX v. [Transformations in drama at the end of the 19 th – beginning of
the 20 th century]. Critique and Semiotics, 2012, no. 17, p. 274–280. (in Russ.)
Cienki A. Multimodal Metaphor Analysis. In: Cameron L., Maslen R. (eds.).
Metaphor Analysis: Research Practice in Applied Linguistics, Social Sciences
and the Humanities. London, 2010, p. 195–214.
Eco U. Kant and the Platypus: Essays on language and cognition. Boston,
2000.
Grishina E. A. Russkaya zhestikulyatsiya s lingvisticheskoj tochki zreniya
(korpusnye issledovaniya) [Russian gestures in linguistic aspect (corpus studies)]. Moscow, 2017. (in Russ.)
Iriskhanova O. K. Igry fokusa v yazyke. Semantika, sintaksis i pragmatika
defokusirovaniya [Focus Games in Language. Semantics, Syntax and Pragmatics of Focusing]. Moscow, 2014. (in Russ.)
Iriskhanova O. K., Prokofieva O. N. Fokusirovanie v ustnom opisatel'nom
diskurse: analiz vizual'noj pertseptsii, rechi i zhestov [Focusing in oral descriptive discourse: visual perception, speech and gesture analysis]. Kognitivnye
issledovaniya yazyka [Cognitive Studies of Language], 2017, iss. 29, p. 80–94.
(in Russ.)
Iriskhanova O. K., Cienki A. The semiotics of gestures in cognitive linguistics: contribution and challenges. Issues in Cognitive Linguistics, 2018,
no. 4 (57), p. 25–36.
Jakobson R. O. Lingvistika i poetika [Linguistics and poetics]. In: Strukturalizm: “za” i “protiv” [Structuralism: Pro and Contra]. Moscow, 1975,
p. 193–230. (in Russ.)
Kendon A. Gesture: Visible action as utterance. Cambridge, 2004.
Kiose M. I. The interplay of syntactic and lexical salience and its effect on
default figurative responses. Studies in Logic, Grammar and Rhetoric, 2020,
vol. 61 (74), p. 161–178.
Kirtley C. How images draw the eye: an eye-tracking study of composition.
Empirical Studies of the Arts, 2018, vol. 36 (1), p. 41–70.
Kress G. Multimodality. A Social Semiotic Approach to Contemporary
Communication. London, 2010.
Langacker R. Grammar and Conceptualisation. Berlin, New York, 2000.
Loginova E. G. Podobie i kontrast elementov semioticheskikh sistem v polimodal'nom diskurse [Similarity and contrast of semiotic system units in multimodal discourse]. Vestnik Moskovskogo gosudarstvennogo lingvisticheskogo
universiteta. Gumanitarnye nauki [Vestnik of Moscow State Linguistic University. Humanities], 2017, p. 216–226. (in Russ.)
Mueller C., Tag S. The dynamics of metaphor: Foregrounding and activating
metaphoricity in conversational interaction. Cognitive Semiotics, 2010,
vol. 10 (6), p. 85–120.
Petrilli S. The Global World and its Manifold Faces. Otherness as the Basis
for Communication. Bern, 2016.
Petrova N. Yu. Postroenie perspektivy v tekste p'esy [Perspective Construal
in Plays]. Moscow, 2017. (in Russ.)
Rauscher F. H., Krauss R. M., Chen Y. Gesture, speech, and lexical access:
The role of lexical movements in speech production. Psychological Science,
1996, no. 7, p. 226–231.
Rayner K., Rotello C. M., Stewart A. J., Keir J., Duffy S. A. Integrating text
and pictorial information: Eye movements when looking at print advertisements.
Journal of Experimental Psychology: Applied, 2001, vol. 7 (3), p. 219–226.
Schmid H.-J. (ed.). Entrenchment and the psychology of language learning.
How we reorganize and adapt linguistic knowledge. Washington DC, 2016.
Sinha C. (Dis-)Continuity, (inter-)corporeality and conventionality in dialogical development. Commentary on Gratier & Bertau and Lyra. In: Bertau M.-C.,
Gonçalves M. M., Raggatt P. T. F. (eds.). Dialogic Formations. Investigations
into the Origins and Development of the Dialogical Self. Charlotte NC, 2012,
p. 145–153.
Sonin A. G. Ponimanie polikodovykh tekstov: kognitivnyj aspect [Polycode
Texts Comprehension: Cognitive Aspects]. Moscow, 2005. (in Russ.)
Sonneson G. The Varieties of Interpretation: A view from semiotics. Galáxia, 2002, vol. 4, p. 67–99.
Sorokin Yu. A., Tarasov E. F. Kreolizovannye teksty i ikh kommunikativnaya funktsiya [Creolized Texts and their Communicative Function]. In:
Optimizatsiya rechevogo vozdejstviya [Optimization in Speech Impact]. Moscow, 1990, p. 180–186. (in Russ.)
Trifonas P. Image and Text. In: Trifonas P. (ed.). International Handbook of
Semiotics. New York, 2015, p. 1139–1154.
Wårwik B. What is foregrounded in narratives? Hypotheses for the cognitive
basis of foregrounding. In: Virtanen T. (ed.). Approaches to Cognition through
Text and Discourse. Berlin, New York, 2002, p. 99–122.
Zlatev J., Racine T. P., Sinha C., Itkonen E. (eds.). The Shared Mind. Perspectives on Intersubjectivity. Amsterdam, 2012.
Zlatev J., Sonneson G., Konderak P. (eds.). Meaning, Mind and Communication: Explorations in Cognitive Semiotics. Berlin, 2016.
Zykova I. V., Kiose M. I. Parametrizatsiya lingvisticheskoj kreativnosti
v mezhdiskursivnom aspekte: kinodiskurs vs diskurs detskoj literatury [Linguistic creativity parametrization in contrasting discourse types: cinematic discourse
vs. discourse of children’s literature]. Voprosy kognitivnoj lingvistiki [Issues in
Cognitive Linguistics], 2020, no. 2, p. 26–40. (in Russ.)
Uniqueness and Typicality Effects in Heterosemiotic Units: Algorithm
and Analysis Procedure С. 70–86. DOI 10.25205/2307-1737-2020-2-70-86