portfolio.IDE Hee-Eun Kim
EN KR
research/rcs ×

Relational Cognitive System (RCS)

The Relational Cognitive System (RCS) is a foundational framework for designing systems that treat cognition as distributed, relational, and emergent. Rather than modelling cognition as internal computation performed by isolated agents, RCS approaches it as an ongoing negotiation among entities within networks. It operates as both theoretical position and design principle, establishing the epistemological ground from which methodologies like Behaviour-Driven Systemic Sonification (BDSS) and Pre-Verbal Affective Dynamics (PVAD) emerge..


Theoretical Foundation

RCS draws on three bodies of work that challenge individualist and reductionist models of cognition.

Distributed Cognition

Hutchins (1995) demonstrates that cognition extends beyond individual minds, distributed across people, tools, and environments. Cognitive processes occur through coordination among these elements rather than within any single locus. Hollan, Hutchins, and Kirsh (2000) extend this framework to human-computer interaction, arguing for systems designed around distributed cognitive processes rather than isolated user minds. RCS builds on this work by treating distribution not merely as an observational framework but as a design principle where agents operate through continuous negotiation rather than centralized coordination.

Second-Order Cybernetics

Von Foerster's (1974) second-order cybernetics positions observers as participants within the systems they observe. Observation transforms systems rather than remaining external to them. This recursive relation challenges the separation between observer and observed, treating feedback as constitutive rather than corrective. RCS extends this to multi-agent architectures where each agent functions as both observer and observed, continuously interpreting and negotiating with others.

Dynamic Systems Theory

Dynamic systems theory conceptualizes cognition as continuous process rather than discrete states (Riley, 2012). Attractors, phase transitions, and multi-scale temporal dynamics describe how cognitive processes unfold over time. RCS applies these concepts to relational systems, modelling how stability, transition, and evolution emerge through agent interaction rather than through predetermined rules or fixed objectives.


Core Principles

RCS operates through four interconnected principles that structure how systems are designed and how behaviour emerges.

Relational Emergence

Cognition emerges from recursive interactions between entities. The pattern of relations among agents determines system behaviour more than the attributes of individual agents. This principle rejects centralized control in favour of distributed architecture where each element operates autonomously yet remains continuously engaged with others. Emergence is not incidental but foundational.

Negotiation-Based Coherence

Systems do not optimize toward predefined values. Instead, agents continuously negotiate to maintain coherence. Stability arises from relational alignment rather than logical convergence or error minimization. Rather than implementing a fixed objective function, systems designed under RCS require negotiation protocols where agents adjust their states in response to one another. Coherence is provisional and dynamic.

Recursive Feedback

System output becomes new input. Systems react to what they generate and evolve through that interaction. This requires recursive structure where feedback loops are integral rather than supplementary. Systems must be self-referential, capable of observing and modulating their own behaviour. The distinction between input and output collapses into continuous circulation.

Temporal Narrativity

Cognition unfolds temporally rather than existing as static condition. Transitional states, intermediate phases, and indeterminate moments constitute sites of meaning formation. The structure of beginning, transition, and remainder constructs meaning over time. Systems designed under this principle track temporal patterns, retain history, detect transitions, and treat process itself as meaningful unit rather than merely recording outcomes.


Applications

RCS functions as the theoretical ground for multiple system implementations, each addressing different aspects of relational cognition.

AI Interaction Systems

The Relational Neuro-Affective Engine (RNAE) distributes participants' linguistic expressions across four neuro-affective registers. Relational emergence manifests as each register responds independently while emotional meaning arises from relations among them. Negotiation-based coherence appears as these registers resist collapsing into single interpretation, maintaining dynamic tension. Temporal narrativity operates through absence recognition, where silence, omission, and detour function as structural signals.

Data Transformation and Sonification

Behaviour-Driven Systemic Sonification (BDSS) applies RCS principles to data sonification. It treats data not as static values but as negotiating agents, allowing sound to emerge from relations between agents rather than from fixed mappings. BDSS operationalizes the principle that data exhibits behaviour rather than merely representing information.

Affective and Cognitive Modelling

The Pre-Verbal Affective Dynamics (PVAD) system converts 468 facial landmarks into XYZ meta-coordinates to trace temporal unfolding of affective experience. While RNAE models simultaneous multiplicity of linguistic data, PVAD focuses on temporal flow of nonverbal data. Temporal narrativity implements through six narrative phases: neutral, sensory reaction, pre-verbal hesitation, post-verbal residue, abrupt transition, and systemic transformation. Recursive feedback realizes through circular structure where participants' facial responses to generated voice become new system inputs.


References

Bonabeau, E. (2002). Agent-based modeling: Methods and techniques for simulating human systems. PNAS, 99(suppl 3), 7280-7287.

von Foerster, H. (1974). Cybernetics of cybernetics. University of Illinois.

Hollan, J., Hutchins, E., & Kirsh, D. (2000). Distributed cognition: Toward a new foundation for human-computer interaction research. ACM Transactions on Computer-Human Interaction, 7(2), 174-196.

Hutchins, E. (1995). Cognition in the wild. Cambridge, MA: MIT Press.

Riley, M. A. (2012). Dynamics of cognition. Wiley Interdisciplinary Reviews: Cognitive Science, 3(6), 593-606.

Selected Media

> Neural Network Sonification
youtube.com/shorts/QzUNDYefY_U
> Temporal Pattern Recognition
youtube.com/shorts/R1rgIYHnlto
> Information Theory
youtube.com/shorts/fFN04Ja855s
> Can AI Witness Instead of Solve?
youtube.com/shorts/Oj1zINkZP9A
>