Can AI companions actually feel “real”

John Searle’s “Minds, Brains, and Programs” (1980) argues against the claim that running the right computer program is sufficient for understanding or having a mind. He presents the Chinese Room thought experiment: imagine a person who does not know Chinese locked in a room. The person follows a detailed program (set of syntactic rules) to manipulate Chinese symbols received through a slot and produces appropriate Chinese replies. To outside Chinese speakers, the room appears to understand Chinese. But the person inside only manipulates symbols according to rules without any comprehension. Searle’s point: syntactic manipulation of symbols (what computers do) is not the same as semantic understanding or mental content. Even if a system behaves as if it understands, it doesn’t necessarily have real understanding or subjective experience. From this he concludes that "strong AI"—the claim that an appropriately programmed computer literally has a mind and consciousness—fails. At best, computers simulate understanding (weak AI), but they do not possess intrinsic intentionality or understanding. Key implications for AI companions: even if an AI companion can convincingly converse and display emotions, Searle’s argument raises the possibility that this is syntactic simulation, not genuine understanding or feeling. The thought experiment focuses attention on the difference between observable behavior and inner qualitative states. Reference: Searle, J. R. (1980). “Minds, Brains, and Programs.” Behavioral and Brain Sciences, 3(3), 417–457.