Starting question
The Institutional Paradox
The Institutional Paradox
6 source links returned. Claims have not been independently verified.
Institutions treat terms like "human values" and "happiness" as static, quantifiable targets to optimize. These concepts lack universal definition. Treating them as objective metrics leads to enforcing a single group's definition over others without consent.
The Politics of Quantification: Legibility and Human Values
2 source links returned. Claims have not been independently verified.
Does trying to hardcode human morality into AI algorithms eliminate conflict, or simply lock in the prejudices of the developers?
Choose a path from here
This point splits the conversation. Pick the direction you want to read next.
-
AnswerRead this path
Hardcoding Morality in AI: Eliminating Conflict or Locking in Prejudices?
-
QuestionRead this path
Once a tech company or government agency spends $100 million and three years locking down a specific set of "alignment values," they have zero incentive to change them, even if those values turn out to be completely out of touch. Changing the rules means admitting the original system was broken, reengineering the model, and risking PR fallout. Precoded morality creates massive moral sunk costs: the institution will defend its outdated choices simply because fixing them is too expensive.
-
QuestionRead this path
Standardising values in software forces the engineers to draw a line around what is "normal" and what is an "anomaly." But in human culture, today's "weird edge case" is often tomorrow's mainstream realisation. Hardcoding values into software means the people at the edges, the ones pushing boundaries or living outside Western institutional norms get quietly muted because the algorithm literally doesn't know where to file them
Continue your thinking
Anyone can read this grid. Sign in to ask questions, post thoughts and use the thinking tools.
Grid history
How this grid was built
Follow the questions, contributions, and edits that shaped this grid, and meet the people behind them.
This grid’s history will appear here as people ask questions, add ideas, and make edits.
More
Your reading
Reading options
This grid
Sign in to follow this grid
Download
Download your grid
Download your grid
Translate this idea
Read the selected idea in another language
Read the selected idea in another language
Opens Google Translate with the selected idea’s content.
Highlights
8 saved passages and connected ideas
Connected ideas