Starting question
The Institutional Paradox
The Institutional Paradox
6 source links returned. Claims have not been independently verified.
Institutions treat terms like "human values" and "happiness" as static, quantifiable targets to optimize. These concepts lack universal definition. Treating them as objective metrics leads to enforcing a single group's definition over others without consent.
The Politics of Quantification: Legibility and Human Values
2 source links returned. Claims have not been independently verified.
Does trying to hardcode human morality into AI algorithms eliminate conflict, or simply lock in the prejudices of the developers?
Hardcoding Morality in AI: Eliminating Conflict or Locking in Prejudices?
4 source links returned. Claims have not been independently verified.
Continue this thread
This path ends here for now.
Sign in or create an account to continue the discussion.
Continue your thinking
Anyone can read this grid. Sign in to ask questions, post thoughts and use the thinking tools.
Other paths you could read
Earlier, at Does trying to hardcode human morality into AI algorithms eliminate conflict, or..., the conversation split. If this is not the thread you want, you can switch to one of the other paths below.
-
QuestionRead this path
Once a tech company or government agency spends $100 million and three years locking down a specific set of "alignment values," they have zero incentive to change them, even if those values turn out to be completely out of touch. Changing the rules means admitting the original system was broken, reengineering the model, and risking PR fallout. Precoded morality creates massive moral sunk costs: the institution will defend its outdated choices simply because fixing them is too expensive.
-
QuestionRead this path
Standardising values in software forces the engineers to draw a line around what is "normal" and what is an "anomaly." But in human culture, today's "weird edge case" is often tomorrow's mainstream realisation. Hardcoding values into software means the people at the edges, the ones pushing boundaries or living outside Western institutional norms get quietly muted because the algorithm literally doesn't know where to file them
Grid history
How this grid was built
Follow the questions, contributions, and edits that shaped this grid, and meet the people behind them.
This grid’s history will appear here as people ask questions, add ideas, and make edits.
More
Your reading
Reading options
This grid
Sign in to follow this grid
Download
Download your grid
Download your grid
Translate this idea
Read the selected idea in another language
Read the selected idea in another language
Opens Google Translate with the selected idea’s content.
Highlights
8 saved passages and connected ideas
Connected ideas