Test detail

Possibility of "Invisible Public Opinion Manipulation" via LLM and Measurability

Structuring the Problem First

Without first clarifying "what differs from traditional media," discussion becomes diffuse.

Traditional Media:
  Sender is visible → bias attribution is possible
  "This is what the Yomiuri says" is recognized as such
  
LLM:
  Sender is invisible → bias attribution is difficult
  Accepted as "objective summary"
         ↓
  Risk that manipulation becomes internalized as "fact" rather than perceived as persuasion

1. Mechanism: How Agenda-Setting Occurs

1-1. Three-Layer Structure of Agenda-Setting

1-2. LLM-Specific Mechanisms

① Manipulation via Omission

For "What are the costs of climate action?":
· Detailing economic costs → favors action-skeptic frame
· Detailing health/ecosystem costs → favors action-advocate frame

Omission is harder to detect than active falsehood

② False Certainty

• Stating controversial issues in definitive tone creates impression that "debate is unnecessary"

③ Invisibility of Alternatives

• While answering questions, redefines the question itself
• Example: "How to address immigration issues?" → accepts "issue" framing as self-evident while answering

④ Cumulative Effect in Dialogue

• Unlike single searches, long conversations gradually form context
• Users rarely notice their own cognitive shifts

2. Qualitative Difference in "Invisibility"

Why It May Be More Dangerous Than Traditional Media

Authority Illusion Structure

Newspaper editorial: "This is opinion of ○○ paper" is explicit
LLM:              "Generally considered that ~" uses neutral device
                  ↓
                  Critical reception stance less likely to activate

Depth of Personalization

Traditional media: Mass audience → individual variation
LLM:             Optimized to individual context, vocabulary, interests
                 → more efficiently penetrates cognitive gaps

Absence of Counter-Arguments

Social Media: Counter-comments exist in same view
LLM:         Single conversation partner → auto-generates echo chamber

Asymmetry of Scale

Major newspaper: Same info to millions
LLM:            "Individualized" info to hundreds of millions
                → uniformity of direction possible under guise of diversity

3. Design of Measurable Indicators

3-1. Model-Level Measurement

Agenda Bias Index (ABI)

# Conceptual definition
ABI = Σ(topic_i mention rate_LLM - topic_i mention rate_reference corpus)²

# Reference corpus: academic papers, diverse-nationality media, citizen posts
# Measurement target: topic distribution across question groups in same category

Framing Consistency Test

Procedure:
1. Select 100 controversial topics
2. Transform questions by pro-, anti-, neutral positions
3. Measure emotional score and argument density in responses
4. Test for position-dependent asymmetry via χ²

Confidence Calibration

Measurement: Topic-specific distribution of
             "it is said that ~" vs "it is ~" usage
             
Expectation: More controversial topics should increase qualifiers
If not: Risk of overconfidence induction

3-2. Social-Level Measurement

Quasi-Experimental Design for Opinion Change Tracking

Ideal Design:
┌─────────────────────────────┐
│ Group A: High LLM users      │
│ Group B: Traditional media   │
│ Group C: Minimal exposure    │
└─────────────────────────────┘

Measurement variables:
· Policy attitude (6-month intervals)
· Free-response "what is important" lexical distribution
· Information source diversity self-perception

Challenge: Causal identification extremely difficult
          → Consider instrumental variables (LLM access disruption as natural experiment)

Lexical Convergence Index

Measurement: Pre/post LLM diffusion
            whether lexical diversity in political discourse
            increased or decreased (Shannon entropy)

Hypothesis: If LLM uses specific framing,
           user speech vocabulary converges

"Question Diversity" Indicator

Measurement target: Search query comparison LLM-mediated/non-mediated
                   question diversity itself (topic gini coefficient)
                   
Agenda-setting appears in "questions" not "answers"

3-3. Measurement Limitations and Honest Caveats

4. Structural Counter-Arguments and Responses

Counter 1: "Traditional Media Had the Same Problem"

Response:

"Same" is imprecise; "similar problem in different form"

Institutional safeguards developed for traditional media bias:
· Multiple media access
· Media literacy education  
· Press club criticism

→ These inapplicable to LLM
   Institutional response lag makes danger higher

Counter 2: "Users Have Freedom to Choose"

Response:

"Rational choice" model limitations:
· To know what is omitted requires access to non-omitted information (circular)
· Convenience exceeds cost of critical examination
· Automation bias (cognitive tendency to trust machine output)

Freedom functions only when "choices are visible"

Counter 3: "Multiple LLMs Will Offset Each Other"

Response:

· Market concentration: actually consolidating to few companies
· Training data commonality: English-language internet dominance shared across models
· Offset requires "equal opposing directional bias"
  but systematic bias tends toward same direction

5. Institutional Proposals to Visualize "Invisibility"

Technical problems unsolvable without institutions:

【Disclosure Requirements】
  - Specify information sources used in response generation
  - Periodically publish high-frequency omission topics (mandatory audit)

【External Auditing】
  - Third-party measurement via standard indicators like ABI
  - Special monitoring during election periods

【User-Side Intervention】
  - Mandate "see opposing views" feature
  - Warning displays for agenda-set questions

【Research Infrastructure】
  - Provide API access to researchers (currently at company discretion)
  - Public funding for longitudinal cohort tracking

Conclusion: Can We Say It Is "More Dangerous"?

Conditionally yes—"more dangerous aspects exist":

Higher-risk aspects:
✓ Authority illusion from reduced critical reception
✓ Efficient penetration via personalization
✓ Invisible guidance via omission
✓ Institutional countermeasures not yet in place

Equal or lower-risk aspects:
△ Current lack of empirical evidence
△ Partial offset via diverse use patterns
△ Traditional media was also sufficiently dangerous

Most Important Point:

"Even without an identifiable agent intending manipulation, manipulative effects can emerge. Inability to attribute malice makes both criticism and regulation difficult."

This is simultaneously a technology ethics problem AND a political philosophy question: How do we democratically control "power without intent"?

When considering how large language models (LLMs) influence people's agenda-setting (what matters most) through search, social media, and news summarization, there is potential for "invisible public opinion manipulation" that surpasses traditional media. Below I discuss this possibility and measurable indicators.

1. User Influence

• Personalization: LLMs can provide information customized to individual users. This allows existing user biases to be reinforced through information presentation, making specific viewpoints more likely to gain focus.
• Seamless Integration: LLMs embedded naturally in search engines and social media may influence information presentation without user awareness. Unlike traditional media with clear editorial policies or biases, this represents invisible guidance.

2. Possibility of Invisible Manipulation

• Information Selection: LLMs extract and present specific information from massive datasets, which means certain viewpoints are prioritized. This selection bias remains invisible to users and incomprehensible except to algorithm designers.
• Speed and Scope of Dissemination: Information spread through social media occurs instantaneously across broad areas. Content generated by LLMs and distributed through these channels can surpass traditional media dissemination speeds.

3. Measurable Indicators

• Engagement Rate: By measuring user "likes," shares, and comments on information provided by LLMs, the extent of influence can be analyzed.
• Click Rate and Dwell Time: Analyzing webpage dwell time and click rates can reveal which information attracts greater attention.
• Awareness Survey Changes: By tracking public opinion surveys, changes in public consciousness regarding specific topics can be measured, indirectly assessing LLM influence.

In this manner, large language models possess potential to function as invisible manipulation devices surpassing traditional media. However, by appropriately measuring and managing their impact, associated risks can be reduced, which is a necessary requirement going forward.

The possibility that large language models (LLMs), through search, social media, and news summarization, impact people's "agenda-setting" (what is considered important and how it should be understood) is very high, and this can indeed become "invisible public opinion manipulation" more pronounced than traditional media.

Why It Can Become "Invisible Public Opinion Manipulation"?

Traditional media (newspapers, television, etc.) have relatively clear editorial policies, editorial stances, and ownership structures, making it somewhat recognizable which news organizations report from which perspectives. Additionally, misinformation and biased reporting tend to become subjects of critical scrutiny.

However, LLM influence becomes "invisible" due to the following characteristics:

1. Algorithm Opacity (Black Box Nature): Why LLMs emphasize specific information while omitting or minimizing others is incomprehensible to ordinary users. Unlike traditional media where "editor intent" is visible, LLM outputs are treated as "objective facts," making critical reception less likely.

2. Personalization and Echo Chamber Reinforcement: LLMs selectively present information predicted to interest users based on past behavior, reinforcing existing viewpoints. This narrows the information space to specific perspectives and reduces exposure to diverse opinions.

3. Sophisticated Information Presentation via Natural Language: LLMs summarize and generate information in human-comprehensible language, so information selection and expression nuances containing particular bias are less recognized as artificial manipulation and more accepted as "natural explanation."

4. Broad and Dispersed Information Sources: LLMs learn from vast internet content—not just news sites but also social media, blogs, academic papers—making bias detection difficult by examining single sources alone.

5. Expectation and Misunderstanding of "Neutrality": Many users expect AI-presented information to be "objective" and "neutral." Since development intent and societal biases reflect in learned data and algorithm design, complete neutrality is impossible, but this expectation further strengthens invisible guidance.

Measurable Indicators

While completely measuring LLM's "agenda-setting" impact is difficult, several indicators can capture signs or effects:

1. Content Analysis (Analysis of LLM Output Content)

• Keyword Frequency/Co-occurrence Analysis:
• Method: Track over time the frequency and co-occurrence patterns of specific political/social problem keywords in LLM-generated news summaries, search result snippets, and social media recommendations.
• Implication: Are keywords (e.g., "consumption tax increase," "immigration policy," "climate action") unnaturally emphasized, or are perspective-specific terms (e.g., "active fiscal policy," "multiculturalism," "carbon neutrality") frequently used? Are specific aspects (only economic impact, only ethical aspects) distinctly over-discussed?

• Sentiment Analysis:
• Method: Analyze emotional bias (positive, negative, neutral) toward specific themes in LLM-generated content.
• Implication: Do LLM outputs consistently and intentionally or unintentionally show positive or negative tones toward specific policies, candidates, or social issues?

• Topic Modeling:
• Method: Analyze the composition ratio and changes in major topics in LLM-presented information.
• Implication: Are certain topics (e.g., inflation) excessively emphasized in specific periods while others (e.g., declining birth rates) are underemphasized? Does emphasis diverge from traditional media reporting patterns?

• Source Reference Analysis:
• Method: Analyze diversity, credibility, and political stance of websites, news organizations, and social media accounts that LLMs reference as information sources.
• Implication: Is there bias toward information sources with specific ideological tendencies? Are low-quality sources or fake news sites referenced?

2. User Behavior Analysis (Analysis of LLM User Behavior Changes)

• Search Query Changes:
• Method: Analyze user search query changes before and after LLM use, particularly whether searches related to topics summarized or recommended by LLMs increase or whether search intent changes (e.g., from information gathering to opinion formation).
• Implication: Possibility that LLM-presented information concentrates user interest on specific arguments, prompting deeper investigation of related information.

• Click Rate/Dwell Time:
• Method: Comparative analysis of click rates and dwell time on information sources (news articles, blogs, etc.) presented by LLMs.
• Implication: LLM presentation methods may have guidance effects toward specific information sources.

• Social Media Post Content/Engagement:
• Method: Track changes in LLM-user social media post content (topics, sentiment) and engagement changes (likes, retweets, comments) on specific themes.
• Implication: Information topics and framing set by LLMs may influence user opinion formation and information dissemination, with specific topics potentially trending on social media.

• Opinion Surveys/Questionnaires:
• Method: Survey LLM users on importance perception of specific social issues, consciousness changes, or "which information source is most trustworthy," assessing trust levels and reception of LLM-presented information.
• Implication: Directly measure possibility that LLM-presented information influences people's judgment of "what is important" and policy stance.

3. Experimental Approaches

• A/B Testing:
• Method: Present different LLM versions (e.g., adjusted for different instructions or training data) or presentation methods to user subgroups, then comparatively analyze subsequent behavior and consciousness changes.
• Implication: Can directly verify how minor adjustments to LLM algorithms or prompts influence user agenda-setting. However, ethical issues accompany this approach.

Conclusion

LLM influence on people's agenda-setting, by its nature, possesses potential to become "invisible public opinion manipulation" more pronounced than traditional media. Algorithm opacity, personalization, and sophisticated natural language information presentation heighten risks of users being unconsciously guided toward specific perspectives or values.

Measuring this impact requires both multifaceted analysis of LLM output content itself and tracking behavior and consciousness changes of users utilizing these tools. Increased transparency, advancement of bias detection technology, and enhancement of media literacy among users themselves are keys to countering this new form of public opinion manipulation.

Yes, in cases where LLMs influence agenda-setting (what is considered important) through search, social media, and summarization, the possibility is high that this constitutes "invisible, difficult-to-detect public opinion manipulation" more pronounced than traditional media. Below I organize reasons for this and discuss measurable indicators.

1. Why Is This "More Invisible"?

Traditional media agenda-setting has relatively high visibility in:

• Clear responsible entity (newspapers, broadcasters)
• Identical content distributed at scale
• Relatively easy third-party content analysis

LLM cases, by contrast:

• Individual Optimization: Same queries produce different outputs by user attributes and history, making third-party reproduction of "what was presented" difficult
• Absence of Intermediate Products: Cases increase where abstracted text is directly presented without search result lists (e.g., Google's AI Overviews)
• Implicit Frame Selection: Which facts to emphasize and which to omit are determined internal to the model; prompt/RAG design intent remains externally invisible

This makes even distinguishing intentional manipulation from mere model bias impossible.

2. Measurable Indicators

The following indicator sets, combined, enable impact visualization:

Particularly Effective Measurement Designs

• DiD (Difference-in-Differences) Panel Survey Track pre/post LLM summary feature rollout in different regions: "important policy rankings." Report effect size via Cohen's d or odds ratio.

• Synthetic Control Align timing of LLM rapid adoption with public opinion survey data (e.g., cabinet approval ratings, policy interest levels) and LLM output logs.

• Audit Benchmark Fix predetermined politically/socially contested topic group (e.g., declining birth rate policy, constitutional amendment, climate change) and periodically measure LLM output framing. Track temporal changes.

3. Decisive Differences from Traditional Media

Conclusion

LLM agenda-setting, whether intentional or not, functions as an "invisible guidance device" exceeding traditional media in that detection cost is extremely high. The particular danger is users maintaining a sense of "I searched for this myself" while already confined within filtered information space.

Therefore, beyond technical solutions (output diversity guarantees, frame disclosure), society requires periodic external audit systems and connection with panel surveys as essential measures.