An AI-Generated NWS Map Hallucinated Fake Towns in Idaho

2026-01-09 · Source: Welcome to the Artificial Intelligence Incident Database · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Government & Public Sector · Depth: Fundamental Awareness, quick

Summary

An AI-generated wind forecast map from the National Weather Service (NWS) for rural Idaho included hallucinated town names like "Orangeotild" and "Whata Bod," which do not exist. The NWS confirmed to "The Washington Post" that the graphic was created using generative AI as part of a broader experiment testing AI tools for forecasting models and visual design. The image was subsequently deleted and corrected. This incident raises concerns about the accuracy of AI in public-facing content, particularly for public safety tools like weather forecasts. Former NWS employee John Sokich noted that experimental products are typically labeled. The article also mentions hundreds of NWS employees have left over the past year, potentially due to issues like this. The incident underscores the risk of AI hallucinations in critical applications and the potential erosion of public trust when details are incorrect.

Key takeaway

For AI Ethicists or Policy Makers evaluating AI deployment in public services, this incident highlights the critical need for robust validation. You must ensure AI-generated content, especially for public safety, undergoes stringent human review to prevent hallucinations. Unlabeled experimental outputs erode public trust and can have severe consequences beyond minor errors. Prioritize transparency and accountability in all AI implementations to maintain institutional credibility.

Key insights

AI hallucinations can manifest as fabricated data in public-facing content, eroding trust in critical information sources.

Principles

• Public safety tools demand absolute factual accuracy.
• Unlabeled experimental AI outputs risk public trust.
• AI implementation requires deep scrutiny of intent.

In practice

• Verify AI-generated content for factual accuracy.
• Clearly label all experimental AI outputs.
• Assess AI's impact on public trust.

Topics

• AI Hallucinations
• Public Safety
• Generative AI
• National Weather Service
• Public Trust
• AI Ethics

Best for: CTO, VP of Engineering/Data, Executive, Director of AI/ML, AI Ethicist, Policy Maker

Related on AIssential

• National Weather Service Uses AI to Generate Forecasts, Accidentally Hallucinates Town With Dirty Joke Name — AI hallucinations in critical public services like weather forecasting can severely damage trust and accuracy.
• Sullivan & Cromwell apologises to US court for filing errors caused by AI hallucinations - Bar and Bench — AI hallucinations pose significant risks in legal contexts, requiring strict adherence to verification protocols.
• AI Report: Cop Turns Into Frog — AI advancements are driving high talent costs, shifting infrastructure paradigms, and introducing both innovative educational tools and concerning hallucinations.
• Pentagon boasts of using AI to write reports mandated by Congress — The Pentagon is rapidly adopting generative AI for critical tasks, risking accuracy and accountability.
• NYC’s New Mayor Is Killing the City’s Faulty, Sketchy Chatbot — Public-facing AI systems require rigorous validation to prevent the dissemination of harmful misinformation.
• Social workers’ AI tool makes ‘gibberish’ transcripts of accounts from children — AI transcription tools in social work introduce harmful inaccuracies and "hallucinations" into official care records.

See Counsel's argued verdicts on the open AI decisions leaders are weighing →

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Welcome to the Artificial Intelligence Incident Database.