Can Great Sky’s Light-Connected AI Enable Bigger Brains?
Summary
Great Sky, a Boulder, Colorado-based company, is developing AI servers that integrate superconducting neural hardware with photonic interconnects for neuromorphic computing. CEO Dr. Jeff Shainline details systems utilizing Josephson junctions and SQUIDs as core computational elements, offering extremely fast (300 GHz) and energy-efficient processing, alongside robust co-located memory for synaptic weights. Photonic interconnects, employing semiconductor diodes and superconducting nanowire single-photon detectors (SPDs), facilitate low-latency, single-photon-level communication across large scales. Manufacturing leverages conventional lithography with superconducting materials like niobium, targeting 65-45 nanometer nodes for cost-effectiveness. Operating at 4 Kelvin with established helium-4 re-liquefier systems, Great Sky projects brain-scale networks (100 trillion synapses) consuming approximately one megawatt, achieving speeds a million times faster than a human brain. This approach promises a 300x lower cost of ownership for large language models like Llama 405B and enables processing 60 million video frames per second for data-intensive tasks. The company has demonstrated individual components and a 1,000-parameter chip, with a roadmap for multi-chip and wafer-scale integration.
Key takeaway
For AI Architects planning future large-scale AI infrastructure, Great Sky's superconducting optoelectronic platform presents a compelling alternative to semiconductor-based systems. You should evaluate its projected 300x lower cost of ownership for LLMs and its ability to process 60 million video frames per second. While requiring 4 Kelvin cryogenic operation, its flat power scaling curve for massive systems fundamentally alters the economics and capabilities for brain-scale AI, enabling previously unfeasible applications.
Key insights
Superconducting optoelectronic neuromorphic hardware offers extreme speed, energy efficiency, and scalability for brain-scale AI by overcoming communication bottlenecks.
Principles
- Josephson junctions offer highest speed/energy quotient.
- Co-locate memory and processing with superconductors.
- Largest cognitive systems communicate at light speed.
Method
Build neural circuits using SQUIDs for adaptive transfer functions. Integrate superconducting electronics with photonics via semiconductor diodes for light generation and SPDs for single-photon detection.
In practice
- Implement Llama 405B for 300x lower cost of ownership.
- Process 60 million video frames/second for data-intensive AI.
- Develop universal assistants for smart glasses.
Topics
- Superconducting AI
- Neuromorphic Computing
- Photonic Interconnects
- Josephson Junctions
- Single-Photon Detectors
- Cryogenic Computing
Best for: Research Scientist, AI Scientist, Machine Learning Engineer, AI Architect
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by Big Data & AI News - EE Times.