How DRAM is being stretched thin as memory scaling runs out

DRAM cells are being made taller and narrower rather than simply smaller, because shrinking them sideways no longer works well. The result is memory.

DRAM cells are being made taller and narrower rather than simply smaller, because shrinking them sideways no longer works well. The result is memory built from very deep, very thin structures — the image behind the informal word “spaghettifying”.

Key takeaways

  • A standard DRAM cell stores a bit as electric charge in a capacitor, and that capacitor must hold enough charge to be read reliably no matter how small its footprint becomes.
  • Because the footprint keeps shrinking, manufacturers have made capacitors progressively deeper and narrower, producing structures with extreme height-to-width ratios that are difficult to etch and mechanically fragile.
  • The informal term “spaghettifying” is a description of that geometry rather than an official industry designation for any particular technology.
  • Interest in DRAM scaling has grown because memory capacity and bandwidth now limit many computing workloads, including the training and serving of large AI models.
  • There is genuine disagreement among engineers about whether the future is stacked three-dimensional DRAM, capacitor-free cell designs, or continued incremental refinement of today’s approach.

What is actually happening inside a DRAM chip

Dynamic random-access memory stores each bit as a small amount of electric charge held in a capacitor, guarded by a single transistor that connects it to a bit line. The charge leaks away, so every cell must be read and rewritten periodically — the “dynamic” part of the name. For a read to work, the stored charge has to be large enough for a sense amplifier to distinguish a one from a zero against electrical noise.

That requirement sets a floor on capacitance. As the area allotted to each cell has shrunk over successive generations, the only way to preserve capacitance has been to build upwards and downwards: the capacitor becomes a deep, narrow cylinder or pillar rather than a flat plate. Its height-to-width ratio has climbed steadily, and etching such features uniformly across a wafer, then coating their inner surfaces with thin insulating and conductive films, is among the harder problems in volume manufacturing. Very tall, very thin structures can also lean, bend or collapse. That physical picture — memory cells drawn out into long filaments — is what the word “spaghettifying” is reaching for.

Why this is being discussed now

The immediate trigger is discussion circulating on technical aggregator sites rather than a product launch or a regulatory decision. The specific claims made in any individual write-up cannot be verified here, and this article does not attempt to summarise one.

The wider reason the subject attracts attention is that memory has become a visible constraint on computing. Processor performance has continued to improve faster than the capacity and bandwidth of the memory attached to it, and workloads built on large neural networks are unusually memory-hungry: model weights and intermediate state must be held somewhere fast enough to keep arithmetic units busy. When a system’s limiting factor is how much data can be stored close to the processor and how quickly it can be moved, the manufacturing physics of DRAM stops being a specialist concern.

There is also a contrast that makes the story legible. Flash memory escaped a similar two-dimensional squeeze by stacking layers vertically. DRAM has not made an equivalent transition into volume production, and explaining why is a natural subject for technical writing.

The background a newcomer needs

Almost all mainstream DRAM uses a one-transistor, one-capacitor cell. Cells sit in arrays crossed by word lines and bit lines; activating a word line connects a row of capacitors to their bit lines, where sense amplifiers detect the tiny voltage change. Reading destroys the stored charge, so the row is written back immediately. Separately, every row must be refreshed on a schedule, which costs power and blocks access while it happens.

Cell size is conventionally expressed as a multiple of the square of the smallest printable feature, and reducing that multiple has been one lever for density. Capacitor design has passed through several eras — flat structures, trenches etched into the substrate, and stacked capacitors built above it — each adopted when the previous one stopped delivering enough capacitance in the available area.

DRAM is also only one layer of a hierarchy. Caches sit closer to the processor and are faster but far smaller; solid-state storage sits further away, denser and much slower. Packaging has become part of the answer too: stacking DRAM dies and connecting them with dense vertical interconnects raises bandwidth without changing the cell itself.

Who is affected, and how

Memory manufacturers are affected most directly, because their business depends on cost per bit falling over time. If each generation requires more process steps, more expensive equipment and lower yields, the historic price decline slows. Semiconductor equipment and materials suppliers are affected in the opposite direction: harder etching, deposition and metrology create demand for more capable tools.

System designers feel it as a budgeting problem. If memory capacity per package grows slowly while compute grows quickly, architectures must compensate — more caching, more compression, more careful data movement, or memory attached over new interfaces. Operators of large data centres see it in capital costs, since memory can account for a substantial share of a server’s price.

End users encounter it indirectly and unevenly, through the price and specification of phones, laptops and cloud services, and through memory market cycles that swing between shortage and glut. Researchers and developers working with large models feel it as a hard limit on what fits on available hardware.

Where informed people disagree

One dispute is architectural. Some argue the durable answer is genuine three-dimensional DRAM, with cell layers stacked and shared peripheral circuitry beneath, in the spirit of what happened to flash. Others argue DRAM’s refresh, speed and signal-integrity requirements make that far harder than stacking flash, and that continued refinement of vertical transistors and capacitors is the more realistic path.

A second dispute concerns the capacitor itself. Alternative cells that store charge on a transistor gate rather than a dedicated capacitor, potentially using semiconductor materials with very low leakage, would remove the aspect-ratio problem entirely — but they must match today’s density, endurance, retention and speed simultaneously, and reasonable people differ on how close that is.

A third is economic rather than physical. A technology can be demonstrated and still fail if it cannot be manufactured at competitive cost. Sceptics note that many memory candidates have been shown in research settings without displacing DRAM. A fourth disagreement is about framing: whether this is a wall, or an ordinary slowdown that engineering has repeatedly worked around before.

What it means in practice

The practical consequence is not that DRAM stops improving, but that improvement becomes more expensive and less predictable. Expect density gains to depend increasingly on packaging, stacking and interface design rather than on cell shrinkage alone, and expect a larger share of system cost to sit in memory and its packaging.

For software, the implication is that data movement deserves the attention that instruction counts once received. Techniques that reduce memory footprint — quantisation, sparsity, streaming, tiering between fast and slow pools — gain value when capacity is the scarce resource. For procurement, it means memory pricing is likely to remain cyclical and sensitive to demand shocks, because adding capacity requires long-lead investment in fabrication plants.

What to watch next

Watch the technical conferences and published proceedings where device research is disclosed, since that is where stacked cells, new channel materials and capacitor-free designs appear years before products. Watch whether demonstrations move from single test structures to pilot lines and yield data, which is the usual dividing line between research and manufacturing.

Watch capital expenditure and capacity announcements from memory makers, and equipment orders for high-aspect-ratio etching and advanced bonding, which signal what is being committed to. Watch interface and packaging standards work, because bandwidth gains may arrive there first. Finally, watch whether memory prices and server configurations track historic trends or diverge from them — the market outcome that ultimately reveals whether the physics problem has been contained.

Frequently asked questions

What does “spaghettifying DRAM” mean?

It is an informal, descriptive phrase rather than an industry term. It refers to the way DRAM storage capacitors have been made progressively deeper and narrower to preserve enough electrical charge as their footprint shrinks, producing tall, thin, strand-like structures. The word borrows an image from physics, where stretching under extreme forces is called spaghettification, and applies it loosely to the geometry of memory cells.

Why does DRAM need a capacitor at all?

The capacitor is what physically holds the bit: a charged capacitor represents one value and a discharged one the other. It must store enough charge that a sense amplifier can reliably detect the difference despite noise and leakage. Because charge drains away, the contents must be refreshed periodically. Designs that avoid a dedicated capacitor exist in research, but mainstream production memory still relies on one.

Why can’t DRAM just be stacked like 3D flash memory?

Flash cells tolerate slower access and do not require constant refreshing, which made vertical stacking with shared control structures practical. DRAM must respond quickly, refresh continuously and maintain clean signalling across long bit lines, and its capacitor adds a structure that is awkward to replicate layer by layer. Stacked DRAM concepts are actively researched, but the engineering and cost hurdles are different and higher.

Does this mean computer memory will stop getting cheaper?

Not necessarily, but the rate of improvement is widely expected to be slower and less steady than in earlier decades. Density gains increasingly come from packaging and stacking rather than from shrinking cells, and those methods add manufacturing steps and cost. Memory prices also swing with supply and demand cycles, so short-term movements often reflect market conditions rather than underlying technology trends.

How does this relate to AI hardware?

Large models require substantial memory capacity and very high bandwidth to keep processors supplied with data, so memory is often the practical limit on what hardware can run. That has raised interest in stacked memory packages placed close to the processor and in software techniques that shrink memory footprints. The manufacturing difficulty of DRAM therefore has direct consequences for the cost of AI infrastructure.

Is DRAM likely to be replaced by another memory technology?

Several alternatives have been researched for years, including magnetic and resistive memories, and each offers advantages such as non-volatility. None has yet matched DRAM’s combination of density, speed, endurance and cost in volume production. The more probable near-term outcome is that alternatives occupy specific niches within the memory hierarchy while DRAM remains the main working memory, but this is contested.

Sources and further reading

  • Hacker News — the community aggregator where the discussion of DRAM scaling surfaced and was debated in comments.
  • JEDEC — the standards organisation that publishes the memory interface specifications referenced across the industry.
  • Published proceedings of academic and industry semiconductor device conferences, where cell structures and process research are disclosed.
  • Trade publications covering semiconductor manufacturing, equipment and memory market cycles, useful for context on cost and capacity.

Surfaced from the hackernews signal “DRAM scaling discussion”. AI-assisted draft, editorially reviewed.

Visited 1 times, 1 visit(s) today
share this recipe:
Facebook
X
WhatsApp
Telegram
Email
Reddit