© Digital Integrated Circuits2nd Memories
Digital Integrated
Digital Integrated
Circuits
Circuits
A Design Perspective
A Design Perspective
Semiconductor
Semiconductor
Memories
Memories
Jan M. Rabaey
Anantha Chandrakasan
Borivoje Nikolic
December 20, 2002
© Digital Integrated Circuits2nd Memories
Chapter Overview
Chapter Overview
 Memory Classification
 Memory Architectures
 The Memory Core
 Periphery
 Reliability
 Case Studies
© Digital Integrated Circuits2nd Memories
Semiconductor Memory Classification
Semiconductor Memory Classification
Read-Write Memory
Non-Volatile
Read-Write
Memory
Read-Only Memory
EPROM
E
2
PROM
FLASH
Random
Access
Non-Random
Access
SRAM
DRAM
Mask-Programmed
Programmable (PROM)
FIFO
Shift Register
CAM
LIFO
© Digital Integrated Circuits2nd Memories
Memory Timing: Definitions
Memory Timing: Definitions
Write cycle
Read access Read access
Read cycle
Write access
Data written
Data valid
DATA
WRITE
READ
© Digital Integrated Circuits2nd Memories
Memory Architecture: Decoders
Memory Architecture: Decoders
Word 0
Word 1
Word 2
WordN 22
WordN 21
Storage
cell
M bits M bits
S0
S1
S2
SN 22
A0
A1
A K 21
K 5 log2N
SN 21
Word 0
Word 1
Word 2
WordN 22
WordN 21
Storage
cell
S0
Input-Output
(M bits)
Intuitive architecture for N x M memory
Too many select signals:
N words == N select signals
K = log2N
Decoder reduces the number of select signals
Input-Output
(M bits)
© Digital Integrated Circuits2nd Memories
Row
Decoder
Bit line
2L 2 K
Word line
A K
A K 1 1
A L 2 1
A 0
M.2K
A K 2 1
Sense amplifiers / Drivers
Column decoder
Input-Output
(M bits)
Array-Structured Memory Architecture
Array-Structured Memory Architecture
Problem: ASPECT RATIO or HEIGHT >> WIDTH
Amplify swing to
rail-to-rail amplitude
Selects appropriate
word
© Digital Integrated Circuits2nd Memories
Hierarchical Memory Architecture
Hierarchical Memory Architecture
Advantages:
Advantages:
1. Shorter wires within blocks
1. Shorter wires within blocks
2. Block address activates only 1 block => power savings
2. Block address activates only 1 block => power savings
Global
amplifier/driver
Control
circuitry
Global data bus
Block selector
Block 0
Row
address
Column
address
Block
address
Block i Block P 2 1
I/O
© Digital Integrated Circuits2nd Memories
Block Diagram of 4 Mbit SRAM
Block Diagram of 4 Mbit SRAM
Clock
generator
CS, WE
buffer
I/O
buffer
Y-address
buffer
X-address
buffer
x1/x4
controller
Z-address
buffer
X-address
buffer
Predecoder and block selector
Bit line load
Transfer gate
Column decoder
Sense amplifier and write driver
[Hirose90]
© Digital Integrated Circuits2nd Memories
Contents-Addressable Memory
Contents-Addressable Memory
Address
Decoder
Data (64 bits)
I/O
Buffers
Comparand
CAM Array
2
9
words3 64 bits
Mask
Control Logic R/W Address (9 bits)
Commands
2
9
Validity
Bits
Priority
Encoder
© Digital Integrated Circuits2nd Memories
Memory Timing: Approaches
Memory Timing: Approaches
DRAM Timing
Multiplexed Adressing
SRAM Timing
Self-timed
Address
bus
RAS
RAS -CAS timing
Row Address
Address
Bus
Address transition
initiates memory operation
Address
Column Address
CAS
© Digital Integrated Circuits2nd Memories
Read-Only Memory Cells
Read-Only Memory Cells
WL
BL
WL
BL
1
WL
BL
WL
BL
WL
BL
0
VDD
WL
BL
GND
Diode ROM MOS ROM 1 MOS ROM 2
© Digital Integrated Circuits2nd Memories
MOS OR ROM
MOS OR ROM
WL[0]
VDD
BL[0]
WL[1]
WL[2]
WL[3]
Vbias
BL[1]
Pull-down loads
BL[2] BL[3]
VDD
© Digital Integrated Circuits2nd Memories
MOS NOR ROM
MOS NOR ROM
WL[0]
GND
BL [0]
WL [1]
WL [2]
WL [3]
VDD
BL [1]
Pull-up devices
BL [2] BL [3]
GND
© Digital Integrated Circuits2nd Memories
MOS NOR ROM Layout
MOS NOR ROM Layout
Programmming using the
Active Layer Only
Polysilicon
Metal1
Diffusion
Metal1 on Diffusion
Cell (9.5 x 7)
© Digital Integrated Circuits2nd Memories
MOS NOR ROM Layout
MOS NOR ROM Layout
Polysilicon
Metal1
Diffusion
Metal1 on Diffusion
Cell (11 x 7)
Programmming using
the Contact Layer Only
© Digital Integrated Circuits2nd Memories
MOS NAND ROM
MOS NAND ROM
All word lines high by default with exception of selected row
WL[0]
WL[1]
WL[2]
WL[3]
VDD
Pull-up devices
BL[3]
BL[2]
BL[1]
BL[0]
© Digital Integrated Circuits2nd Memories
MOS NAND ROM Layout
MOS NAND ROM Layout
No contact to VDD or GND necessary;
Loss in performance compared to NOR ROM
drastically reduced cell size
Polysilicon
Diffusion
Metal1 on Diffusion
Cell (8 x 7)
Programmming using
the Metal-1 Layer Only
© Digital Integrated Circuits2nd Memories
NAND ROM Layout
NAND ROM Layout
Cell (5 x 6)
Polysilicon
Threshold-altering
implant
Metal1 on Diffusion
Programmming using
Implants Only
© Digital Integrated Circuits2nd Memories
Equivalent Transient Model for MOS NOR ROM
Equivalent Transient Model for MOS NOR ROM
 Word line parasitics
 Wire capacitance and gate capacitance
 Wire resistance (polysilicon)
 Bit line parasitics
 Resistance not dominant (metal)
 Drain and Gate-Drain capacitance
Model for NOR ROM VDD
Cbit
rword
cword
WL
BL
© Digital Integrated Circuits2nd Memories
Equivalent Transient Model for MOS NAND ROM
Equivalent Transient Model for MOS NAND ROM
 Word line parasitics
 Similar to NOR ROM
 Bit line parasitics
 Resistance of cascaded transistors dominates
 Drain/Source and complete gate capacitance
Model for NAND ROM
VDD
CL
rword
cword
cbit
rbit
WL
BL
© Digital Integrated Circuits2nd Memories
Decreasing Word Line Delay
Decreasing Word Line Delay
Metal bypass
Polysilicon word line
K cells
Polysilicon word line
WL
Driver
(b) Using a metal bypass
(a) Driving the word line from both sides
Metal word line
WL
(c) Use silicides
© Digital Integrated Circuits2nd Memories
Precharged MOS NOR ROM
Precharged MOS NOR ROM
PMOS precharge device can be made as large as necessary,
but clock driver becomes harder to design.
WL[0]
GND
BL[0]
WL[1]
WL[2]
WL[3]
VDD
BL[1]
Precharge devices
BL[2] BL[3]
GND
pre
f
© Digital Integrated Circuits2nd Memories
Non-Volatile Memories
Non-Volatile Memories
The Floating-gate transistor (FAMOS)
The Floating-gate transistor (FAMOS)
Floating gate
Source
Substrate
Gate
Drain
n+ n+_
p
tox
tox
Device cross-section Schematic symbol
G
S
D
© Digital Integrated Circuits2nd Memories
Floating-Gate Transistor Programming
Floating-Gate Transistor Programming
0 V
2 5 V 0 V
D
S
Removing programming
voltage leaves charge trapped
5 V
22.5 V 5 V
D
S
Programming results in
higher VT.
20 V
10 V 5 V 20 V
D
S
Avalanche injection
© Digital Integrated Circuits2nd Memories
A “Programmable-Threshold” Transistor
A “Programmable-Threshold” Transistor
“0”-state “1”-state
DV T
V WL V GS
“ON”
“OFF ”
© Digital Integrated Circuits2nd Memories
FLOTOX EEPROM
FLOTOX EEPROM
Floating gate
Source
Substrate
p
Gate
Drain
n1 n1
FLOTOX transistor
Fowler-Nordheim
I-V characteristic
20–30 nm
10 nm
-10 V
10 V
I
VGD
© Digital Integrated Circuits2nd Memories
EEPROM Cell
EEPROM Cell
WL
BL
VDD
Absolute threshold control
is hard
Unprogrammed transistor
might be depletion
 2 transistor cell
© Digital Integrated Circuits2nd Memories
Flash EEPROM
Flash EEPROM
Control gate
erasure
p-
substrate
Floating gate
Thin tunneling oxide
n1 source n1 drain
programming
Many other options …
© Digital Integrated Circuits2nd Memories
Cross-sections of NVM cells
Cross-sections of NVM cells
EPROM
Flash
Courtesy Intel
© Digital Integrated Circuits2nd Memories
Basic Operations in a NOR Flash Memory―
Basic Operations in a NOR Flash Memory―
Erase
Erase
S D
12 V
G
cell array
BL 0 BL 1
open open
WL 0
WL 1
0 V
0 V
© Digital Integrated Circuits2nd Memories
Basic Operations in a NOR Flash Memory―
Basic Operations in a NOR Flash Memory―
Write
Write
S D
12 V
6 V
G
BL 0 BL 1
6 V 0 V
WL 0
WL 1
12 V
0 V
© Digital Integrated Circuits2nd Memories
Basic Operations in a NOR Flash Memory―
Basic Operations in a NOR Flash Memory―
Read
Read
5 V
1 V
G
S D
BL 0 BL 1
1 V 0 V
WL 0
WL 1
5 V
0 V
© Digital Integrated Circuits2nd Memories
NAND Flash Memory
NAND Flash Memory
Unit Cell
Word line(poly)
Source line
(Diff. Layer)
Courtesy Toshiba
Gate
ONO
FG
Gate
Oxide
© Digital Integrated Circuits2nd Memories
NAND Flash Memory
NAND Flash Memory
Word lines
Select transistor
Bit line contact Source line contact
Active area
STI
Courtesy Toshiba
© Digital Integrated Circuits2nd Memories
Characteristics of State-of-the-art NVM
Characteristics of State-of-the-art NVM
© Digital Integrated Circuits2nd Memories
Read-Write Memories (RAM)
Read-Write Memories (RAM)
 STATIC (SRAM)
 DYNAMIC (DRAM)
Data stored as long as supply is applied
Large (6 transistors/cell)
Fast
Differential
Periodic refresh required
Small (1-3 transistors/cell)
Slower
Single Ended
© Digital Integrated Circuits2nd Memories
6-transistor CMOS SRAM Cell
6-transistor CMOS SRAM Cell
WL
BL
VDD
M5
M6
M4
M1
M2
M3
BL
Q
Q
© Digital Integrated Circuits2nd Memories
CMOS SRAM Analysis (Read)
CMOS SRAM Analysis (Read)
WL
BL
VDD
M5
M6
M4
M1
VDD
VDD VDD
BL
Q = 1
Q = 0
Cbit Cbit
© Digital Integrated Circuits2nd Memories
CMOS SRAM Analysis (Read)
CMOS SRAM Analysis (Read)
0
0
0.2
0.4
0.6
0.8
1
1.2
0.5 1 1.2 1.5 2
Cell Ratio (CR)
2.5 3
Voltage
Rise
(V)
© Digital Integrated Circuits2nd Memories
CMOS SRAM Analysis (Write)
CMOS SRAM Analysis (Write)
BL = 1 BL = 0
Q = 0
Q = 1
M1
M4
M5
M6
VDD
VDD
WL
© Digital Integrated Circuits2nd Memories
CMOS SRAM Analysis (Write)
CMOS SRAM Analysis (Write)
© Digital Integrated Circuits2nd Memories
6T-SRAM — Layout
6T-SRAM — Layout
VDD
GND
Q
Q
WL
BL
BL
M1 M3
M4
M2
M5 M6
© Digital Integrated Circuits2nd Memories
Resistance-load SRAM Cell
Resistance-load SRAM Cell
Static power dissipation -- Want RL large
Bit lines precharged to VDD to address tp problem
M3
RL RL
VDD
WL
Q Q
M1 M2
M4
BL BL
© Digital Integrated Circuits2nd Memories
SRAM Characteristics
SRAM Characteristics
© Digital Integrated Circuits2nd Memories
3-Transistor DRAM Cell
3-Transistor DRAM Cell
No constraints on device ratios
Reads are non-destructive
Value stored at node X when writing a “1” = VWWL-VTn
WWL
BL1
M1 X
M3
M2
CS
BL2
RWL
V DD
V DD 2 VT
DV
V DD 2 VT
BL2
BL1
X
RWL
WWL
© Digital Integrated Circuits2nd Memories
3T-DRAM — Layout
3T-DRAM — Layout
BL2 BL1 GND
RWL
WWL
M3
M2
M1
© Digital Integrated Circuits2nd Memories
1-Transistor DRAM Cell
1-Transistor DRAM Cell
Write: CS is charged or discharged by asserting WL and BL.
Read: Charge redistribution takes places between bit line and storage capacitance
Voltage swing is small; typically around 250 mV.
M1
CS
WL
BL
CBL
V DD 2 V T
WL
X
sensing
BL
GND
Write 1 Read 1
V DD
V DD /2 V
V BL VPRE
– VBIT VPRE
–
CS
CS CBL
+
------------
= =
V
© Digital Integrated Circuits2nd Memories
DRAM Cell Observations
DRAM Cell Observations
 1T DRAM requires a sense amplifier for each bit line, due
to charge redistribution read-out.
 DRAM memory cells are single ended in contrast to
SRAM cells.
The read-out of the 1T DRAM cell is destructive; read
and refresh operations are necessary for correct
operation.
 Unlike 3T cell, 1T cell requires presence of an extra
capacitance that must be explicitly included in the design.
 When writing a “1” into a DRAM cell, a threshold
voltage is lost. This charge loss can be circumvented by
bootstrapping the word lines to a higher value than VDD
© Digital Integrated Circuits2nd Memories
Sense Amp Operation
Sense Amp Operation
DV(1)
V(1)
V(0)
t
VPRE
VBL
Sense amp activated
Word line activated
© Digital Integrated Circuits2nd Memories
1-T DRAM Cell
1-T DRAM Cell
Uses Polysilicon-Diffusion Capacitance
Expensive in Area
M1 word
line
Diffused
bit line
Polysilicon
gate
Polysilicon
plate
Capacitor
Cross-section Layout
Metal word line
Poly
SiO2
Field Oxide
n+ n+
Inversion layer
induced by
plate bias
Poly
© Digital Integrated Circuits2nd Memories
SEM of poly-diffusion capacitor 1T-DRAM
SEM of poly-diffusion capacitor 1T-DRAM
© Digital Integrated Circuits2nd Memories
Advanced 1T DRAM Cells
Advanced 1T DRAM Cells
Cell Plate Si
Capacitor Insulator
Storage Node Poly
2nd Field Oxide
Refilling Poly
Si Substrate
Trench Cell Stacked-capacitor Cell
Capacitor dielectric layer
Cell plate
Word line
Insulating Layer
Isolation
Transfer gate
Storage electrode
© Digital Integrated Circuits2nd Memories
Static CAM Memory Cell
Static CAM Memory Cell
CAM
Bit
Word
Bit
••• CAM
Bit Bit
CAM
Word
Wired-NOR Match Line
Match
M1
M2
M7
M6
M4 M5
M8 M9
M3
int
S
Word
••• CAM
Bit Bit
S
© Digital Integrated Circuits2nd Memories
CAM in Cache Memory
CAM in Cache Memory
CAM
ARRAY
Input Drivers
Tag Hit
Address
SRAM
ARRAY
Sense Amps / Input Drivers
Data
R/W
© Digital Integrated Circuits2nd Memories
Periphery
Periphery
 Decoders
 Sense Amplifiers
 Input/Output Buffers
 Control / Timing Circuitry
© Digital Integrated Circuits2nd Memories
Row Decoders
Row Decoders
Collection of 2M
complex logic gates
Organized in regular and dense fashion
(N)AND Decoder
NOR Decoder
© Digital Integrated Circuits2nd Memories
Hierarchical Decoders
Hierarchical Decoders
• • •
• • •
A2
A2
A2A3
WL 0
A2A3
A2A3
A2A3
A3 A3
A0
A0
A0A1
A0A1
A0A1
A0A1
A1 A1
WL 1
Multi-stage implementation improves performance
NAND decoder using
NAND decoder using
2-input pre-decoders
2-input pre-decoders
© Digital Integrated Circuits2nd Memories
Dynamic Decoders
Dynamic Decoders
Precharge devices
VDD 
GND
WL3
WL2
WL1
WL0
A0
A0
GND
A1
A1

WL3
A0
A0 A1
A1
WL 2
WL 1
WL 0
VDD
VDD
VDD
VDD
2-input NOR decoder 2-input NAND decoder
© Digital Integrated Circuits2nd Memories
4-input pass-transistor based column
4-input pass-transistor based column
decoder
decoder
Advantages: speed (tpd does not add to overall memory access time)
Only one extra transistor in signal path
Disadvantage: Large transistor count
A0
S0
BL 0 BL 1 BL 2 BL 3
A1
S1
S2
S3
D
© Digital Integrated Circuits2nd Memories
4-to-1 tree based column decoder
4-to-1 tree based column decoder
Number of devices drastically reduced
Delay increases quadratically with # of sections; prohibitive for large decoders
buffers
progressive sizing
combination of tree and pass transistor approaches
Solutions:
BL 0 BL 1 BL 2 BL 3
D
A0
A0
A1
A1
© Digital Integrated Circuits2nd Memories
Decoder for circular shift-register
Decoder for circular shift-register
V DD
V DD
R
WL 0
V DD
f
f
f
f
V DD
R
WL 1
V DD
f
f
f
f
V DD
R
WL 2
V DD
f
f
f
f
• • •
© Digital Integrated Circuits2nd Memories
Sense Amplifiers
Sense Amplifiers
tp
C V

Iav
----------------
=
make V as small
as possible
small
large
Idea: Use Sense Amplifer
output
input
s.a.
small
transition
© Digital Integrated Circuits2nd Memories
Differential Sense Amplifier
Differential Sense Amplifier
Directly applicable to
SRAMs
M4
M1
M5
M3
M2
V DD
bit
bit
SE
Out
y
© Digital Integrated Circuits2nd Memories
Differential Sensing ― SRAM
Differential Sensing ― SRAM
V DD
V DD
V DD
V DD
BL
EQ
Diff.
Sense
Amp
(a) SRAM sensing scheme (b) two stage differential amplifier
SRAM cell i
WL i
2
x
x
V DD
Output
BL
PC
M3
M1
M5
M2
M4
x
SE
SE
SE
Output
SE
x
2
x 2
x
© Digital Integrated Circuits2nd Memories
Latch-Based Sense Amplifier (DRAM)
Latch-Based Sense Amplifier (DRAM)
Initialized in its meta-stable point with EQ
Once adequate voltage gap created, sense amp enabled with SE
Positive feedback quickly forces output to a stable operating point.
EQ
VDD
BL BL
SE
SE
© Digital Integrated Circuits2nd Memories
Charge-Redistribution Amplifier
Charge-Redistribution Amplifier
0.5
1.0
1.5
2.0
2.5
0.0
0.0 1.00 2.00
time(nsec)
V
V in
V ref 5 3V
V L
V S
(b) Transient response
3.00
Concept
M2 M3
M1
V L VS
Vref
Csmall
Clarge
Transient Response
© Digital Integrated Circuits2nd Memories
Charge-Redistribution Amplifier―
Charge-Redistribution Amplifier―
EPROM
EPROM
SE
VDD
WLC
Load
Cascode
device
Column
decoder
EPROM
array
BL
WL
Vcasc
Out
Cout
Ccol
CBL
M1
M2
M3
M4
© Digital Integrated Circuits2nd Memories
Single-to-Differential Conversion
Single-to-Differential Conversion
How to make a good Vref?
Diff.
S.A.
Cell
2
x
x
Output
WL
V ref
BL
1
2
© Digital Integrated Circuits2nd Memories
Open bitline architecture with
Open bitline architecture with
dummy cells
dummy cells
CS CS CS CS
BLL
L L1 L0 R0
CS
R1
CS
L
… …
BLR
V DD
SE
SE
EQ
Dummy cell Dummy cell
© Digital Integrated Circuits2nd Memories
DRAM Read Process with Dummy Cell
DRAM Read Process with Dummy Cell
3
2
1
0
0 1 2 3
BL
BL
t (ns)
reading 0
3
2
1
0
0 1 2 3
SE
EQ WL
t (ns)
control signals
3
2
1
0
0 1 2 3
BL
BL
t (ns)
reading 1
© Digital Integrated Circuits2nd Memories
Voltage Regulator
Voltage Regulator
-
+
VDD
VREF
Vbias
Mdrive
Mdrive
VDL
VDL
VREF
Equivalent Model
© Digital Integrated Circuits2nd Memories
Charge Pump
Charge Pump
CLK
V DD
A B
M1
M2
V load
Cload
Cpump
2V DD 2 V T
V DD 2 V T
0 V
V B
V load
0 V
© Digital Integrated Circuits2nd Memories
DRAM Timing
DRAM Timing
© Digital Integrated Circuits2nd Memories
RDRAM Architecture
RDRAM Architecture
memory
array
Data
bus
Clocks
Column
Row
demux packet dec.
packet dec.
Bus
k
k 3l
demux
© Digital Integrated Circuits2nd Memories
Address Transition Detection
Address Transition Detection
DELAY
td
A0
DELAY
td
A1
DELAY
td
AN2 1
VDD
ATD ATD
…
© Digital Integrated Circuits2nd Memories
Reliability and Yield
Reliability and Yield
© Digital Integrated Circuits2nd Memories
Sensing Parameters in DRAM
Sensing Parameters in DRAM
From [Itoh01]
4K
10
100
1000
64K 1M 16M 256M 4G 64G
Memory Capacity (bits/chip)
CD (1F)
CS(1F)
QS(1C)
Vsmax(mv)
V DD (V)
QS 5 CS V DD /2
Vsmax 5 QS/(CS 1 CD)
© Digital Integrated Circuits2nd Memories
Noise Sources in 1T DRam
Noise Sources in 1T DRam
Ccross
electrode
a-particles
leakage
CS
WL
BL substrate Adjacent BL
CWBL
© Digital Integrated Circuits2nd Memories
Open Bit-line Architecture —Cross Coupling
Open Bit-line Architecture —Cross Coupling
Sense
Amplifier
C
WL1
BL
C BL
C WBL C WBL
C
C
WL0
C
C BL
C C
WL D WL D WL0 WL1
BL
EQ
© Digital Integrated Circuits2nd Memories
Folded-Bitline Architecture
Folded-Bitline Architecture
Sense
Amplifier
C
WL 1
CWBL
CWBL
C
WL 0 WL 0 WL D
C
C
WL 1
C
C
WL D
BL CBL
BL CBL
EQ
x
x
y
© Digital Integrated Circuits2nd Memories
Transposed-Bitline Architecture
Transposed-Bitline Architecture
SA
Ccross
(a) Straightforward bit-line routing
(b) Transposed bit-line architecture
BL 9
BL
BL
BL 99
SA
Ccross
BL 9
BL
BL
BL 99
© Digital Integrated Circuits2nd Memories
Alpha-particles (or Neutrons)
Alpha-particles (or Neutrons)
1 Particle ~ 1 Million Carriers
WL
BL
V DD
n1
a-particle
SiO2
1
1
1
1
1
1
2
2
2
2
2
2
© Digital Integrated Circuits2nd Memories
Yield
Yield
Yield curves at different stages of process maturity
(from [Veendrick92])
© Digital Integrated Circuits2nd Memories
Redundancy
Redundancy
Memory
Array
Column Decoder
Redundant
rows
Redundant
columns
Row
Address
Column
Address
Fuse
Bank
:
© Digital Integrated Circuits2nd Memories
Error-Correcting Codes
Error-Correcting Codes
Example: Hamming Codes
with
e.g. B3 Wrong
1
1
0
= 3
© Digital Integrated Circuits2nd Memories
Redundancy and Error Correction
Redundancy and Error Correction
© Digital Integrated Circuits2nd Memories
Sources of Power Dissipation in
Sources of Power Dissipation in
Memories
Memories
PERIPHERY
ROW
DEC
selected
non-selected
CHIP
COLUMN DEC
nCDE V INTf
mCDE V INTf
CPT V INTf
IDCP
ARRAY
m
n
m(n2 1)ihld
miact
V DD
VSS
IDD 5 SCiDVif 1S IDCP
From [Itoh00]
© Digital Integrated Circuits2nd Memories
Data Retention in SRAM
Data Retention in SRAM
1.30u
1.10u
900n
700n
500n
300n
100n
0.00 .600 1.20 1.80
Factor 7
0.13 m CMOS
m
0.18 m CMOS
m
VDD
I
leakage
SRAM leakage increases with technology scaling
© Digital Integrated Circuits2nd Memories
Suppressing Leakage in SRAM
Suppressing Leakage in SRAM
SRAM
cell
SRAM
cell
SRAM
cell
VDD,int
VDD
VDD VDDL
VSS,int
sleep
sleep
SRAM
cell
SRAM
cell
SRAM
cell
VDD,int
sleep
low-threshold transistor
Reducing the supply voltage
Reducing the supply voltage
Inserting Extra Resistance
Inserting Extra Resistance
© Digital Integrated Circuits2nd Memories
Data Retention in DRAM
Data Retention in DRAM
10
1
100
102 1
10
2 2
102 3
102 4
10
2 5
10
2 6
15M 64M 255M 1G 4G 15G 64G
Capacity (bit)
Current
(A)
3.3 2.5 2.0 1.5 1.2 1.0 0.8
Operating voltage (V)
0.53 0.40 0.32 0.24 0.19 0.16 0.13
Extrapolated threshold voltage at 25 C (V)
IACT
IAC
IDC
Cycle time : 150 ns
T 5 75 C, S
From [Itoh00]
© Digital Integrated Circuits2nd Memories
Case Studies
Case Studies
 Programmable Logic Array
 SRAM
 Flash Memory
© Digital Integrated Circuits2nd Memories
PLA versus ROM
PLA versus ROM
 Programmable Logic Array
structured approach to random logic
“two level logic implementation”
NOR-NOR (product of sums)
NAND-NAND (sum of products)
IDENTICAL TO ROM!
 Main difference
ROM: fully populated
PLA: one element per minterm
Note: Importance of PLA’s has drastically reduced
1. slow
2. better software techniques (mutli-level logic
synthesis)
But …
© Digital Integrated Circuits2nd Memories
Programmable Logic Array
Programmable Logic Array
GND GND GND GND
GND
GND
GND
V DD
V DD
X0
X0 X1 f0 f1
X1 X2
X2
AND-plane OR-plane
Pseudo-NMOS PLA
© Digital Integrated Circuits2nd Memories
Dynamic PLA
Dynamic PLA
GND
GND
V DD
V DD
X0
X0 X1 f0 f1
X1 X2
X2
AND
f
AND
f
OR
f
OR
f
AND-plane OR-plane
© Digital Integrated Circuits2nd Memories
Clock Signal Generation
Clock Signal Generation
for self-timed dynamic PLA
for self-timed dynamic PLA
f
tpre teval
f AND
f
f AND
f AND
f OR
f OR
(a) Clock signals (b) Timing generation circuitry
Dummy AND row
Dummy AND row
© Digital Integrated Circuits2nd Memories
PLA Layout
PLA Layout
VDD GND

And-Plane Or-Plane
f0 f1
x0 x0 x1 x1 x2 x2
Pull-up devices Pull-up devices
© Digital Integrated Circuits2nd Memories
4 Mbit SRAM
4 Mbit SRAM
Hierarchical Word-line Architecture
Hierarchical Word-line Architecture
Global word line
Sub-global word line
Block group
select
Block
select
Block
select
Memory cell
Local
word line
Block 0
•••
Local
word line
Block 1
•••
Block 2...
•••
© Digital Integrated Circuits2nd Memories
Bit-line Circuitry
Bit-line Circuitry
Bit-line
load
Block
select ATD
BEQ
Local WL
Memory cell
I/O line
I/O
B/T
CD
Sense amplifier
CD CD
I/O
B/T
© Digital Integrated Circuits2nd Memories
Sense Amplifier (and Waveforms)
Sense Amplifier (and Waveforms)
BS
I/O I/O
DATA
Block
select ATD
BS
SA SA
BS
SEQ
SEQ
SEQ
SEQ
SEQ
Dei
I/O Lines
Address
Data-cut
ATD
BEQ
SEQ
DATA
Vdd
GND
SA, SA
Vdd
GND
© Digital Integrated Circuits2nd Memories
1 Gbit Flash Memory
1 Gbit Flash Memory
Sense Latches
(10241 32) 3 8
Data Caches
(10241 32) 3 8
Sense Latches
(1024 1 32) 3 8
Data Caches
(1024 1 32) 3 8
Word
Line
Driver
Word
Line
Driver
Word
Line
Driver
Word
Line
Driver
512Mb Memory Array 512Mb Memory Array
BL0 BL1 ····· BL16895 BL16996 BL16897··· BL33791
SGD
WL31
WL0
SGS
Block0
BLT0
Block1023
Block0
Block1023
Bit Line Control Circuit
BLT1
I/O
From [Nakamura02]
© Digital Integrated Circuits2nd Memories
Writing Flash Memory
Writing Flash Memory
Number
of
memory
cells
0V 1V 2V
Vt of memory cells
Verify level 5 0.8 V Word-line level5 4.5 V
(a)
3V 4V
Result of 4 times
program
100
0V 1V 2V
Vt of memory cells
3V 4V
102
104
106
108
Evolution of thresholds Final Distribution
From [Nakamura02]
© Digital Integrated Circuits2nd Memories
125
125mm
mm2
2
1Gbit NAND Flash Memory
1Gbit NAND Flash Memory
10.7mm
11.7mm
2kB
Page
buffer
&
cache
Charge
pump
16896 bit lines
32 word lines
x 1024 blocks
From [Nakamura02]
© Digital Integrated Circuits2nd Memories
125
125mm
mm2
2
1Gbit NAND Flash Memory
1Gbit NAND Flash Memory
 Technology 0.13m p-sub CMOS triple-well
1poly, 1polycide, 1W, 2Al
 Cell size 0.077m2
 Chip size 125.2mm2
 Organization 2112 x 8b x 64 page x 1k block
 Power supply 2.7V-3.6V
 Cycle time 50ns
 Read time 25s
 Program time 200s / page
 Erase time 2ms / block
From [Nakamura02]
© Digital Integrated Circuits2nd Memories
Semiconductor Memory Trends
Semiconductor Memory Trends
(up to the 90’s)
(up to the 90’s)
Memory Size as a function of time: x 4 every three years
© Digital Integrated Circuits2nd Memories
Semiconductor Memory Trends
Semiconductor Memory Trends
(updated)
(updated)
From [Itoh01]
© Digital Integrated Circuits2nd Memories
Trends in Memory Cell Area
Trends in Memory Cell Area
From [Itoh01]
© Digital Integrated Circuits2nd Memories
Semiconductor Memory Trends
Semiconductor Memory Trends
Technology feature size for different SRAM generations

More Related Content

PPTX
chapter-12memory.pptx
PPTX
Semiconductor memories
PDF
9 semiconductor memory
PPTX
Semiconductor Memory Overview (Module 3)
PPT
Microelectronics U4.pptx.ppt
PPT
Lec17 Intro to Computer Engineering by Hsien-Hsin Sean Lee Georgia Tech -- Me...
PPTX
eMMC Embedded Multimedia Card overview
PDF
Slides of talk
chapter-12memory.pptx
Semiconductor memories
9 semiconductor memory
Semiconductor Memory Overview (Module 3)
Microelectronics U4.pptx.ppt
Lec17 Intro to Computer Engineering by Hsien-Hsin Sean Lee Georgia Tech -- Me...
eMMC Embedded Multimedia Card overview
Slides of talk

Similar to Digital Integrated Circuit A Design Perspective (20)

PPTX
SEMICONDUCTOR MEMORIES(RAM &ROM).pptx
PDF
DDR DIMM Design
PDF
IRJET- Design And VLSI Verification of DDR SDRAM Controller Using VHDL
PPT
Memoryhierarchy
PDF
DDR SDRAM : Notes
PDF
Design, Validation and Correlation of Characterized SODIMM Modules Supporting...
PDF
Lecture2
PPTX
Digital electronics and logic design
PPTX
Memory modules
PDF
CArcMOOC 07.02 - Non-volatile memory devices
PPT
static random access memory very large scale integration(vlsi)
PDF
Code GPU with CUDA - SIMT
PDF
VLSI DESIGN ITS ANALYSIS AND APPLICATIONS
PDF
DESIGN AND PERFORMANCE ANALYSIS OF ZBT SRAM CONTROLLER
PDF
Kernel Recipes 2019 - Marvels of Memory Auto-configuration (SPD)
PPT
PPT on DMA controller 82577 for Btech 4 sem
PPT
DF_Captronics06
PPT
lect13.ppt
PPTX
Memory And Storages
PPTX
soc ip core based for spacecraft application
SEMICONDUCTOR MEMORIES(RAM &ROM).pptx
DDR DIMM Design
IRJET- Design And VLSI Verification of DDR SDRAM Controller Using VHDL
Memoryhierarchy
DDR SDRAM : Notes
Design, Validation and Correlation of Characterized SODIMM Modules Supporting...
Lecture2
Digital electronics and logic design
Memory modules
CArcMOOC 07.02 - Non-volatile memory devices
static random access memory very large scale integration(vlsi)
Code GPU with CUDA - SIMT
VLSI DESIGN ITS ANALYSIS AND APPLICATIONS
DESIGN AND PERFORMANCE ANALYSIS OF ZBT SRAM CONTROLLER
Kernel Recipes 2019 - Marvels of Memory Auto-configuration (SPD)
PPT on DMA controller 82577 for Btech 4 sem
DF_Captronics06
lect13.ppt
Memory And Storages
soc ip core based for spacecraft application
Ad

Recently uploaded (20)

PDF
Unit I -OPERATING SYSTEMS_SRM_KATTANKULATHUR.pptx.pdf
PDF
Soil Improvement Techniques Note - Rabbi
PDF
Computer organization and architecuture Digital Notes....pdf
PPTX
Software Engineering and software moduleing
PDF
Artificial Superintelligence (ASI) Alliance Vision Paper.pdf
PPTX
Management Information system : MIS-e-Business Systems.pptx
PDF
Prof. Dr. KAYIHURA A. SILAS MUNYANEZA, PhD..pdf
PPTX
Sorting and Hashing in Data Structures with Algorithms, Techniques, Implement...
PPTX
CyberSecurity Mobile and Wireless Devices
PDF
Implantable Drug Delivery System_NDDS_BPHARMACY__SEM VII_PCI .pdf
PDF
MLpara ingenieira CIVIL, meca Y AMBIENTAL
PDF
Java Basics-Introduction and program control
PDF
Applications of Equal_Area_Criterion.pdf
PDF
First part_B-Image Processing - 1 of 2).pdf
PPTX
Feature types and data preprocessing steps
PDF
distributed database system" (DDBS) is often used to refer to both the distri...
PPTX
Chemical Technological Processes, Feasibility Study and Chemical Process Indu...
PDF
Accra-Kumasi Expressway - Prefeasibility Report Volume 1 of 7.11.2018.pdf
PPTX
"Array and Linked List in Data Structures with Types, Operations, Implementat...
PDF
UEFA_Embodied_Carbon_Emissions_Football_Infrastructure.pdf
Unit I -OPERATING SYSTEMS_SRM_KATTANKULATHUR.pptx.pdf
Soil Improvement Techniques Note - Rabbi
Computer organization and architecuture Digital Notes....pdf
Software Engineering and software moduleing
Artificial Superintelligence (ASI) Alliance Vision Paper.pdf
Management Information system : MIS-e-Business Systems.pptx
Prof. Dr. KAYIHURA A. SILAS MUNYANEZA, PhD..pdf
Sorting and Hashing in Data Structures with Algorithms, Techniques, Implement...
CyberSecurity Mobile and Wireless Devices
Implantable Drug Delivery System_NDDS_BPHARMACY__SEM VII_PCI .pdf
MLpara ingenieira CIVIL, meca Y AMBIENTAL
Java Basics-Introduction and program control
Applications of Equal_Area_Criterion.pdf
First part_B-Image Processing - 1 of 2).pdf
Feature types and data preprocessing steps
distributed database system" (DDBS) is often used to refer to both the distri...
Chemical Technological Processes, Feasibility Study and Chemical Process Indu...
Accra-Kumasi Expressway - Prefeasibility Report Volume 1 of 7.11.2018.pdf
"Array and Linked List in Data Structures with Types, Operations, Implementat...
UEFA_Embodied_Carbon_Emissions_Football_Infrastructure.pdf
Ad

Digital Integrated Circuit A Design Perspective

  • 1. © Digital Integrated Circuits2nd Memories Digital Integrated Digital Integrated Circuits Circuits A Design Perspective A Design Perspective Semiconductor Semiconductor Memories Memories Jan M. Rabaey Anantha Chandrakasan Borivoje Nikolic December 20, 2002
  • 2. © Digital Integrated Circuits2nd Memories Chapter Overview Chapter Overview  Memory Classification  Memory Architectures  The Memory Core  Periphery  Reliability  Case Studies
  • 3. © Digital Integrated Circuits2nd Memories Semiconductor Memory Classification Semiconductor Memory Classification Read-Write Memory Non-Volatile Read-Write Memory Read-Only Memory EPROM E 2 PROM FLASH Random Access Non-Random Access SRAM DRAM Mask-Programmed Programmable (PROM) FIFO Shift Register CAM LIFO
  • 4. © Digital Integrated Circuits2nd Memories Memory Timing: Definitions Memory Timing: Definitions Write cycle Read access Read access Read cycle Write access Data written Data valid DATA WRITE READ
  • 5. © Digital Integrated Circuits2nd Memories Memory Architecture: Decoders Memory Architecture: Decoders Word 0 Word 1 Word 2 WordN 22 WordN 21 Storage cell M bits M bits S0 S1 S2 SN 22 A0 A1 A K 21 K 5 log2N SN 21 Word 0 Word 1 Word 2 WordN 22 WordN 21 Storage cell S0 Input-Output (M bits) Intuitive architecture for N x M memory Too many select signals: N words == N select signals K = log2N Decoder reduces the number of select signals Input-Output (M bits)
  • 6. © Digital Integrated Circuits2nd Memories Row Decoder Bit line 2L 2 K Word line A K A K 1 1 A L 2 1 A 0 M.2K A K 2 1 Sense amplifiers / Drivers Column decoder Input-Output (M bits) Array-Structured Memory Architecture Array-Structured Memory Architecture Problem: ASPECT RATIO or HEIGHT >> WIDTH Amplify swing to rail-to-rail amplitude Selects appropriate word
  • 7. © Digital Integrated Circuits2nd Memories Hierarchical Memory Architecture Hierarchical Memory Architecture Advantages: Advantages: 1. Shorter wires within blocks 1. Shorter wires within blocks 2. Block address activates only 1 block => power savings 2. Block address activates only 1 block => power savings Global amplifier/driver Control circuitry Global data bus Block selector Block 0 Row address Column address Block address Block i Block P 2 1 I/O
  • 8. © Digital Integrated Circuits2nd Memories Block Diagram of 4 Mbit SRAM Block Diagram of 4 Mbit SRAM Clock generator CS, WE buffer I/O buffer Y-address buffer X-address buffer x1/x4 controller Z-address buffer X-address buffer Predecoder and block selector Bit line load Transfer gate Column decoder Sense amplifier and write driver [Hirose90]
  • 9. © Digital Integrated Circuits2nd Memories Contents-Addressable Memory Contents-Addressable Memory Address Decoder Data (64 bits) I/O Buffers Comparand CAM Array 2 9 words3 64 bits Mask Control Logic R/W Address (9 bits) Commands 2 9 Validity Bits Priority Encoder
  • 10. © Digital Integrated Circuits2nd Memories Memory Timing: Approaches Memory Timing: Approaches DRAM Timing Multiplexed Adressing SRAM Timing Self-timed Address bus RAS RAS -CAS timing Row Address Address Bus Address transition initiates memory operation Address Column Address CAS
  • 11. © Digital Integrated Circuits2nd Memories Read-Only Memory Cells Read-Only Memory Cells WL BL WL BL 1 WL BL WL BL WL BL 0 VDD WL BL GND Diode ROM MOS ROM 1 MOS ROM 2
  • 12. © Digital Integrated Circuits2nd Memories MOS OR ROM MOS OR ROM WL[0] VDD BL[0] WL[1] WL[2] WL[3] Vbias BL[1] Pull-down loads BL[2] BL[3] VDD
  • 13. © Digital Integrated Circuits2nd Memories MOS NOR ROM MOS NOR ROM WL[0] GND BL [0] WL [1] WL [2] WL [3] VDD BL [1] Pull-up devices BL [2] BL [3] GND
  • 14. © Digital Integrated Circuits2nd Memories MOS NOR ROM Layout MOS NOR ROM Layout Programmming using the Active Layer Only Polysilicon Metal1 Diffusion Metal1 on Diffusion Cell (9.5 x 7)
  • 15. © Digital Integrated Circuits2nd Memories MOS NOR ROM Layout MOS NOR ROM Layout Polysilicon Metal1 Diffusion Metal1 on Diffusion Cell (11 x 7) Programmming using the Contact Layer Only
  • 16. © Digital Integrated Circuits2nd Memories MOS NAND ROM MOS NAND ROM All word lines high by default with exception of selected row WL[0] WL[1] WL[2] WL[3] VDD Pull-up devices BL[3] BL[2] BL[1] BL[0]
  • 17. © Digital Integrated Circuits2nd Memories MOS NAND ROM Layout MOS NAND ROM Layout No contact to VDD or GND necessary; Loss in performance compared to NOR ROM drastically reduced cell size Polysilicon Diffusion Metal1 on Diffusion Cell (8 x 7) Programmming using the Metal-1 Layer Only
  • 18. © Digital Integrated Circuits2nd Memories NAND ROM Layout NAND ROM Layout Cell (5 x 6) Polysilicon Threshold-altering implant Metal1 on Diffusion Programmming using Implants Only
  • 19. © Digital Integrated Circuits2nd Memories Equivalent Transient Model for MOS NOR ROM Equivalent Transient Model for MOS NOR ROM  Word line parasitics  Wire capacitance and gate capacitance  Wire resistance (polysilicon)  Bit line parasitics  Resistance not dominant (metal)  Drain and Gate-Drain capacitance Model for NOR ROM VDD Cbit rword cword WL BL
  • 20. © Digital Integrated Circuits2nd Memories Equivalent Transient Model for MOS NAND ROM Equivalent Transient Model for MOS NAND ROM  Word line parasitics  Similar to NOR ROM  Bit line parasitics  Resistance of cascaded transistors dominates  Drain/Source and complete gate capacitance Model for NAND ROM VDD CL rword cword cbit rbit WL BL
  • 21. © Digital Integrated Circuits2nd Memories Decreasing Word Line Delay Decreasing Word Line Delay Metal bypass Polysilicon word line K cells Polysilicon word line WL Driver (b) Using a metal bypass (a) Driving the word line from both sides Metal word line WL (c) Use silicides
  • 22. © Digital Integrated Circuits2nd Memories Precharged MOS NOR ROM Precharged MOS NOR ROM PMOS precharge device can be made as large as necessary, but clock driver becomes harder to design. WL[0] GND BL[0] WL[1] WL[2] WL[3] VDD BL[1] Precharge devices BL[2] BL[3] GND pre f
  • 23. © Digital Integrated Circuits2nd Memories Non-Volatile Memories Non-Volatile Memories The Floating-gate transistor (FAMOS) The Floating-gate transistor (FAMOS) Floating gate Source Substrate Gate Drain n+ n+_ p tox tox Device cross-section Schematic symbol G S D
  • 24. © Digital Integrated Circuits2nd Memories Floating-Gate Transistor Programming Floating-Gate Transistor Programming 0 V 2 5 V 0 V D S Removing programming voltage leaves charge trapped 5 V 22.5 V 5 V D S Programming results in higher VT. 20 V 10 V 5 V 20 V D S Avalanche injection
  • 25. © Digital Integrated Circuits2nd Memories A “Programmable-Threshold” Transistor A “Programmable-Threshold” Transistor “0”-state “1”-state DV T V WL V GS “ON” “OFF ”
  • 26. © Digital Integrated Circuits2nd Memories FLOTOX EEPROM FLOTOX EEPROM Floating gate Source Substrate p Gate Drain n1 n1 FLOTOX transistor Fowler-Nordheim I-V characteristic 20–30 nm 10 nm -10 V 10 V I VGD
  • 27. © Digital Integrated Circuits2nd Memories EEPROM Cell EEPROM Cell WL BL VDD Absolute threshold control is hard Unprogrammed transistor might be depletion  2 transistor cell
  • 28. © Digital Integrated Circuits2nd Memories Flash EEPROM Flash EEPROM Control gate erasure p- substrate Floating gate Thin tunneling oxide n1 source n1 drain programming Many other options …
  • 29. © Digital Integrated Circuits2nd Memories Cross-sections of NVM cells Cross-sections of NVM cells EPROM Flash Courtesy Intel
  • 30. © Digital Integrated Circuits2nd Memories Basic Operations in a NOR Flash Memory― Basic Operations in a NOR Flash Memory― Erase Erase S D 12 V G cell array BL 0 BL 1 open open WL 0 WL 1 0 V 0 V
  • 31. © Digital Integrated Circuits2nd Memories Basic Operations in a NOR Flash Memory― Basic Operations in a NOR Flash Memory― Write Write S D 12 V 6 V G BL 0 BL 1 6 V 0 V WL 0 WL 1 12 V 0 V
  • 32. © Digital Integrated Circuits2nd Memories Basic Operations in a NOR Flash Memory― Basic Operations in a NOR Flash Memory― Read Read 5 V 1 V G S D BL 0 BL 1 1 V 0 V WL 0 WL 1 5 V 0 V
  • 33. © Digital Integrated Circuits2nd Memories NAND Flash Memory NAND Flash Memory Unit Cell Word line(poly) Source line (Diff. Layer) Courtesy Toshiba Gate ONO FG Gate Oxide
  • 34. © Digital Integrated Circuits2nd Memories NAND Flash Memory NAND Flash Memory Word lines Select transistor Bit line contact Source line contact Active area STI Courtesy Toshiba
  • 35. © Digital Integrated Circuits2nd Memories Characteristics of State-of-the-art NVM Characteristics of State-of-the-art NVM
  • 36. © Digital Integrated Circuits2nd Memories Read-Write Memories (RAM) Read-Write Memories (RAM)  STATIC (SRAM)  DYNAMIC (DRAM) Data stored as long as supply is applied Large (6 transistors/cell) Fast Differential Periodic refresh required Small (1-3 transistors/cell) Slower Single Ended
  • 37. © Digital Integrated Circuits2nd Memories 6-transistor CMOS SRAM Cell 6-transistor CMOS SRAM Cell WL BL VDD M5 M6 M4 M1 M2 M3 BL Q Q
  • 38. © Digital Integrated Circuits2nd Memories CMOS SRAM Analysis (Read) CMOS SRAM Analysis (Read) WL BL VDD M5 M6 M4 M1 VDD VDD VDD BL Q = 1 Q = 0 Cbit Cbit
  • 39. © Digital Integrated Circuits2nd Memories CMOS SRAM Analysis (Read) CMOS SRAM Analysis (Read) 0 0 0.2 0.4 0.6 0.8 1 1.2 0.5 1 1.2 1.5 2 Cell Ratio (CR) 2.5 3 Voltage Rise (V)
  • 40. © Digital Integrated Circuits2nd Memories CMOS SRAM Analysis (Write) CMOS SRAM Analysis (Write) BL = 1 BL = 0 Q = 0 Q = 1 M1 M4 M5 M6 VDD VDD WL
  • 41. © Digital Integrated Circuits2nd Memories CMOS SRAM Analysis (Write) CMOS SRAM Analysis (Write)
  • 42. © Digital Integrated Circuits2nd Memories 6T-SRAM — Layout 6T-SRAM — Layout VDD GND Q Q WL BL BL M1 M3 M4 M2 M5 M6
  • 43. © Digital Integrated Circuits2nd Memories Resistance-load SRAM Cell Resistance-load SRAM Cell Static power dissipation -- Want RL large Bit lines precharged to VDD to address tp problem M3 RL RL VDD WL Q Q M1 M2 M4 BL BL
  • 44. © Digital Integrated Circuits2nd Memories SRAM Characteristics SRAM Characteristics
  • 45. © Digital Integrated Circuits2nd Memories 3-Transistor DRAM Cell 3-Transistor DRAM Cell No constraints on device ratios Reads are non-destructive Value stored at node X when writing a “1” = VWWL-VTn WWL BL1 M1 X M3 M2 CS BL2 RWL V DD V DD 2 VT DV V DD 2 VT BL2 BL1 X RWL WWL
  • 46. © Digital Integrated Circuits2nd Memories 3T-DRAM — Layout 3T-DRAM — Layout BL2 BL1 GND RWL WWL M3 M2 M1
  • 47. © Digital Integrated Circuits2nd Memories 1-Transistor DRAM Cell 1-Transistor DRAM Cell Write: CS is charged or discharged by asserting WL and BL. Read: Charge redistribution takes places between bit line and storage capacitance Voltage swing is small; typically around 250 mV. M1 CS WL BL CBL V DD 2 V T WL X sensing BL GND Write 1 Read 1 V DD V DD /2 V V BL VPRE – VBIT VPRE – CS CS CBL + ------------ = = V
  • 48. © Digital Integrated Circuits2nd Memories DRAM Cell Observations DRAM Cell Observations  1T DRAM requires a sense amplifier for each bit line, due to charge redistribution read-out.  DRAM memory cells are single ended in contrast to SRAM cells. The read-out of the 1T DRAM cell is destructive; read and refresh operations are necessary for correct operation.  Unlike 3T cell, 1T cell requires presence of an extra capacitance that must be explicitly included in the design.  When writing a “1” into a DRAM cell, a threshold voltage is lost. This charge loss can be circumvented by bootstrapping the word lines to a higher value than VDD
  • 49. © Digital Integrated Circuits2nd Memories Sense Amp Operation Sense Amp Operation DV(1) V(1) V(0) t VPRE VBL Sense amp activated Word line activated
  • 50. © Digital Integrated Circuits2nd Memories 1-T DRAM Cell 1-T DRAM Cell Uses Polysilicon-Diffusion Capacitance Expensive in Area M1 word line Diffused bit line Polysilicon gate Polysilicon plate Capacitor Cross-section Layout Metal word line Poly SiO2 Field Oxide n+ n+ Inversion layer induced by plate bias Poly
  • 51. © Digital Integrated Circuits2nd Memories SEM of poly-diffusion capacitor 1T-DRAM SEM of poly-diffusion capacitor 1T-DRAM
  • 52. © Digital Integrated Circuits2nd Memories Advanced 1T DRAM Cells Advanced 1T DRAM Cells Cell Plate Si Capacitor Insulator Storage Node Poly 2nd Field Oxide Refilling Poly Si Substrate Trench Cell Stacked-capacitor Cell Capacitor dielectric layer Cell plate Word line Insulating Layer Isolation Transfer gate Storage electrode
  • 53. © Digital Integrated Circuits2nd Memories Static CAM Memory Cell Static CAM Memory Cell CAM Bit Word Bit ••• CAM Bit Bit CAM Word Wired-NOR Match Line Match M1 M2 M7 M6 M4 M5 M8 M9 M3 int S Word ••• CAM Bit Bit S
  • 54. © Digital Integrated Circuits2nd Memories CAM in Cache Memory CAM in Cache Memory CAM ARRAY Input Drivers Tag Hit Address SRAM ARRAY Sense Amps / Input Drivers Data R/W
  • 55. © Digital Integrated Circuits2nd Memories Periphery Periphery  Decoders  Sense Amplifiers  Input/Output Buffers  Control / Timing Circuitry
  • 56. © Digital Integrated Circuits2nd Memories Row Decoders Row Decoders Collection of 2M complex logic gates Organized in regular and dense fashion (N)AND Decoder NOR Decoder
  • 57. © Digital Integrated Circuits2nd Memories Hierarchical Decoders Hierarchical Decoders • • • • • • A2 A2 A2A3 WL 0 A2A3 A2A3 A2A3 A3 A3 A0 A0 A0A1 A0A1 A0A1 A0A1 A1 A1 WL 1 Multi-stage implementation improves performance NAND decoder using NAND decoder using 2-input pre-decoders 2-input pre-decoders
  • 58. © Digital Integrated Circuits2nd Memories Dynamic Decoders Dynamic Decoders Precharge devices VDD  GND WL3 WL2 WL1 WL0 A0 A0 GND A1 A1  WL3 A0 A0 A1 A1 WL 2 WL 1 WL 0 VDD VDD VDD VDD 2-input NOR decoder 2-input NAND decoder
  • 59. © Digital Integrated Circuits2nd Memories 4-input pass-transistor based column 4-input pass-transistor based column decoder decoder Advantages: speed (tpd does not add to overall memory access time) Only one extra transistor in signal path Disadvantage: Large transistor count A0 S0 BL 0 BL 1 BL 2 BL 3 A1 S1 S2 S3 D
  • 60. © Digital Integrated Circuits2nd Memories 4-to-1 tree based column decoder 4-to-1 tree based column decoder Number of devices drastically reduced Delay increases quadratically with # of sections; prohibitive for large decoders buffers progressive sizing combination of tree and pass transistor approaches Solutions: BL 0 BL 1 BL 2 BL 3 D A0 A0 A1 A1
  • 61. © Digital Integrated Circuits2nd Memories Decoder for circular shift-register Decoder for circular shift-register V DD V DD R WL 0 V DD f f f f V DD R WL 1 V DD f f f f V DD R WL 2 V DD f f f f • • •
  • 62. © Digital Integrated Circuits2nd Memories Sense Amplifiers Sense Amplifiers tp C V  Iav ---------------- = make V as small as possible small large Idea: Use Sense Amplifer output input s.a. small transition
  • 63. © Digital Integrated Circuits2nd Memories Differential Sense Amplifier Differential Sense Amplifier Directly applicable to SRAMs M4 M1 M5 M3 M2 V DD bit bit SE Out y
  • 64. © Digital Integrated Circuits2nd Memories Differential Sensing ― SRAM Differential Sensing ― SRAM V DD V DD V DD V DD BL EQ Diff. Sense Amp (a) SRAM sensing scheme (b) two stage differential amplifier SRAM cell i WL i 2 x x V DD Output BL PC M3 M1 M5 M2 M4 x SE SE SE Output SE x 2 x 2 x
  • 65. © Digital Integrated Circuits2nd Memories Latch-Based Sense Amplifier (DRAM) Latch-Based Sense Amplifier (DRAM) Initialized in its meta-stable point with EQ Once adequate voltage gap created, sense amp enabled with SE Positive feedback quickly forces output to a stable operating point. EQ VDD BL BL SE SE
  • 66. © Digital Integrated Circuits2nd Memories Charge-Redistribution Amplifier Charge-Redistribution Amplifier 0.5 1.0 1.5 2.0 2.5 0.0 0.0 1.00 2.00 time(nsec) V V in V ref 5 3V V L V S (b) Transient response 3.00 Concept M2 M3 M1 V L VS Vref Csmall Clarge Transient Response
  • 67. © Digital Integrated Circuits2nd Memories Charge-Redistribution Amplifier― Charge-Redistribution Amplifier― EPROM EPROM SE VDD WLC Load Cascode device Column decoder EPROM array BL WL Vcasc Out Cout Ccol CBL M1 M2 M3 M4
  • 68. © Digital Integrated Circuits2nd Memories Single-to-Differential Conversion Single-to-Differential Conversion How to make a good Vref? Diff. S.A. Cell 2 x x Output WL V ref BL 1 2
  • 69. © Digital Integrated Circuits2nd Memories Open bitline architecture with Open bitline architecture with dummy cells dummy cells CS CS CS CS BLL L L1 L0 R0 CS R1 CS L … … BLR V DD SE SE EQ Dummy cell Dummy cell
  • 70. © Digital Integrated Circuits2nd Memories DRAM Read Process with Dummy Cell DRAM Read Process with Dummy Cell 3 2 1 0 0 1 2 3 BL BL t (ns) reading 0 3 2 1 0 0 1 2 3 SE EQ WL t (ns) control signals 3 2 1 0 0 1 2 3 BL BL t (ns) reading 1
  • 71. © Digital Integrated Circuits2nd Memories Voltage Regulator Voltage Regulator - + VDD VREF Vbias Mdrive Mdrive VDL VDL VREF Equivalent Model
  • 72. © Digital Integrated Circuits2nd Memories Charge Pump Charge Pump CLK V DD A B M1 M2 V load Cload Cpump 2V DD 2 V T V DD 2 V T 0 V V B V load 0 V
  • 73. © Digital Integrated Circuits2nd Memories DRAM Timing DRAM Timing
  • 74. © Digital Integrated Circuits2nd Memories RDRAM Architecture RDRAM Architecture memory array Data bus Clocks Column Row demux packet dec. packet dec. Bus k k 3l demux
  • 75. © Digital Integrated Circuits2nd Memories Address Transition Detection Address Transition Detection DELAY td A0 DELAY td A1 DELAY td AN2 1 VDD ATD ATD …
  • 76. © Digital Integrated Circuits2nd Memories Reliability and Yield Reliability and Yield
  • 77. © Digital Integrated Circuits2nd Memories Sensing Parameters in DRAM Sensing Parameters in DRAM From [Itoh01] 4K 10 100 1000 64K 1M 16M 256M 4G 64G Memory Capacity (bits/chip) CD (1F) CS(1F) QS(1C) Vsmax(mv) V DD (V) QS 5 CS V DD /2 Vsmax 5 QS/(CS 1 CD)
  • 78. © Digital Integrated Circuits2nd Memories Noise Sources in 1T DRam Noise Sources in 1T DRam Ccross electrode a-particles leakage CS WL BL substrate Adjacent BL CWBL
  • 79. © Digital Integrated Circuits2nd Memories Open Bit-line Architecture —Cross Coupling Open Bit-line Architecture —Cross Coupling Sense Amplifier C WL1 BL C BL C WBL C WBL C C WL0 C C BL C C WL D WL D WL0 WL1 BL EQ
  • 80. © Digital Integrated Circuits2nd Memories Folded-Bitline Architecture Folded-Bitline Architecture Sense Amplifier C WL 1 CWBL CWBL C WL 0 WL 0 WL D C C WL 1 C C WL D BL CBL BL CBL EQ x x y
  • 81. © Digital Integrated Circuits2nd Memories Transposed-Bitline Architecture Transposed-Bitline Architecture SA Ccross (a) Straightforward bit-line routing (b) Transposed bit-line architecture BL 9 BL BL BL 99 SA Ccross BL 9 BL BL BL 99
  • 82. © Digital Integrated Circuits2nd Memories Alpha-particles (or Neutrons) Alpha-particles (or Neutrons) 1 Particle ~ 1 Million Carriers WL BL V DD n1 a-particle SiO2 1 1 1 1 1 1 2 2 2 2 2 2
  • 83. © Digital Integrated Circuits2nd Memories Yield Yield Yield curves at different stages of process maturity (from [Veendrick92])
  • 84. © Digital Integrated Circuits2nd Memories Redundancy Redundancy Memory Array Column Decoder Redundant rows Redundant columns Row Address Column Address Fuse Bank :
  • 85. © Digital Integrated Circuits2nd Memories Error-Correcting Codes Error-Correcting Codes Example: Hamming Codes with e.g. B3 Wrong 1 1 0 = 3
  • 86. © Digital Integrated Circuits2nd Memories Redundancy and Error Correction Redundancy and Error Correction
  • 87. © Digital Integrated Circuits2nd Memories Sources of Power Dissipation in Sources of Power Dissipation in Memories Memories PERIPHERY ROW DEC selected non-selected CHIP COLUMN DEC nCDE V INTf mCDE V INTf CPT V INTf IDCP ARRAY m n m(n2 1)ihld miact V DD VSS IDD 5 SCiDVif 1S IDCP From [Itoh00]
  • 88. © Digital Integrated Circuits2nd Memories Data Retention in SRAM Data Retention in SRAM 1.30u 1.10u 900n 700n 500n 300n 100n 0.00 .600 1.20 1.80 Factor 7 0.13 m CMOS m 0.18 m CMOS m VDD I leakage SRAM leakage increases with technology scaling
  • 89. © Digital Integrated Circuits2nd Memories Suppressing Leakage in SRAM Suppressing Leakage in SRAM SRAM cell SRAM cell SRAM cell VDD,int VDD VDD VDDL VSS,int sleep sleep SRAM cell SRAM cell SRAM cell VDD,int sleep low-threshold transistor Reducing the supply voltage Reducing the supply voltage Inserting Extra Resistance Inserting Extra Resistance
  • 90. © Digital Integrated Circuits2nd Memories Data Retention in DRAM Data Retention in DRAM 10 1 100 102 1 10 2 2 102 3 102 4 10 2 5 10 2 6 15M 64M 255M 1G 4G 15G 64G Capacity (bit) Current (A) 3.3 2.5 2.0 1.5 1.2 1.0 0.8 Operating voltage (V) 0.53 0.40 0.32 0.24 0.19 0.16 0.13 Extrapolated threshold voltage at 25 C (V) IACT IAC IDC Cycle time : 150 ns T 5 75 C, S From [Itoh00]
  • 91. © Digital Integrated Circuits2nd Memories Case Studies Case Studies  Programmable Logic Array  SRAM  Flash Memory
  • 92. © Digital Integrated Circuits2nd Memories PLA versus ROM PLA versus ROM  Programmable Logic Array structured approach to random logic “two level logic implementation” NOR-NOR (product of sums) NAND-NAND (sum of products) IDENTICAL TO ROM!  Main difference ROM: fully populated PLA: one element per minterm Note: Importance of PLA’s has drastically reduced 1. slow 2. better software techniques (mutli-level logic synthesis) But …
  • 93. © Digital Integrated Circuits2nd Memories Programmable Logic Array Programmable Logic Array GND GND GND GND GND GND GND V DD V DD X0 X0 X1 f0 f1 X1 X2 X2 AND-plane OR-plane Pseudo-NMOS PLA
  • 94. © Digital Integrated Circuits2nd Memories Dynamic PLA Dynamic PLA GND GND V DD V DD X0 X0 X1 f0 f1 X1 X2 X2 AND f AND f OR f OR f AND-plane OR-plane
  • 95. © Digital Integrated Circuits2nd Memories Clock Signal Generation Clock Signal Generation for self-timed dynamic PLA for self-timed dynamic PLA f tpre teval f AND f f AND f AND f OR f OR (a) Clock signals (b) Timing generation circuitry Dummy AND row Dummy AND row
  • 96. © Digital Integrated Circuits2nd Memories PLA Layout PLA Layout VDD GND  And-Plane Or-Plane f0 f1 x0 x0 x1 x1 x2 x2 Pull-up devices Pull-up devices
  • 97. © Digital Integrated Circuits2nd Memories 4 Mbit SRAM 4 Mbit SRAM Hierarchical Word-line Architecture Hierarchical Word-line Architecture Global word line Sub-global word line Block group select Block select Block select Memory cell Local word line Block 0 ••• Local word line Block 1 ••• Block 2... •••
  • 98. © Digital Integrated Circuits2nd Memories Bit-line Circuitry Bit-line Circuitry Bit-line load Block select ATD BEQ Local WL Memory cell I/O line I/O B/T CD Sense amplifier CD CD I/O B/T
  • 99. © Digital Integrated Circuits2nd Memories Sense Amplifier (and Waveforms) Sense Amplifier (and Waveforms) BS I/O I/O DATA Block select ATD BS SA SA BS SEQ SEQ SEQ SEQ SEQ Dei I/O Lines Address Data-cut ATD BEQ SEQ DATA Vdd GND SA, SA Vdd GND
  • 100. © Digital Integrated Circuits2nd Memories 1 Gbit Flash Memory 1 Gbit Flash Memory Sense Latches (10241 32) 3 8 Data Caches (10241 32) 3 8 Sense Latches (1024 1 32) 3 8 Data Caches (1024 1 32) 3 8 Word Line Driver Word Line Driver Word Line Driver Word Line Driver 512Mb Memory Array 512Mb Memory Array BL0 BL1 ····· BL16895 BL16996 BL16897··· BL33791 SGD WL31 WL0 SGS Block0 BLT0 Block1023 Block0 Block1023 Bit Line Control Circuit BLT1 I/O From [Nakamura02]
  • 101. © Digital Integrated Circuits2nd Memories Writing Flash Memory Writing Flash Memory Number of memory cells 0V 1V 2V Vt of memory cells Verify level 5 0.8 V Word-line level5 4.5 V (a) 3V 4V Result of 4 times program 100 0V 1V 2V Vt of memory cells 3V 4V 102 104 106 108 Evolution of thresholds Final Distribution From [Nakamura02]
  • 102. © Digital Integrated Circuits2nd Memories 125 125mm mm2 2 1Gbit NAND Flash Memory 1Gbit NAND Flash Memory 10.7mm 11.7mm 2kB Page buffer & cache Charge pump 16896 bit lines 32 word lines x 1024 blocks From [Nakamura02]
  • 103. © Digital Integrated Circuits2nd Memories 125 125mm mm2 2 1Gbit NAND Flash Memory 1Gbit NAND Flash Memory  Technology 0.13m p-sub CMOS triple-well 1poly, 1polycide, 1W, 2Al  Cell size 0.077m2  Chip size 125.2mm2  Organization 2112 x 8b x 64 page x 1k block  Power supply 2.7V-3.6V  Cycle time 50ns  Read time 25s  Program time 200s / page  Erase time 2ms / block From [Nakamura02]
  • 104. © Digital Integrated Circuits2nd Memories Semiconductor Memory Trends Semiconductor Memory Trends (up to the 90’s) (up to the 90’s) Memory Size as a function of time: x 4 every three years
  • 105. © Digital Integrated Circuits2nd Memories Semiconductor Memory Trends Semiconductor Memory Trends (updated) (updated) From [Itoh01]
  • 106. © Digital Integrated Circuits2nd Memories Trends in Memory Cell Area Trends in Memory Cell Area From [Itoh01]
  • 107. © Digital Integrated Circuits2nd Memories Semiconductor Memory Trends Semiconductor Memory Trends Technology feature size for different SRAM generations