Artificial Intelligence Hardware Design: Challenges and Solutions 1st Edition Albert Chun-Chen Liu Download
Artificial Intelligence Hardware Design: Challenges and Solutions 1st Edition Albert Chun-Chen Liu Download
https://ebookmeta.com/product/artificial-intelligence-hardware-
design-challenges-and-solutions-1st-edition-albert-chun-chen-liu/
https://ebookmeta.com/product/artificial-intelligence-
technologies-applications-and-challenges-1st-edition-lavanya-
sharma-editor/
https://ebookmeta.com/product/artificial-intelligence-and-
digital-diplomacy-challenges-and-opportunities-1st-edition-
fatima-roumate/
https://ebookmeta.com/product/artificial-intelligence-and-
society-5-0-issues-opportunities-and-challenges-1st-edition-
vikas-khullar/
https://ebookmeta.com/product/behavioral-finance-and-asset-
prices-the-influence-of-investors-emotions-1st-edition-david-
bourghelle/
My Family Celebrates Kwanzaa Lisa Bullard
https://ebookmeta.com/product/my-family-celebrates-kwanzaa-lisa-
bullard/
https://ebookmeta.com/product/microeconomics-theory-and-
applications-with-calculus-5th-global-edition-jeffrey-m-perloff/
https://ebookmeta.com/product/the-bloomsbury-companion-to-
spinoza-1st-edition-wiep-van-bunge/
https://ebookmeta.com/product/cases-in-public-relations-
strategy-1st-edition-burton-st-john-iii/
https://ebookmeta.com/product/the-russian-idea-in-international-
relations-civilization-and-national-distinctiveness-1st-edition-
andrei-p-tsygankov/
Nation-State Cyber Offensive Capabilities 1st Edition
Eduardo Izycki
https://ebookmeta.com/product/nation-state-cyber-offensive-
capabilities-1st-edition-eduardo-izycki/
Table of Contents
Cover
Series Page
Title Page
Copyright Page
Author Biographies
Preface
Acknowledgments
Table of Figures
1 Introduction
1.1 Development History
1.2 Neural Network Models
1.3 Neural Network Classification
1.4 Neural Network Framework
1.5 Neural Network Comparison
Exercise
References
2 Deep Learning
2.1 Neural Network Layer
2.2 Deep Learning Challenges
Exercise
References
3 Parallel Architecture
3.1 Intel Central Processing Unit (CPU)
3.2 NVIDIA Graphics Processing Unit (GPU)
3.3 NVIDIA Deep Learning Accelerator (NVDLA)
3.4 Google Tensor Processing Unit (TPU)
3.5 Microsoft Catapult Fabric Accelerator
Exercise
References
4 Streaming Graph Theory
4.1 Blaize Graph Streaming Processor
4.2 Graphcore Intelligence Processing Unit
Exercise
References
5 Convolution Optimization
5.1 Deep Convolutional Neural Network Accelerator
5.2 Eyeriss Accelerator
Exercise
References
6 In‐Memory Computation
6.1 Neurocube Architecture
6.2 Tetris Accelerator
6.3 NeuroStream Accelerator
Exercise
References
7 Near‐Memory Architecture
7.1 DaDianNao Supercomputer
7.2 Cnvlutin Accelerator
Exercise
References
8 Network Sparsity
8.1 Energy Efficient Inference Engine (EIE)
8.2 Cambricon‐X Accelerator
8.3 SCNN Accelerator
8.4 SeerNet Accelerator
Exercise
References
9 3D Neural Processing
9.1 3D Integrated Circuit Architecture
9.2 Power Distribution Network
9.3 3D Network Bridge
9.4 Power‐Saving Techniques
Exercise
References
Appendix A: Neural Network Topology
Index
End User License Agreement
List of Tables
Chapter 1
Table 1.1 Neural network framework.
Chapter 2
Table 2.1 AlexNet neural network model.
Chapter 3
Table 3.1 Intel Xeon family comparison.
Table 3.2 NVIDIA GPU architecture comparison.
Table 3.3 TPU v1 applications.
Table 3.4 Tensor processing unit comparison.
Chapter 5
Table 5.1 Efficiency loss comparison.
Table 5.2 DNN accelerator performance comparison.
Table 5.3 Eyeriss v2 architectural hierarchy.
Table 5.4 Eyeriss architecture.
Chapter 6
Table 6.1 Neurocube performance comparison.
Chapter 8
Table 8.1 SeerNet system performance comparison.
List of Illustrations
Chapter 1
Figure 1.1 High‐tech revolution.
Figure 1.2 Neural network development timeline.
Figure 1.3 ImageNet challenge.
Figure 1.4 Neural network model.
Figure 1.5 Regression.
Figure 1.6 Clustering.
Figure 1.7 Neural network top 1 accuracy vs. computational
complexity.
Figure 1.8 Neural network top 1 accuracy density vs. model
efficiency [14]....
Figure 1.9 Neural network memory utilization and
computational complexity [1...
Chapter 2
Figure 2.1 Deep neural network AlexNet architecture [1].
Figure 2.2 Deep neural network AlexNet model parameters.
Figure 2.3 Deep neural network AlexNet feature map
evolution [3].
Figure 2.4 Convolution function.
Figure 2.5 Nonlinear activation functions.
Figure 2.6 Pooling functions.
Figure 2.7 Dropout layer.
Figure 2.8 Deep learning hardware issues [1].
Chapter 3
Figure 3.1 Intel Xeon processor ES 2600 family Grantley
platform ring archit...
Figure 3.2 Intel Xeon processor scalable family Purley
platform mesh archite...
Figure 3.3 Two‐socket configuration.
Figure 3.4 Four‐socket ring configuration.
Figure 3.5 Four‐socket crossbar configuration.
Figure 3.6 Eight‐socket configuration.
Figure 3.7 Sub‐NUMA cluster domains [3].
Figure 3.8 Cache hierarchy comparison.
Figure 3.9 Intel multiple sockets parallel processing.
Figure 3.10 Intel multiple socket training performance
comparison [4].
Figure 3.11 Intel AVX‐512 16 bits FMA operations
(VPMADDWD + VPADDD).
Figure 3.12 Intel AVX‐512 with VNNI 16 bits FMA operation
(VPDPWSSD).
Figure 3.13 Intel low‐precision convolution.
Figure 3.14 Intel Xenon processor training throughput
comparison [2].
Figure 3.15 Intel Xenon processor inference throughput
comparison [2].
Figure 3.16 NVIDIA turing GPU architecture.
Figure 3.17 NVIDIA GPU shared memory.
Figure 3.18 Tensor core 4 × 4 × 4 matrix operation [9].
Figure 3.19 Turing tensor core performance [7].
Figure 3.20 Matrix D thread group indices.
Figure 3.21 Matrix D 4 × 8 elements computation.
Figure 3.22 Different size matrix multiplication.
Figure 3.23 Simultaneous multithreading (SMT).
Figure 3.24 Multithreading schedule.
Figure 3.25 GPU with HBM2 architecture.
Figure 3.26 Eight GPUs NVLink2 configuration.
Figure 3.27 Four GPUs NVLink2 configuration.
Figure 3.28 Two GPUs NVLink2 configuration.
Figure 3.29 Single GPU NVLink2 configuration.
Figure 3.30 NVDLA core architecture.
Figure 3.31 NVDLA small system model.
Figure 3.32 NVDLA large system model.
Figure 3.33 NVDLA software dataflow.
Figure 3.34 Tensor processing unit architecture.
Figure 3.35 Tensor processing unit floorplan.
Figure 3.36 Multiply–Accumulate (MAC) systolic array.
Figure 3.37 Systolic array matrix multiplication.
Figure 3.38 Cost of different numerical format operation.
Figure 3.39 TPU brain floating‐point format.
Figure 3.40 CPU, GPU, and TPU performance comparison [15].
Figure 3.41 Tensor Processing Unit (TPU) v1.
Figure 3.42 Tensor Processing Unit (TPU) v2.
Figure 3.43 Tensor Processing Unit (TPU) v3.
Figure 3.44 Google TensorFlow subgraph optimization.
Figure 3.45 Microsoft Brainwave configurable cloud
architecture.
Figure 3.46 Tour network topology.
Figure 3.47 Microsoft Brainwave design flow.
Figure 3.48 The Catapult fabric shell architecture.
Figure 3.49 The Catapult fabric microarchitecture.
Figure 3.50 Microsoft low‐precision quantization [27].
Figure 3.51 Matrix‐vector multiplier overview.
Figure 3.52 Tile engine architecture.
Figure 3.53 Hierarchical decode and dispatch scheme.
Figure 3.54 Sparse matrix‐vector multiplier architecture.
Figure 3.55 (a) Sparse Matrix; (b) CSR Format; and (c) CISR
Format.
Chapter 4
Figure 4.1 Data streaming TCS model.
Figure 4.2 Blaize depth‐first scheduling approach.
Figure 4.3 Blaize graph streaming processor architecture.
Figure 4.4 Blaize GSP thread scheduling.
Figure 4.5 Blaize GSP instruction scheduling.
Figure 4.6 Streaming vs. sequential processing comparison.
Figure 4.7 Blaize GSP convolution operation.
Figure 4.8 Intelligence processing unit architecture [8].
Figure 4.9 Intelligence processing unit mixed‐precision
multiplication.
Figure 4.10 Intelligence processing unit single‐precision
multiplication.
Figure 4.11 Intelligence processing unit interconnect
architecture [9].
Figure 4.12 Intelligence processing unit bulk synchronous
parallel model.
Figure 4.13 Intelligence processing unit bulk synchronous
parallel execution...
Figure 4.14 Intelligence processing unit bulk synchronous
parallel inter‐chi...
Chapter 5
Figure 5.1 Deep convolutional neural network hardware
architecture.
Figure 5.2 Convolution computation.
Figure 5.3 Filter decomposition with zero padding.
Figure 5.4 Filter decomposition approach.
Figure 5.5 Data streaming architecture with the data flow.
Figure 5.6 DCNN accelerator COL buffer architecture.
Figure 5.7 Data streaming architecture with 1×1 convolution
mode.
Figure 5.8 Max pooling architecture.
Figure 5.9 Convolution engine architecture.
Figure 5.10 Accumulation (ACCU) buffer architecture.
Figure 5.11 Neural network model compression.
Figure 5.12 Eyeriss system architecture.
Figure 5.13 2D convolution to 1D multiplication mapping.
Figure 5.14 2D convolution to 1D multiplication – step #1.
Figure 5.15 2D convolution to 1D multiplication – step #2.
Figure 5.16 2D convolution to 1D multiplication – step #3.
Figure 5.17 2D convolution to 1D multiplication – step #4.
Figure 5.18 Output stationary.
Figure 5.19 Output stationary index looping.
Figure 5.20 Weight stationary.
Figure 5.21 Weight stationary index looping.
Figure 5.22 Input stationary.
Figure 5.23 Input stationary index looping.
Figure 5.24 Eyeriss Row Stationary (RS) dataflow.
Figure 5.25 Filter reuse.
Figure 5.26 Feature map reuse.
Figure 5.27 Partial sum reuse.
Figure 5.28 Eyeriss run‐length compression.
Figure 5.29 Eyeriss processing element architecture.
Figure 5.30 Eyeriss global input network.
Figure 5.31 Eyeriss processing element mapping (AlexNet
CONV1).
Figure 5.32 Eyeriss processing element mapping (AlexNet
CONV2).
Figure 5.33 Eyeriss processing element mapping (AlexNet
CONV3).
Figure 5.34 Eyeriss processing element mapping (AlexNet
CONV4/CONV5).
Figure 5.35 Eyeriss processing element operation (AlexNet
CONV1).
Figure 5.36 Eyeriss processing element operation (AlexNet
CONV2).
Figure 5.37 Eyeriss processing element (AlexNet CONV3).
Figure 5.38 Eyeriss processing element operation (AlexNet
CONV4/CONV5).
Figure 5.39 Eyeriss architecture comparison.
Figure 5.40 Eyeriss v2 system architecture.
Figure 5.41 Network‐on‐Chip configurations.
Figure 5.42 Mesh network configuration.
Figure 5.43 Eyeriss v2 hierarchical mesh network examples.
Figure 5.44 Eyeriss v2 input activation hierarchical mesh
network.
Figure 5.45 Weights hierarchical mesh network.
Figure 5.46 Eyeriss v2 partial sum hierarchical mesh network.
Figure 5.47 Eyeriss v1 neural network model performance. [6]
Figure 5.48 Eyeriss v2 neural network model performance. [6]
Figure 5.49 Compressed sparse column format.
Figure 5.50 Eyeriss v2 PE architecture.
Figure 5.51 Eyeriss v2 row stationary plus dataflow.
Figure 5.52 Eyeriss architecture AlexNet throughput speedup
[6].
Figure 5.53 Eyeriss architecture AlexNet energy efficiency [6].
Figure 5.54 Eyeriss architecture MobileNet throughput
speedup [6].
Figure 5.55 Eyeriss architecture MobileNet energy efficiency
[6].
Chapter 6
Figure 6.1 Neurocube architecture.
Figure 6.2 Neurocube organization.
Figure 6.3 Neurocube 2D mesh network.
Figure 6.4 Memory‐centric neural computing flow.
Figure 6.5 Programmable neurosequence generator
architecture.
Figure 6.6 Neurocube programmable neurosequence
generator.
Figure 6.7 Tetris system architecture.
Figure 6.8 Tetris neural network engine.
Figure 6.9 In‐memory accumulation.
Figure 6.10 Global buffer bypass.
Figure 6.11 NN partitioning scheme comparison.
Figure 6.12 Tetris performance and power comparison [7].
Figure 6.13 NeuroStream and NeuroCluster architecture.
Figure 6.14 NeuroStream coprocessor architecture.
Figure 6.15 NeuroStream 4D tiling.
Figure 6.16 NeuroStream roofline plot [8].
Chapter 7
Figure 7.1 DaDianNao system architecture.
Figure 7.2 DaDianNao neural functional unit architecture.
Figure 7.3 DaDianNao pipeline configuration.
Figure 7.4 DaDianNao multi‐node mapping.
Figure 7.5 DaDianNao timing performance (Training) [1].
Figure 7.6 DaDianNao timing performance (Inference) [1].
Figure 7.7 DaDianNao power reduction (Training) [1].
Figure 7.8 DaDianNao power reduction (Inference) [1].
Figure 7.9 DaDianNao basic operation.
Figure 7.10 Cnvlutin basic operation.
Figure 7.11 DaDianNao architecture.
Figure 7.12 Cnvlutin architecture.
Figure 7.13 DaDianNao processing order.
Figure 7.14 Cnvlutin processing order.
Figure 7.15 Cnvlutin zero free neuron array format.
Figure 7.16 Cnvlutin dispatch.
Figure 7.17 Cnvlutin timing comparison [4].
Figure 7.18 Cnvlutin power comparison [4].
Figure 7.19 Cnvlutin2 ineffectual activation skipping.
Figure 7.20 Cnvlutin2 ineffectual weight skipping.
Chapter 8
Figure 8.1 EIE leading nonzero detection network.
Figure 8.2 EIE processing element architecture.
Figure 8.3 Deep compression weight sharing and
quantization.
Figure 8.4 Matrix W, vector a and b are interleaved over four
processing ele...
Figure 8.5 Matrix W layout in compressed sparse column
format.
Figure 8.6 EIE timing performance comparison [1].
Figure 8.7 EIE energy efficient comparison [1].
Figure 8.8 Cambricon‐X architecture.
Figure 8.9 Cambricon‐X processing element architecture.
Figure 8.10 Cambricon‐X sparse compression.
Figure 8.11 Cambricon‐X buffer controller architecture.
Figure 8.12 Cambricon‐X index module architecture.
Figure 8.13 Cambricon‐X direct indexing architecture.
Figure 8.14 Cambricon‐X step indexing architecture.
Figure 8.15 Cambricon‐X timing performance comparison [4].
Figure 8.16 Cambricon‐X energy efficiency comparison [4].
Figure 8.17 SCNN convolution.
Figure 8.18 SCNN convolution nested loop.
Figure 8.19 PT‐IS‐CP‐dense dataflow.
Figure 8.20 SCNN architecture.
Figure 8.21 SCNN dataflow.
Figure 8.22 SCNN weight compression.
Figure 8.23 SCNN timing performance comparison [5].
Figure 8.24 SCNN energy efficiency comparison [5].
Figure 8.25 SeerNet architecture.
Figure 8.26 SeerNet Q‐ReLU and Q‐max‐pooling.
Figure 8.27 SeerNet quantization.
Figure 8.28 SeerNet sparsity‐mask encoding.
Chapter 9
Figure 9.1 2.5D interposer architecture.
Figure 9.2 3D stacked architecture.
Figure 9.3 3D‐IC PDN configuration (pyramid shape).
Figure 9.4 PDN – Conventional PDN Manthan geometry.
Figure 9.5 Novel PDN X topology.
Figure 9.6 3D network bridge.
Figure 9.7 Neural network layer multiple nodes connection.
Figure 9.8 3D network switch.
Figure 9.9 3D network bridge segmentation.
Figure 9.10 Multiple‐channel bidirectional high‐speed link.
Figure 9.11 Power switch configuration.
Figure 9.12 3D neural processing power gating approach.
Figure 9.13 3D neural processing clock gating approach.
IEEE Press
445 Hoes Lane
Piscataway, NJ 08854
Ingraham, Prentiss. The gambler pirate; or, Bessie, the lady of the
lagoon.... New York: Beadle & Adams, 1882. 26 p. illus. fo. (no. 205.)
Companion story to his The skeleton schooner.
Whittaker, Frederick. One Eye, the cannoneer; or, Marshal Ney’s last
legacy. A story of the exile of St. Helena. New York: Beadle &
Adams, 1882. 29 p. illus. 4. ed. fo. (no. 206.)
Warne, Philip S. Old Hard Head; or, Whirlwind and his milk-white
mare. A tale of the Kioway country. New York: Beadle & Adams,
1882. 29 p. illus. 6. ed. fo. (no. 207.)
Willett, Edward. Buck Farley, the bonanza prince; or, The romance
of Death Gulch. New York: Beadle & Adams, 1882. 24 p. illus. 4. ed.
fo. (no. 209.)
Ingraham, Prentiss. Buccaneer Bess, the lioness of the sea; or, The
red sea trail. A romance of the Gulf of Mexico and its shores.... New
York: Beadle & Adams, 1882. 29 p. illus. fo. (no. 210.)
Companion story to his The skeleton schooner and The gambler pirate.
Eyster, William R. The two cool sports; or, Gertie of the gulch. A
story of the hidden city. New York: Beadle & Adams, 1882. 24 p.
illus. 8. ed. fo. (no. 214.)
Hall, Samuel S. The serpent of El Paso; or, Frontier Frank, the scout
of the Rio Grande. By “Buckskin Sam”—Major Sam S. Hall.... New
York: Beadle & Adams, 1882. 22 p. illus. 4. ed. fo. (no. 217.)
Reid, Mayne. The wild huntress; or, The big squatter’s vengeance.
New York: Beadle & Adams, 1882. 28 p. illus. fo. (no. 218.)
Willett, Edward. Bill, the blizzard; or, Red Jack’s double crime. A
story of the mystery of Tenspot Gulch. New York: Beadle & Adams,
1883. 23 p. illus. fo. (no. 222.)
Manning, William H. Canyon Dave, the man of the mountain; or, The
toughs of Silver Spur. By Captain Mark Wilton [pseud.].... New York:
Beadle & Adams, 1883. 29 p. illus. 3. ed. fo. (no. 223.)
Ingraham, Prentiss. Black Beard, the buccaneer; or, The curse of the
coast. A romance of the Carolina waters a century ago. New York:
Beadle & Adams, 1883. 28 p. illus. 3. ed. fo. (no. 224.)
Hall, Samuel S. Rocky Mountain Al; or, Nugget Nell, the waif of the
range. By “Buckskin Sam”—Major Sam S. Hall.... New York: Beadle &
Adams, 1883. 23 p. illus. 4. ed. fo. (no. 225.)
Whittaker, Frederick. The mad hussars; or, The O’s and the Macs. A
story of four Irish soldiers of fortune. New York: Beadle & Adams,
1883. 28 p. illus. fo. (no. 226.)
Reid, Mayne. The hunters’ feast. New York: Beadle & Adams, 1883.
28 p. illus. fo. (no. 234.)
Ingraham, Prentiss. Red Lightning, the man of chance; or, Flush times
in Golden Gulch.... A romance of adventure and mystery in
borderland. New York: Beadle & Adams, 1883. 22 p. illus. fo. (no.
235.)
Companion story to his The kid glove miner.
Morris, Anthony P. Hank Hound, the Crescent City detective; or, The
owls of New Orleans. A strange life drama of the great city of the
south. New York: Beadle & Adams, 1883. 22 p. illus. fo. (no. 238.)
Hall, Samuel S. The terrible trio; or, The angel of the army. A
romance of the Lone Star state. By “Buckskin Sam”—Major Sam S.
Hall.... New York: Beadle & Adams, 1883. 30 p. illus. 3. ed. fo. (no.
239.)
Badger, Joseph E. Spitfire Saul, king of the rustlers; or, Queen Dixie’s
grand “round-up.” New York: Beadle & Adams, 1883. 29 p. illus. fo.
(no. 241.)
Whittaker, Frederick. The fog devil; or, The skipper of the Flash. A
story of the Gloucester trawlers. New York: Beadle & Adams, 1883.
28 p. illus. fo. (no. 242.)
Ingraham, Prentiss. Queen Helen, the amazon of the overland; or, The
ghouls of the gold mines. New York: Beadle & Adams, 1883. 23 p.
illus. 9. ed. fo. (no. 246.)
Hall, Samuel S. The rough riders; or, Sharp Eye, the Seminole
scourge. A tale of the chaparral. By “Buckskin Sam”—Major Sam S.
Hall.... New York: Beadle & Adams, 1883. 29 p. illus. 4. ed. fo. (no.
250.)
Warne, Philip S. Tiger Dick vs. Iron Despard; or, Every man has his
match. An account of the “leetle diffikilty” at Fool’s Luck. New York:
Beadle & Adams, 1883. 28 p. illus. fo. (no. 251.)
Aiken, Albert W. The Wall street blood; or, Tick Tick, the telegraph
girl. New York: Beadle & Adams, 1883. 24 p. illus. 4. ed. fo. (no.
252.)
Curtis, Newton Mallory. Giant Jake, the patrol of the mountain. A tale
of the Champlain hills. New York: Beadle & Adams, 1883. 24 p. illus.
3. ed. fo. (no. 254.)
Hall, Samuel S. Double Dan, the dastard; or, The pirates of the
Pecos. By Major Sam S. Hall—“Buckskin Sam”.... New York: Beadle &
Adams, 1883. 29 p. illus. 3. ed. fo. (no. 256.)
Ingraham, Prentiss. Cutlass and cross; or, The ghouls of the sea....
New York: Beadle & Adams, 1883. 24 p. illus. fo. (no. 259.)
Companion romance to his The pirate priest.
Yards, Jo. Black Sam, the prairie thunderbolt; or, The bandit-hunters.
A tale of the southwest frontier. By Col. Jo Yards—“Virginia Jo.” New
York: Beadle & Adams, 1883. 24 p. illus. fo. (no. 261.)
Hall, Samuel S. The crooked three; or, The black hearts of the
Guadalupe. By “Buckskin Sam”—Major Sam S. Hall.... New York:
Beadle & Adams, 1883. 29 p. illus. fo. (no. 264.)
Whittaker, Frederick. Old Double Sword; or, Pilots and pirates. A tale
of the omnipresent Yankee in far eastern seas. New York: Beadle &
Adams, 1883. 28 p. illus. fo. (no. 265.)
Reid, Mayne. The white squaw. New York: Beadle & Adams, 1883. 23
p. illus. 4. ed. fo. (no. 267.)
Eyster, William R. Magic Mike, the man of frills; or, Bad Ben’s bad
brigade. New York: Beadle & Adams, 1883. 29 p. illus. fo. (no. 268.)
Hall, Samuel S. The bayou bravo; or, The terrible trail. By Major Sam
S. Hall—“Buckskin Sam”.... New York: Beadle & Adams, 1883. 27 p.
illus. 3. ed. fo. (no. 269.)
Hall, Samuel S. Mountain Mose, the gorge outlaw; or, Light Horse
Leon’s five fights for life. By Major Sam S. Hall—“Buckskin Sam”....
New York: Beadle & Adams, 1884. 24 p. illus. fo. (no. 273.)
Willett, Edward. Flush Fred, the Mississippi sport; or, Tough times in
Tennessee. New York: Beadle & Adams, 1884. 23 p. illus. 4. ed. fo.
(no. 274.)
Warne, Philip S. Black-Hoss Ben; or, Tiger Dick’s lone hand. A tale of
wild ranch life. New York: Beadle & Adams, 1884. 28 p. illus. fo. (no.
280.)
Willett, Edward. Flush Fred’s full hand; or, Life and strife in
Louisiana. New York: Beadle & Adams, 1884. 24 p. illus. fo. (no.
289.)
Manning, William H. Horseshoe Hank. the man of big luck; or, The
gold brick of Idaho. By Captain Mark Wilton [pseud.].... New York:
Beadle & Adams, 1884. 31 p. illus. fo. (no. 291.)
Badger, Joseph E. Moke Horner, the boss roustabout; or, The fresh-
water sharks of the overflow. A romance of Mississippi river life. New
York: Beadle & Adams, 1884. 29 p. illus. 2. ed. fo. (no. 292.)
Hall, Samuel S. Stampede Steve; or, The doom of the double face.
By “Buckskin Sam”—Major Sam S. Hall.... New York: Beadle &
Adams, 1884. 28 p. illus. 2. ed. fo. (no. 293.)
Harbaugh, Thomas Chalmers. Broadcloth Burt, the Denver dandy; or,
The thirty pards of Deadwood. By Captain Howard Holmes
[pseud.].... New York: Beadle & Adams, 1884. 29 p. illus. fo. (no.
294.)
Willett, Edward. Logger Lem; or, Life and peril in the pine woods.
New York: Beadle & Adams, 1884. 23 p. illus. fo. (no. 298.)
Warne, Philip S. Three of a kind. Tiger Dick, Iron Despard, and the
Sportive Sport. New York: Beadle & Adams, 1884. 28 p. illus. fo. (no.
299.)
Hall, Samuel S. Bowlder Bill; or, The man from Taos. By “Buckskin
Sam”—Major Sam S. Hill.... New York: Beadle & Adams, 1884. 27 p.
illus. 2. ed. fo. (no. 301.)
Whittaker, Frederick. Top Notch Tom, the cowboy outlaw; or, The
Satanstown election.... New York: Beadle & Adams, 1884. 28 p. illus.
5. ed. fo. (no. 303.)
Sequel to his Old Cross-Eye, the maverick-hunter.
Willett, Edward. Hemlock Hank, tough and true; or, The shadow of
Mount Katahdin. New York: Beadle & Adams, 1884. 29 p. illus. fo.
(no. 308.)
Hall, Samuel S. Raybold, the rattling ranger; or, Old Rocky’s tough
campaign. By “Buckskin Sam”—Major Sam S. Hall.... New York:
Beadle & Adams, 1884. 28 p. illus. 3. ed. fo. (no. 309.)
Manning, William H. Heavy Hand, the relentless; or, The marked men
of Paradise Gulch. By Captain Mark Wilton [pseud.].... New York:
Beadle & Adams, 1884. 30 p. illus. fo. (no. 311.)
Ingraham, Joseph Holt. Lafitte; or, The pirate of the gulf. New York:
Beadle & Adams, 1884. 29 p. illus. 10. ed. fo. (no. 314.)
Willett, Edward. Flush Fred’s double; or, The squatters’ league of six.
New York: Beadle & Adams, 1884. 28 p. illus. 5. ed. fo. (no. 315.)
Aiken, Albert W. The genteel spotter; or, The night hawks of New
York: New York: Beadle & Adams, 1884. 22 p. illus. 5. ed. fo. (no.
320.)
Hall, Samuel S. King Kent; or, The bandits of the bason [sic], by
Buckskin Sam [pseud.]. New York: Beadle & Adams, 1885. 23 p.
illus. 2. ed. fo. (no. 328.)
Morris, Charles. Cop Colt, the Quaker City detective; or, A hound on
the wolves’ track. New York: Beadle & Adams, 1885. 29 p. illus. 4.
ed. fo. (no. 330.)
Badger, Joseph E. Chispa Charley, the gold nugget sport; or, The
Rocky mountain masks.... New York: Beadle & Adams, 1885. 28 p.
illus. 2. ed. fo. (no. 331.)
Companion story to his Old Forked-lightning.
Eyster, William R. Derringer Deck, the man with the drop; or, Colonel
Coldsteel and his lucky seven. New York: Beadle & Adams, 1885. 30
p. illus. 3. ed. fo. (no. 333.
Harbaugh, Thomas Chalmers. Flash Dan, the nabob; or, The blades of
Bowie Bar. A story of the gold lands. By Captain H. Holmes
[pseud.].... New York: Beadle & Adams, 1885. 29 p. illus. 3. ed. fo.
(no. 335.)
Ingraham, Prentiss. The magic ship. New York: Beadle & Adams,
1885. 21 p. illus. 4. ed. fo. (no. 336.)
Willett, Edward. Old Gabe, the mountain tramp; or, The tragedy of
the deserted camp. New York: Beadle & Adams, 1885. 29 p. illus. 2.
ed. fo. (no. 337.)
Warne, Philip S. Jack Sand, the boss of the town; or, The fool of
fiddler’s folly. New York: Beadle & Adams, 1885. 27 p. illus. fo. (no.
338.)
Morris, Anthony P. The head hunter; or, Mark Magic in the mines.
New York: Beadle & Adams, 1885. 30 p. illus. fo. (no. 343.)
Harbaugh, Thomas Chalmers. Denver Duke, the man with “sand”; or,
Centipede Sam’s lone hand. By Captain Howard Holmes [pseud.]....
New York: Beadle & Adams, 1885. 29 p. illus. 4. ed. fo. (no. 34.)
Harbaugh, Thomas Chalmers. The desperate dozen; or, The fair fiend
of the Coeur d’Alene. By Captain H. Holmes [pseud.].... New York:
Beadle & Adams, 1885. 29 p. illus. 5. ed. fo. (no. 352.)
Aiken, Albert W. Red Richard; or, The brand of the crimson cross. A
romance of California mining life. New York: Beadle & Adams, 1885.
22 p. illus. fo. (no. 354.)
Badger, Joseph E. The mad athlete; or, The worst pill in the box. New
York: Beadle & Adams, 1885. 28 p. illus. 4. ed. fo. (no. 355.)
Warne, Philip S. Yellow Jack, the mestizo; or, Tiger Dick to the
rescue.... New York: Beadle & Adams, 1885. 30 p. illus. 6. ed. fo.
(no. 359.)
Sequel to his Three of a kind and Black-Hoss Ben.
Judson, Edward Zane Carroll. Tombstone Dick, the train pilot; or, The
traitor’s trail. A story of the Arizonian wilds. By Ned Buntline
[pseud.].... New York: Beadle & Adams, 1885. 31 p. illus. 6. ed. fo.
(no. 361.)
Harbaugh, Thomas Chalmers. Keen Kennard, the Shasta shadow; or,
The branded face. A wild romance of the Sierras. By Capt. Howard
Holmes [pseud.].... New York: Beadle & Adams, 1885. 30 p. illus. 8.
ed. fo. (no. 365.)
Badger, Joseph E. A royal flush; or, Dan Brown’s big game of freeze-
out. New York: Beadle & Adams, 1885. 31 p. illus. 4. ed. fo. (no.
367.)
Willett, Edward. The canyon king; or, A price on his head. A tale of
the Wahsatch range. New York: Beadle & Adams, 1885. 30 p. illus.
4. ed. fo. (no. 368.)
Ingraham, Prentiss. The coast corsair; or, Madcap Madge, the siren of
the sea.... New York: Beadle & Adams, 1885. 28 p. illus. fo. (no.
369.)
Companion tale to his The sea fugitive.
Badger, Joseph E. Captain Crisp, the man with a record. New York:
Beadle & Adams, 1885. 31 p. illus. 3. ed. fo. (no. 372.)
Badger, Joseph E. Dark Durg, the Ishmael of the hills; or, The gold
phantom. New York: Beadle & Adams, 1886. 31 p. illus. 2. ed. fo.
(no. 387.)
Cowdrick, Jesse C. The giant cupid; or, Cibuta John’s great jubilee.
New York: Beadle & Adams, 1886. 30 p. illus. fo. (no. 390.)
Harbaugh, Thomas Chalmers. The lost bonanza; or, The boot of Silent
Hound. A tale of three millions. By Capt. Howard Holmes [pseud.]....
New York: Beadle & Adams, 1886. 30 p. illus. fo. (no. 392.)
Badger, Joseph E. Deadly Aim, the duke of Derringers; or, A fight for
five millions. New York: Beadle & Adams, 1886. 31 p. illus. fo. (no.
395.)
Cody, William Frederick. The wizard brothers; or, White Beaver’s red
trail. By Buffalo Bill (Hon. Wm. F. Cody). New York: Beadle & Adams,
1886. 29 p. illus. fo. (no. 397.)
Ingraham, Prentiss. The new Monte Cristo; or, The wandering Jew of
the sea. New York: Beadle & Adams, 1886. 29 p. illus. fo. (no. 399.)
Eyster, William R. Snapshot Sam, the pistol sharp; or, The racket at
Angels’ Flat. New York: Beadle & Adams, 1886. 29 p. illus. 5. ed. fo.
(no. 402.)
Badger, Joseph E. Rob Roy Ranch; or, The imps of the Pan-handle.
New York: Beadle & Adams, 1886. 30 p. illus. fo. (no. 409.)
Dumont, Daniel Boone. The white crook; or, Old Hark’s fortress. A tale
of the Arizona raid. New York: Beadle & Adams, 1886. 30 p. illus. 5.
ed. fo. (no. 411.)
---- The old river sport; or, A man of honor. New York: Beadle &
Adams, 1886. 30 p. illus. 3. ed. fo. (no. 420.)
Cowdrick, Jesse C. Blue Grass Burt, the gold star detective; or, To
duty bound—to vengeance sworn. A romance of the southland. New
York: Beadle & Adams, 1886. 29 p. illus. 4. ed. fo. (no. 422.)
Eyster, William R. Hair Trigger Tom of Red Bend; or, All wool, and a
yard wide. New York: Beadle & Adams, 1887. 31 p. illus. 3. ed. fo.
(no. 429.)
Ingraham, Prentiss. The fatal frigate: or, Rivals in love and war. A
romance of ocean mysteries a century ago. New York: Beadle &
Adams, 1887. 29 p. illus. fo. (no. 430.)
Warne, Philip S. Californy Kit, the always on hand; or, The mountain
rivals. New York: Beadle & Adams, 1887. 28 p. illus. fo. (no. 431.)
Jenks, George Charles. The giant horseman; or, Tracking the red
cross gang. New York: Beadle & Adams, 1887. 29 p. illus. fo. (no.
432.)
Badger, Joseph E. Laughing Leo; or, Spread Eagle Sam’s dandy pard.
New York: Beadle & Adams, 1887. 30 p. illus. fo. (no. 433.)
Cowdrick, Jesse C. Kentucky Jean, the sport from Yellow Pine; or,
Blue-eyed Belle of Bended Bow. New York: Beadle & Adams, 1887.
31 p. illus. fo. (no. 436.)
Manning, William H. Deep Duke, the silent sleuth; or, The man of two
lives. The story of the ways and wiles of a wicked set. New York:
Beadle & Adams, 1887. 30 p. illus. fo. (no. 437.)
---- —— New York: Beadle & Adams, 1887. 27 p. illus. 2. ed. fo. (no.
440.)
Harbaugh, Thomas Chalmers. The California sleuth; or, The trail of the
gold grandee. A story of Shasta. By Capt. Howard Holmes
[pseud.].... New York: Beadle & Adams, 1887. 30 p. illus. fo. (no.
441.)
Manning, William H. Wild West Walt, the mountain veteran; or, The
gunmakers of World’s End. New York: Beadle & Adams, 1887. 31 p.
illus. fo. (no. 442.)
Ingraham, Prentiss. Ocean Ogre, the outcast corsair; or, The good
ship of ill-omen. A romance of piracy.... New York: Beadle & Adams,
1887. 28 p. illus. fo. (no. 446.)
Companion story to his The fatal frigate and The one-armed buccaneer.
Manning, William H. Bluff Burke, king of the Rockies; or, The black
stake rivals. New York: Beadle & Adams, 1887. 30 p. illus. fo. (no.
449.)
Harbaugh, Thomas Chalmers. Captain Coldgrip’s long trail; or, The
rivals of Silver Deck. By Capt. Howard Holmes [pseud.]. New York:
Beadle & Adams, 1887. 29 p. illus. 4. ed. fo. (no. 453.)
Lewis, Leon. Captain Ready, the red ransomer; or, Nick Peddie’s wild
west inheritance. The romance of Dead Man’s Ranch. New York:
Beadle & Adams, 1888. 29 p. illus. fo. (no. 484.)
Harbaugh, Thomas Chalmers. Sunshine Sam, chip of the old block; or,
The silent trail of the silent six. A romance of no-gold land. By Capt.
Howard Holmes [pseud.].... New York: Beadle & Adams, 1888. 31 p.
illus. fo. (no. 487.)
Aiken, Albert W. The Lone Hand in Texas; or, The red-gloved raiders
of the Rio Grande. A tale of wild life on the southwestern border.
New York: Beadle & Adams, 1888. 29 p. illus. fo. (no. 490.)
Cowdrick, Jesse C. Twilight Charlie, the road sport; or, Sulphur Sam’s
double. A romance of the wild lands of the Yampah. New York:
Beadle & Adams, 1888. 28 p. illus. fo. (no. 499.)
Warne, Philip S. Bareback Buck, the centaur of the plains; or, The
trail of six. A romance of spur, saddle and trains. New York: Beadle &
Adams, 1888. 29 p. illus. fo. (no. 502.)
Eyster, William R. The dude from Denver; or, The game at Ground
Hog. New York: Beadle & Adams, 1888. 28 p. illus. fo. (no. 503.)
Badger, Joseph E. Solemn Saul, the sad man from San Saba; or, The
big shell out. A romance of the end of the road. New York: Beadle &
Adams, 1888. 30 p. illus. fo. (no. 504.)
Dumont, Daniel Boone. Topnotch Tim, the mad parson; or, The bad
men of the basin. The romance of a wilderness layout. New York:
Beadle & Adams, 1888. 28 p. illus. fo. (no. 508.)
Hall, Samuel S. Paint Pete, the prairie patrol; or, The rival rancheros.
New York: Beadle & Adams, 1888. 30 p. illus. fo. (no. 511.)
Harbaugh, Thomas Chalmers. Captain Velvet’s big stake; or, The gold
goths of No Man’s Ground. A romance of Shasta. By Captain Howard
Holmes [pseud.].... New York: Beadle & Adams, 1888. 29 p. illus. fo.
(no. 512.)
Badger, Joseph E. Gabe Gunn, the grizzly from Ginseng; or, Solemn
Saul’s seraph. New York: Beadle & Adams, 1888. 30 p. illus. fo. (no.
514.)
Aiken, Albert W. The Lone Hand on the Caddo; or, The bad man of
the big bayou. New York: Beadle & Adams, 1888. 28 p. illus. fo. (no.
520.)
Badger, Joseph E. Dandy Andy, the diamond detective; or, The twins
of Tip-Top. New York: Beadle & Adams, 1888. 29 p. illus. fo. (no.
527.)
Eyster, William R. Oregon, the sport with a scar; or, The best men of
Brace Box. New York: Beadle & Adams, 1889. 30 p. illus. fo. (no.
533.)
Patten, William G. Hustler Harry, the cowboy sport; or, Daring Dan
Shark’s general delivery. New York: Beadle & Adams, 1889. 30 p.
illus. fo. (no. 545.)
Eyster, William R. Belshazzar Brick, the bailiff of Blue Blazes; or, Four
Horse Frank’s frolic at Bad Luck Bar. New York: Beadle & Adams,
1889. 29 p. illus. fo. (no. 549.)
Harbaugh, Thomas Chalmers. Silk Hand, the Mohave ferret, or, The
marked man of Arizona. By Captain Howard Holmes [pseud.].... New
York: Beadle & Adams, 1889. 29 p. illus. fo. (no. 550.)
Manning, William H. Garry Kean, the man with backbone; or, The
gladiators of Jack’s Delight. A story of the Idaho mines. New York:
Beadle & Adams, 1889. 31 p. illus. fo. (no. 551.)
Sims, A. K. Prince Primrose, the flower of the flock; or, The grand
coup at Paradise Gulch. A romance of silverland. New York: Beadle &
Adams, 1889. 31 p. illus. fo. (no. 552.)
Badger, Joseph E. Grip-sack Sid, the sample sport; or, The rivals of
Rack-about Range. New York: Beadle & Adams, 1889. 30 p. illus. fo.
(no. 555.)
Aiken, Albert W. Lone Hand, the shadow; or, The master of the
Triangle Ranch. A romance of the Wichita country. New York: Beadle
& Adams, 1889. 29 p. illus. fo. (no. 562.)
Warne, Philip S. Captain Midnight, the man of craft: or, The road-
knight’s plot. A romance of the Cony Flat rivals. New York: Beadle &
Adams, 1889. 29 p. illus. fo. (no. 567.)
Eyster, William R. Seven Shot Steve; or, Dan Garland’s great clean-
up. New York: Beadle & Adams, 1889. 28 p. illus. fo. (no. 578.)
Aiken, Albert W. The Silver Sharp detective; or, The big rustle at XL
ranch. A story of Wyoming. New York: Beadle & Adams, 1890. 29 p.
illus. fo. (no. 586.)
Harbaugh, Thomas Chalmers. Captain Sid, the Shasta ferret; or, The
rivals of Sunset. The romance of the Rattlesnake mine. By Captain
Howard Holmes [pseud.].... New York: Beadle & Adams, 1890. 31 p.
illus. fo. (no. 592.)
Aiken, Albert W. Fire Face, the silver king’s foe; or, The mysterious
highwayman. A tale of Colorado. New York: Beadle & Adams, 1890.
29 p. illus. fo. (no. 594.)
Eyster, William R. Desert Alf, the man with the cougar; or, The
strange pilgrimage of Gentle Jack. The romance of Estacado desert
kingdom. New York: Beadle & Adams, 1890. 28 p. illus. fo. (no. 603.)
Dunbar, Noel. The detective in rags. New York: Beadle & Adams,
1890. 32 p. illus. fo. (no. 604.)
Aiken, Albert W. Old Benzine, the hard case detective; or, Joe Bowers’
racket at Ricaree City. New York: Beadle & Adams, 1890. 29 p. illus.
fo. (no. 607.)
Manning, William H. Alkali Abe, the game-chicken from Texas; or, The
smash-up in “No-world kingdom.” A romance of the unexplored
range. New York: Beadle & Adams, 1890. 29 p. illus. fo. (no. 611.)
Badger, Joseph E. The gripsack sharp’s even-up; or, The boss racket
at Solid City. New York: Beadle & Adams, 1890. 30 p. illus. 2. ed. fo.
(no. 617.)
Coomes, Oll. Kit Bandy and Co., the border detectives. New York:
Beadle & Adams, 1890. 29 p. illus. 2. ed. fo. (no. 619.)
Cowdrick, Jesse C. Ducats Dion, the nabob sport detective; or, The
sealed secret of the copper coffin. New York: Beadle & Adams, 1890.
28 p. illus. 2. ed. fo. (no. 626.)
Lewis, Leon. Daredeath Dick, the king of the cowboys. New York:
Beadle & Adams, 1890. 28 p. illus. fo. (no. 629.)
Patten, William G. Colonel Cool, the Santa Fe sharp; or, The lucky
pards of Goodenough. New York: Beadle & Adams, 1890. 29 p. illus.
fo. (no. 631.)
Judson, Edward Zane Carroll. The sea spy, by Ned Buntline [pseud.].
New York: Beadle & Adams, 1890. 30 p. illus. fo. (no. 633.)
Aiken, Albert W. Joe Phenix in Crazy Camp; or, The great detective’s
long chase. A romance of the Little Colorado. New York: Beadle &
Adams, 1891. 28 p. illus. fo. (no. 637.)
Patten, William G. Aztec Jack, the desert nomad; or, The vultures’
swoop. A story of astonishing adventures in the buried city of
northern Arizona. New York: Beadle & Adams, 1891. 28 p. illus. fo.
(no. 641.)
Harbaugh, Thomas Chalmers. Red pard and yellow; or, The nabobs of
Centipede. A romance of Arizona mines and Arizona vengeance. By
Captain Howard Holmes [pseud.].... New York: Beadle & Adams,
1891. 31 p. illus. fo. (no. 642.)
Manning, William H. Dark John, the grim guard; or, Hailstorm’s north
plains braves. A romance of Montana. New York: Beadle & Adams,
1891. 30 p. illus. fo. (no. 646.)
Aiken, Albert W. The Fresh of Frisco at Santa Fé. New York: Beadle &
Adams, 1891. 31 p. illus. fo. (no. 647.)
Badger, Joseph E. Silver-tip Steve, the sky scraper from Siskiyou; or,
The secrets of the skull. New York: Beadle & Adams, 1891. 30 p.
illus. fo. (no. 651.)
Aiken, Albert W. Jackson Blake, the bouncer detective; or, The Fresh
of ’Frisco’s rustle at Painted City. The romance of a bu’sted camp.
New York: Beadle & Adams, 1891. 29 p. illus. fo. (no. 652.)
Ingraham, Prentiss. The lasso king’s league; or, The tigers of Texas. A
romance of heroes in Buckskin.... New York: Beadle & Adams, 1891.
28 p. illus. fo. (no. 653.)
Companion story to his Buck Taylor, the saddle king.
Patten, William G. Old Plug Ugly, the rough and ready; or, The last
stroke of the land sharks. New York: Beadle & Adams, 1891. 29 p.
illus. fo. (no. 656.)
Eyster, William R. Gilt-edge Johnny; or, Roldan and his rovers. The
story of the “Ranch accursed.” New York: Beadle & Adams, 1891. 30
p. illus. fo. (no. 659.)
Aiken, Albert W. The Fresh in Montana; or, Jackson Blake’s full hand
at Hardtack. New York: Beadle & Adams, 1891. 29 p. illus. fo. (no.
660.)
Ingraham, Prentiss. The Jew detective. New York: Beadle & Adams,
1891. 27 p. illus. fo. (no. 662.)
Badger, Joseph E. Solemn Saul’s luck streak; or, The boomer from
Blissful Buttes. New York: Beadle & Adams, 1891. 31 p. illus. fo. (no.
668.)
Patten, William G. Old True Blue, the trusty; or, The marauder of the
Mimbres. New York: Beadle & Adams, 1891. 30 p. illus. fo. (no. 669.)
Sims, A. K. Stuttering Sam, the whitest sport of Santa Fe; or, How the
hummer from Hummingbird feathered his nest. New York: Beadle &
Adams, 1891. 32 p. illus. fo. (no. 673.)
Badger, Joseph E. Steel Surry, the sport from Sunrise; or, The blind
deal at Breakneck. New York: Beadle & Adams, 1891. 31 p. illus. fo.
(no. 675.)
Patten, William G. Hurricane Hal, the cowboy hotspur; or, Old True
Blue’s pilgrimage in Satan’s section. A romance of the Red Spur
ranch.... New York: Beadle & Adams, 1891. 30 p. illus. fo. (no. 676.)
Companion story to his Old True Blue, the trusty.
Eyster, William R. Mr. Jackson, the gent from Jaybird; or, The
mystery of the lower drift. New York: Beadle & Adams, 1891. 31 p.
illus. fo. (no. 677.)
Eyster, William R. Double Cinch Dan, the sport with a charm; or, The
saints of Sunrise. New York: Beadle & Adams, 1891. 30 p. illus. fo.
(no. 687.)
Manning, William H. Dead Shot Paul, the deep-range explorer; or, The
mountain spy’s vendetta. New York: Beadle & Adams, 1892. 30 p.
illus. fo. (no. 692.)
Badger, Joseph E. Bantam Bob, the beauty from Butte. New York:
Beadle & Adams, 1892. 30 p. illus. fo. (no. 705.)
Eyster, William R. The rival rovers; or, Uncle Bedrock’s big break. A
romance of Paddy’s Flat. New York: Beadle & Adams, 1892. 30 p.
illus. fo. (no. 707.)
Manning, William H. Gabe Gall, the gambolier from Great Hump; or,
Corralling half the town. A romance of Shadow Shaft. New York:
Beadle & Adams, 1892. 31 p. illus. fo. (no. 714.)
Eyster, William R. Uncle Bedrock’s big bounce; or, The bad men of
Mineral Bar. A romance of Sunken river. New York: Beadle & Adams,
1892. 30 p. illus. fo. (no. 718.)
Badger, Joseph E. The secret six; or, Old Halcyon, the stranger within
the gates. New York: Beadle & Adams, 1892. 30 p. illus. fo. (no.
720.)