Low Frequency Traders in A High Frequency World
Low Frequency Traders in A High Frequency World
A Survival Guide
Electronic
Electronic copycopy availableat:
available at: https://ssrn.com/abstract=2150876
http://ssrn.com/abstract=2150876
Key Points
• Multiple empirical studies have shown that Order Flow
Imbalance has explanatory power over the trading range.
• The PIN Theory (Easley et al. [1996]) reveals the
Microstructure mechanism by which
– Market Makers adjust their trading range to avoid being
adversely selected by Informed Traders.
– Informed Traders reveal their future trading intentions
when they alter the Order Flow.
– Consequently, Market Makers’ trading range is a function
of the Order Flow imbalance.
• VPIN is a High Frequency estimate of PIN, which can be
used to detect the presence of Informed Traders.
2
Electronic
Electronic copycopy availableat:
available at: https://ssrn.com/abstract=2150876
http://ssrn.com/abstract=2150876
SECTION I
The great divide
Electronic
Electronic copycopy availableat:
available at: https://ssrn.com/abstract=2150876
http://ssrn.com/abstract=2150876
Is speed the real issue?
6
Electronic copy available at: https://ssrn.com/abstract=2150876
What is the new paradigm? (2/3)
• Machines operate on an internal clock that is not
chrono based, but event based: The cycle.
• A machine will complete a cycle at various chrono
rates, depending on the amount of information
involved in a particular instruction.
• As it happens, HFT relies on machines, thus
measuring time in terms of events.
• Thinking in volume-time is challenging for us
humans. But for a ‘silicon trader’, it is the natural way
to process information and engage in sequential,
strategic trading.
7
Electronic copy available at: https://ssrn.com/abstract=2150876
What is the new paradigm? (3/3)
0.2
Sampling by Volume
time allows for a
0.15
partial recovery of
Normality, IID
0.1
0.05
0
-5 -4 -3 -2 -1 0 1 2 3 4 5
Time clock Volume clock Normal Dist (same bins as Time clock)
9
Electronic copy available at: https://ssrn.com/abstract=2150876
SECTION II
High Frequency and Adverse Selection
1 𝛼𝜇
𝑖𝑓 𝛿 = ⇒Σ= 𝑆 − 𝑆𝑖
2 𝛼𝜇 + 2𝜀 𝑖
PIN
2
14
Electronic copy available at: https://ssrn.com/abstract=2150876
Estimating PIN in High Frequency
• Suppose that we divide the market activity in n volume buckets of
equal size V. We can index these buckets as 𝜏 = 1, … , 𝑛.
• Let 𝑉𝜏𝐵 be the proportion of volume in a volume bucket 𝜏 associated
with buying pressure, and 𝑉𝜏𝑆 associated with selling pressure.
• We know from Easley, Engle, O’Hara and Wu (2008) that the
expected arrival rate of informed trades is E 𝑉𝜏𝑆 − 𝑉𝜏𝐵 =
𝛼𝜇 2𝛿 − 1 , and E 𝑉𝜏𝑆 − 𝑉𝜏𝐵 ≈ 𝛼𝜇. The expected arrival rate of
total trade is
1 n
n 1
VB VS V 1 1 2
volumefrom up event volumefrom down event volumefrom no event
15
Electronic copy available at: https://ssrn.com/abstract=2150876
Bulk Volume Classification
𝑉
• For each volume bucket 𝜏, we can form J volume bars of size .
𝐽
• For each bar j, T% of the volume is classified as buy and (1-T)%
as sell (denoted “bulk classification”). Caution: Not all the
volume of a single trade or bar is classified as buy or sell (some
researchers are confused by this). Then:
𝐽
𝑉 𝑃𝜏,𝑗 − 𝑃𝜏,𝑗−1
𝑉𝜏𝐵 = 𝑇 , 𝑑𝑓
𝐽 𝜎∆𝑃
𝑗=1
𝐽
𝑆
1 𝑃𝜏,𝑗 − 𝑃𝜏,𝑗−1
𝑉𝜏 = 𝑉 1 − 𝑇 , 𝑑𝑓 = 𝑉 − 𝑉𝜏𝐵
𝐽 𝜎∆𝑃
𝑗=1
where 𝑃𝜏,𝑗 is the last price in bar j within bucket 𝜏, T is the CDF of
the t-distribution with df degrees of freedom, and 𝜎∆𝑃 is the
estimate of the standard derivation of price changes between bars.
16
Electronic copy available at: https://ssrn.com/abstract=2150876
Bulk Volume Classification vs. Tick Rule (1/4)
• The Tick Rule (TR) and the Bulk Volume Classification
(BVC) algorithms have different goals:
– TR attempts to classify trades as buy-initiated or sell-initiated.
– BVC determines the proportion of volume associated with
buying or selling pressure.
• TR was designed for a time when most informed traders
were aggressors.
• With the advent of high frequency, informed traders are
increasingly relying on limit orders.
• A critical advantage of BVC is that it incorporates:
– Buying (selling) pressure from orders resting in the bid (ask).
– Buying (selling) pressure from cancellations in the ask (bid).
17
Electronic copy available at: https://ssrn.com/abstract=2150876
Bulk Volume Classification vs. Tick Rule (2/4)
20
Electronic copy available at: https://ssrn.com/abstract=2150876
Does the PIN Theory work in practice?
21
Electronic copy available at: https://ssrn.com/abstract=2150876
E-mini S&P500 futures on 05/06/10
1 60000 By 11:56am, the realized
0.9
value of the VPIN metric
59000 was in the 10% tail of the
0.8
distribution (it exceeded a
0.7
58000
90% CDF(VPIN) critical
0.6
value). By 1:08pm, the
57000
realized value of VPIN was
Market Value
Probability
0.5
in the 5% tail of the
56000
0.4 distribution (over a 95%
0.3
55000
CDF(VPIN)). At 2:32pm the
crash begins according to
0.2
54000
the CFTC-SEC Report time
0.1
line. Link to video.
0 53000
5/6/10 2:31
5/6/10 5:28
5/6/10 8:27
5/6/10 9:16
5/6/10 9:40
5/6/10 9:55
5/6/10 13:56
5/6/10 15:19
5/6/10 10:18
5/6/10 10:35
5/6/10 10:52
5/6/10 11:07
5/6/10 11:18
5/6/10 11:36
5/6/10 11:51
5/6/10 12:12
5/6/10 12:40
5/6/10 13:12
5/6/10 13:29
5/6/10 14:09
5/6/10 14:17
5/6/10 14:24
5/6/10 14:34
5/6/10 14:39
5/6/10 14:43
5/6/10 14:45
5/6/10 14:48
5/6/10 14:52
5/6/10 14:56
5/6/10 15:03
5/6/10 15:09
5/6/10 15:29
5/6/10 15:41
5/6/10 15:49
5/6/10 15:57
5/6/10 16:02
5/6/10 19:37
Note: The May 6th 2010
‘Flash Crash’ is just one of
VPIN CDF(VPIN) Market value
hundreds of liquidity
events explained by VPIN!
22
Electronic copy available at: https://ssrn.com/abstract=2150876
Price
4
4.2
4.4
4.6
4.8
5
5.2
5.4
5.6
5.8
7/30/12 9:31
7/30/12 16:03
7/30/12 16:25
7/31/12 9:50
7/31/12 15:15
8/1/12 9:30
8/1/12 9:32
8/1/12 9:35
8/1/12 9:36
8/1/12 9:40
8/1/12 9:42
8/1/12 9:44
8/1/12 9:45
8/1/12 9:47
8/1/12 9:48
8/1/12 9:49
8/1/12 9:50
ARC US Price
8/1/12 9:53
8/1/12 9:54
8/1/12 9:55
8/1/12 9:56
8/1/12 9:57
8/1/12 9:58
CDF(VPIN)
8/1/12 10:02
8/1/12 10:15
8/1/12 10:37
8/1/12 10:53
8/1/12 11:57
8/1/12 14:22
8/1/12 15:01
8/1/12 15:14
8/1/12 15:45
8/1/12 15:59
8/1/12 16:58
8/1/12 17:13
0
1
0.1
0.2
0.3
0.5
0.6
0.7
0.8
0.9
0.4
CDF(VPIN)
Price
10
10.5
11
11.5
12
12.5
13
7/30/12 9:33
7/30/12 10:15
7/30/12 11:10
7/30/12 12:18
7/30/12 13:26
7/30/12 14:20
7/30/12 15:26
7/30/12 15:59
7/31/12 9:52
7/31/12 10:04
7/31/12 10:13
7/31/12 10:21
7/31/12 10:44
7/31/12 11:06
7/31/12 15:50
7/31/12 17:12
8/1/12 9:37
CDF(VPIN)
8/1/12 9:46
8/1/12 9:53
8/1/12 10:00
8/1/12 10:11
8/1/12 10:38
8/1/12 11:26
8/1/12 12:36
8/1/12 13:45
8/1/12 14:36
8/1/12 14:54
jumped, but the relevant piece is that the price jump occurred as a result of persistent
order imbalance. It was the result of overwhelming and uninterrupted buying pressure
8/1/12 15:10
both cases, CDF(VPIN) jumps to high levels within a few minutes of the open. Prices also
8/1/12 15:48
8/1/12 18:42
Trades for ARC US (American Reprographics) were cancelled, not for GT US (Goodyear). In
23
0
1
(which lasted for 44 minutes), rather than a price adjustment to new information. Knight’s
0.1
0.2
0.3
0.5
0.6
0.7
0.8
0.9
0.4
CDF(VPIN)
SECTION III
Forecasting (and understanding) Volatility
25
Electronic copy available at: https://ssrn.com/abstract=2150876
Forecasting Toxicity-induced volatility (2/4)
0.45
We have computed
two distributions of
0.4 probability: One for
MIRs following an
0.35
event e (in blue), and
0.3
another one for MIRs
at random starts (in
red).
Frequency
0.25
0.2
Following an event e,
0.15 most MIR (blue) fall
within one of the two
0.1
tails of the
0.05
unconstrained
distribution (red). High
0 volatility occurred after
-0.1 -0.05 0 0.05 0.1 0.15
MIR VPIN crossed the
designated threshold
26
Electronic copy available at: https://ssrn.com/abstract=2150876
Forecasting Toxicity-induced volatility (3/4)
0.04 This qq-plot
shows that both
distributions are
0.02
clearly different:
VPIN events are
0 not random and
-0.06 -0.05 -0.04 -0.03 -0.02 -0.01 0 0.01 0.02
indeed have
consequences in
-0.02
terms of non-
standard MIR).
-0.04
This is consistent
with most (blue)
-0.06 𝑀𝐼𝑅 𝑒 falling at
the tails of
unconstrained
-0.08
MIR (red).
27
Electronic copy available at: https://ssrn.com/abstract=2150876
Forecasting Toxicity-induced volatility (4/4)
BDP D Events eMean eStd uMean uStd KS_Stat KS_CDF
25 0.2 239 0.02819 0.01628 0.01860 0.011903 0.19171 1.00000
25 0.5 144 0.03149 0.01597 0.01860 0.011903 0.24984 1.00000
25 1 81 0.03554 0.01727 0.01860 0.011903 0.31130 1.00000
50 0.2 257 0.03051 0.01716 0.01951 0.012073 0.24169 1.00000
50 0.5 124 0.03392 0.01681 0.01951 0.012073 0.26478 1.00000
50 1 73 0.03499 0.01570 0.01951 0.012073 0.32145 1.00000
75 0.2 241 0.03166 0.01707 0.01969 0.012319 0.25774 1.00000
75 0.5 121 0.03552 0.01759 0.01969 0.012319 0.26242 1.00000
75 1 64 0.03761 0.01713 0.01969 0.012319 0.32163 1.00000
100 0.2 244 0.03127 0.01667 0.02010 0.012236 0.19684 1.00000
100 0.5 142 0.03470 0.01809 0.02010 0.012236 0.26960 1.00000
100 1 88 0.03912 0.01913 0.02010 0.012236 0.32815 1.00000
The intermediate returns that follow high VPIN events have a mean (eMean) that is
up to 100% greater than the intermediate returns at random events (uMean). The
table above compares those means and standard deviations (eStd, uStd), for the
Events identified through various combinations of Buckets per Day (BPD) and Days
of Sample (D).
28
Electronic copy available at: https://ssrn.com/abstract=2150876
SECTION IV
What can Low Frequency Traders do?
34
Electronic copy available at: https://ssrn.com/abstract=2150876
Conclusions
• Orders from informed traders generate a persistent
order flow imbalance.
• Market makers adjust their trading range accordingly, in
order to avoid adverse selection.
• Market makers operate in a Volume Clock, an are
particularly susceptible to imbalances in that frequency.
• The key to optimal execution is to minimize the
footprint of your trades on the order flow in volume
clock.
• The Optimal Execution Horizon (OEH) algorithm
determines the amount of volume needed to conceal
the intentions of an informed trader.
35
Electronic copy available at: https://ssrn.com/abstract=2150876
THANKS FOR YOUR ATTENTION!
36
Electronic copy available at: https://ssrn.com/abstract=2150876
Bibliography (1/2)
• Almgren, R. and N. Chriss (2000): “Optimal Execution of Portfolio Transactions”,
Journal of Risk (3), 5-39.
• Almgren, R. and G. Burghardt (2011): “A window into the world of futures market
liquidity”, CME Group Research Note, March 30th.
• Easley, D., Kiefer, N., O’Hara, M. and J. Paperman (1996): "Liquidity, Information,
and Infrequently Traded Stocks", Journal of Finance, September.
• Easley, D., R. F. Engle, M. O’Hara and L. Wu (2008): “Time-Varying Arrival Rates of
Informed and Uninformed Traders”, Journal of Financial Econometrics.
• Easley, D., M. López de Prado and M. O’Hara (2011a): “The Microstructure of the
Flash Crash”, The Journal of Portfolio Management, Vol. 37, No. 2, Winter, 118-
128. http://ssrn.com/abstract=1695041
• Easley, D., M. López de Prado and M. O’Hara (2011b): “The Exchange of Flow
Toxicity”, The Journal of Trading, Vol. 6, No. 2, Spring, 8-13.
http://ssrn.com/abstract=1748633
• Easley, D., M. López de Prado and M. O’Hara (2012a): “Flow Toxicity and Liquidity
in a High Frequency World”, Review of Financial Studies, Vol. 25 (5), pp. 1457-
1493: http://ssrn.com/abstract=1695596
37
Electronic copy available at: https://ssrn.com/abstract=2150876
Bibliography (2/2)
• Easley, D., M. López de Prado and M. O’Hara (2012b): “Bulk Volume Classification”,
Working paper: http://ssrn.com/abstract=1989555
• Easley, D., M. López de Prado and M. O’Hara (2012c): “The Volume Clock: Insights
into the High Frequency paradigm”, Journal of Portfolio Management
(forthcoming). http://ssrn.com/abstract=2034858
• Easley, D., M. López de Prado and M. O’Hara (2012d): “Optimal Execution Horizon”,
Working paper: http://ssrn.com/abstract=2038387
• Eisler, Zoltan, J.-P. Bouchaud and J. Kockelkoren (2012): “The Impact of order book
events: Market orders, limit orders and cancellations”, Quantitative Finance, 12(9),
1395-1419. Available at http://ssrn.com/abstract=1373762
• Leinweber, D. (2009): “Nerds on Wall Street: Math, Machines and Wired Markets”,
Wiley.
• López de Prado, M. (2011): “Advances in High Frequency Strategies”, Ed.
Complutense University. http://tinyurl.com/hfpin
• NANEX (2011): “Strange Days June 8'th, 2011 - NatGas Algo”,
http://www.nanex.net/StrangeDays/06082011.html
• O’Hara, M. (2011): “What is a quote?”, Journal of Trading, Spring, 10-15.
38
Electronic copy available at: https://ssrn.com/abstract=2150876
Bio
Marcos López de Prado is Senior Managing Director at Guggenheim Partners. He is also a Research
Affiliate at Lawrence Berkeley National Laboratory's Computational Research Division (U.S. Department
of Energy’s Office of Science).
Before that, Marcos was Head of Quantitative Trading & Research at Hess Energy Trading Company (the
trading arm of Hess Corporation, a Fortune 100 company) and Head of Global Quantitative Research at
Tudor Investment Corporation. In addition to his 15+ years of trading and investment management
experience at some of the largest corporations, he has received several academic appointments,
including Postdoctoral Research Fellow of RCC at Harvard University and Visiting Scholar at Cornell
University. Marcos earned a Ph.D. in Financial Economics (2003), a second Ph.D. in Mathematical
Finance (2011) from Complutense University, is a recipient of the National Award for Excellence in
Academic Performance by the Government of Spain (National Valedictorian, 1998) among other awards,
and was admitted into American Mensa with a perfect test score.
Marcos is the co-inventor of four international patent applications on High Frequency Trading. He has
collaborated with ~30 leading academics, resulting in some of the most read papers in Finance (SSRN),
three textbooks, publications in the top Mathematical Finance journals, etc. Marcos has an Erdös #3 and
an Einstein #4 according to the American Mathematical Society.
39
Electronic copy available at: https://ssrn.com/abstract=2150876
Notice:
41
Electronic copy available at: https://ssrn.com/abstract=2150876