A Fitting Approach To Generate Symbolic Expressions For Linear and Nonlinear Analog Circuit Performance Characteristics
A Fitting Approach To Generate Symbolic Expressions For Linear and Nonlinear Analog Circuit Performance Characteristics
the approach.
Expression Generation Template
(Matrix− or Graph−Based) Estimation
1 Introduction
Network Function Expression Template
The sizing of transistor-level analog integrated circuits is a time
consuming and thus expensive step in the design of analog and Symbolic Simulation−based
mixed-signal circuits. Automation of this process is currently an Postprocessing Template Fitting
important research target in the electronic design automation busi-
ness. Performance Parameter Performance Parameter
The sizing process can be decomposed into two subtasks [1]:
• one “investigates” the circuit’s behavior (knowledge acquisition), Figure 1. Comparison of the traditional symbolic analysis tech-
and nique with the proposed analysis technique
• one adjusts the design parameters according to the obtained knowl-
edge (knowledge use)
Symbolic analysis tries to automate the first subtask. Therefore, it followed by an expression generation step. This step first tries to
is an important research topic in the analog electronic design area. simplify the netlist, then generates a simplified network function
While symbolic analysis research started much earlier, the first re- containing only the dominant terms. Finally symbolic postprocess-
search boom is located in the 1980s [2], [3], [4], [5], [6], [7] mainly ing techniques are used to extract the performance characteristics
due to the wider availability of computing equipment. Soon it be- from the network function.
came obvious that the size of the circuits that could be analyzed However, so far, a number of problems remain unsolved:
was severely restricted by the exponential relationship between the 1. The mainstream symbolic analysis techniques are lim-
the length of the generated expressions and the size of the circuit. ited to linear (or linearized) analog circuits with some
Therefore, the research focus restricted itself more and more to- extensions to weakly nonlinear circuits.
wards enabling the analysis of larger linear circuits by employ-
2. The resulting expressions generated by the current linear
ing all sorts of approximation techniques [8], [9], [10], [11], [12],
and nonlinear techniques are lengthy and their complex-
[13], [14]. The developed approximation techniques are based on
ity is difficult to control, sometimes making their useful-
exploiting the numerical differences in order of magnitude of the
ness for interactive use questionable.
small-signal parameters. In most techniques reported in literature
these differences are obtained by numerically analyzing the circuit 3. The linear expressions that are generated are formulated
in a single design point. Another line of research investigated hi- in terms of (correlated) small-signal parameters (gm , cgs ,
erarchical techniques, i.e. splitting the symbolic analysis task up ro , . . .) instead of in terms of the true uncorrelated design
in several smaller tasks [15], [16], [17]. Linear hierarchical tech- parameters (Vbias , Ibias , w, l, . . .). This makes an ex-
niques typically generate a sequence of expressions relating a net- tra substitution necessary to reveal the true dependence
work function with the small-signal parameters involved and the on the design parameters. In addition, symbolic postpro-
Laplace variable s. Flat techniques generate network functions like cessing steps are needed to extract the performance char-
Pp acteristics (e.g. phase margin, pass-band ripple) from the
a i si generated network functions. E.g., for the gain-bandwidth
H(s) = Ppi=0 j
. (1) (GBW) of a circuit, this leads to the following substitu-
j=0 bj s
More recently, some promising extensions towards pole-zero anal- tion sequence:
ysis [18], [19], [20], [21], [22] and nonlinear analysis [23], [24] gm , cgs , ro , . . . = f (Vbias , Ibias , w, l, R, L, C) (2)
also emerged.
H(s) = g (s, gm, cgs, ro , . . .) (3)
The traditional approach used in symbolic analysis for linear (or
linearized) analog circuits has been depicted on the left-hand side GBW = h (H(s)) (4)
of Fig. 1. The approach starts with an AC expansion of the netlist, = h (g (f (Vbias , Ibias , w, l, R, L, C)))
(5)
4. Simplified transistor models are needed, in order to limit E S Y X S P
5. The simplification (or simplified generation) of the ex- Figure 2. Electronic system seen (a) as a system that relates an
pressions is only verified in a single design point, and input signal E to an output signal Y and (b) as a system that
therefore uncertainty arises concerning the reliability of relates a set of design parameters X the system’s performance
the generated expressions. P
6. The form of the expressions is not tuned towards the use
in an optimization engine used for automatic sizing. 2.2 Posynomial expressions
This paper describes an approach that attempts to overcome these
problems. The idea behind the proposed method can be seen on Let X = (x1 , x2 , x3 , . . . , xn )T be a vector of real, positive vari-
ables. An expression f is called signomial if it has the form
the right-hand side of Fig. 1. The core of the method consists of !
directly fitting well-chosen expression templates to the numerically Xm Y
n
αij
simulated performance characteristics of the circuit. Its strong points f (X) = ci xj (7)
i=1 j=1
are:
1. Expressions for linear and nonlinear characteristics can with ci ∈ R and αij ∈ R. If we restrict all ci to be positive (ci ∈
be generated. R+ ), then the expression f is called posynomial. Whereas the
former has better fitting properties, the latter allows to formulate
2. The complexity of the resulting expression is limited and
analog circuit sizing as a geometric program [26], [27].
imposed by the complexity of the fitting template. The
A (primal) geometric program is the constrained optimization prob-
designer is informed about the accuracy of the fit.
lem:
3. Performance parameters are expressed directly in terms
of the design parameters, avoiding additional postpro- minimize f0 (X)
cessing and substitutions. E.g., for the Gain-Bandwidth with the constraints: fi (X) ≤ 1, i = 1, . . . , p (8)
(GBW ) of a circuit, this corresponds to the following gj (X) = 1, j = 1, . . . , q
single expression:
xk ≥ 0, k = 1, . . . , n
GBW = u(Vbias , Ibias , w , l , R, L, C ) (6) with all fi (X) posynomial and all gj (X) monomial. By substitut-
ing all variables xi by zk = log (xk ) and taking the logarithm of
4. Well established and accepted device models, such as
the objective function f0 and every constraint fi , gj , it can read-
BSIM-3v3 or MM9 (used and trusted by designers to-
ily be seen that the transformed problem is a convex optimization
day), can be used without impairing the compactness of
problem. Because of this, it has only one global optimum. In ad-
the resulting expression.
dition, this optimum can be found very efficiently using interior
5. The fitting samples are chosen so that the part of the de- point methods [28], even for large problems. Notice that strictly
sign space in which the designer is interested is fully cov- speaking posynomial expressions are not convex: the above men-
ered. Therefore the expressions are suited to be used over tioned transformation makes them convex. However, in view of
a larger part of the design space during circuit design. that property, we conveniently denote them as convex expressions.
6. The technique generates posynomial expressions [25].
This allows to formulate the sizing problem as a geo- 3 Symbolic Performance expression genera-
metric program [26], [27]. tion
The paper is organized as follows. Section 2 will provide some Fig. 3 shows the outline of the proposed method to generate sym-
theoretical background. In section 3, we will discuss our approach bolic performance expressions. First we will determine a set of
in detail. The proposed approach has been implemented in a soft- experiments to perform, in order to obtain an optimal dataset for
ware prototype. The experimental results obtained with this proto- the expression template estimator. In a second step we will per-
type are described in section 4. Finally, section 5 summarizes both form these experiments using a numerical circuit-level simulator
strong and the weak points of the presented approach. Some ideas such as SPICE. The obtained samples are then used to estimate a
for future research also have been indicated. good posynomial template and afterwards reused to generate the
posynomial expression. In a final step, the model quality is veri-
2 Posynomial performance parameter expres- fied. In the next subsections we will treat the different steps of our
sions method in detail.
2.1 Performance parameters 3.1 Posynomial expression generation
Consider a system S transforming an input signal E into an output
Whereas traditional symbolic analysis methods compose their ex-
signal Y (Fig. 2-(a)). The mathematical modeling of this input-
pressions using network analysis intermixed with numerical ap-
output relationship is called behavioral modeling. Fig. 2-(b) de-
proximation techniques, our method is based on straight mathemat-
picts the same system seen from a designer’s point of view: a num-
ical fitting of a pre-estimated expression template using simulated
ber of design parameters (X) cause the system to exhibit a partic-
data. Standard mathematical fitting techniques like interpolation
ular performance (P ). The modeling of this relationship is called
or least-squares regression are well kown, but are rarely used in
performance modeling. Because our goal is to compose symbol-
symbolic analysis methods.
ical expressions that can be used for designing a circuit, we will
However, the advantages of using simulation-based fitting tech-
concentrate on the latter.
niques over traditional symbolic analysis techniques are multiple:
Design of Experiments 1. start with an empty template
2. add ci,0,j,0
Simulation−based 3. if di > 0, then add ci,1,j,0 x1i
Performance Calculation else if di < 0, then add ci,−1,j,0 x−1 i
4. if di,i > 0, then add ci,1,i,1 x2i
Expression Template Estimation else if di < 0, then add ci,−1,j,0 x−1 i
5. if di,j |i6=j > 0, then add ci,1,j,1 xi xj
Posynomial else if di,j |i6=j < 0, then,
Expression Generation if (a0 ), then
if (∆xi /xi > ∆xj /xj ), then
Posynomial Expression add ci,−1,j,1 x−1
i xj and ci,0,j,−1 xj
−1
else
Expression Quality Verification
add ci,1,j,−1 x1i x−1
j and ci,−1,j,0 xi
−1
else
Figure 3. Outline of the expression-generation method if (∆xi /xi < ∆xj /xj ), then
add ci,−1,j,1 x−1
i xj and ci,0,j,−1 xj
−1
else
• any performance parameter (linear as well as nonlinear) add ci,1,j,−1 x1i x−1 −1
j and ci,−1,j,0 xi
can be fitted, 6. if (a1 ), then add ci,−1,j,0 , i = 1 . . . n
• full accuracy SPICE transistor models can be used, 7. if (a2 ), then add ci,1,j,0 , i = 1 . . . n
8. if (a3 ), then add ci,2,j,0 , i = 1 . . . n
• performance parameters (such as GBW or slew rate) are
directly fitted as a function of the design parameters, and Figure 4. The template estimation algorithm
• the complexity of the resulting expression is directly im-
posed by the fitting template that is chosen.
Of course, the selection of the expression template is crucial, in A set of template estimators is proposed based on a single algo-
order to obtain a good fit. A trade-off between the number of fit rithm that contains 4 binary choices. This leads to 16 alternatives.
parameters allowed and the resulting fit accuracy has to be made. For convenience, we represent the 4 binary choices by a 4-bit word
The designer’s experience and insight in the system may clearly (a3 a2 a1 a0 ). The algorithm can be found in Fig. 4.
help in selecting (or refining) a model template. However, to assist This algorithm keeps the terms of (11) that have positive coeffi-
the designer in this process, we propose the use of an expression cients and replaces the negative terms by appropriate approxima-
template estimator that allows to compose a template without rely- tions (see [29]). The number of terms of the estimated templates is
ing on human input. at most 1/2n2 + 5/2n + 1. In order to keep the template as sparse
Consider the generic n-dimensional posynomial template as possible, the estimation correlation between the coefficients of
n
! (11) should be as close as possible to zero. Techniques from design
X X Xn X of experiments can assist us to achieve this goal.
f (X) = k l
ci,k,j,l xi xj (9)
k=−1,0,1 l=−1,0,1 i=1 j=1
3.3 Design of experiments
with n the number of design parameters and all ci,k,j,l positive. The theory of Design Of Experiments (DOE) provides a mathemat-
The template of (9) allows to obtain good fitting results. However, ical basis to select an optimal sample set that allows an uncorre-
the number of independent parameters to fit equals lated estimation of the fit parameters, given a fit template [30]. The
3 2 5 number of sampling schemes described in literature is vast: start-
#ci,j,indep = n + n+1 (10)
2 2 ing from full- and fractional factorial design, over Placket-Burman
This number of fit parameters is too large for realistic sizing prob- and Taguchi schemes, to Latin hypercube and even random design.
lems (e.g., n > 10 leads to #ci,j,indep > 176). The expression A sampling scheme that allows an uncorrelated estimation of the
template estimator described in the next subsection allows to re- coefficients of (11) are level-3 orthogonal arrays of strength 3 [31].
duce this number. This scheme places the sampling points on the edges of a fitting hy-
percube of size ∆X around a center point X ∗ . Usually the center
3.2 Expression template estimation point is provided as well.
This sampling scheme has been chosen, in order to keep the coef-
To estimate which coefficients ci,k,j,l need to be retained in the
ficient leakage in (11) as small as possible.
posynomial fitting, we first fit the signomial function
The same samples are reused to fit the estimated posynomial tem-
X
n X
n
Xn X
n
plate. This avoids additional (costly) numerical simulations.
g(X) = d0 + (di xi ) + di,i x2i + (di,j xi xj )
i=1 i=1 i=1 j=i+1
(11)
3.4 Fit quality verification
to the experimental data. The number of independent parameters In order to assess the quality of fit, we use the quality-of-fit param-
to fit amounts to eter q, defined in [29]. The starting point for this parameter is the
1 3 root mean square of the deviation in the a sampling points. This pa-
#di,j,indep = n2 + n + 1, (12) rameter then is normalized by division with the performance range
2 2
of the sampling points:
which is about a third lower than (10). Because the fitting process qP
itself is O(d3i,j,indep ), this is a considerable gain.
j=1 (f (Xj ) − pj )
a
Then, a template estimation algorithm is applied to relate the ob- q= . (13)
tained coefficients di,j to the ci,k,j,l that need to be present in (9). a c + maxaj=1 pj − minaj=1 pj
VDD
In (13) c is a constant to avoid error overestimation when the per-
formance range approaches zero. If we reuse the sampling points M5a M6 M5b
used during the fitting process, then this figure is: n4a n5 n4b
1. computationally cheap (no extra simulations are needed), and
2. easy to assess: a quality larger than 1 suggests a bad fit. M4a M7 M4b
We will further denote the fit-quality parameter that reuses only the
iB3 n1
set of sampling points by q0 . In order to have a more realistic view iB2 nin_p M1a M1b nin_m nout
on the fit quality, additional samples located in the interior of the iB1
fitting hypercube may be selected. We will label this fit-quality pa-
rameter q1 . A drawback of the latter is the need for extra circuit M2a M2b
N VSS
4.1 S-PR I SM
N
The flow of Fig. 3 has been implemented in S-PR I SM, our Sym- Figure 6. Schematic of a high-speed CMOS OTA
bolic Posynomial Response Surface Modeling prototype. Fig. 5
N
shows the overall concept of S-PR I SM. Sixteen alternative tem-
the posynomial formulation). Note that transistor currents and volt-
ages are chosen as variables, rather than transistor widths, since we
Analysis Analysis Analysis
Server Server Server
use an operating-point driven formulation for analog circuit sizing
[32].
Analysis Analysis Analysis Analysis Analysis
Client Client Client Client Client
Coefficient Values
0.75e2
0x3 -- -- -- -- o -- -- ++ -- -- ++ -- ++ ++ --
0x4 o + ++ ++ + ++ - -- ++ + + ++ ++ - ++ 0.5e2
0x5 -- o ++ -- - ++ -- o -- ++ -- ++ -- ++ ++
0x6 o + ++ ++ + ++ - -- ++ + + ++ ++ - ++ 0.25e2
0x7 -- o ++ ++ - -- -- o -- ++ ++ ++ ++ ++ --
0x8 ++ ++ ++ ++ ++ -- ++ - ++ -- ++ ++ -- -- ++ 0
0x9 -- -- ++ -- -- -- o + -- ++ ++ ++ ++ ++ -- Dynamic 1
Range 0
0xA ++ ++ ++ ++ ++ -- ++ - ++ -- ++ ++ -- -- ++
0xB -- -- ++ -- ++ -- o + -- ++ -- ++ ++ ++ -- vsg1
vgs2
0xC ++ ++ ++ ++ ++ + ++ -- ++ -- + -- -- - ++
o = average, - = poor, -- = bad) for ∆X1 (I), ∆X2 (II), ∆X3 (III) ib2
ib3
Coefficient Values
paid by a small loss of accuracy. Also notice the low fitting time of 1.5e9
vsg1
0.15 ib1
quadratic polynomial template ib2
ib3
0.10
8e8
0
Coefficient Values
0 50 100 150 20
6e8
Fitting Time [sec]
4e8
vsg1
Resulting models vgs2
Scaled Input Parameters
vds2
The obtained number of terms in the resulting expressions, the fit- vsg3
vsg4
vsg5
ting time and the fit-quality parameters can be found in Table III. vsd5
vsd6
id1
We can clearly observe that the fit quality improves with smaller id2
hypercube widths (∆X1 > ∆X2 > ∆X3 ) and that the expres-
ib1
ib2
ib3
sions based on the estimated templates are a good trade-off be- Input parameter legend Coefficient legend
tween generation time and accuracy. Also take note of the small 1st power −1st power 2nd power positive coefficient negative coefficient
number of terms needed for the expressions. The fact that the fit
Figure 8. Graphical representation of the expression for Av,LF ,
quality of the expression based on the full template is sometimes SR p and SR n fitted for ∆X3
outperformed by the expressions based on the estimated template
indicates that the fit routine itself can be improved.