Scribd
Upload
64 views4 pages

Lecture - Ex - 03 - Jupyter Notebook

This document discusses combining features in a pandas dataframe. It demonstrates how to generate data, combine feature names into a new string, add two columns together, and multiply two features to create an interaction term. Multiplying is preferable to adding because it separates the feature space into a grid, making it easier to distinguish the impact of varying one feature on the interaction term in the data. Creating interaction terms will be practiced in this week's graded assignment.

Uploaded by

Timothy Suraj
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
64 views4 pages

Lecture - Ex - 03 - Jupyter Notebook

This document discusses combining features in a pandas dataframe. It demonstrates how to generate data, combine feature names into a new string, add two columns together, and multiply two features to create an interaction term. Multiplying is preferable to adding because it separates the feature space into a grid, making it easier to distinguish the impact of varying one feature on the interaction term in the data. Creating interaction terms will be practiced in this week's graded assignment.

Uploaded by

Timothy Suraj
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 4

Course 2 week 1 lecture notebook Exercise 03

Combine features
In this exercise, you will practice how to combine features in a pandas dataframe. This will help you in the
graded assignment at the end of the week.

In addition, you will explore why it makes more sense to multiply two features rather than add them in order to
create interaction terms.

First, you will generate some data to work with.

In [ ]:

# Import pandas
import pandas as pd

# Import a pre-defined function that generates data


from utils import load_data

In [ ]:

# Generate features and labels


X, y = load_data(100)

In [ ]:

X.head()

In [ ]:

feature_names = X.columns
feature_names

Combine strings
Even though you can visually see feature names and type the name of the combined feature, you can
programmatically create interaction features so that you can apply this to any dataframe.

Use f-strings to combine two strings. There are other ways to do this, but Python's f-strings are quite useful.

In [ ]:

name1 = feature_names[0]
name2 = feature_names[1]

print(f"name1: {name1}")
print(f"name2: {name2}")
In [ ]:

# Combine the names of two features into a single string, separated by '_&_' for clarity
combined_names = f"{name1}_&_{name2}"
combined_names

Add two columns


Add the values from two columns and put them into a new column.
You'll do something similar in this week's assignment.

In [ ]:

X[combined_names] = X['Age'] + X['Systolic_BP']


X.head(2)

Why we multiply two features instead of adding


Why do you think it makes more sense to multiply two features together rather than adding them together?

Please take a look at two features, and compare what you get when you add them, versus when you multiply
them together.

In [ ]:

# Generate a small dataset with two features


df = pd.DataFrame({'v1': [1,1,1,2,2,2,3,3,3],
'v2': [100,200,300,100,200,300,100,200,300]
})

# add the two features together


df['v1 + v2'] = df['v1'] + df['v2']

# multiply the two features together


df['v1 x v2'] = df['v1'] * df['v2']
df

It may not be immediately apparent how adding or multiplying makes a difference; either way you get unique
values for each of these operations.

To view the data in a more helpful way, rearrange the data (pivot it) so that:

feature 1 is the row index


feature 2 is the column name.
Then set the sum of the two features as the value.

Display the resulting data in a heatmap.

In [ ]:

# Import seaborn in order to use a heatmap plot


import seaborn as sns
In [ ]:

# Pivot the data so that v1 + v2 is the value

df_add = df.pivot(index='v1',
columns='v2',
values='v1 + v2'
)
print("v1 + v2\n")
display(df_add)
print()
sns.heatmap(df_add);

Notice that it doesn't seem like you can easily distinguish clearly when you vary feature 1 (which ranges from 1
to 3), since feature 2 is so much larger in magnitude (100 to 300). This is because you added the two features
together.

View the 'multiply' interaction

Now pivot the data so that:

feature 1 is the row index


feature 2 is the column name.
The values are 'v1 x v2'

Use a heatmap to visualize the table.

In [ ]:

df_mult = df.pivot(index='v1',
columns='v2',
values='v1 x v2'
)
print('v1 x v2')
display(df_mult)
print()
sns.heatmap(df_mult);

Notice how when you multiply the features, the heatmap looks more like a 'grid' shape instead of three vertical
bars.

This means that you are more clearly able to make a distinction as feature 1 varies from 1 to 2 to 3.

Discussion
When you find the interaction between two features, you ideally hope to see how varying one feature makes an
impact on the interaction term. This is better achieved by multiplying the two features together rather than
adding them together.

Another way to think of this is that you want to separate the feature space into a "grid", which you can do by
multiplying the features together.

In this week's assignment, you will create interaction terms!


This is the end of this practice section.
Please continue on with the lecture videos!

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy