Move from Excel to Python with Pandas Transcripts
Chapter: Course conclusion and review
Lecture: Data wrangling
Login or
purchase this course
to watch this video and the rest of the course contents.
0:00
in the next chapter, we went into more detail on pandas specifically around data wrangling
0:04
And one of the important concepts is to make sure that you have the correct
0:08
data types for your pandas. Data frame handles Data types are very similar to sell
0:13
formatting in Excel, you can use the Info Command to see all of your data
0:17
types, and for the most part,
0:18
pandas will determine a data type correctly when reading in files.
0:22
But sometimes it doesn't. So.
0:24
It's important to do a quick check and understand your data types and make sure that
0:29
it supports the A types of analysis that you want to use in future analysis or
0:34
transformation steps. We also discuss that there are some additional advanced options,
0:39
such as the category, Boolean and string that we didn't go into detail in this
0:44
course, but you will encounter as you continue on your pandas journey.
0:47
Once the data is in the proper type,
0:50
you can start to filter it for doing additional analysis or data scrubbing or cleaning.
0:55
And the concept that we talked about was the Excel Auto Filter,
0:58
which is very familiar to all Excel users and is a good analogy for bullying,
1:04
indexing, bullying indexing allows us to create a list of true false values that represent
1:10
different rows in our data frame and then apply them to that data frame in a
1:15
very flexible style so that we can filter our data down to a smaller subset that
1:20
we care about for future analysis or cleaning or data wrangling efforts.