Move from Excel to Python with Pandas Transcripts
Chapter: Data I/O (input and output)
Lecture: Excel fails at reading this large file
0:00 I want to go through one concrete example that shows where Excel struggles.
0:04 But pandas really has no problem.
0:06 And that's in reading large files.
0:08 So here's an example will file.
0:10 It's a C S V file that is almost 100 megabytes,
0:14 and I'm gonna try and open it up in Excel.
0:17 And I'm not gonna edit this to speeded up or slowed down.
0:21 So it tries to open up this file.
0:23 It's gonna take a little bit of time.
0:24 It's, ah, a little bit over halfway.
0:27 And then I get the air that the file is not loaded completely.
0:31 And when we go in and look at the file,
0:33 it does its best. But on Lee has a little over a million rose,
0:39 so all the data isn't there.
0:41 Let's see how we would do this with pandas.