[MUSIC]

In the data science and business software worlds,

it's hard to escape the dreaded spreadsheet.

Well, maybe you don't dread them as much as I do.

I just never learned to use Office software appropriately.

Okay, enough about me.

Anyway, in those two worlds and many others,

a lot of your work as a coder will be using CSV or comma separated value files.

These files usually have a header row and then multiple rows below them with each

columns of value separated from the previous column by a comma.

Yeah, it's a spreadsheet without all of the Excel excellence.

Python though has a pretty robust CSV module that lets us read and

write tabular data in this popular format.

Now if you've done the data science basics course you've already seen how to

use CSVs, but it's worth focusing on this for all of you that have to use CSVs but

don't need all of the information in that course.

I have a CSV here from the Canada Science and Technology Museums Corporation.

And has about a hundred of their artifacts in it but I

can't display CSVs in work spaces and even if I could I don't really wanna read it.

I wanna use it, so let's make a file for this.

I'm gonna say new file, artifacts.py,

Python's CSV module is where we wanna start, at least most of the time.

I'll put a link or two in the teacher's notes for some other CSV libraries.

The biggest problem that Python's built-in one has

is that it's slightly lacking when it comes to Unicode support.

But let's just see what we can do with it.

So we're gonna import csv.

And we're gonna, obviously the first thing I have to do is import the library.

And then I wanna see about reading from our file.

We need to open the file a little bit differently than we normally would do.

Normally we would just get with you know a flag or something.

And in this case we wanna give it a new line argument, so let's just say,

with open museum.csv,

and then when I say newline is equal to and just an empty thing here.

The reason I want to do that is because if we have a new line inside

of a quoted section then we want to be sure and

be able to differentiate that from an actual new line marking a new line.

So yeah.

And we're just gonna call this csvfile.

Oops, I forgot my colon.

And so now we need to make our CSV reader.

And we instantiate this reader so that we can tell it how to read from the file.

So I'm gonna call this, I don't know, artreader, and it will be csv.reader.

And it's gonna be a csv file.

And the delimiter,

I know this from looking at my, I think that's how you spell it,

they actually used a pipe character as the delimiter instead of a comma.

So really it's a pipe separated value file.

Whatever, the idea is that something separates each thing.

You kind of have to look at your csv files to see what they're using as a delimiter.

All right, so our artreader object here is a generator.

That means we can't index it.

We can't do like artreader two but I only wanna look at a few of the records.

So I'm gonna go ahead and turn this thing into a list.

So I'm gonna say rows = list (artreader).

And now I can loop over it.

So for row in rows up to two, let's print a comma and a space.

And we'll join whatever is in that row.

So okay, cool.

And now, let's go ahead and python artifacts.py.

So, cool.

There is the stuff that's in our file.

So you can see our first row that we printed out there,

those are our field names.

So, artifact number, object name, category three, and so on.

And then we get this thing here, that here's the number, it's a cover,

it's paper.

And so on.

So that's cool.

The problem with this is, I have to know, like, which column the thing I want is in.

And that's not always the easiest thing, right?

So let's turn these into dictionaries instead of just lists.

And we can do that by changing our reader.

So we have this reader here.

Think of this as like a list reader and

we can actually replace that with what's called DictReader.

And DictReader reads and gives us dictionaries.

So that's pretty cool, all right.

So we'll just take those first two.

Actually, let's skip that first one.

And let's print out row and

then let's print out group1, so whatever they have in their group1 field.

Let's go ahead and run that again.

And our two groups, or

our two rows rather, both have Aviation as their group1.

So that's pretty cool.

We can give a list of field names to the DictReader,

when we specify the DictReader right here.

And it'll use those as the field names in order, but since we didn't do that,

it actually reads in that first row, and uses those as the field names.

So it's kind of smart, which is pretty cool.

Let's change group one over there to manucity.

Which is the manufactured city.

If we run that, then we don't have a manufactured city for

either of those two items.

Alright, cool.

This is for working with a reader.

Just the thing that reads in the data and parses it.

Let's talk about making something that writes out to a CSV.

I'm actually going to do a new file for this.

Just because I kind of want to keep these a little bit separate, right?

So I'm gonna call this teachers.py, and again I'm gonna import CSV.

And then I'm gonna do with open teachers.csv with the a format as csvfile,

and I'm gonna say my field names are first name

and last name and topic.

You can, of course, put whatever fieldnames in here you want.

You can have hundreds of these, that's completely up to you.

I'm going to call this 'Teach Writer'.

And we'll do csv.DictWriter and we're going to write to our csv files.

And our field names are the field names variable.

So then let's do teachwriter.

Writeheader and so that writes out a row that has the header stuff in it.

And then we'll do teachwriter.writerow.

And we'll write first_name is Kenneth.

Last_name is Love and topic is Python.

And I'm gonna rack those up.

All right, cool.

I'm actually pretty good.

If I had a list of dictionaries that already had all my things in it,

then I could pass those in to the right rows method as well.

Or I could call right row multiple times.

So, like let's add in two rows here.

I'm gonna add in Alena Holligan, and she teaches PHP.

All right, so now let's run this.

Python teachers.py.

And then if I was to cat teachers.csv,

then we've got our header row, and then we have the row for me and the row for Alena.

So that's pretty cool, so

reading and writing CSVs is fairly straightforward in Python.

The main thing you have to remember to do is create these field names if you're

writing I recommend using the DictReader and DictWriter.

They're a little bit more useful.