Bummer! This is just a preview. You need to be signed in with a Basic account to view the entire video.
Start a free Basic trial
to watch this video
Let's download the project and get up and running!
Get the code
git@github.com:treehouse-projects/java-fp-indeed-jobs.git
Learn more
-
0:00
I wanted to create a project that we could use to explore some big data.
-
0:05
So, I was looking for a large dataset I could use.
-
0:08
There are a ton of external APIs that you can connect to to get data like movies,
-
0:12
and books, and recipes, muppets, you name it.
-
0:16
So I thought,
-
0:17
what's something that has a really large amount of recent relative data?
-
0:22
I know, how about job listings for java developers?
-
0:25
So I used an API from the site indeed.com.
-
0:29
Indeed is what is known as job aggregator they gather jobs from all sorts of sites.
-
0:33
Its wonderful of you're on the hunt.
-
0:35
They also offer access to their search.
-
0:38
So, I wrote some code that grabs the first thousand recent java job postings and
-
0:42
I cached them, or saved them for later.
-
0:44
Now, the code is up on GitHub, and also available in the downloads.
-
0:48
I'm going to install it using GitHub.
-
0:49
If this is new to you, check the teacher's notes.
-
0:52
>> Okay so here in IntelliJ, I'm going to choose Check out from Version Control, and
-
0:56
I'm gonna choose GitHub.
-
0:58
I'm gonna go ahead and paste the URL from the teacher's notes in there, and
-
1:02
I'm gonna choose clone.
-
1:05
And I'm open it up, and I'm gonna let Gradle do it's thing.
-
1:08
I'm gonna go ahead and click the import Gradle Project.
-
1:12
And then I'm gonna click Create Directories for empty content where
-
1:15
it's automatically just in case I always like to have that one checked.
-
1:18
And I click OK.
-
1:20
These are okay to click OK through.
-
1:22
Doing it's thing right now, it's going and it's downloading some sources for us.
-
1:28
If you get one of these, don't worry about it.
-
1:32
Okay, and now I'm gonna open up the projects.
-
1:36
So I'm gonna go do this project view right here.
-
1:38
And let's open it up and let's take a look in here.
-
1:42
Main java com.teamtreehouse jobs, and then I'm gonna go to app.
-
1:47
And you're gonna see it, but doesn't know what string is.
-
1:49
That's because the SDK isn't defined yet here, I'm going to set up SDK,
-
1:52
I want to chose that one.
-
1:56
Okay, so this has those cached jobs that we were looking at, so
-
1:59
there should be about a 1,000.
-
2:01
I'm just going to print something here, make sure that we're working.
-
2:05
Hi mom and I'm gonna go ahead, I'm gonna click the play button over here,
-
2:08
we're gonna say Run App.main.
-
2:13
Cool.
-
2:14
So we have a 1,000 jobs to play with, it's saying hi mom.
-
2:17
I was thinking that we could kinda just slice and dice this data and
-
2:20
keep the methods that we write throughout the course as a little cheat sheet to
-
2:23
refer back to later.
-
2:24
That sound good?
-
2:26
Okay, all right, so now we're ready to roll.
-
2:28
So, let's open up the stream on these jobs, right after this break.
You need to sign up for Treehouse in order to download course files.
Sign up