Welcome to the Treehouse Community

Want to collaborate on code errors? Have bugs you need feedback on? Looking for an extra set of eyes on your latest project? Get support with fellow developers, designers, and programmers of all backgrounds and skill levels here with the Treehouse Community! While you're at it, check out some resources Treehouse students have shared here.

Looking to learn something new?

Treehouse offers a seven day free trial for new students. Get access to thousands of hours of content and join thousands of Treehouse students and alumni in the community today.

Start your free trial

Data Analysis Introduction to Big Data Where and How is Big Data Used Domain: Data Storage

Jeffrey Kwok
Jeffrey Kwok
3,006 Points
Posted by Jeffrey Kwok
Jeffrey Kwok
3,006 Points

are there big data tools that help analyze JSON files?

title says it all

1 Answer

Jared Smith
STAFF
Jared Smith
Treehouse Guest Teacher
Jared Smith
Jared Smith
Treehouse Guest Teacher

Hey Jeffrey,

Many popular Big Data toolsets can help you import JSON into a form that's easily analyzed with the toolset.

For example, you can use Apache Spark's DataFrames to import JSON and query over them: https://spark.apache.org/docs/latest/sql-programming-guide.html#json-datasets

You can also do this in Hadoop: https://dzone.com/articles/hadoop-practice (search for "JSON", it's further down on the page).

Finally, you can always parse your JSON file into a more representative format using a language like Python, then import it into other tools.

Best, Jared

Jeffrey Kwok
Jeffrey Kwok
3,006 Points
Jeffrey Kwok
Jeffrey Kwok
3,006 Points

HI Jared,

Thank you for your reply. In your opinion, what differentiates Apache Spark's Frame from Hadoop?