Is the concept of objects taught in this video the same for all object-oriented languages?

What this video shows you is some of the uses of the Object data type, but not actual object-oriented programming techniques.

I would encourage you to read into the different programming paradigms. This is a brief explanation into the two primary styles of programming, procedural and object-oriented. What you will have mostly encountered in Treehouse is procedural programming.

If you are curious, take a look at this list of languages that is organized by "type"

The concept of an object is similar in any language. The primary alternative to an object-oriented design OOD is a procedural design. There are different types of procedural styles with varying degrees of variances away from being purely procedural, but from a high level can be viewed a similar. The main difference is that procedural design will focus on separating data structures from procedures with an end result that you have a series of routines and sub-routines to process data while in OOD the procedures and data are combined into a class or object which process data and then pass the results to some other object with neither object really knowing or caring about how another object works as long as it gets the data it needs to do its thing.