Mineral Catalog (tech degree) JSON file

Sure can! So this is the relevant part of the function

filename = os.path.join(BASE_DIR, options['filename'])
try:
    with open(filename, 'r', encoding='utf-8') as data_file:
        # example 1
        print(data_file) # This WORKS, will print this as an _io.TextIOWrapper obj

        # Example 2
        data = json.load(data_file)
            print(data) # this would fail

        # Example 3
        for item in data_file: # this fails at start of the loop
            print(item)

except FileNotFoundError:
    print('Error, that file does not exist.')

I started throwing anything at it, even tried csv.DictReader. if I add in extra exception handling to the above snippet such as:

# Additional Exceptions

except UnicodeDecodeError:
    print('Unicode Decode Error')
    pass
    except UnicodeEncodeError:
    print('Unicode Encode Error')
    pass

My console output will pass on the stack trace but print the following from the minerals.json but ONLY for the for loop, I had to comment out the json.load section because that just fails and skips the code below it.

[

        {

                "name": "Abelsonite",

                "image filename": "240px-Abelsonite_-_Green_River_Formation%2C_Uintah_County%2C_Utah%2C_USA.jpg",

                "image caption": "Abelsonite from the Green River Formation, Uintah County, Utah, US",

                "category": "Organic",

                "formula": "C<sub>31</sub>H<sub>32</sub>N<sub>4</sub>Ni",

                "strunz classification": "10.CA.20",

                "crystal system": "Triclinic",

Unicode Encode Error

This is where it fails, every time.

The very next iteration in that loop, is looping over the unit cell key in the dict. Which I posted the value of that in the initial post. I think maybe that symbol at column 60?

The actual error message reads as this.

UnicodeEncodeError: 'charmap' codec can't encode character '\u03b2' in position 62: character maps to <undefined>

with open(filename, 'r', encoding='utf-8') as data_file:
                    data = json.loads(data_file.read())
                    print(data)

So something like this? With this one I get another UnicodeEncodeError but much further past character 62.

Now the error reads this.

UnicodeEncodeError: 'charmap' codec can't encode character '\u2013' in position 534: character maps to <undefined>

Which seems to be the En Dash

Hmm, OK.

json.loads(data_file.read(), encoding="utf-8")

?

Full Error with Path, Python is angry at me. LOL

File "C:\Program Files\Python35\lib\encodings\cp437.py", line 19, in encode
    return codecs.charmap_encode(input,self.errors,encoding_map)[0]
UnicodeEncodeError: 'charmap' codec can't encode character '\u2013' in position 27: character maps to <undefined>

So Kenneth,

I tried creating a new minerals.json file called minerals2.json

I threw in a List of Dictionary Items with 3 sets (3 dictionary items inside the list) containing 4 key value string pairs. I put some random string characters in each and also copied a few lines from minerals.json that didnt contain any symbols in their string.

It ran without errors and printed fine.

I redownloaded the zip, unpacked the minerals.json file to the proper directory and tried it to run it again.

I am beginning to feel this is a specific issue with Unicode + Windows + Python in Command Prompt. Doing some searches with these as keywords I found this bug

Going to look into this a bit more, but for right now I am not able to get Minerals Catalog working yet. :(

So weird! Mine doesn't run it, I still get a Unicode error.

What happens when you go into the python shell in CMD and type:

EDIT

>>> import sys
>>> sys.getdefaultencoding()
>>> print(sys.stdout.encoding)

I get

'utf-8'

cp437

I THINK that Code Page ( cp437 ) may be the problem?

Also I found this bug

Jeremy McLain

would you be able to give Python 3.5.2 a try on your Windows OS and do this again?

So I have another Desktop PC which is running Windows 10 as well though it did not have Python installed on it.

Since you were running Python 3.4.4 (32bit) on Windows I thought I would try the same.

I went ahead and tried installing then uninstalling each of the following and tried running that script with minerals.json in this order.

• Python 3.4.4 (32bit then 64bit)
• Python 3.5.2 (32bit then 64bit)

No success with any of them. Ugh.

From what I remember, this didn't work for me both ways. But since this was 2 months ago I can't recall every step, for sure this was one of them. Now I'll have to give this a shot again on the machine I had the original problem just for curiosity and a sanity check. I'll let you know what comes of it. :)

Im not sure if

set PYTHONIOENCODING=

even mattered at this point, the first two seemed to do the trick. Well the first one did the trick but the symbols weren't displaying properly.

BEFORE ANY COMMANDS http://d.pr/i/YVlP

AFTER set PYTHONIOENCODING=UTF-8 https://d.pr/sFRx

AFTER cmd /u /k chcp 65001 https://d.pr/3BUI