How could the content be improved?
Query / Context:
When in the "Starting With Data" section, a surveys.csv is used but the file is incomplete so when read in using pandas the dataframe fills in the blanks with Nans as expected. Nans don't look to be discussed on this episode or prior episodes in series and can be seen in screenshots for the episode. Additionally, the weight column which is used to show pandas functions for metrics has prominent number of Nans in starting rows.
Suggested improvement:
Include documentation and explanation of what Nans are. This would be good as links into the challenges for visualisation later why 1 group doesn't have a bar and later a column with Nans in the first rows is used for multiplication example. When discussing csv structure or when first load in data could be a good point to introduce concept (and if time few simple commands to check for nans) as can show the lack of values in raw/table display and then in pandas preview.
Additional context:
As people will want to use what have learnt for own data, explaining what nans are and maybe how to identify them would help as a lot of analysis can be wrong or break if include nans and plenty of errors relating to Nans.
Screenshots from lesson:
Example of column weight usage which has high number of nans so not true representation of all records:
Which part of the content does your suggestion apply to?
https://datacarpentry.github.io/python-ecology-lesson/02-starting-with-data.html
How could the content be improved?
Query / Context:
When in the "Starting With Data" section, a
surveys.csvis used but the file is incomplete so when read in using pandas the dataframe fills in the blanks with Nans as expected. Nans don't look to be discussed on this episode or prior episodes in series and can be seen in screenshots for the episode. Additionally, theweightcolumn which is used to show pandas functions for metrics has prominent number of Nans in starting rows.Suggested improvement:
Include documentation and explanation of what Nans are. This would be good as links into the challenges for visualisation later why 1 group doesn't have a bar and later a column with Nans in the first rows is used for multiplication example. When discussing csv structure or when first load in data could be a good point to introduce concept (and if time few simple commands to check for nans) as can show the lack of values in raw/table display and then in pandas preview.
Additional context:
As people will want to use what have learnt for own data, explaining what nans are and maybe how to identify them would help as a lot of analysis can be wrong or break if include nans and plenty of errors relating to Nans.
Screenshots from lesson:
Example of column
weightusage which has high number of nans so not true representation of all records:Which part of the content does your suggestion apply to?
https://datacarpentry.github.io/python-ecology-lesson/02-starting-with-data.html