You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@donmezayca
There was an issue introduced with scraping data from country files because of the way that the language selection is implemented. At the moment the column names are translated automatically when a new language is selected. It is difficult in the R script to switch the language. Making it easier to scrape these files would be good for a number of reasons:
ETL scripts used by jmpwashdata, the JMP team, and others should have predictable column names/codes
There shouldn't be a dependency on running a heavy piece of software like Excel
At the moment, solutions are:
hardcoding column names and ranges in the R script, but with the disadvantage that we cannot check when there are mistakes (because a column was shifted for example). This requires coordination with JMP to make sure the assumed fixed columns are indeed correct.
adding a raw data sheet that only has the data + column code names that is used as the data source both in the Excel sheet and by ETL scripts (this requires an action by JMP).
The text was updated successfully, but these errors were encountered:
Interestingly this is happening because we are extracting the data from "Chart Data" instead of from "Data Summary". In Data Summary, this is already fixed and must be the source used by the Stata files as the hidden column names are not translated. The chart column names are translated, perhaps for the charts translations but probably isn't needed because there are the same column names with readable variable names above it.
For now, the workaround in jmpwashdata is to manually rename the first three columns that are the only ones translated.
@donmezayca
There was an issue introduced with scraping data from country files because of the way that the language selection is implemented. At the moment the column names are translated automatically when a new language is selected. It is difficult in the R script to switch the language. Making it easier to scrape these files would be good for a number of reasons:
At the moment, solutions are:
The text was updated successfully, but these errors were encountered: