pull changes to main to opj branch #55
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Bumps [pyarrow](https://github.com/apache/arrow) from 13.0.0 to 14.0.1. - [Commits](apache/arrow@go/v13.0.0...apache-arrow-14.0.1) --- updated-dependencies: - dependency-name: pyarrow dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]>
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.0.5 to 2.0.7. - [Release notes](https://github.com/urllib3/urllib3/releases) - [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst) - [Commits](urllib3/urllib3@v2.0.5...2.0.7) --- updated-dependencies: - dependency-name: urllib3 dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]>
Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.2 to 3.1.3. - [Release notes](https://github.com/pallets/jinja/releases) - [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst) - [Commits](pallets/jinja@3.1.2...3.1.3) --- updated-dependencies: - dependency-name: jinja2 dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]>
Bumps [pillow](https://github.com/python-pillow/Pillow) from 10.1.0 to 10.2.0. - [Release notes](https://github.com/python-pillow/Pillow/releases) - [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst) - [Commits](python-pillow/Pillow@10.1.0...10.2.0) --- updated-dependencies: - dependency-name: pillow dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]>
Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.8.5 to 3.9.2. - [Release notes](https://github.com/aio-libs/aiohttp/releases) - [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst) - [Commits](aio-libs/aiohttp@v3.8.5...v3.9.2) --- updated-dependencies: - dependency-name: aiohttp dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]>
Analysis of trends in a specific type of negative feedback from responders to the nøku oki-skjema
Tested the NNI method used for the production of nøku statistics. Test provided for an alternative method, but is in the prelimanary stages. Will need some improvement but the proof of concept is there.
Swear word analysis and NNI testing
Commit main notebook for NNI testing
Clean up the code a little bit.
Fix some errors
1. Added ml evaluations on a 3-siffer level 2. fixed a bug where commas were causing columns to be classifed as strings 3. added a few extra tests to Master
…b-4.2.5 Bump jupyterlab from 4.2.4 to 4.2.5
…phy-43.0.1 Bump cryptography from 43.0.0 to 43.0.1
…7.2.2 Bump notebook from 7.2.1 to 7.2.2
….9.2 Bump aiohttp from 3.8.5 to 3.9.2
….2.0 Bump pillow from 10.1.0 to 10.2.0
Bump jinja2 from 3.1.2 to 3.1.3
….0.1 Bump pyarrow from 13.0.0 to 14.0.1
Bump urllib3 from 2.0.5 to 2.0.7
Update README_NO.md
Update README.md
Little updates that allow you to switch on/off options such as whether to rerun ml models, or include UU data.
Moved data to the new google cloud bucket: ssb-strukt-naering-data-produkt-prod updated all the file paths in the functions and notebooks.
Data leakage test
jep739
approved these changes
Oct 14, 2024
New knn model with custom distance function takes at least 24 hours to run. This is too long, although maybe worth doing once during the year . To combat this i updated the original KNN model which had data leakage and also adjusted the training data to include some data from outside the sample. Results look good..... too good. Adjusted method for reading in parquet files. Doesnt seem to work in the new bucket for some reason.
Imputed data now gets saved to google cloud every time its run, so now we can skip the machine learning part of the program.
Data leakage test
Update README.md
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.