Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add export option to harvest errors table #4981

Closed
1 task
tdlowden opened this issue Nov 25, 2024 · 3 comments
Closed
1 task

Add export option to harvest errors table #4981

tdlowden opened this issue Nov 25, 2024 · 3 comments
Assignees

Comments

@tdlowden
Copy link
Member

User Story

As a harvest source POC, I want a way to export the error table data, so that I can work with the data in a spreadsheet vs in the UI

Acceptance Criteria

  • GIVEN a user visits a harvest job page
    WHEN the error table renders
    THEN the user has an option to download the table in .csv format

Background

https://docs.google.com/document/d/1ktdicfssXhtjyYnkdvi1q7GCEDDMWAfv1kDrvnxUcL8/edit?tab=t.0

Security Considerations (required)

none

Sketch

Technical details TBD

@rshewitt rshewitt self-assigned this Jan 22, 2025
@rshewitt rshewitt moved this from 📥 Queue to 🏗 In Progress [8] in data.gov team board Jan 22, 2025
@rshewitt
Copy link
Contributor

rshewitt commented Jan 22, 2025

exporting all record errors can be expensive. we paginate the data because of this. we could cache the download response to avoid unnecessary processing. the record errors of a job aren't going to change so the cache time can be whatever we want. if we intend to clear record errors we'd probably want to clear the associated cache as well

@rshewitt
Copy link
Contributor

rshewitt commented Jan 22, 2025

exporting job errors. functionality is the same for records.

Screen.Recording.2025-01-22.at.4.11.02.PM.mov

@rshewitt
Copy link
Contributor

export job record errors without pagination. there's 10 record errors for this job but only 5 records are displayed in the table because of pagination. the output csv contains all 10 record errors for this job.

Screen.Recording.2025-01-23.at.10.47.21.AM.mov

@rshewitt rshewitt moved this from 🏗 In Progress [8] to 👀 Needs Review [2] in data.gov team board Jan 29, 2025
@rshewitt rshewitt moved this from 👀 Needs Review [2] to ✔ Done in data.gov team board Jan 31, 2025
@rshewitt rshewitt closed this as completed by moving to ✔ Done in data.gov team board Jan 31, 2025
@hkdctol hkdctol moved this from ✔ Done to 🗄 Closed in data.gov team board Feb 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Archived in project
Development

No branches or pull requests

2 participants