Skip to content

Commit

Permalink
Merge Split Branch
Browse files Browse the repository at this point in the history
  • Loading branch information
actions-user committed Dec 20, 2024
2 parents a90d909 + 6e6edac commit 634589b
Show file tree
Hide file tree
Showing 7 changed files with 26 additions and 26 deletions.
2 changes: 1 addition & 1 deletion preview-update-submodules/assets/search/index.json

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion preview-update-submodules/assets/search/metadata.json

Large diffs are not rendered by default.

28 changes: 14 additions & 14 deletions preview-update-submodules/fellowships/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -247,14 +247,14 @@ <h2 class="mt-1">Applications are now open!</h2>

<h2 id="featured-fellow">Featured Fellow</h2>

<div id="ryan-boone" class="bg-white team-card justify-content-center mb-3 flex-grow-1">
<div id="thinh-nguyen" class="bg-white team-card justify-content-center mb-3 flex-grow-1">
<div class="uw-card-content shadow">
<div class="row">
<div class="col-3">
<div class="overflow-hidden d-flex justify-content-center">


<img src="/web-preview/preview-update-submodules/staff-list/images/ryan_boone.jpg" alt="Headshot for Ryan Boone" />
<img src="/web-preview/preview-update-submodules/staff-list/images/thinh_nguyen.jpg" alt="Headshot for Thinh Nguyen" />

</div>
</div>
Expand All @@ -263,28 +263,28 @@ <h2 id="featured-fellow">Featured Fellow</h2>
<div>
<h2 class="uw-mini-bar mb-0 mt-3">

Ryan Boone
Thinh Nguyen

</h2>
<div><h6 class="mt-2">Mentor(s):</h6> Cole Bollig and Rachel Lombardi</div>
<div><h6 class="mt-2">Mentor(s):</h6> Justin Hiemstra</div>
</div>
</div>
</div>
<div class="col-12">
<h4 class="mt-3">Grid Exerciser</h4>
<h4 class="mt-3">ML for failure classification in the OSPool</h4>
<div class="pt-2">
<p>The OSPool is a very large, very dynamic, heterogenous high throughput system composed of execute
points from dozens of campuses all over the United States. Sometimes, something will go wrong
at one of these many sites, or one network, or one storage point, and it is difficult to determine
where the problem is. This project proposed the design and construction of a “Grid Exerciser”,
which consists of intentionally sending sample jobs to targetted locations on the OSPool to verify
correct operation and sufficient performance. The project will also have a reporting and
visualization component so that the voluminous results can be understood by a human in a
concise manner.</p>
<p>The OSPool runs hundreds of thousands of jobs every day on dozens of
different sites, each unique in their own way. Naturally, there are
many hundreds of failures, most of which the system works around, but
with added latency to workflow completion. This project would attempt
to automatically classify failures from job logs to detect common
patterns and highlight places for humans to look to fix common failures
with the most payoff. Students working on this project will gain
experience applying ML techniques to real world problems.</p>

</div>
<div>
<a class="btn btn-primary" href="./reports/2024/ryan-boone">Read Final Report</a>
<a class="btn btn-primary" href="./reports/2024/thinh-nguyen">Read Final Report</a>
</div>
</div>
</div>
Expand Down
12 changes: 6 additions & 6 deletions preview-update-submodules/htc-euro-workshop-24.html
Original file line number Diff line number Diff line change
Expand Up @@ -238,10 +238,10 @@ <h4 class="mt-0">

<div class="row justify-content-center">
<div class="col-12 col-md-6">
<img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc-euro/group.jpeg" class="figure-img img-fluid rounded" alt="HTC24 Group Photo" />
<img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc24-euro/group.jpeg" class="figure-img img-fluid rounded" alt="HTC24 Group Photo" />
</div>
<div class="col-12 col-md-6">
<img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc-euro/building.jpeg" class="figure-img img-fluid rounded" alt="Building" />
<img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc24-euro/building.jpeg" class="figure-img img-fluid rounded" alt="Building" />
</div>
<div class="col">
<p>The 2024 European Autumn HTCondor Workshop was hosted this year by <a href="https://www.nikhef.nl/en/">Nikhef</a>, the Dutch National Institute for Subatomic Physics. With the intention of pairing developers with users, participation in the workshop was open to all organizations, companies, and people interested in HTCondor. A total of 68 global participants engaged in the experience, dedicating time to discuss topics ranging from dealing with diverse sources of data to opportunities and challenges courtesy of Linux Cgroups. You can find a detailed overview of the workshop <a href="https://indico.cern.ch/event/1386170/">here</a>.</p>
Expand All @@ -255,29 +255,29 @@ <h4 class="mt-0">
<p><a href="https://htcondor.org/">HTCondor</a> is an advanced software suite developed by CHTC for harnessing the power of a network of clustered computers. Rather than overloading an individual computer with a computational task, HTCondor will split a task into simultaneously running self-contained tasks, yielding results that otherwise might have taken weeks or even years to complete on a single system. The application of such software is vast, providing enormous amounts of computing power to researchers in multiple disciplines. HTCondor is not only an open source high-throughput computing software that aids research efforts, but it’s an innovative working research effort itself. As such, feedback, collaboration, and community is critical to furthering both HTCondor and the work it supports; and all three of these features are encouraged and promoted by experiences such as the European HTCondor Workshop.</p>

<figure style="float: left; margin: 0 1rem 1rem 0;">
<img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc-euro/dinner.jpeg" height="600" width="435" class="figure-img img-fluid rounded" alt="People discussing HTCondor post meetings." />
<img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc24-euro/dinner.jpeg" height="600" width="435" class="figure-img img-fluid rounded" alt="People discussing HTCondor post meetings." />
</figure>

<p>With approximately 70 attendees, representing 27 organizations and over 13 countries, interaction with users and administrators was the forefront priority of the conference. Much of the work of CHTC promotes connections across disciplines and time zones. Yet, as high throughput computing (HTC) is the execution of computational work as numerous self contained tasks, this work is predicated by division of jobs into smaller groups. Seemingly, the software side mimics the people side: with thousands of people across the globe using and working on HTCondor (a community) but in a socially isolated manner. Because of this, in-person conferences have a significant value. As attendee Cole Bollig notes, “there is nothing like getting in a room together and just talking to people and addressing their specific needs. That sort of collaboration happens best in person…As someone attending this for the first time, a big thing for me was putting faces to email addresses. We lovingly call a lot of people who work on HTCondor our ‘European friends,’ so it was just nice to finally meet them, my peers in England and Germany.”</p>

<figure style="float: right; margin: 0 1rem 0 1rem;">
<img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc-euro/class.jpeg" height="420" width="500" class="figure-img img-fluid rounded" alt="People listening" />
<img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc24-euro/class.jpeg" height="420" width="500" class="figure-img img-fluid rounded" alt="People listening" />
</figure>

<p>To promote this sort of collaboration, Chair of the Local Organizing Committee, Mary Hester (Linux DevOps Engineer at Nikhef) explained how cultivating a social, relaxed environment was central to this experience. She notes, “I first attended this workshop in 2023 since we had recently switched over to HTCondor at Nikhef. I wanted to get to know the community and have collaborative support. Now, as an organizer, I wanted to help bring people together since getting to talk to people last year was so helpful for me personally.” Hester, along with other organizers put an emphasis on the social aspect of the conference. To bring together users and administrators with developers to exchange experiences, the schedule for this conference was composed of about two daily workshop sessions, and a town hall and an office hour session. Additionally, the schedule allotted for a daily group lunch, multiple coffee breaks, and two evening social events. The impact of this led to constant mingling. As Cole Bollig states,” Often, I would be walking out of a session and continuing a conversation with someone who asked a question or I would be the one still asking questions. It was easy to keep talking about sessions outside of session; I was hunting down people or being hunted down during the breaks. Plus, coffee was provided! Which is always a plus.”</p>

<p>The coffee was actually a crucial part of the experience. Hester explains that, “it’s very important in Dutch culture to have good coffee in the workplace!” With brand new coffee machines and a newly remodeled building, Nikef, supported by workshop sponsors <a href="https://www.netapp.com/">NetApp</a>, <a href="https://www.amd.com/en/products/graphics/desktops/radeon.html">AMD-GPU</a> and <a href="https://www.lenovo.com/us/en/d/deals/doorbusters/?orgRef=https%253A%252F%252Fwww.google.com%252F&amp;cid=us%3Asem%7Cse%7Cgoogle%7Cbrand_lenovo_exact%7Clenovo_exact_intel%7Clenovo%7Ce%7C65105264%7C3187900184%7Ckwd-845751236%7Csearch%7C%7Cconsumer&amp;gad_source=1&amp;gclid=CjwKCAiA9vS6BhA9EiwAJpnXwyjEdM31NaW1xHuQp2hvLbd2IH-wXjpAkHDOWyR_R48F0yJHRmFk0BoCvEAQAvD_BwE&amp;sortBy=Recommended">Lenovo</a>, ensured attendees felt caffeinated and comfortable while asking questions in a casual way. As Hester elaborates, “It’s extremely valuable to have facetime with people, but more valuable to have a setting where people are relaxed enough to get the most out of the limited facetime.” This included a fresh Stroopwafel cart that Hester organized for the final day of the conference.</p>

<figure style="float: right; margin: 0 1rem 0 1rem;">
<img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc-auro/food.jpeg" height="420" width="300" class="figure-img img-fluid rounded" alt="People eating waffles" />
<img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc24-euro/food.jpeg" height="420" width="300" class="figure-img img-fluid rounded" alt="People eating waffles" />
</figure>

<p>Organizational efforts to promote collaboration coupled with the small size of the conference resulted in in-depth discussions. Having presented and led a workshop on DISK enforcement, Bollig reflects, “I was presenting for a 30-minute slot in this really small room, and I was worried about filling up the full 30 minutes. I only had eight slides! But, with all the conversation, we actually ended up going super overtime. I was surprised by how much we all had to talk about.” Compared to larger conferences, the EU Workshop’s smaller scale meant less formality in discussions. Hester and Bollig both commented on how the EU workshop has a shared, unspoken, notion that individuals can ask questions as they arise—even in the middle of a presentation.</p>

<p>These sorts of discussions led to surprising discoveries. Notably, the collective interest in the idea of a Prometheus exporter. Currently, used by CHTC’s <a href="https://htcondor.org/featured-users/2023-11-16-the-pelican-project.html">Pelican Project</a>, Prometheus is a newer software that helps visualize and store metrics. While CHTC was already working on a first class Prometheus exporter, hearing administrators’ enthusiasm for the project resulted in CHTC attendees prioritizing the project, making it a goal for 2025.</p>

<figure style="float: left; margin: 0 1rem 1rem 0;">
<img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc-auro/gong.jpeg" height="420" width="300" class="figure-img img-fluid rounded" alt="Todd hitting gong" />
<img src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc24-euro/gong.jpeg" height="420" width="300" class="figure-img img-fluid rounded" alt="Todd hitting gong" />
</figure>

<p>Additionally, scientific endeavors aided by HTCondor were shared at the conference. Zef Wolff, a PhD student in Experimental Physics at Nikhef noted that “cluster systems are a foundational building block” of all the work he does. Wolff’s works on the <a href="https://atlas.cern/about">ATLAS Experiment</a>, an international collaboration of physicists, engineers, technicians, and students, responsible for ground-breaking discoveries, such as that of the Higgs boson, an unstable, fundamental particle that gives mass to other particles such as electrons and quarks. Wolff relies on HTCondor to <a href="https://atlas.cern/Updates/Briefing/Higgs-Total-Width">model numerous measurements</a> of parameters and interactions of the Higgs boson, to determine if they are consistent with Standard Model predictions. The vast implications of computing resources like HTCondor also prove to be useful for the search for neutrinos and radio detection of air showers, work that is conducted in Argentina’s <a href="https://www.auger.org/">Pierre Auger Observatory</a>. Researcher Kevin Almeida Cheminant presented on <a href="https://www.investopedia.com/terms/m/montecarlosimulation.asp">Monte Carlo simulations</a>, intensive computational algorithms to predict uncertain events, and how they are needed to describe the development of air showers, which are cascades of subatomic particles and ionized nuclei that occur when a cosmic ray enters the Earth’s atmosphere. Furthermore, it was shared that HTCondor is a resource for the development of the <a href="https://www.et-gw.eu/">Einstein telescope</a>, a gravitational wave observatory expected to start construction in 2028. High performance computing and Cloud Research Technician Luca Tabasso presented on how HTCondor is being used for gravitational wave research on this project; similar to how it was used by <a href="https://www.ligo.caltech.edu/">LIGO</a>, the group that was awarded the <a href="https://www.nobelprize.org/prizes/physics/2017/press-release/">2017 Nobel Prize for Physics</a> for its detection of gravitational waves from the collision of two black holes. <a href="https://htcondor.com/about">LIGO is an collaborator and significant user</a> of HTCondor. These three projects, among others, presented on how HTCondor aids research efforts, further emphasizing the impact of global collaboration between high throughput computing and scientific research. To read more about individual presentations and review presentational materials, more can be found on the conference website, <a href="https://indico.cern.ch/event/1386170/">here</a>.</p>
Expand Down
4 changes: 2 additions & 2 deletions preview-update-submodules/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -258,7 +258,7 @@
<div class="uw-card-content pb-0">

<a href="" class="col-6">
<img class="img-fluid rounded-top rounded-bottom" style="aspect-ratio: 2; object-fit: cover" src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc-euro/building.jpeg" alt="Nikhef Building" />
<img class="img-fluid rounded-top rounded-bottom" style="aspect-ratio: 2; object-fit: cover" src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc24-euro/building.jpeg" alt="Nikhef Building" />
</a>

<a href="" class="col-6">
Expand Down Expand Up @@ -425,7 +425,7 @@ <h2 class="uw-mini-bar mb-4">News</h2>
<div class="uw-card-content pb-0">

<a href="" class="col-6">
<img class="img-fluid rounded-top rounded-bottom" style="aspect-ratio: 2; object-fit: cover" src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc-euro/building.jpeg" alt="Nikhef Building" />
<img class="img-fluid rounded-top rounded-bottom" style="aspect-ratio: 2; object-fit: cover" src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc24-euro/building.jpeg" alt="Nikhef Building" />
</a>

<a href="" class="col-6">
Expand Down
2 changes: 1 addition & 1 deletion preview-update-submodules/news.html
Original file line number Diff line number Diff line change
Expand Up @@ -249,7 +249,7 @@ <h2 class="text-center mt-0">Featured News</h2>
<div class="uw-card-content">

<a href="/web-preview/preview-update-submodules/htc-euro-workshop-24.html" class="">
<img class="img-fluid rounded-top" style="aspect-ratio: 2; object-fit: cover" src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc-euro/building.jpeg" alt="Nikhef Building" />
<img class="img-fluid rounded-top" style="aspect-ratio: 2; object-fit: cover" src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc24-euro/building.jpeg" alt="Nikhef Building" />
</a>

<div class="uw-card-copy">
Expand Down
2 changes: 1 addition & 1 deletion preview-update-submodules/uw-research-computing/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -353,7 +353,7 @@ <h2 class="uw-mini-bar mt-5 mb-4">
<div class="uw-card-content">

<a href="/web-preview/preview-update-submodules/htc-euro-workshop-24.html" class="">
<img class="img-fluid rounded-top" style="aspect-ratio: 2; object-fit: cover" src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc-euro/building.jpeg" alt="Nikhef Building" />
<img class="img-fluid rounded-top" style="aspect-ratio: 2; object-fit: cover" src="https://raw.githubusercontent.com/CHTC/Articles/main/images/htc24-euro/building.jpeg" alt="Nikhef Building" />
</a>

<div class="uw-card-copy">
Expand Down

0 comments on commit 634589b

Please sign in to comment.