DAOS-10028 client: Add Go bindings for libdaos (Pool) #15659

mjmac · 2024-12-22T01:04:55Z

Start the work of converting the raw cgo in the daos
tool into proper Go bindings for libdaos. This patch
covers pool functionality and adds some new infrastructure
common to both pools and containers.

Features: daos_cmd pool
Required-githooks: true
Signed-off-by: Michael MacDonald [email protected]

github-actions · 2024-12-22T01:05:16Z

Ticket title is 'Update golang binding for the DAOS API'
Status is 'In Progress'
Labels: 'SODACODE2022'
https://daosio.atlassian.net/browse/DAOS-10028

daosbuild1 · 2024-12-22T01:14:27Z

Test stage Build RPM on EL 9 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-15659/2/execution/node/345/log

daosbuild1 · 2024-12-22T01:15:52Z

Test stage Build RPM on EL 8 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-15659/2/execution/node/346/log

daosbuild1 · 2024-12-22T01:16:28Z

Test stage Build RPM on Leap 15.5 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-15659/2/execution/node/337/log

daosbuild1 · 2024-12-22T01:20:46Z

Test stage Build DEB on Ubuntu 20.04 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-15659/2/execution/node/340/log

daosbuild1 · 2024-12-22T01:22:52Z

Test stage Build on EL 8 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-15659/2/execution/node/469/log

daosbuild1 · 2024-12-22T01:27:06Z

Test stage Build on Leap 15.5 with Intel-C and TARGET_PREFIX completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-15659/2/execution/node/508/log

daosbuild1 · 2024-12-24T19:05:15Z

Test stage Functional Hardware Large completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-15659/4/execution/node/1483/log

daosbuild1 · 2024-12-25T02:29:14Z

Test stage Functional Hardware Large completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-15659/5/execution/node/544/log

daosbuild1 · 2024-12-25T09:03:36Z

Test stage Functional Hardware Medium completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-15659/5/execution/node/560/log

daosbuild1 · 2024-12-28T00:49:33Z

Test stage NLT on EL 8.8 completed with status UNSTABLE. https://build.hpdd.intel.com/job/daos-stack/job/daos//view/change-requests/job/PR-15659/7/testReport/

daosbuild1 · 2024-12-29T05:38:06Z

Test stage Functional Hardware Large completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-15659/9/execution/node/1405/log

daosbuild1 · 2024-12-29T11:28:30Z

Test stage Functional Hardware Medium completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-15659/9/execution/node/1415/log

Start the work of converting the raw cgo in the daos tool into proper Go bindings for libdaos. This patch covers pool functionality and adds some new infrastructure common to both pools and containers. Features: daos_cmd Required-githooks: true Signed-off-by: Michael MacDonald <[email protected]>

mjmac · 2025-01-18T16:41:06Z

Note to reviewers... Yeah, this is big. It's the first of several patches, though, and contains a lot of the infrastructure needed to start the change over to using the client API instead of raw cgo in the daos tool. There is no new functionality here, and my focus will be on maintaining parity with the existing implementation for now. Most of the "new" code is just the existing cgo moved over into the API, along with extensive unit tests. Imagine that, unit tests!

For context, this is the first follow-on PR (still a WIP): #15721

Features: daos_cmd Required-githooks: true Signed-off-by: Michael MacDonald <[email protected]>

daosbuild1 · 2025-01-26T21:34:48Z

Test stage NLT on EL 8.8 completed with status UNSTABLE. https://build.hpdd.intel.com/job/daos-stack/job/daos//view/change-requests/job/PR-15659/23/testReport/

mjmac · 2025-01-29T13:02:06Z

If it's helpful, it may be easiest to focus on the changes to the daos command specifically, e.g.

https://github.com/daos-stack/daos/pull/15659/files#diff-a2bbc3ab4e19cd5d6f398e18eb8713a348289cac5bf983930db913e1462cf0a6

Starting with those changes should give reviewers a sense of how the new API works, e.g.

	-poolInfo, err := queryPool(cmd.cPoolHandle, queryMask)
	+poolInfo, err := cmd.pool.Query(cmd.MustLogCtx(), queryMask)

The code under lib/daos/api is mostly not new, just moved from the tool and made unit-testable via a mocking framework.

Signed-off-by: Michael MacDonald <[email protected]>

kjacque

A nice cleanup overall. I do find myself worrying about the rapidly-expanding stubs, though. I'm also curious how people are supposed to mock the API without the stubs, given that they are functions and not interfaces.

kjacque · 2025-02-01T01:10:25Z

src/control/lib/daos/api/attribute.go

+	/*case contAttr:
+	rc = daos_cont_list_attr(hdl, nil, &totalSize, nil)*/


Does this need to be enabled? Or removed?

This was code moved over from the tool... The next PR (#15721) migrates a lot of the container logic into the API, and these are uncommented.

kjacque · 2025-02-01T01:11:19Z

src/control/lib/daos/api/attribute.go

+	/*case contAttr:
+	rc = daos_cont_list_attr(hdl, (*C.char)(buf), &totalSize, nil)*/


Same question

kjacque · 2025-02-01T01:12:32Z

src/control/lib/daos/api/attribute.go

+	/*case contAttr:
+	rc = daos_cont_get_attr(hdl, C.int(numAttr), &attrNames[0], nil, &attrSizes[0], nil)*/


Same question -- if these are being left as placeholders, it would be better to add a TODO with a ticket number.

Next PR (#15721) is coming in hot right behind this one. :) Trying to make them a little easier to review in chunks.

kjacque · 2025-02-01T01:17:28Z

src/control/lib/daos/api/attribute.go

+	// Next, create a slice of C.size_t entries to hold the sizes of the values,
+	// and a slice of pointers to the actual values.


Any reason this step couldn't be done at the same time as the previous one? I understand why we couldn't do that for the getter, but the setter should be able to build all of these arrays at the same time.

This code has been working as-is for a couple of years now. My inclination is to get it all moved inside the API with proper unit tests first, and then work on cleaning up inefficiencies with confidence that the unit tests will find any mistakes.

kjacque · 2025-02-01T01:21:22Z

src/control/lib/daos/api/handle.go

+// this handle -- use of this method should be discouraged as
+// it is provided for compatibility with older code that calls
+// into libdaos directly.
+func (ch *connHandle) FillHandle(cHandle unsafe.Pointer) error {


The caller is a CGo function, right? Any reason cHandle shouldn't explicitly be a *C.daos_handle_t?

No, this function is for users outside of the API boundary (e.g. the daos tool). Can't use C types in public function signatures. Eventually we should be able to remove this entirely once the API is complete and all of the tool code is cleaned up.

kjacque · 2025-02-01T01:26:07Z

src/control/lib/daos/api/api_test.go

+// Long-term, this should be phased out as API users should mock
+// the API instead of relying on the stubs.


IMO we probably need a task to change any existing code at the higher level so people don't imitate it.

Yeah, good point. I see these as temporary scaffolding for the construction of the API. I'll update the comment to make that more explicit.

kjacque · 2025-02-01T01:34:03Z

src/control/lib/daos/api/util.h

+/*static inline uint32_t
+get_rebuild_state(struct daos_rebuild_status *drs)
+{
+	if (drs == NULL)
+		return 0;
+
+	return drs->rs_state;
+}*/


Should this be commented out?

Hmm, I think that's cruft that I missed. I'll remove it if I need to make changes to this PR, or in the next one.

mjmac · 2025-02-01T17:51:26Z

A nice cleanup overall. I do find myself worrying about the rapidly-expanding stubs, though.

I really don't see a better way to make the code testable, but I'm open to suggestions. Personally, I think it's fine for the long term because all of the stub stuff should eventually be hidden behind the API, so API users and external tests don't need to deal with them.

I'm also curious how people are supposed to mock the API without the stubs, given that they are functions and not interfaces.

I was thinking about this the other day. I started playing around with the api.Provider thing when I added the health check stuff. One option would be to expand that to include methods for all of the API functions. At the moment, though, I think that would be a maintenance headache.

I think a better way to do this is to delegate mocking to users of the API. So, e.g. out in the daos tool we can define interfaces for the parts of the API that we want to stub, and just create wrappers to implement those interfaces. This seems like a more maintainable and cleaner solution. I think it will be clearer as more of the tool code is moved into the API, and the code that remains under cmd/daos is mostly presentation layer, which means that the tests and stubs should be pretty simple.

There's already some precedent for this kind of thing in the http.HandlerFunc pattern. Basically you can wrap a function in a struct with a method to implement an interface. We use it in the server: https://github.com/daos-stack/daos/blob/master/src/control/server/server_utils.go#L692

mjmac force-pushed the mjmac/DAOS-10028-pool branch from 20e923c to 68a15e1 Compare December 22, 2024 01:09

mjmac force-pushed the mjmac/DAOS-10028-pool branch 2 times, most recently from 785f5c7 to d94cc38 Compare December 22, 2024 16:02

mjmac force-pushed the mjmac/DAOS-10028-pool branch 2 times, most recently from 5a76de4 to 628f3ce Compare December 28, 2024 00:03

mjmac force-pushed the mjmac/DAOS-10028-pool branch 2 times, most recently from 510d64b to 90ef6d7 Compare December 28, 2024 18:58

mjmac force-pushed the mjmac/DAOS-10028-pool branch from 90ef6d7 to ad55ebd Compare December 31, 2024 12:32

mjmac force-pushed the mjmac/DAOS-10028-pool branch 7 times, most recently from 6d9b688 to 5f28018 Compare January 13, 2025 23:04

mjmac force-pushed the mjmac/DAOS-10028-pool branch 2 times, most recently from 7a1ccde to aae584f Compare January 17, 2025 21:24

mjmac force-pushed the mjmac/DAOS-10028-pool branch from aae584f to cf8ef8a Compare January 17, 2025 22:59

mjmac force-pushed the mjmac/DAOS-10028-pool branch from cf8ef8a to 9b0d824 Compare January 17, 2025 23:01

mjmac marked this pull request as ready for review January 18, 2025 16:36

mjmac requested review from a team as code owners January 18, 2025 16:36

mjmac self-assigned this Jan 18, 2025

Merge branch 'master' into mjmac/DAOS-10028-pool

9a42d11

Features: daos_cmd Required-githooks: true Signed-off-by: Michael MacDonald <[email protected]>

mjmac requested review from tanabarr, kjacque and knard38 January 29, 2025 12:53

Merge branch 'master' into mjmac/DAOS-10028-pool

5565afe

Signed-off-by: Michael MacDonald <[email protected]>

kjacque reviewed Feb 1, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

DAOS-10028 client: Add Go bindings for libdaos (Pool) #15659

DAOS-10028 client: Add Go bindings for libdaos (Pool) #15659

mjmac commented Dec 22, 2024 •

edited

Loading

github-actions bot commented Dec 22, 2024

daosbuild1 commented Dec 22, 2024

daosbuild1 commented Dec 22, 2024

daosbuild1 commented Dec 22, 2024

daosbuild1 commented Dec 22, 2024

daosbuild1 commented Dec 22, 2024

daosbuild1 commented Dec 22, 2024

daosbuild1 commented Dec 24, 2024

daosbuild1 commented Dec 25, 2024

daosbuild1 commented Dec 25, 2024

daosbuild1 commented Dec 28, 2024

daosbuild1 commented Dec 29, 2024

daosbuild1 commented Dec 29, 2024

mjmac commented Jan 18, 2025 •

edited

Loading

daosbuild1 commented Jan 26, 2025

mjmac commented Jan 29, 2025

kjacque left a comment

kjacque Feb 1, 2025

mjmac Feb 1, 2025

kjacque Feb 1, 2025

kjacque Feb 1, 2025

mjmac Feb 1, 2025

kjacque Feb 1, 2025

mjmac Feb 1, 2025

kjacque Feb 1, 2025 •

edited

Loading

mjmac Feb 1, 2025

kjacque Feb 1, 2025

mjmac Feb 1, 2025

kjacque Feb 1, 2025

mjmac Feb 1, 2025

mjmac commented Feb 1, 2025 •

edited

Loading

		/*case contAttr:
		rc = daos_cont_list_attr(hdl, nil, &totalSize, nil)*/

		/*case contAttr:
		rc = daos_cont_list_attr(hdl, (C.char)(buf), &totalSize, nil)/

		/*case contAttr:
		rc = daos_cont_get_attr(hdl, C.int(numAttr), &attrNames[0], nil, &attrSizes[0], nil)*/

		// Next, create a slice of C.size_t entries to hold the sizes of the values,
		// and a slice of pointers to the actual values.

		// Long-term, this should be phased out as API users should mock
		// the API instead of relying on the stubs.

DAOS-10028 client: Add Go bindings for libdaos (Pool) #15659

Are you sure you want to change the base?

DAOS-10028 client: Add Go bindings for libdaos (Pool) #15659

Conversation

mjmac commented Dec 22, 2024 • edited Loading

github-actions bot commented Dec 22, 2024

daosbuild1 commented Dec 22, 2024

daosbuild1 commented Dec 22, 2024

daosbuild1 commented Dec 22, 2024

daosbuild1 commented Dec 22, 2024

daosbuild1 commented Dec 22, 2024

daosbuild1 commented Dec 22, 2024

daosbuild1 commented Dec 24, 2024

daosbuild1 commented Dec 25, 2024

daosbuild1 commented Dec 25, 2024

daosbuild1 commented Dec 28, 2024

daosbuild1 commented Dec 29, 2024

daosbuild1 commented Dec 29, 2024

mjmac commented Jan 18, 2025 • edited Loading

daosbuild1 commented Jan 26, 2025

mjmac commented Jan 29, 2025

kjacque left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

kjacque Feb 1, 2025 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

mjmac commented Feb 1, 2025 • edited Loading

mjmac commented Dec 22, 2024 •

edited

Loading

mjmac commented Jan 18, 2025 •

edited

Loading

kjacque Feb 1, 2025 •

edited

Loading

mjmac commented Feb 1, 2025 •

edited

Loading