stage.0 Exception: 'getpwuid(): uid not found:

[kuijpersj]

Description of Issue/Question

I'm trying to expand my CEPH cluster with some new nodes. While running stage.0 i'm getting en error on the existing master in stage 19.

deepsea salt-run state.orch ceph.stage.0

I hope someone can help me resolve this issue.

Setup

openSUSE Leap 15.0 (existing servers)
openSUSE Leap 15.1 (new servers)
CEPH Nautilus

Steps to Reproduce Issue

Run deepsea salt-run state.orch ceph.stage.0

`[19/87] ceph.processes on
cro-nld-ams-am4-ceph-osd3.mgmt.crossyn.local................................... ✓ (2s)
|_ cephprocesses.wait........................................................ ✓
cro-nld-grk-ceph-osd3.mgmt.crossyn.local....................................... ✓ (2s)
|_ cephprocesses.wait........................................................ ✓
cro-nld-ams-am4-ceph-osd2.mgmt.crossyn.local................................... ✓ (2s)
|_ cephprocesses.wait........................................................ ✓
cro-nld-ams-am4-ceph-master1.mgmt.crossyn.local................................ ✓ (2s)
|_ cephprocesses.wait........................................................ ✓
cro-nld-ams-am4-ceph-master2.mgmt.crossyn.local................................ ✓ (2s)
|_ cephprocesses.wait........................................................ ✓
cro-nld-grk-ceph-osd1.mgmt.crossyn.local....................................... ✓ (2s)
|_ cephprocesses.wait........................................................ ✓
cro-nld-grk-ceph-osd2.mgmt.crossyn.local....................................... ✓ (2s)
|_ cephprocesses.wait........................................................ ✓
cro-nld-ams-am4-ceph-osd1.mgmt.crossyn.local................................... ✓ (2s)
|_ cephprocesses.wait........................................................ ✓
cro-nld-grk-ceph-master1.mgmt.crossyn.local.................................... ❌ (2s)
|_ cephprocesses.wait........................................................ ❌

Ended stage: ceph.stage.0 succeeded=18/87 failed=1/87 time=177.9s

Failures summary:

ceph.processes (/srv/salt/ceph/processes):
cro-nld-grk-ceph-master1.mgmt.crossyn.local:
wait for all processes: Module function cephprocesses.wait threw an exception. Exception: 'getpwuid(): uid not found: 377000001'`

Run salt-call cephprocesses.check

[ERROR ] An un-handled exception was caught by salt's global exception handler:
KeyError: 'getpwuid(): uid not found: 377000001'
Traceback (most recent call last):
File "/usr/bin/salt-call", line 11, in
salt_call()
File "/usr/lib/python3.6/site-packages/salt/scripts.py", line 431, in salt_call
client.run()
File "/usr/lib/python3.6/site-packages/salt/cli/call.py", line 57, in run
caller.run()
File "/usr/lib/python3.6/site-packages/salt/cli/caller.py", line 138, in run
ret = self.call()
File "/usr/lib/python3.6/site-packages/salt/cli/caller.py", line 237, in call
ret['return'] = self.minion.executors[fname](self.opts, data, func, args, kwargs)
File "/usr/lib/python3.6/site-packages/salt/executors/direct_call.py", line 12, in execute
return func(*args, **kwargs)
File "/var/cache/salt/minion/extmods/modules/cephprocesses.py", line 353, in check
res.add(ProcInfo(running_proc), role)
File "/var/cache/salt/minion/extmods/modules/cephprocesses.py", line 137, in init
self.uid_name = pwd.getpwuid(self.uid).pw_name
KeyError: 'getpwuid(): uid not found: 377000001'
Traceback (most recent call last):
File "/usr/bin/salt-call", line 11, in
salt_call()
File "/usr/lib/python3.6/site-packages/salt/scripts.py", line 431, in salt_call
client.run()
File "/usr/lib/python3.6/site-packages/salt/cli/call.py", line 57, in run
caller.run()
File "/usr/lib/python3.6/site-packages/salt/cli/caller.py", line 138, in run
ret = self.call()
File "/usr/lib/python3.6/site-packages/salt/cli/caller.py", line 237, in call
ret['return'] = self.minion.executors[fname](self.opts, data, func, args, kwargs)
File "/usr/lib/python3.6/site-packages/salt/executors/direct_call.py", line 12, in execute
return func(*args, **kwargs)
File "/var/cache/salt/minion/extmods/modules/cephprocesses.py", line 353, in check
res.add(ProcInfo(running_proc), role)
File "/var/cache/salt/minion/extmods/modules/cephprocesses.py", line 137, in init
self.uid_name = pwd.getpwuid(self.uid).pw_name
KeyError: 'getpwuid(): uid not found: 377000001'

Versions Report

(Provided by running:
salt-run deepsea.version
0.9.30+git.0.e2dea4531

rpm -qi salt-minion
Name : salt-minion
Version : 2019.2.0
Release : lp150.3.39.1
Architecture: x86_64
Install Date: Mon Jun 29 12:34:04 2020
Group : System/Management
Size : 41019
License : Apache-2.0
Signature : RSA/SHA256, Thu Nov 7 18:12:06 2019, Key ID b88b2fd43dbdc284
Source RPM : salt-2019.2.0-lp150.3.39.1.src.rpm
Build Date : Thu Nov 7 18:10:17 2019
Build Host : lamb14
Relocations : (not relocatable)
Packager : http://bugs.opensuse.org
Vendor : openSUSE
URL : http://saltstack.org/
Summary : The client component for Saltstack
Description :
Salt minion is queried and controlled from the master.
Listens to the salt master and execute the commands.
Distribution: openSUSE Leap 15.0

rpm -qi salt-master
Name : salt-master
Version : 2019.2.0
Release : lp150.3.39.1
Architecture: x86_64
Install Date: Mon Jun 29 12:32:19 2020
Group : System/Management
Size : 2936818
License : Apache-2.0
Signature : RSA/SHA256, Thu Nov 7 18:12:05 2019, Key ID b88b2fd43dbdc284
Source RPM : salt-2019.2.0-lp150.3.39.1.src.rpm
Build Date : Thu Nov 7 18:10:17 2019
Build Host : lamb14
Relocations : (not relocatable)
Packager : http://bugs.opensuse.org
Vendor : openSUSE
URL : http://saltstack.org/
Summary : The management component of Saltstack with zmq protocol supported
Description :
The Salt master is the central server to which all minions connect.
Enabled commands to remote systems to be called in parallel rather
than serially.
Distribution: openSUSE Leap 15.0

)