Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sporadic errors during make #405

Open
dzhovi opened this issue Jan 11, 2025 · 6 comments
Open

Sporadic errors during make #405

dzhovi opened this issue Jan 11, 2025 · 6 comments
Labels
bug Something isn't working

Comments

@dzhovi
Copy link
Contributor

dzhovi commented Jan 11, 2025

when i try to run make i keep getting error 141 on different make stages. In happens sporadically on random make stage.
Last time, on 6th januray, everything worked fine.
Here are last lines from several make runs:

+++ discover +++

Using discover-repos.rb...
Trying to find 1 repos in GitHub
Taking up to 1 repos per one GitHub API request
Querying for repositories created in 2025...
Completed querying for year 2025. Found 0 repositories so far.
Querying for repositories created in 2024...
Found "826148267/cjml_server" GitHub repo #1 (91 forks, 856 stars) with license: apache-2.0
Let's sleep for 2 seconds to cool off GitHub API (already found 1 repos, need 1)...
Completed querying for year 2024. Found 1 repositories so far.
Found 1 total repositories in GitHub
The list of 1 repos saved into /home/dzhovi/IdeaProjects/cam/dataset/repositories.csv
Device set to use cpu
Filtering dataset/repositories.csv with transformer...
Copied 826148267/cjml_server to pipeline/input.csv
Predicting... (all predictions will be saved into predictions.csv)
826148267/cjml_server classified as real
found 0 samples
Filtering completed. Output saved to dataset/no-samples.csv
full_name,default_branch,created_at,open_issues_count,description,topics,stars,forks,size
826148267/cjml_server,master,2024-04-18T08:49:56Z,1,Secure storage system based on cryptography｜基于密码学的安全存储系统,crypto cryptography java javafx spring-boot springcloud,856,91,73087
Finished, in 9s
make: *** [Makefile:116: polish] Ошибка 141

+++ clone +++

826148267/cjml_server (1/1): trying to clone it...
826148267/cjml_server cloned (1/1), 306M, in 1m21s
Cloned 1 repositories in 8 threads, in 1m21s
Finished, in 1m21s



+++ unregister +++

All 1 repositories checked, 1 are good
Finished, in 17ms
make: *** [Makefile:129: jpeek] Ошибка 141

~/IdeaProjects/cam$ sudo make
make: *** [Makefile:106: env] Ошибка 141

+++ env +++

+ echo TARGET=dataset
TARGET=dataset
+ echo LOCAL=/home/dzhovi/IdeaProjects/cam
LOCAL=/home/dzhovi/IdeaProjects/cam
+ echo SHELL=/bin/bash
SHELL=/bin/bash
+ echo HOME=/root
HOME=/root
+ env
SHELL=/bin/bash
step=   set -e
        /home/dzhovi/IdeaProjects/cam/help/check-make.sh
        start=$(date +%s%N)
        echo -e "\n\n\n+++  +++\n"
        source "/home/dzhovi/IdeaProjects/cam/help/gnu-utils.sh"
        if [ -d "/home/dzhovi/IdeaProjects/cam/venv" ]; then
                source "/home/dzhovi/IdeaProjects/cam/venv/bin/activate"
        fi
        @bash /home/dzhovi/IdeaProjects/cam/steps/.sh
        echo "Finished$("${LOCAL}/help/tdiff.sh" "${start}")"
SUDO_GID=1000
MAKE_TERMOUT=/dev/pts/2
REPO=
MAKEFILE_LIST=Makefile
JAVA_OPTS=-Xmx128m
SUDO_COMMAND=/usr/bin/make
SUDO_USER=dzhovi
GNUMAKEFLAGS=
PWD=/home/dzhovi/IdeaProjects/cam
LOGNAME=root
XAUTHORITY=/run/user/1000/.mutter-Xwaylandauth.W7X6Z2
CURDIR=/home/dzhovi/IdeaProjects/cam
HOME=/root
LANG=ru_RU.UTF-8
LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=00:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.avif=01;35:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:*~=00;90:*#=00;90:*.bak=00;90:*.crdownload=00;90:*.dpkg-dist=00;90:*.dpkg-new=00;90:*.dpkg-old=00;90:*.dpkg-tmp=00;90:*.old=00;90:*.orig=00;90:*.part=00;90:*.rej=00;90:*.rpmnew=00;90:*.rpmorig=00;90:*.rpmsave=00;90:*.swp=00;90:*.tmp=00;90:*.ucf-dist=00;90:*.ucf-new=00;90:*.ucf-old=00;90:
XDG_CURRENT_DESKTOP=ubuntu:GNOME
VIRTUAL_ENV=/home/dzhovi/IdeaProjects/cam/venv
JPEEK=/opt/app/jpeek.jar
MFLAGS=
MAKEFLAGS=
TOKEN=
TERM=xterm-256color
TOTAL=1
USER=root
MAKE_TERMERR=/dev/pts/2
DISPLAY=:0
SHLVL=2
MAKELEVEL=1
VIRTUAL_ENV_PROMPT=(venv) 
LOCAL=/home/dzhovi/IdeaProjects/cam
REPOS=
PATH=/home/dzhovi/IdeaProjects/cam/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin
VERSION=0.0.0
SUDO_UID=1000
MAIL=/var/mail/root
TARGET=dataset
BASH_FUNC_date%%=() {  if "${LOCAL}/help/is-macos.sh"; then
 gdate "$@";
 else
 command date "$@";
 fi
}
BASH_FUNC_sed%%=() {  if "$LOCAL/help/is-macos.sh"; then
 gsed "$@";
 else
 command sed "$@";
 fi
}
BASH_FUNC_realpath%%=() {  if "$LOCAL/help/is-macos.sh"; then
 grealpath "$@";
 else
 command realpath "$@";
 fi
}
_=/usr/bin/env
+ bash_version=5
+ '[' 5 -lt 5 ']'
+ ruby -v
ruby 3.2.3 (2024-01-18 revision 52bb2ac0a6) [x86_64-linux-gnu]
+ rubocop -v
1.56.3
++ python3 --version
++ cut -f2 '-d '
+ [[ 3.12.3 =~ ^[1-2] ]]
+ flake8 --version
7.0.0 (mccabe: 0.7.0, pycodestyle: 2.11.1, pyflakes: 3.2.0) CPython 3.12.3 on Linux
+ pylint --version
pylint 3.2.7
astroid 3.2.4
Python 3.12.3 (main, Nov  6 2024, 18:32:19) [GCC 13.2.0]
+ tlmgr --version
++ /home/dzhovi/IdeaProjects/cam/help/texlive-bin.sh
+ PATH=/home/dzhovi/IdeaProjects/cam/venv/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/usr/local/texlive/2024/bin/x86_64-linux
+ export PATH
+ pdflatex --version
pdfTeX 3.141592653-2.6-1.40.26 (TeX Live 2024)
kpathsea version 6.4.0
Copyright 2024 Han The Thanh (pdfTeX) et al.
There is NO warranty.  Redistribution of this software is
covered by the terms of both the pdfTeX copyright and
the Lesser GNU General Public License.
For more information about these matters, see the file
named COPYING and the pdfTeX source.
Primary author of pdfTeX: Han The Thanh (pdfTeX) et al.
Compiled with libpng 1.6.43; using libpng 1.6.43
Compiled with zlib 1.3.1; using zlib 1.3.1
Compiled with xpdf version 4.04
+ pdftotext -v
pdftotext version 24.02.0
Copyright 2005-2024 The Poppler Developers - http://poppler.freedesktop.org
Copyright 1996-2011, 2022 Glyph & Cog, LLC
+ inkscape --version
Inkscape 1.4 (1:1.4+202410161351+e7c3feb100)
+ aspell --version
@(#) International Ispell Version 3.1.20 (but really Aspell 0.60.8.1)
+ latexmk --version
Latexmk, John Collins, 27 Dec. 2024. Version 4.86a
+ xmlstarlet --version
1.6.1
compiled against libxml2 2.9.14, linked with 20914
compiled against libxslt 1.1.35, linked with 10139
+ shellcheck --version
ShellCheck - shell script analysis tool
version: 0.9.0
license: GNU General Public License, version 3
website: https://www.shellcheck.net
+ jq --version
jq-1.7
+ multimetric --help
+ awk --version
GNU Awk 5.2.1, API 3.2, PMA Avon 8-g1, (GNU MPFR 4.2.1, GNU MP 6.3.0)
Copyright (C) 1989, 1991-2022 Free Software Foundation.

Это свободное программное обеспечение; вы можете распространять
и/или изменять его на условиях GNU General Public License,
опубликованной Free Software Foundation; либо версии 3 этой лицензии,
либо (по вашему выбору) любой более поздней версии.

Эта программа распространяется в надежде, что она будет полезной, но БЕЗ
КАКИХ-ЛИБО ГАРАНТИЙ; даже без подразумеваемых гарантий КОММЕРЧЕСКОЙ ЦЕННОСТИ или
ПРИГОДНОСТИ ДЛЯ КОНКРЕТНОЙ ЦЕЛИ.  Для получения более подробной информации
смотрите Универсальную Общественную Лицензию GNU.

Вы должны были получить копию GNU General Public License
вместе с программой. Если этого не произошло, смотрите http://www.gnu.org/licenses/.
+ parallel --version
GNU parallel 20231122
Copyright (C) 2007-2023 Ole Tange, http://ole.tange.dk and Free Software
Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <https://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
GNU parallel comes with no warranty.

Web site: https://www.gnu.org/software/parallel

When using programs that use GNU Parallel to process data for publication
please cite as described in the manpage.
+ git --version
git version 2.43.0
+ cloc --version
1.98
+ pmd --version
  ████                            ████
  ██                                ██
  ██  █████ █ ███    ███  ███████   ██
 ███  ██  ███ ████  ████  ██    ██  ███
 ███  ███████ ██ ████ ██  ██    ██  ███
  ██  ██      ██  ██  ██  ███████   ██
  ██                                ██
  ████                            ████
PMD 7.5.0 (74ada426afd47d7e3748317047d2ad5fee4a35c8, 2024-08-30T08:11:07Z)
Java version: 17.0.13, vendor: Ubuntu, runtime: /usr/lib/jvm/java-17-openjdk-amd64
+ nproc --version
nproc (GNU coreutils) 9.4
Copyright (C) 2023 Free Software Foundation, Inc.
Лицензия GPLv3+: GNU GPL версии 3 или новее <https://gnu.org/licenses/gpl.html>.
Это свободное ПО: вы можете изменять и распространять его.
Нет НИКАКИХ ГАРАНТИЙ в пределах действующего законодательства.

Автор программы — Джузеппе Скривано (Giuseppe Scrivano).
+ sed --version
+ /home/dzhovi/IdeaProjects/cam/help/is-macos.sh
+ command sed --version
sed (GNU sed) 4.9
Упакован Debian
Copyright © 2022 Free Software Foundation, Inc.
Лицензия GPLv3+: GNU GPL версии 3 или новее <https://gnu.org/licenses/gpl.html>.
Это свободное ПО: вы можете изменять и распространять его.
Нет НИКАКИХ ГАРАНТИЙ до степени, разрешённой законом.

Авторы программы — Джей Фенласон (Jay Fenlason), Том Лорд (Tom Lord), Кен Пиццини (Ken Pizzini),
Паоло Бонзини (Paolo Bonzini), Джим Мейеринг (Jim Meyering) и Ассаф Гордон (Assaf Gordon).

Программа sed собрана с поддержкой SELinux.
В системе выключен SELinux.

Домашняя страница GNU sed: <https://www.gnu.org/software/sed/>.
Справка по работе с программами GNU: <https://www.gnu.org/gethelp/>.
Сообщения об ошибках отправляйте на <[email protected]>.
+ realpath --version
+ /home/dzhovi/IdeaProjects/cam/help/is-macos.sh
+ command realpath --version
realpath (GNU coreutils) 9.4
Copyright (C) 2023 Free Software Foundation, Inc.
Лицензия GPLv3+: GNU GPL версии 3 или новее <https://gnu.org/licenses/gpl.html>.
Это свободное ПО: вы можете изменять и распространять его.
Нет НИКАКИХ ГАРАНТИЙ в пределах действующего законодательства.

Автор программы — Падрайг Брэди (Padraig Brady).
+ bc -v
bc 1.07.1
Copyright 1991-1994, 1997, 1998, 2000, 2004, 2006, 2008, 2012-2017 Free Software Foundation, Inc.
+ javac -version
javac 17.0.13
+ java -jar /opt/app/jpeek.jar --help
Usage: <main class> [options]
  Options:
    --help
      Print usage options
    --include-ctors
      Include constructors into all formulas
      Default: false
    --include-private-methods
      Include private methods into all formulas
      Default: false
    --include-static-methods
      Include static methods into all formulas
      Default: false
    --metrics
      Comma-separated list of metrics to include
      Default: LCOM5,NHD,MMAC,SCOM,CAMC
    --overwrite
      Overwrite the target directory if it exists (otherwise an error is 
      raised) 
      Default: false
    --quiet
      Turn logging off
      Default: false
  * --sources, -s
      Directory with .class files
  * --target, -t
      Output directory

+ gradle --version

------------------------------------------------------------
Gradle 7.4
------------------------------------------------------------

Build time:   2022-02-08 09:58:38 UTC
Revision:     f0d9291c04b90b59445041eaa75b2ee744162586

Kotlin:       1.5.31
Groovy:       3.0.9
Ant:          Apache Ant(TM) version 1.10.11 compiled on July 10 2021
JVM:          17.0.13 (Ubuntu 17.0.13+11-Ubuntu-2ubuntu124.04)
OS:           Linux 6.8.0-51-generic amd64

+ mvn --version
Apache Maven 3.8.7
Maven home: /usr/share/maven
Java version: 17.0.13, vendor: Ubuntu, runtime: /usr/lib/jvm/java-17-openjdk-amd64
Default locale: ru_RU, platform encoding: UTF-8
OS name: "linux", version: "6.8.0-51-generic", arch: "amd64", family: "unix"
+ locale
LANG=ru_RU.UTF-8
LANGUAGE=
LC_CTYPE="ru_RU.UTF-8"
LC_NUMERIC="ru_RU.UTF-8"
LC_TIME="ru_RU.UTF-8"
LC_COLLATE="ru_RU.UTF-8"
LC_MONETARY="ru_RU.UTF-8"
LC_MESSAGES="ru_RU.UTF-8"
LC_PAPER="ru_RU.UTF-8"
LC_NAME="ru_RU.UTF-8"
LC_ADDRESS="ru_RU.UTF-8"
LC_TELEPHONE="ru_RU.UTF-8"
LC_MEASUREMENT="ru_RU.UTF-8"
LC_IDENTIFICATION="ru_RU.UTF-8"
LC_ALL=
Finished, in 3s
STARTED yegor256/cam 0.0.0 at Сб 11 янв 2025 23:39:47 MSK


Архитектура:              x86_64
  CPU op-mode(s):         32-bit, 64-bit
  Address sizes:          39 bits physical, 48 bits virtual
  Порядок байт:           Little Endian
CPU(s):                   8
  On-line CPU(s) list:    0-7
ID прроизводителя:        GenuineIntel
  BIOS Vendor ID:         Intel(R) Corporation
  Имя модели:             11th Gen Intel(R) Core(TM) i7-1165G7 @ 2.80GHz
    BIOS Model name:      11th Gen Intel(R) Core(TM) i7-1165G7 @ 2.80GHz NULL CPU @ 2.8GHz
    BIOS CPU family:      198
    Семейство ЦПУ:        6
    Модель:               140
    Потоков на ядро:      2
    Ядер на сокет:        4
    Сокетов:              1
    Степпинг:             1
    CPU(s) scaling MHz:   40%
    CPU max MHz:          4700,0000
    CPU min MHz:          400,0000
    BogoMIPS:             5606,40
    Флаги:                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_g
                          ood nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_
                          timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l2 cdp_l2 ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 
                          smep bmi2 erms invpcid rdt_a avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves split_lock_detect user_shstk d
                          therm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req vnmi avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid movdir
                          i movdir64b fsrm avx512_vp2intersect md_clear ibt flush_l1d arch_capabilities
Virtualization features:  
  Виртуализация:          VT-x
Caches (sum of all):      
  L1d:                    192 KiB (4 instances)
  L1i:                    128 KiB (4 instances)
  L2:                     5 MiB (4 instances)
  L3:                     12 MiB (1 instance)
NUMA:                     
  NUMA node(s):           1
  NUMA node0 CPU(s):      0-7
Vulnerabilities:          
  Gather data sampling:   Mitigation; Microcode
  Itlb multihit:          Not affected
  L1tf:                   Not affected
  Mds:                    Not affected
  Meltdown:               Not affected
  Mmio stale data:        Not affected
  Reg file data sampling: Not affected
  Retbleed:               Not affected
  Spec rstack overflow:   Not affected
  Spec store bypass:      Mitigation; Speculative Store Bypass disabled via prctl
  Spectre v1:             Mitigation; usercopy/swapgs barriers and __user pointer sanitization
  Spectre v2:             Mitigation; Enhanced / Automatic IBRS; IBPB conditional; RSB filling; PBRSB-eIBRS SW sequence; BHI SW loop, KVM SW loop
  Srbds:                  Not affected
  Tsx async abort:        Not affected
make: *** [Makefile:111: dataset/repositories.csv] Ошибка 141
@dzhovi
Copy link
Contributor Author

dzhovi commented Jan 11, 2025

@yegor256 could you please help with it

@yegor256
Copy link
Owner

@dzhovi I have absolutely no idea what this could be. Maybe you have some?

@yegor256 yegor256 added the bug Something isn't working label Jan 12, 2025
@dzhovi
Copy link
Contributor Author

dzhovi commented Jan 12, 2025

@yegor256 i tried many different stuff, i even reinstalled os(ubuntu 24.04) but the issue still persists. It may be some problem on the level of the hardware, but i am not sure about it.

@dzhovi
Copy link
Contributor Author

dzhovi commented Jan 12, 2025

@yegor256 could you test the project on your local machine?

@yegor256
Copy link
Owner

@dzhovi it fails because of this: #406 But I don't see the 141 error, as you see

@dzhovi dzhovi mentioned this issue Jan 18, 2025
Merged
@dzhovi
Copy link
Contributor Author

dzhovi commented Jan 18, 2025

@yegor256 the error 141 existed because of a broken pipes. After some investigation i have identified 2 places that lead to this error. Fixes in #408
for #406 i'll deliver fixes in the separate pr

@dzhovi dzhovi mentioned this issue Jan 18, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@yegor256 @dzhovi