Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[VL] Flaky CSV UTs #8214

Open
zhztheplayer opened this issue Dec 12, 2024 · 0 comments
Open

[VL] Flaky CSV UTs #8214

zhztheplayer opened this issue Dec 12, 2024 · 0 comments
Labels
bug Something isn't working triage

Comments

@zhztheplayer
Copy link
Member

zhztheplayer commented Dec 12, 2024

Some hidden class compatibility issues have been affecting Velox backend CI on the CSV UTs for quite long time.

E.g.,

2024-12-11T09:21:48.0305864Z - Write timestamps correctly in ISO8601 format by default
2024-12-11T09:21:48.1943924Z /opt/gluten/ep/_ep/arrow_ep/java/dataset/src/main/cpp/jni_util.cc:79: Failed to update reservation while freeing bytes: Java Exception: java.lang.IncompatibleClassChangeError
2024-12-11T09:21:48.1948261Z 
2024-12-11T09:21:48.1948518Z /tmp/jnilib-8500491444229891829.tmp(+0x11b6338)[0x7f9520112338]
2024-12-11T09:21:48.1953154Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow4util8ArrowLogD1Ev+0xed)[0x7f952011276d]
2024-12-11T09:21:48.1954217Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow7dataset3jni31ReservationListenableMemoryPool4FreeEPhll+0x47d)[0x7f951f78758d]
2024-12-11T09:21:48.1958481Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow10PoolBufferD0Ev+0x47)[0x7f95203b76e7]
2024-12-11T09:21:48.1963648Z /tmp/jnilib-8500491444229891829.tmp(_ZNSt23_Sp_counted_ptr_inplaceIN5arrow9ArrayDataESaIS1_ELN9__gnu_cxx12_Lock_policyE2EE10_M_disposeEv+0x10e)[0x7f951f98858e]
2024-12-11T09:21:48.1969261Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow17SimpleRecordBatchD1Ev+0x10e)[0x7f952024094e]
2024-12-11T09:21:48.1974011Z /tmp/jnilib-8500491444229891829.tmp(_ZNSt16_Sp_counted_baseILN9__gnu_cxx12_Lock_policyE2EE10_M_releaseEv+0x3a)[0x7f951f77e46a]
2024-12-11T09:21:48.1997122Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow8internal6FnOnceIFvRKNS_10FutureImplEEE6FnImplINS_6FutureISt10shared_ptrINS_11RecordBatchEEE20WrapResultOnComplete8CallbackINSC_14ThenOnCompleteIZNS_23DefaultIfEmptyGeneratorISB_EclEvEUt_NSC_17PassthruOnFailureISI_EEEEEEED0Ev+0x2e)[0x7f951f7d2ffe]
2024-12-11T09:21:48.1999568Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl22DoMarkFinishedOrFailedENS_11FutureStateE+0x1a4)[0x7f952012c494]
2024-12-11T09:21:48.2000925Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow6FutureISt10shared_ptrINS_11RecordBatchEEE12MarkFinishedENS_6ResultIS3_EE+0x96)[0x7f951f7f3526]
2024-12-11T09:21:48.2002931Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow8internal6FnOnceIFvRKNS_10FutureImplEEE6FnImplINS_6FutureISt10shared_ptrINS_11RecordBatchEEE20WrapResultOnComplete8CallbackINS_6detail16MarkNextFinishedISC_SC_Lb0ELb0EEEEEE6invokeES4_+0x55)[0x7f951f7f3895]
2024-12-11T09:21:48.2004519Z - Write dates correctly in ISO8601 format by default
2024-12-11T09:21:48.2023794Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl21RunOrScheduleCallbackERKSt10shared_ptrINS_10FutureImplEEONS2_14CallbackRecordEb+0x40)[0x7f952012c1c0]
2024-12-11T09:21:48.2027865Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow10FutureImpl11AddCallbackENS_8internal6FnOnceIFvRKS0_EEENS_15CallbackOptionsE+0xe5)[0x7f9520122b35]
2024-12-11T09:21:48.2034465Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow8internal6FnOnceIFvRKNS_10FutureImplEEE6FnImplINS_6FutureISt8functionIFNS8_ISt10shared_ptrINS_11RecordBatchEEEEvEEE20WrapResultOnComplete8CallbackINSG_14ThenOnCompleteIZNS_20FutureFirstGeneratorISC_EclEvEUlRKSF_E_NSG_17PassthruOnFailureISO_EEEEEEE6invokeES4_+0x10c)[0x7f951f7f3dbc]
2024-12-11T09:21:48.2040056Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl22DoMarkFinishedOrFailedENS_11FutureStateE+0x196)[0x7f952012c486]
2024-12-11T09:21:48.2044707Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow6FutureISt8functionIFNS0_ISt10shared_ptrINS_11RecordBatchEEEEvEEE12MarkFinishedENS_6ResultIS7_EE+0x117)[0x7f951f7fd2a7]
2024-12-11T09:21:48.2048494Z /tmp/jnilib-8500491444229891829.tmp(+0x85c160)[0x7f951f7b8160]
2024-12-11T09:21:48.2056083Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl22DoMarkFinishedOrFailedENS_11FutureStateE+0x196)[0x7f952012c486]
2024-12-11T09:21:48.2060547Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow6FutureISt10shared_ptrINS_3csv15StreamingReaderEEE12MarkFinishedENS_6ResultIS4_EE+0x10c)[0x7f951f7e57bc]
2024-12-11T09:21:48.2064085Z /tmp/jnilib-8500491444229891829.tmp(+0x8484ea)[0x7f951f7a44ea]
2024-12-11T09:21:48.2070585Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl22DoMarkFinishedOrFailedENS_11FutureStateE+0x196)[0x7f952012c486]
2024-12-11T09:21:48.2076369Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow8internal6FnOnceIFvRKNS_10FutureImplEEE6FnImplINS_6FutureISt10shared_ptrINS_3csv15StreamingReaderEEE20WrapResultOnComplete8CallbackINS_6detail16MarkNextFinishedISD_SD_Lb0ELb0EEEEEE6invokeES4_+0x15b)[0x7f951f7d7a5b]
2024-12-11T09:21:48.2080386Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl22DoMarkFinishedOrFailedENS_11FutureStateE+0x196)[0x7f952012c486]
2024-12-11T09:21:48.2085400Z /tmp/jnilib-8500491444229891829.tmp(+0x115f4e4)[0x7f95200bb4e4]
2024-12-11T09:21:48.2091778Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl22DoMarkFinishedOrFailedENS_11FutureStateE+0x196)[0x7f952012c486]
2024-12-11T09:21:48.2096014Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow6FutureINS_8internal5EmptyEE12MarkFinishedIS2_vEEvNS_6StatusE+0xc2)[0x7f951f7d0742]
2024-12-11T09:21:48.2099834Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow8internal6FnOnceIFvRKNS_10FutureImplEEE6FnImplINS_6FutureINS0_5EmptyEE21WrapStatusyOnComplete8CallbackINS_6detail16MarkNextFinishedISA_SA_Lb1ELb1EEEEEE6invokeES4_+0x28)[0x7f951f7d15b8]
2024-12-11T09:21:48.2104851Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl22DoMarkFinishedOrFailedENS_11FutureStateE+0x196)[0x7f952012c486]
2024-12-11T09:21:48.2108640Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow6FutureINS_8internal5EmptyEE12MarkFinishedIS2_vEEvNS_6StatusE+0xc2)[0x7f951f7d0742]
2024-12-11T09:21:48.2114231Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow8internal6FnOnceIFvRKNS_10FutureImplEEE6FnImplINS_6FutureINS0_5EmptyEE21WrapStatusyOnComplete8CallbackINS_6detail16MarkNextFinishedISA_SA_Lb1ELb1EEEEEE6invokeES4_+0x28)[0x7f951f7d15b8]
2024-12-11T09:21:48.2119680Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl21RunOrScheduleCallbackERKSt10shared_ptrINS_10FutureImplEEONS2_14CallbackRecordEb+0x40)[0x7f952012c1c0]
2024-12-11T09:21:48.2124498Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow10FutureImpl11AddCallbackENS_8internal6FnOnceIFvRKS0_EEENS_15CallbackOptionsE+0xe5)[0x7f9520122b35]
2024-12-11T09:21:48.2129232Z /tmp/jnilib-8500491444229891829.tmp(+0x1153266)[0x7f95200af266]
2024-12-11T09:21:48.2134807Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl22DoMarkFinishedOrFailedENS_11FutureStateE+0x196)[0x7f952012c486]
2024-12-11T09:21:48.2140122Z /tmp/jnilib-8500491444229891829.tmp(+0x11320b6)[0x7f952008e0b6]
2024-12-11T09:21:48.2145091Z /tmp/jnilib-8500491444229891829.tmp(+0x113e048)[0x7f952009a048]
2024-12-11T09:21:48.2150664Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl21RunOrScheduleCallbackERKSt10shared_ptrINS_10FutureImplEEONS2_14CallbackRecordEb+0x40)[0x7f952012c1c0]
2024-12-11T09:21:48.2155941Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow10FutureImpl11AddCallbackENS_8internal6FnOnceIFvRKS0_EEENS_15CallbackOptionsE+0xe5)[0x7f9520122b35]
2024-12-11T09:21:48.2160731Z /tmp/jnilib-8500491444229891829.tmp(+0x1149d15)[0x7f95200a5d15]
2024-12-11T09:21:48.2166247Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl22DoMarkFinishedOrFailedENS_11FutureStateE+0x196)[0x7f952012c486]
2024-12-11T09:21:48.2171108Z /tmp/jnilib-8500491444229891829.tmp(+0x1132a92)[0x7f952008ea92]
2024-12-11T09:21:48.2176981Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl21RunOrScheduleCallbackERKSt10shared_ptrINS_10FutureImplEEONS2_14CallbackRecordEb+0x40)[0x7f952012c1c0]
2024-12-11T09:21:48.2181983Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow10FutureImpl11AddCallbackENS_8internal6FnOnceIFvRKS0_EEENS_15CallbackOptionsE+0xe5)[0x7f9520122b35]
2024-12-11T09:21:48.2186842Z /tmp/jnilib-8500491444229891829.tmp(+0x114a39d)[0x7f95200a639d]
2024-12-11T09:21:48.2192505Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl22DoMarkFinishedOrFailedENS_11FutureStateE+0x196)[0x7f952012c486]
2024-12-11T09:21:48.2196756Z /tmp/jnilib-8500491444229891829.tmp(+0x11327aa)[0x7f952008e7aa]
2024-12-11T09:21:48.2203297Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl21RunOrScheduleCallbackERKSt10shared_ptrINS_10FutureImplEEONS2_14CallbackRecordEb+0x40)[0x7f952012c1c0]
2024-12-11T09:21:48.2208404Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow10FutureImpl11AddCallbackENS_8internal6FnOnceIFvRKS0_EEENS_15CallbackOptionsE+0xe5)[0x7f9520122b35]
2024-12-11T09:21:48.2213376Z /tmp/jnilib-8500491444229891829.tmp(+0x1147ca6)[0x7f95200a3ca6]
2024-12-11T09:21:48.2218925Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl22DoMarkFinishedOrFailedENS_11FutureStateE+0x196)[0x7f952012c486]
2024-12-11T09:21:48.2223651Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow6FutureISt10shared_ptrINS_6BufferEEE12MarkFinishedENS_6ResultIS3_EE+0xef)[0x7f951fb3961f]
2024-12-11T09:21:48.2229027Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow8internal6FnOnceIFvRKNS_10FutureImplEEE6FnImplINS_6FutureISt10shared_ptrINS_6BufferEEE20WrapResultOnComplete8CallbackINS_6detail16MarkNextFinishedISC_SC_Lb0ELb0EEEEEE6invokeES4_+0x55)[0x7f951fb398c5]
2024-12-11T09:21:48.2234015Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl21RunOrScheduleCallbackERKSt10shared_ptrINS_10FutureImplEEONS2_14CallbackRecordEb+0x40)[0x7f952012c1c0]
2024-12-11T09:21:48.2243445Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow10FutureImpl11AddCallbackENS_8internal6FnOnceIFvRKS0_EEENS_15CallbackOptionsE+0xe5)[0x7f9520122b35]
2024-12-11T09:21:48.2249591Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow8internal6FnOnceIFvRKNS_10FutureImplEEE6FnImplINS_6FutureISt10shared_ptrINS_6BufferEEE20WrapResultOnComplete8CallbackINSC_14ThenOnCompleteIZNS_21TransformingGeneratorISB_SB_E26TransformingGeneratorStateclEvEUlRKSB_E_NSC_17PassthruOnFailureISL_EEEEEEE6invokeES4_+0xa6)[0x7f95200d3ff6]
2024-12-11T09:21:48.2254113Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow18ConcreteFutureImpl22DoMarkFinishedOrFailedENS_11FutureStateE+0x196)[0x7f952012c486]
2024-12-11T09:21:48.2259056Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow6FutureISt10shared_ptrINS_6BufferEEE12MarkFinishedENS_6ResultIS3_EE+0xef)[0x7f951fb3961f]
2024-12-11T09:21:48.2263928Z /tmp/jnilib-8500491444229891829.tmp(_ZN5arrow8internal6FnOnceIFvvEE6FnImplIZZNS0_8Executor10DoTransferISt10shared_ptrINS_6BufferEENS_6FutureIS9_EENS_6ResultIS9_EEEENSA_IT_EESF_bENUlRKSD_E0_clESH_EUlvE_E6invokeEv+0x54)[0x7f951fb39744]
2024-12-11T09:21:48.2284604Z /tmp/jnilib-8500491444229891829.tmp(+0x11b18d4)[0x7f952010d8d4]
2024-12-11T09:21:48.2284977Z /lib64/libstdc++.so.6(+0xc2ba3)[0x7f95f8773ba3]
2024-12-11T09:21:48.2285282Z /lib64/libpthread.so.0(+0x817a)[0x7f95fa4b517a]
2024-12-11T09:21:48.2285551Z /lib64/libc.so.6(clone+0x43)[0x7f95f9bb9dc3]
@zhztheplayer zhztheplayer added bug Something isn't working triage labels Dec 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working triage
Projects
None yet
Development

No branches or pull requests

1 participant