Oct 30 02:39:12.508194 ip-10-0-128-202 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 02:39:12.508207 ip-10-0-128-202 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 02:39:12.508218 ip-10-0-128-202 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 02:39:12.508580 ip-10-0-128-202 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 02:39:23.605532 ip-10-0-128-202 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 02:39:23.605551 ip-10-0-128-202 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 737f32ff25774b1a9960226050d0c06e --
Oct 30 02:41:28.029594 ip-10-0-128-202 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 02:41:28.433116 ip-10-0-128-202 kubenswrapper[2543]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:41:28.433116 ip-10-0-128-202 kubenswrapper[2543]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 02:41:28.433709 ip-10-0-128-202 kubenswrapper[2543]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:41:28.433709 ip-10-0-128-202 kubenswrapper[2543]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:41:28.441041 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.440950    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:41:28.441041 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441036    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:41:28.441041 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441042    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:41:28.441041 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441046    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:41:28.441041 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441050    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441056    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441060    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441063    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441067    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441070    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441073    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441077    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441080    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441084    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441087    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441091    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441096    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441100    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441105    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441108    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441112    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441116    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441120    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441124    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:41:28.441368 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441128    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441133    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441136    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441140    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441144    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441148    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441153    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441157    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441166    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441171    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441175    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441179    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441184    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441189    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441193    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441197    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441202    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441206    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441213    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:41:28.442216 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441219    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441224    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441229    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441234    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441238    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441242    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441247    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441251    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441255    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441260    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441265    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441269    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441273    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441277    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441306    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441310    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441315    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441319    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441323    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441327    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:41:28.443032 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441332    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441336    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441340    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441344    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441349    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441354    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441360    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441364    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441368    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441374    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441381    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441386    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441390    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441394    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441399    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441404    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441408    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441412    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441416    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:41:28.443936 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441420    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441425    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441429    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441433    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441437    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441442    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441446    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441451    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441455    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441460    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441464    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441468    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441473    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441477    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441483    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441487    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441491    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441496    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441500    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441504    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:41:28.444748 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441508    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441512    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441517    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.441524    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442851    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442864    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442872    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442878    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442883    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442887    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442891    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442895    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442901    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442905    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442910    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442914    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442918    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442923    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442927    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:41:28.445869 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442931    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442935    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442940    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442945    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442949    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442954    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442958    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442963    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442967    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442971    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442975    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442980    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442984    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442988    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442992    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.442996    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443000    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443005    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443009    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:41:28.446374 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443013    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443017    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443021    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443025    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443029    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443033    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443038    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443042    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443046    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443050    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443057    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443062    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443066    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443070    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443074    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443078    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443083    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443088    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443093    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443097    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:41:28.447100 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443101    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443105    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443110    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443114    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443118    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443122    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443127    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443131    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443135    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443139    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443143    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443147    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443151    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443155    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443160    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443165    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443169    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443173    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443177    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443182    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:41:28.448002 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443187    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443194    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443202    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443207    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443211    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443215    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443220    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443224    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443228    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443233    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443237    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443242    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443246    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443250    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443254    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443259    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443263    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443267    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443271    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:41:28.448886 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443275    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443299    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443303    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443307    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443311    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443316    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443320    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443324    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443328    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443334    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443338    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443342    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.443346    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444168    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444177    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444182    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444187    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444191    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444195    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:41:28.449369 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444198    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444203    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444207    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444211    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444215    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444220    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444224    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444228    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444232    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444237    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444242    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444246    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444250    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444254    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444259    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444263    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444267    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444271    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444275    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:41:28.450038 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444300    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444304    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444311    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444316    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444321    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444325    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444330    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444334    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444340    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444344    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444348    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444353    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444357    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444361    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444365    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444369    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444373    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444378    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444382    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444386    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:41:28.450516 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444390    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444394    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444401    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444405    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444411    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444415    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444419    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444423    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444430    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444436    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444442    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444447    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444452    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444456    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444460    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444464    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444469    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444473    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444478    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:41:28.451043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444482    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444487    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444493    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444497    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444501    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444505    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444510    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444514    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444518    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444522    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444526    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444530    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444534    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444538    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444542    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444548    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444552    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444557    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444562    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444566    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:41:28.451528 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444571    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444575    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444579    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444583    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444587    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444591    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444595    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444599    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444603    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444608    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444612    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444616    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444620    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444624    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444628    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444635    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444641    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444646    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444650    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444654    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:41:28.452017 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444658    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.444662    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446504    2543 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446522    2543 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446535    2543 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446542    2543 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446549    2543 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446557    2543 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446568    2543 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446575    2543 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446580    2543 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446584    2543 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446590    2543 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446595    2543 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446600    2543 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446604    2543 flags.go:64] FLAG: --cgroup-root=""
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446609    2543 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446613    2543 flags.go:64] FLAG: --client-ca-file=""
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446618    2543 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446623    2543 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446629    2543 flags.go:64] FLAG: --cluster-domain=""
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446633    2543 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446638    2543 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446645    2543 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 02:41:28.452505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446651    2543 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446657    2543 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446662    2543 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446667    2543 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446673    2543 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446678    2543 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446683    2543 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446687    2543 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446692    2543 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446697    2543 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446704    2543 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446709    2543 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446713    2543 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446718    2543 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446723    2543 flags.go:64] FLAG: --enable-server="true"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446732    2543 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446740    2543 flags.go:64] FLAG: --event-burst="100"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446745    2543 flags.go:64] FLAG: --event-qps="50"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446750    2543 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446754    2543 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446759    2543 flags.go:64] FLAG: --eviction-hard=""
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446765    2543 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446770    2543 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446775    2543 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446780    2543 flags.go:64] FLAG: --eviction-soft=""
Oct 30 02:41:28.453049 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446785    2543 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446789    2543 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446794    2543 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446799    2543 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446803    2543 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446808    2543 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446815    2543 flags.go:64] FLAG: --feature-gates=""
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446821    2543 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446826    2543 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446832    2543 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446837    2543 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446842    2543 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446848    2543 flags.go:64] FLAG: --help="false"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446853    2543 flags.go:64] FLAG: --hostname-override="ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446858    2543 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446863    2543 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446868    2543 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446873    2543 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446878    2543 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446883    2543 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446887    2543 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446891    2543 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446898    2543 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 02:41:28.453821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446903    2543 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446908    2543 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446912    2543 flags.go:64] FLAG: --kube-reserved=""
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446917    2543 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446922    2543 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446927    2543 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446931    2543 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446935    2543 flags.go:64] FLAG: --lock-file=""
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446940    2543 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446945    2543 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446950    2543 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446959    2543 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446963    2543 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446968    2543 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446973    2543 flags.go:64] FLAG: --logging-format="text"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446979    2543 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446984    2543 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446989    2543 flags.go:64] FLAG: --manifest-url=""
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.446994    2543 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447001    2543 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447006    2543 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447012    2543 flags.go:64] FLAG: --max-pods="110"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447021    2543 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447027    2543 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447031    2543 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 02:41:28.454443 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447036    2543 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447041    2543 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447046    2543 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447051    2543 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447063    2543 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447068    2543 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447075    2543 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447079    2543 flags.go:64] FLAG: --pod-cidr=""
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447084    2543 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447088    2543 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447093    2543 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447098    2543 flags.go:64] FLAG: --port="10250"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447102    2543 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447107    2543 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dffc18aa93e96ccc"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447112    2543 flags.go:64] FLAG: --qos-reserved=""
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447116    2543 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447121    2543 flags.go:64] FLAG: --register-node="true"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447126    2543 flags.go:64] FLAG: --register-with-taints=""
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447132    2543 flags.go:64] FLAG: --registry-burst="10"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447137    2543 flags.go:64] FLAG: --registry-qps="5"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447141    2543 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447151    2543 flags.go:64] FLAG: --reserved-memory=""
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447159    2543 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447164    2543 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447168    2543 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447173    2543 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 02:41:28.455032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447178    2543 flags.go:64] FLAG: --runonce="false"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447182    2543 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447188    2543 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447192    2543 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447207    2543 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447212    2543 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447217    2543 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447222    2543 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447227    2543 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447231    2543 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447236    2543 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447240    2543 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447245    2543 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447250    2543 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447255    2543 flags.go:64] FLAG: --system-cgroups=""
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447259    2543 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447268    2543 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447273    2543 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447277    2543 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447302    2543 flags.go:64] FLAG: --tls-min-version=""
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447307    2543 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447311    2543 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447315    2543 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447320    2543 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447325    2543 flags.go:64] FLAG: --v="2"
Oct 30 02:41:28.455671 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447331    2543 flags.go:64] FLAG: --version="false"
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447337    2543 flags.go:64] FLAG: --vmodule=""
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447343    2543 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.447350    2543 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447565    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447571    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447576    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447581    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447585    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447589    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447594    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447598    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447604    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447608    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447612    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447616    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447621    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447625    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447629    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447634    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:41:28.456253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447638    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447642    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447646    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447650    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447655    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447659    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447663    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447667    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447672    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447676    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447680    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447684    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447689    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447693    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447698    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447704    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447711    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447718    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447722    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:41:28.456749 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447728    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447733    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447737    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447741    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447745    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447750    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447755    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447759    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447763    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447767    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447772    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447776    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447781    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447785    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447789    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447793    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447798    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447802    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447806    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:41:28.457199 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447811    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447815    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447819    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447824    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447828    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447832    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447836    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447840    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447845    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447851    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447855    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447859    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447864    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447868    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447872    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447876    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447880    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447887    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447893    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447898    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:41:28.457669 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447904    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447909    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447913    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447918    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447922    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447926    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447930    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447934    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447938    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447942    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447946    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447950    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447954    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447957    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447962    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447966    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447970    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447975    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447979    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447983    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:41:28.458185 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447988    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447993    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.447997    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448001    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448005    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448009    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448013    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448017    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448021    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448025    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448029    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448033    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.448075    2543 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448130    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448138    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448144    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:41:28.458664 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448150    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448156    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448161    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448166    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448170    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448175    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448179    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448183    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448188    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448192    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448196    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448201    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448205    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448208    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448213    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448217    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448221    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448225    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448231    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448235    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:41:28.459046 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448240    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448244    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448248    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448252    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448257    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448262    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448266    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448270    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448277    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448312    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448319    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448325    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448331    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448336    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448340    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448344    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448348    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448353    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:41:28.459535 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448357    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448362    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448366    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448371    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448375    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448380    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448384    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448388    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448392    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448396    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448402    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448407    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448412    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448416    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448421    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448425    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448430    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448434    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448438    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:41:28.459960 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448442    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448446    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448451    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448456    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448460    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448464    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448469    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448475    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448479    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448483    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448489    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448495    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448499    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448504    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448508    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448513    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448517    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448521    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448525    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448530    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448534    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:41:28.460427 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448538    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448542    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448546    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448550    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448556    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448560    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448564    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448569    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448573    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448577    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448582    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448586    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448591    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448595    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448599    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448603    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448608    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448612    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448618    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:41:28.460913 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448622    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448626    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448630    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448634    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448639    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.448645    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.456010    2543 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.456024    2543 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.456040    2543 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.456044    2543 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456109    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456114    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456117    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456121    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456123    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456126    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456129    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456131    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456134    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:41:28.461411 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456136    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456139    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456141    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456144    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456147    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456149    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456152    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456154    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456157    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456159    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456162    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456164    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456172    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456175    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456178    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456181    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456183    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456186    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456188    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456191    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:41:28.461857 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456194    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456196    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456198    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456201    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456205    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456208    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456212    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456215    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456218    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456220    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456223    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456226    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456228    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456231    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456233    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456236    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456238    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456241    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456244    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456246    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:41:28.462352 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456248    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456251    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456253    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456256    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456259    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456267    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456270    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456273    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456275    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456277    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456293    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456297    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456301    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456304    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456306    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456308    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456311    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456313    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456316    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:41:28.462806 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456318    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456320    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456323    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456326    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456328    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456330    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456333    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456335    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456337    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456340    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456342    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456345    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456347    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456349    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456352    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456354    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456356    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456359    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456361    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:41:28.463310 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456369    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456372    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456375    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456377    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456380    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456382    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456385    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456388    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456390    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456392    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456395    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456397    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456400    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456402    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456405    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456407    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456410    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456412    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:41:28.463750 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456415    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.456442    2543 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456638    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456643    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456646    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456649    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456651    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456655    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456658    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456660    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456663    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456665    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456668    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456670    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456673    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456681    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:41:28.464162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456683    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456686    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456688    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456691    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456693    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456696    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456698    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456701    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456703    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456706    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456708    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456711    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456713    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456717    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456721    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456723    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456726    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456728    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456731    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:41:28.464778 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456734    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456736    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456739    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456741    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456744    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456746    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456749    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456752    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456754    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456757    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456760    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456762    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456765    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456773    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456776    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456778    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456781    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456783    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456785    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456788    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:41:28.465505 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456790    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456793    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456809    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456817    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456820    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456823    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456826    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456829    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456831    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456834    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456843    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456846    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456849    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456852    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456855    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456857    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456860    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456862    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456865    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456867    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:41:28.466061 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456870    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456872    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456875    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456877    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456880    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456882    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456890    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456893    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456896    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456899    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456903    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456906    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456908    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456911    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456914    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456918    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456920    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456923    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456925    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:41:28.466686 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456928    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456930    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456933    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456935    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456938    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456940    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456943    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456945    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456947    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456950    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456952    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456955    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456957    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.456959    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.456982    2543 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457021    2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457025    2543 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:41:28.467165 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457028    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457031    2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457034    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457042    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457045    2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457047    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457049    2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457052    2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457054    2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457057    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457059    2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457063    2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457066    2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457068    2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457071    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457073    2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457075    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457078    2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457081    2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457083    2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:41:28.467579 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457085    2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457088    2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457090    2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457093    2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457095    2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457098    2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457100    2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457102    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457105    2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457107    2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457110    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457112    2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457114    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457117    2543 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457119    2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457121    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457129    2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457132    2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457136    2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:41:28.468084 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457140    2543 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457143    2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457145    2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457148    2543 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457152    2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457155    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457157    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457160    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457162    2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457164    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457168    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457171    2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457173    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457176    2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457178    2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457181    2543 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457183    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457186    2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457188    2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457191    2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:41:28.468568 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457193    2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457196    2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457199    2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457202    2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457204    2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457207    2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457210    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457212    2543 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457215    2543 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457217    2543 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457225    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457228    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457230    2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457232    2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457235    2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457238    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457241    2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457243    2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457246    2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457249    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:41:28.469045 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457251    2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457254    2543 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457259    2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457261    2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457264    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457266    2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457269    2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457271    2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457274    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457276    2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457291    2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457294    2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457297    2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457299    2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457304    2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457307    2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457310    2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457312    2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457315    2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:41:28.469538 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457317    2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:41:28.469967 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457319    2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:41:28.469967 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457322    2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:41:28.469967 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457324    2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:41:28.469967 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457333    2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:41:28.469967 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:28.457335    2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:41:28.469967 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.457384    2543 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 02:41:28.469967 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.459533    2543 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 02:41:28.469967 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.460536    2543 server.go:1014] "Starting client certificate rotation"
Oct 30 02:41:28.469967 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.460637    2543 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 02:41:28.469967 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.460666    2543 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 02:41:28.469967 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.462882    2543 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 02:41:28.469967 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.467562    2543 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 02:41:28.492398 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.492378    2543 log.go:25] "Validated CRI v1 runtime API"
Oct 30 02:41:28.494840 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.494823    2543 log.go:25] "Validated CRI v1 image API"
Oct 30 02:41:28.495661 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.495639    2543 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 02:41:28.499854 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.499828    2543 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 db969b9d-dbdd-467e-9156-6ba8e20256d8:/dev/nvme0n1p3 e2b5786c-1779-4a87-9ca0-48cfa43c0c7d:/dev/nvme0n1p4]
Oct 30 02:41:28.499927 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.499853    2543 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 02:41:28.505011 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.504902    2543 manager.go:217] Machine: {Timestamp:2026-10-30 02:41:28.503589388 +0000 UTC m=+0.361064527 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091423 MemoryCapacity:32812011520 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ae21d24e2653e50e65ff16d20b756 SystemUUID:ec2ae21d-24e2-653e-50e6-5ff16d20b756 BootID:737f32ff-2577-4b1a-9960-226050d0c06e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406003712 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cc:af:f4:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cc:af:f4:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:e4:6b:54:98:bd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812011520 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 02:41:28.505011 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.505010    2543 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 02:41:28.505127 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.505088    2543 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 02:41:28.506407 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.506374    2543 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 02:41:28.506602 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.506412    2543 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 02:41:28.507065 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.507051    2543 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 02:41:28.507106 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.507068    2543 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 02:41:28.507106 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.507089    2543 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 02:41:28.507106 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.507101    2543 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 02:41:28.507895 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.507885    2543 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 02:41:28.510498 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.510486    2543 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 02:41:28.510620 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.510611    2543 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 02:41:28.511263 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.511253    2543 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 02:41:28.511307 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.511271    2543 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 02:41:28.511307 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.511304    2543 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 02:41:28.511365 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.511319    2543 kubelet.go:405] "Adding apiserver pod source"
Oct 30 02:41:28.511365 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.511331    2543 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 02:41:28.511723 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.511712    2543 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 02:41:28.514112 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.514084    2543 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 02:41:28.518775 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.518760    2543 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 02:41:28.519819 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.519800    2543 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 02:41:28.519911 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.519846    2543 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 02:41:28.520073 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.520058    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 02:41:28.520132 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.520082    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 02:41:28.520132 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.520092    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 02:41:28.520132 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.520101    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 02:41:28.520132 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.520112    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 02:41:28.520132 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.520122    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 02:41:28.520635 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.520615    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 02:41:28.520635 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.520632    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 02:41:28.520771 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.520654    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 02:41:28.520771 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.520664    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 02:41:28.520771 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.520679    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 02:41:28.520771 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.520693    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 02:41:28.521944 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.521923    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 02:41:28.521944 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.521943    2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 02:41:28.526572 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.526559    2543 server.go:1263] "Started kubelet"
Oct 30 02:41:28.526678 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.526618    2543 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 02:41:28.526769 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.526716    2543 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 02:41:28.526821 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.526794    2543 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 02:41:28.527341 ip-10-0-128-202 systemd[1]: Started Kubernetes Kubelet.
Oct 30 02:41:28.528177 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.528003    2543 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 02:41:28.528349 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.528257    2543 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 02:41:28.532746 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.532725    2543 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 02:41:28.532746 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.532734    2543 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 02:41:28.532873 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.532791    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:28.533373 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.533354    2543 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 02:41:28.533373 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.533356    2543 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 02:41:28.533511 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.533387    2543 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 02:41:28.533511 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.533456    2543 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 02:41:28.533511 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.533467    2543 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 02:41:28.533660 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.533517    2543 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 02:41:28.534032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.534016    2543 factory.go:153] Registering CRI-O factory
Oct 30 02:41:28.534032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.534032    2543 factory.go:223] Registration of the crio container factory successfully
Oct 30 02:41:28.534145 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.534076    2543 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 02:41:28.534145 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.534082    2543 factory.go:55] Registering systemd factory
Oct 30 02:41:28.534145 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.534088    2543 factory.go:223] Registration of the systemd container factory successfully
Oct 30 02:41:28.534145 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.534101    2543 factory.go:103] Registering Raw factory
Oct 30 02:41:28.534145 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.534121    2543 manager.go:1199] Started watching for new ooms in manager
Oct 30 02:41:28.535048 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.535029    2543 manager.go:319] Starting recovery of all containers
Oct 30 02:41:28.545947 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.545926    2543 manager.go:324] Recovery completed
Oct 30 02:41:28.548206 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.548153    2543 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 02:41:28.551248 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.551234    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:41:28.553008 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.552987    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:41:28.553077 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.553021    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:41:28.553077 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.553030    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:41:28.553608 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.553596    2543 cpu_manager.go:226] "Starting" policy="none"
Oct 30 02:41:28.553608 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.553605    2543 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 02:41:28.553718 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.553608    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:41:28.553718 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.553619    2543 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 02:41:28.554299 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.554266    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:41:28.554379 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.554327    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:41:28.554379 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.554338    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:41:28.554756 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.554746    2543 policy_none.go:50] "Start"
Oct 30 02:41:28.554794 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.554765    2543 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 02:41:28.554794 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.554777    2543 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 02:41:28.555705 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.555694    2543 policy_none.go:44] "Start"
Oct 30 02:41:28.556176 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.556161    2543 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 02:41:28.556229 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.556218    2543 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-589mz"
Oct 30 02:41:28.557608 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.557593    2543 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-202.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 02:41:28.558664 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.557685    2543 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-202.ec2.internal.18e32e65225aad5b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-202.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-202.ec2.internal,},FirstTimestamp:2026-10-30 02:41:28.526531931 +0000 UTC m=+0.384007071,LastTimestamp:2026-10-30 02:41:28.526531931 +0000 UTC m=+0.384007071,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-202.ec2.internal,}"
Oct 30 02:41:28.559120 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.559105    2543 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-589mz"
Oct 30 02:41:28.565147 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.565129    2543 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 02:41:28.565240 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.565218    2543 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 02:41:28.582756 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.582736    2543 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:41:28.595898 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.595867    2543 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 02:41:28.598125 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.598105    2543 manager.go:341] "Starting Device Plugin manager"
Oct 30 02:41:28.598173 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.598143    2543 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 02:41:28.598173 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.598152    2543 server.go:87] "Starting device plugin registration server"
Oct 30 02:41:28.598422 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.598408    2543 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 02:41:28.598495 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.598422    2543 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 02:41:28.598495 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.598488    2543 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 02:41:28.598597 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.598564    2543 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 02:41:28.598597 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.598573    2543 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 02:41:28.599046 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.599021    2543 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 02:41:28.599122 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.599066    2543 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:28.669983 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.669959    2543 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 02:41:28.671335 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.671319    2543 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 02:41:28.671397 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.671343    2543 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 02:41:28.671397 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.671366    2543 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 02:41:28.671469 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.671405    2543 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 02:41:28.687758 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.687706    2543 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:41:28.698798 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.698784    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:41:28.699725 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.699710    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:41:28.699787 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.699741    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:41:28.699787 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.699752    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:41:28.699787 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.699778    2543 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.721624 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.721600    2543 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.721624 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.721626    2543 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-202.ec2.internal\": node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:28.772492 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.772468    2543 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"]
Oct 30 02:41:28.772615 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.772524    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:41:28.773326 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.773311    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:28.773458 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.773447    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:41:28.773505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.773474    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:41:28.773505 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.773483    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:41:28.774869 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.774857    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:41:28.775020 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.775003    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.775081 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.775049    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:41:28.775597 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.775575    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:41:28.775597 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.775594    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:41:28.775732 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.775604    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:41:28.775732 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.775609    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:41:28.775732 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.775614    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:41:28.775732 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.775618    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:41:28.776732 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.776717    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.776806 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.776741    2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:41:28.777488 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.777472    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:41:28.777573 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.777496    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:41:28.777573 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.777508    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:41:28.801789 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.801766    2543 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-202.ec2.internal\" not found" node="ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.805331 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.805316    2543 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-202.ec2.internal\" not found" node="ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.834554 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.834536    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d8efc8ec06fad6f0d8086d712252ab5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" (UID: \"7d8efc8ec06fad6f0d8086d712252ab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.834638 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.834560    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d8efc8ec06fad6f0d8086d712252ab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" (UID: \"7d8efc8ec06fad6f0d8086d712252ab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.834638 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.834585    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ce1fe095f8980ce35b373b8b077959e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-202.ec2.internal\" (UID: \"3ce1fe095f8980ce35b373b8b077959e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.873683 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.873661    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:28.935010 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.934837    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ce1fe095f8980ce35b373b8b077959e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-202.ec2.internal\" (UID: \"3ce1fe095f8980ce35b373b8b077959e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.935010 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.934921    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ce1fe095f8980ce35b373b8b077959e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-202.ec2.internal\" (UID: \"3ce1fe095f8980ce35b373b8b077959e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.935122 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.935040    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d8efc8ec06fad6f0d8086d712252ab5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" (UID: \"7d8efc8ec06fad6f0d8086d712252ab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.935122 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.935061    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d8efc8ec06fad6f0d8086d712252ab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" (UID: \"7d8efc8ec06fad6f0d8086d712252ab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.935122 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.935065    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d8efc8ec06fad6f0d8086d712252ab5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" (UID: \"7d8efc8ec06fad6f0d8086d712252ab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.935122 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:28.935083    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d8efc8ec06fad6f0d8086d712252ab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" (UID: \"7d8efc8ec06fad6f0d8086d712252ab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:28.973861 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:28.973803    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:29.074700 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:29.074664    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:29.105408 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.105389    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:29.109376 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.109348    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:29.175278 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:29.175238    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:29.275860 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:29.275793    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:29.376958 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:29.376912    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:29.461029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.460994    2543 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 02:41:29.461528 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.461138    2543 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 02:41:29.461528 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.461173    2543 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 02:41:29.477670 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:29.477639    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:29.563007 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.562961    2543 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 02:36:29 +0000 UTC" deadline="2028-04-07 12:12:13.229587252 +0000 UTC"
Oct 30 02:41:29.563007 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.563001    2543 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12609h30m43.666590099s"
Oct 30 02:41:29.578124 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:29.578091    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:29.651656 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:29.651624    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce1fe095f8980ce35b373b8b077959e.slice/crio-52a6f15272c962215f75146f627ad7913b9620f0581d32c45d417766b4ae9879 WatchSource:0}: Error finding container 52a6f15272c962215f75146f627ad7913b9620f0581d32c45d417766b4ae9879: Status 404 returned error can't find the container with id 52a6f15272c962215f75146f627ad7913b9620f0581d32c45d417766b4ae9879
Oct 30 02:41:29.652172 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:29.652154    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8efc8ec06fad6f0d8086d712252ab5.slice/crio-0468b3905d84222e656fae1e5d1aa678e1e5287e43c7e972764e0766857dcbdd WatchSource:0}: Error finding container 0468b3905d84222e656fae1e5d1aa678e1e5287e43c7e972764e0766857dcbdd: Status 404 returned error can't find the container with id 0468b3905d84222e656fae1e5d1aa678e1e5287e43c7e972764e0766857dcbdd
Oct 30 02:41:29.656101 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.656085    2543 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 02:41:29.674552 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.674505    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal" event={"ID":"7d8efc8ec06fad6f0d8086d712252ab5","Type":"ContainerStarted","Data":"0468b3905d84222e656fae1e5d1aa678e1e5287e43c7e972764e0766857dcbdd"}
Oct 30 02:41:29.675661 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.675639    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal" event={"ID":"3ce1fe095f8980ce35b373b8b077959e","Type":"ContainerStarted","Data":"52a6f15272c962215f75146f627ad7913b9620f0581d32c45d417766b4ae9879"}
Oct 30 02:41:29.679114 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:29.679097    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:29.781893 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:29.781872    2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:41:29.819233 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.819189    2543 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:41:29.833272 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.833248    2543 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:29.860648 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.860622    2543 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:41:29.862819 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.862802    2543 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:41:29.882171 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.882147    2543 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:41:29.905202 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:29.905176    2543 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:41:30.512539 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.512506    2543 apiserver.go:52] "Watching apiserver"
Oct 30 02:41:30.534323 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.534285    2543 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 02:41:30.550790 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.550743    2543 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 02:41:30.551156 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.551134    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-76fqh","kube-system/konnectivity-agent-h6mqn","kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal","openshift-dns/node-resolver-sm872","openshift-network-diagnostics/network-check-target-jw4x2","openshift-multus/network-metrics-daemon-nhkvm","kube-system/global-pull-secret-syncer-pb6zp","openshift-image-registry/node-ca-cz9ks","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal","openshift-multus/multus-additional-cni-plugins-4n9g9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc","openshift-cluster-node-tuning-operator/tuned-lcpmf","openshift-multus/multus-bh824","openshift-network-operator/iptables-alerter-kwkx5"]
Oct 30 02:41:30.553189 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.553158    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:30.553337 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:30.553267    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:30.554625 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.554603    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.555903 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.555883    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:41:30.557117 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.557096    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sm872"
Oct 30 02:41:30.558329 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.558304    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:30.558467 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:30.558396    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:30.559568 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.559545    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:30.559659 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:30.559623    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:30.560867 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.560846    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:41:30.563154 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.563127    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.565848 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.565823    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:41:30.568411 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.568156    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.569838 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.569818    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.570893 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.570871    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6bd55\""
Oct 30 02:41:30.571002 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.570977    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 02:41:30.571069 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.571055    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 02:41:30.571160 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.571145    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 02:41:30.571229 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.571218    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 02:41:30.571582 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.571554    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.572499 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.572476    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-kxfcp\""
Oct 30 02:41:30.573740 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.573719    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:41:30.573858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.573831    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 02:41:30.577213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.576241    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2wtbz\""
Oct 30 02:41:30.577213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.576307    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 02:41:30.577213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.576487    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 02:41:30.577213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.576500    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 02:41:30.577213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.576542    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 02:41:30.577213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.576813    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 02:41:30.577213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.576915    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 02:41:30.577213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.576930    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 02:41:30.577213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.577103    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zm8vf\""
Oct 30 02:41:30.577213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.577103    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zz8vj\""
Oct 30 02:41:30.577213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.577174    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 02:41:30.577882 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.577400    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 02:41:30.578032 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.578010    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 02:41:30.582249 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.582219    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 02:41:30.582482 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.582309    2543 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 02:41:30.582560 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.582492    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 02:41:30.582627 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.582601    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 02:41:30.583345 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.583274    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-stwqd\""
Oct 30 02:41:30.585629 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.585600    2543 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-766s2"
Oct 30 02:41:30.585739 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.585659    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 02:41:30.585960 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.585937    2543 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:41:30.594638 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.594613    2543 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-766s2"
Oct 30 02:41:30.635055 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.635019    2543 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 02:41:30.646896 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.646863    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-cni-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.647074 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.646909    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7djkd\" (UniqueName: \"kubernetes.io/projected/8ed11453-6d18-4f24-a945-b312108cd664-kube-api-access-7djkd\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.647074 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.646936    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bec335ab-48e3-4940-aeea-f8f46a184eed-hosts-file\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:41:30.647074 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.646957    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-cnibin\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.647074 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.646987    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-multus-certs\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.647074 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647006    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-registration-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.647403 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647069    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-modprobe-d\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.647403 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647117    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-lib-modules\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.647403 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647181    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-ovnkube-config\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.647403 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647221    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-env-overrides\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.647403 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647246    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.647403 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647280    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-system-cni-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.647403 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647304    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c9c1786-1f61-4a8b-a780-19de703b790e-host-slash\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:41:30.647403 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647338    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-kubernetes\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.647403 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647360    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysctl-conf\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647444    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqzfw\" (UniqueName: \"kubernetes.io/projected/2291168b-f4ed-40e5-9767-afe1561cf5d5-kube-api-access-vqzfw\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647473    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-k8s-cni-cncf-io\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647498    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-daemon-config\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647528    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647557    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb2tr\" (UniqueName: \"kubernetes.io/projected/e337e618-cdd3-4496-858f-4f61c4622859-kube-api-access-qb2tr\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647581    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-cnibin\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647608    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c9c1786-1f61-4a8b-a780-19de703b790e-iptables-alerter-script\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647634    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-ovn\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647730    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-systemd\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647771    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87cca6f3-8578-41cd-ba4a-da8798608de9-host\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647803    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cc2t\" (UniqueName: \"kubernetes.io/projected/7f1c39ff-4766-4915-8cd2-2ff6730302fb-kube-api-access-6cc2t\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647820    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647838    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8cf619f-9892-48d5-911e-5f7432d945ec-kubelet-config\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:30.647858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647854    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-systemd-units\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647887    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-etc-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647912    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-netns\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647939    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-run\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647973    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-sys\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.647998    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-host\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648044    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-socket-dir-parent\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648072    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648100    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-var-lib-kubelet\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648127    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648150    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec335ab-48e3-4940-aeea-f8f46a184eed-tmp-dir\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648274    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-log-socket\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648305    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-cni-bin\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648339    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87cca6f3-8578-41cd-ba4a-da8798608de9-serviceca\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648376    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-conf-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648406    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-systemd\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648423    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-system-cni-dir\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.648578 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648451    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d\") pod \"network-check-target-jw4x2\" (UID: \"416971fa-0af3-448e-b81c-48c6d02bdbb5\") " pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648481    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-etc-selinux\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648499    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-var-lib-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648523    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-run-ovn-kubernetes\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648573    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-etc-kubernetes\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648596    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pscxj\" (UniqueName: \"kubernetes.io/projected/87cca6f3-8578-41cd-ba4a-da8798608de9-kube-api-access-pscxj\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648621    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-tuned\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648656    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-run-netns\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648681    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-cni-netd\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648724    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e337e618-cdd3-4496-858f-4f61c4622859-ovn-node-metrics-cert\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648758    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-cni-bin\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648782    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-cni-multus\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648800    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-hostroot\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648825    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-node-log\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648846    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-sys-fs\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648864    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48a605d4-42c2-4362-b230-08a10ab9dec6-agent-certs\") pod \"konnectivity-agent-h6mqn\" (UID: \"48a605d4-42c2-4362-b230-08a10ab9dec6\") " pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:41:30.649418 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648900    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-socket-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648935    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-device-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648961    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-slash\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.648985    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-kubelet\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649031    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8cf619f-9892-48d5-911e-5f7432d945ec-dbus\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649050    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-ovnkube-script-lib\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649069    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5476\" (UniqueName: \"kubernetes.io/projected/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-kube-api-access-b5476\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649093    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysctl-d\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649349    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prxbd\" (UniqueName: \"kubernetes.io/projected/43923788-5bf7-4b82-b721-4ae9c7acf9e6-kube-api-access-prxbd\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649402    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-kubelet\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649456    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649489    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649530    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-cni-binary-copy\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649567    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzcqx\" (UniqueName: \"kubernetes.io/projected/6c9c1786-1f61-4a8b-a780-19de703b790e-kube-api-access-jzcqx\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649598    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48a605d4-42c2-4362-b230-08a10ab9dec6-konnectivity-ca\") pod \"konnectivity-agent-h6mqn\" (UID: \"48a605d4-42c2-4362-b230-08a10ab9dec6\") " pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649618    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysconfig\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.650218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649633    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43923788-5bf7-4b82-b721-4ae9c7acf9e6-tmp\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.651069 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649650    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2rzs\" (UniqueName: \"kubernetes.io/projected/bec335ab-48e3-4940-aeea-f8f46a184eed-kube-api-access-k2rzs\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:41:30.651069 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649680    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:30.651069 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.649713    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.680010 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.679677    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 02:41:30.680010 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.679722    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 02:41:30.680010 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.679769    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 02:41:30.680010 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.679967    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 02:41:30.680432 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.680022    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:41:30.680531 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.680513    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 02:41:30.680623 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.680552    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hjgzr\""
Oct 30 02:41:30.680682 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.680643    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-29rqz\""
Oct 30 02:41:30.680736 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.680689    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vzqmp\""
Oct 30 02:41:30.680736 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.680700    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 02:41:30.750516 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750473    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-etc-kubernetes\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.750719 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750557    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pscxj\" (UniqueName: \"kubernetes.io/projected/87cca6f3-8578-41cd-ba4a-da8798608de9-kube-api-access-pscxj\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:41:30.750719 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750592    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-tuned\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.750719 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750638    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-etc-kubernetes\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.750719 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750641    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-run-netns\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.750719 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750690    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-run-netns\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.750719 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750706    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-cni-netd\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.751033 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750737    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e337e618-cdd3-4496-858f-4f61c4622859-ovn-node-metrics-cert\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.751033 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750763    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-cni-bin\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.751033 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750792    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-cni-multus\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.751033 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750817    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-hostroot\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.751033 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750852    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-node-log\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.751033 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750879    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-sys-fs\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.751033 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750906    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48a605d4-42c2-4362-b230-08a10ab9dec6-agent-certs\") pod \"konnectivity-agent-h6mqn\" (UID: \"48a605d4-42c2-4362-b230-08a10ab9dec6\") " pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:41:30.751033 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750932    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-socket-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.751033 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750973    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-device-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.751033 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.750998    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-slash\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.751033 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751025    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-kubelet\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751050    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8cf619f-9892-48d5-911e-5f7432d945ec-dbus\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751075    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-ovnkube-script-lib\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751100    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5476\" (UniqueName: \"kubernetes.io/projected/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-kube-api-access-b5476\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751109    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-node-log\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751132    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysctl-d\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751159    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prxbd\" (UniqueName: \"kubernetes.io/projected/43923788-5bf7-4b82-b721-4ae9c7acf9e6-kube-api-access-prxbd\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751172    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-cni-bin\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751190    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-kubelet\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751227    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-cni-multus\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751228    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751271    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751320    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-cni-binary-copy\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751349    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzcqx\" (UniqueName: \"kubernetes.io/projected/6c9c1786-1f61-4a8b-a780-19de703b790e-kube-api-access-jzcqx\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751377    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48a605d4-42c2-4362-b230-08a10ab9dec6-konnectivity-ca\") pod \"konnectivity-agent-h6mqn\" (UID: \"48a605d4-42c2-4362-b230-08a10ab9dec6\") " pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751403    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysconfig\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751430    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43923788-5bf7-4b82-b721-4ae9c7acf9e6-tmp\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.751634 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751464    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-cni-netd\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751488    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2rzs\" (UniqueName: \"kubernetes.io/projected/bec335ab-48e3-4940-aeea-f8f46a184eed-kube-api-access-k2rzs\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751518    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751545    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751897    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-cni-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751936    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7djkd\" (UniqueName: \"kubernetes.io/projected/8ed11453-6d18-4f24-a945-b312108cd664-kube-api-access-7djkd\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751962    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bec335ab-48e3-4940-aeea-f8f46a184eed-hosts-file\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751986    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-cnibin\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752013    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-multus-certs\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752034    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-registration-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752056    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-modprobe-d\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752080    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-lib-modules\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752106    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-ovnkube-config\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752124    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-env-overrides\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752145    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752170    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-system-cni-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752194    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c9c1786-1f61-4a8b-a780-19de703b790e-host-slash\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:41:30.752493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752214    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-kubernetes\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.753342 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752235    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysctl-conf\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.753342 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752265    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqzfw\" (UniqueName: \"kubernetes.io/projected/2291168b-f4ed-40e5-9767-afe1561cf5d5-kube-api-access-vqzfw\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.753342 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752288    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-k8s-cni-cncf-io\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.753342 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752309    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-daemon-config\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.753342 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752329    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.753342 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752375    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2tr\" (UniqueName: \"kubernetes.io/projected/e337e618-cdd3-4496-858f-4f61c4622859-kube-api-access-qb2tr\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.753342 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752409    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-cnibin\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.753342 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.753019    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.753342 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751276    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.753342 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.753060    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c9c1786-1f61-4a8b-a780-19de703b790e-iptables-alerter-script\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:41:30.753342 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.753114    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-sys-fs\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.753866 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.753410    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysconfig\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.753866 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.753425    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-hostroot\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.753866 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.753552    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-socket-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.753866 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.753649    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-cni-binary-copy\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.754064 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:30.753987    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:41:30.754120 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:30.754072    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs podName:7f1c39ff-4766-4915-8cd2-2ff6730302fb nodeName:}" failed. No retries permitted until 2026-10-30 02:41:31.254047605 +0000 UTC m=+3.111522758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs") pod "network-metrics-daemon-nhkvm" (UID: "7f1c39ff-4766-4915-8cd2-2ff6730302fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:41:30.754400 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754356    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-cni-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.754594 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754561    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.754680 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754602    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bec335ab-48e3-4940-aeea-f8f46a184eed-hosts-file\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:41:30.754741 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754694    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-cnibin\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.754799 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754773    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-registration-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.754849 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754792    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-device-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.754849 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754813    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.754849 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754822    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-env-overrides\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.754849 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754828    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-multus-certs\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.755058 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754854    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-slash\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.755058 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754912    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.755058 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754969    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8cf619f-9892-48d5-911e-5f7432d945ec-dbus\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:30.755058 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.754990    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-system-cni-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.755058 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755033    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-kubelet\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.755058 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755049    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-k8s-cni-cncf-io\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.755390 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755113    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-kubernetes\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.755390 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755259    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysctl-conf\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.755390 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.751089    2543 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 02:41:30.755559 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755410    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-ovnkube-script-lib\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.755559 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755415    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-modprobe-d\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.755559 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755436    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-ovnkube-config\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.755709 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755631    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-daemon-config\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.755709 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755636    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c9c1786-1f61-4a8b-a780-19de703b790e-host-slash\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:41:30.755817 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755742    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-cnibin\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.755817 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755754    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-lib-modules\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.755817 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755799    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-kubelet\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.755966 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.755839    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysctl-d\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.756063 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.752445    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c9c1786-1f61-4a8b-a780-19de703b790e-iptables-alerter-script\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:41:30.756138 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756104    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-ovn\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.756186 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756141    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-systemd\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.756186 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756170    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87cca6f3-8578-41cd-ba4a-da8798608de9-host\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:41:30.756277 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756176    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-ovn\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.756277 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756201    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cc2t\" (UniqueName: \"kubernetes.io/projected/7f1c39ff-4766-4915-8cd2-2ff6730302fb-kube-api-access-6cc2t\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:30.756277 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756253    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.756440 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756339    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8cf619f-9892-48d5-911e-5f7432d945ec-kubelet-config\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:30.756440 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756422    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-systemd-units\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.756536 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756460    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-etc-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.756536 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756488    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-netns\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.756536 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756501    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-systemd\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.756670 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756541    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-run\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.756670 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756562    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87cca6f3-8578-41cd-ba4a-da8798608de9-host\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:41:30.756670 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756563    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-sys\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.756670 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756590    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-host\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.756670 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756618    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-socket-dir-parent\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.756670 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756656    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.756935 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756762    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-var-lib-kubelet\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.756935 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756786    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:30.756935 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756817    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec335ab-48e3-4940-aeea-f8f46a184eed-tmp-dir\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:41:30.756935 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756847    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-log-socket\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.756935 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756900    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-cni-bin\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.757176 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.756979    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87cca6f3-8578-41cd-ba4a-da8798608de9-serviceca\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:41:30.757404 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.757345    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-conf-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.757483 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.757427    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-systemd\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.757561 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.757541    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-system-cni-dir\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.759159    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d\") pod \"network-check-target-jw4x2\" (UID: \"416971fa-0af3-448e-b81c-48c6d02bdbb5\") " pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.759205    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-etc-selinux\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.759245    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-var-lib-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.759275    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-run-ovn-kubernetes\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758092    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-etc-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758160    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-netns\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758209    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-run\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.759393    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48a605d4-42c2-4362-b230-08a10ab9dec6-konnectivity-ca\") pod \"konnectivity-agent-h6mqn\" (UID: \"48a605d4-42c2-4362-b230-08a10ab9dec6\") " pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.757955    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758338    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-log-socket\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758399    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758774    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec335ab-48e3-4940-aeea-f8f46a184eed-tmp-dir\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758813    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-var-lib-kubelet\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:30.758908    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:30.759561    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret podName:f8cf619f-9892-48d5-911e-5f7432d945ec nodeName:}" failed. No retries permitted until 2026-10-30 02:41:31.259541438 +0000 UTC m=+3.117016581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret") pod "global-pull-secret-syncer-pb6zp" (UID: "f8cf619f-9892-48d5-911e-5f7432d945ec") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758954    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-cni-bin\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.760029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758992    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-conf-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.760858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.759027    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-systemd\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.760858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.759037    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-system-cni-dir\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.760858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758258    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-sys\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.760858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.757791    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-socket-dir-parent\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.760858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.759717    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-etc-selinux\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.760858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758009    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8cf619f-9892-48d5-911e-5f7432d945ec-kubelet-config\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:30.760858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.759778    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-var-lib-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.760858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758052    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-systemd-units\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.760858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.759900    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-run-ovn-kubernetes\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.760858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758933    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87cca6f3-8578-41cd-ba4a-da8798608de9-serviceca\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:41:30.760858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.758303    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-host\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.760858 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.760121    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e337e618-cdd3-4496-858f-4f61c4622859-ovn-node-metrics-cert\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.762393 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.762369    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-tuned\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.762493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.762410    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43923788-5bf7-4b82-b721-4ae9c7acf9e6-tmp\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.762659 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.762607    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48a605d4-42c2-4362-b230-08a10ab9dec6-agent-certs\") pod \"konnectivity-agent-h6mqn\" (UID: \"48a605d4-42c2-4362-b230-08a10ab9dec6\") " pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:41:30.780689 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.780304    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzcqx\" (UniqueName: \"kubernetes.io/projected/6c9c1786-1f61-4a8b-a780-19de703b790e-kube-api-access-jzcqx\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:41:30.780906 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.780880    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2rzs\" (UniqueName: \"kubernetes.io/projected/bec335ab-48e3-4940-aeea-f8f46a184eed-kube-api-access-k2rzs\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:41:30.781684 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:30.781631    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:41:30.781684 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:30.781681    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:41:30.781819 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:30.781697    2543 projected.go:196] Error preparing data for projected volume kube-api-access-bx28d for pod openshift-network-diagnostics/network-check-target-jw4x2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:41:30.781819 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:30.781797    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d podName:416971fa-0af3-448e-b81c-48c6d02bdbb5 nodeName:}" failed. No retries permitted until 2026-10-30 02:41:31.281774833 +0000 UTC m=+3.139249986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bx28d" (UniqueName: "kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d") pod "network-check-target-jw4x2" (UID: "416971fa-0af3-448e-b81c-48c6d02bdbb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:41:30.782590 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.782534    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cc2t\" (UniqueName: \"kubernetes.io/projected/7f1c39ff-4766-4915-8cd2-2ff6730302fb-kube-api-access-6cc2t\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:30.783116 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.783095    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7djkd\" (UniqueName: \"kubernetes.io/projected/8ed11453-6d18-4f24-a945-b312108cd664-kube-api-access-7djkd\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.784373 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.784338    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb2tr\" (UniqueName: \"kubernetes.io/projected/e337e618-cdd3-4496-858f-4f61c4622859-kube-api-access-qb2tr\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.785694 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.785665    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prxbd\" (UniqueName: \"kubernetes.io/projected/43923788-5bf7-4b82-b721-4ae9c7acf9e6-kube-api-access-prxbd\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.787424 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.787349    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pscxj\" (UniqueName: \"kubernetes.io/projected/87cca6f3-8578-41cd-ba4a-da8798608de9-kube-api-access-pscxj\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:41:30.787424 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.787402    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqzfw\" (UniqueName: \"kubernetes.io/projected/2291168b-f4ed-40e5-9767-afe1561cf5d5-kube-api-access-vqzfw\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.788777 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.788756    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5476\" (UniqueName: \"kubernetes.io/projected/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-kube-api-access-b5476\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.858874 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.858831    2543 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:41:30.870490 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.870456    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bh824"
Oct 30 02:41:30.883260 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.883236    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:41:30.894611 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:30.894575    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9c1786_1f61_4a8b_a780_19de703b790e.slice/crio-52ce237b0f14b3329fd2e1d0e7947be79fda363b4603fc28d595fb7596c4ef55 WatchSource:0}: Error finding container 52ce237b0f14b3329fd2e1d0e7947be79fda363b4603fc28d595fb7596c4ef55: Status 404 returned error can't find the container with id 52ce237b0f14b3329fd2e1d0e7947be79fda363b4603fc28d595fb7596c4ef55
Oct 30 02:41:30.897836 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.897805    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sm872"
Oct 30 02:41:30.900115 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.900089    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:41:30.910911 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:30.910871    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec335ab_48e3_4940_aeea_f8f46a184eed.slice/crio-d2444ea7c885c4958ef04cbcf4042aab78d8a77d3f235d54cf71d346e36b1d33 WatchSource:0}: Error finding container d2444ea7c885c4958ef04cbcf4042aab78d8a77d3f235d54cf71d346e36b1d33: Status 404 returned error can't find the container with id d2444ea7c885c4958ef04cbcf4042aab78d8a77d3f235d54cf71d346e36b1d33
Oct 30 02:41:30.913064 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:30.912976    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cca6f3_8578_41cd_ba4a_da8798608de9.slice/crio-2877d8a1b2bd48f629256a9211fcf68bfe798c7e04342c0eb490691961f4ae14 WatchSource:0}: Error finding container 2877d8a1b2bd48f629256a9211fcf68bfe798c7e04342c0eb490691961f4ae14: Status 404 returned error can't find the container with id 2877d8a1b2bd48f629256a9211fcf68bfe798c7e04342c0eb490691961f4ae14
Oct 30 02:41:30.919221 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.919198    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:30.920678 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.920655    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:41:30.932164 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:30.932124    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode337e618_cdd3_4496_858f_4f61c4622859.slice/crio-799a05beabe541b1f12fac7abfab3b786d7d278467a29d04d8eeba1433a25b2a WatchSource:0}: Error finding container 799a05beabe541b1f12fac7abfab3b786d7d278467a29d04d8eeba1433a25b2a: Status 404 returned error can't find the container with id 799a05beabe541b1f12fac7abfab3b786d7d278467a29d04d8eeba1433a25b2a
Oct 30 02:41:30.934177 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.934149    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:41:30.935144 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:30.935121    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a605d4_42c2_4362_b230_08a10ab9dec6.slice/crio-4a568a28b0ebde9bdbb7fb1d184b81676106192bba4199235a5731a1ef81d9eb WatchSource:0}: Error finding container 4a568a28b0ebde9bdbb7fb1d184b81676106192bba4199235a5731a1ef81d9eb: Status 404 returned error can't find the container with id 4a568a28b0ebde9bdbb7fb1d184b81676106192bba4199235a5731a1ef81d9eb
Oct 30 02:41:30.938899 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.938874    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:41:30.944784 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:30.944755    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:41:30.952746 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:30.952714    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2291168b_f4ed_40e5_9767_afe1561cf5d5.slice/crio-0f15cd4316a0773284414e662b8dfe0049acdc57d31d7728671ab16b2b5a8d71 WatchSource:0}: Error finding container 0f15cd4316a0773284414e662b8dfe0049acdc57d31d7728671ab16b2b5a8d71: Status 404 returned error can't find the container with id 0f15cd4316a0773284414e662b8dfe0049acdc57d31d7728671ab16b2b5a8d71
Oct 30 02:41:30.953273 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:30.953247    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed11453_6d18_4f24_a945_b312108cd664.slice/crio-6c2a3fc39f445a1db2115843110f0dc5d7f729c32f2d4af779d94c6da55cc2f2 WatchSource:0}: Error finding container 6c2a3fc39f445a1db2115843110f0dc5d7f729c32f2d4af779d94c6da55cc2f2: Status 404 returned error can't find the container with id 6c2a3fc39f445a1db2115843110f0dc5d7f729c32f2d4af779d94c6da55cc2f2
Oct 30 02:41:30.957394 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:41:30.957340    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43923788_5bf7_4b82_b721_4ae9c7acf9e6.slice/crio-2e49d75fa94270f38775f3c7636bd6e0f14d486630ec2dbdb2225272c97f1eba WatchSource:0}: Error finding container 2e49d75fa94270f38775f3c7636bd6e0f14d486630ec2dbdb2225272c97f1eba: Status 404 returned error can't find the container with id 2e49d75fa94270f38775f3c7636bd6e0f14d486630ec2dbdb2225272c97f1eba
Oct 30 02:41:31.263717 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.263680    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:31.263837 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.263758    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:31.263900 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:31.263859    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:41:31.263900 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:31.263889    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:41:31.264005 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:31.263954    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs podName:7f1c39ff-4766-4915-8cd2-2ff6730302fb nodeName:}" failed. No retries permitted until 2026-10-30 02:41:32.263920251 +0000 UTC m=+4.121395401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs") pod "network-metrics-daemon-nhkvm" (UID: "7f1c39ff-4766-4915-8cd2-2ff6730302fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:41:31.264005 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:31.263979    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret podName:f8cf619f-9892-48d5-911e-5f7432d945ec nodeName:}" failed. No retries permitted until 2026-10-30 02:41:32.263966923 +0000 UTC m=+4.121442054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret") pod "global-pull-secret-syncer-pb6zp" (UID: "f8cf619f-9892-48d5-911e-5f7432d945ec") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:41:31.365179 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.365129    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d\") pod \"network-check-target-jw4x2\" (UID: \"416971fa-0af3-448e-b81c-48c6d02bdbb5\") " pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:31.365506 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:31.365394    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:41:31.365506 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:31.365422    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:41:31.365506 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:31.365437    2543 projected.go:196] Error preparing data for projected volume kube-api-access-bx28d for pod openshift-network-diagnostics/network-check-target-jw4x2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:41:31.365661 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:31.365511    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d podName:416971fa-0af3-448e-b81c-48c6d02bdbb5 nodeName:}" failed. No retries permitted until 2026-10-30 02:41:32.365488528 +0000 UTC m=+4.222963676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bx28d" (UniqueName: "kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d") pod "network-check-target-jw4x2" (UID: "416971fa-0af3-448e-b81c-48c6d02bdbb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:41:31.600350 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.599954    2543 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 02:36:31 +0000 UTC" deadline="2028-05-17 16:38:12.19850365 +0000 UTC"
Oct 30 02:41:31.600350 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.600307    2543 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13573h56m40.598203536s"
Oct 30 02:41:31.671811 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.671772    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:31.672008 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:31.671929    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:31.692103 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.691969    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lcpmf" event={"ID":"43923788-5bf7-4b82-b721-4ae9c7acf9e6","Type":"ContainerStarted","Data":"2e49d75fa94270f38775f3c7636bd6e0f14d486630ec2dbdb2225272c97f1eba"}
Oct 30 02:41:31.711734 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.711686    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h6mqn" event={"ID":"48a605d4-42c2-4362-b230-08a10ab9dec6","Type":"ContainerStarted","Data":"4a568a28b0ebde9bdbb7fb1d184b81676106192bba4199235a5731a1ef81d9eb"}
Oct 30 02:41:31.724179 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.724072    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh" event={"ID":"e337e618-cdd3-4496-858f-4f61c4622859","Type":"ContainerStarted","Data":"799a05beabe541b1f12fac7abfab3b786d7d278467a29d04d8eeba1433a25b2a"}
Oct 30 02:41:31.726399 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.726367    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cz9ks" event={"ID":"87cca6f3-8578-41cd-ba4a-da8798608de9","Type":"ContainerStarted","Data":"2877d8a1b2bd48f629256a9211fcf68bfe798c7e04342c0eb490691961f4ae14"}
Oct 30 02:41:31.747863 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.747822    2543 generic.go:356] "Generic (PLEG): container finished" podID="7d8efc8ec06fad6f0d8086d712252ab5" containerID="0540b99e2771264e27653ae227fca9b23db84864249bd6034683a84a81e5e116" exitCode=0
Oct 30 02:41:31.748081 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.747946    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal" event={"ID":"7d8efc8ec06fad6f0d8086d712252ab5","Type":"ContainerDied","Data":"0540b99e2771264e27653ae227fca9b23db84864249bd6034683a84a81e5e116"}
Oct 30 02:41:31.790019 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.789978    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal" event={"ID":"3ce1fe095f8980ce35b373b8b077959e","Type":"ContainerStarted","Data":"dbc5a84f46f78ed57442b15af0fa4163dd55b8bd22e234c58ba824a0e9c3bbbf"}
Oct 30 02:41:31.798328 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.798218    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc" event={"ID":"8ed11453-6d18-4f24-a945-b312108cd664","Type":"ContainerStarted","Data":"6c2a3fc39f445a1db2115843110f0dc5d7f729c32f2d4af779d94c6da55cc2f2"}
Oct 30 02:41:31.815091 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.815005    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n9g9" event={"ID":"2291168b-f4ed-40e5-9767-afe1561cf5d5","Type":"ContainerStarted","Data":"0f15cd4316a0773284414e662b8dfe0049acdc57d31d7728671ab16b2b5a8d71"}
Oct 30 02:41:31.831597 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.831548    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal" podStartSLOduration=1.831533708 podStartE2EDuration="1.831533708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:41:31.830351481 +0000 UTC m=+3.687826636" watchObservedRunningTime="2026-10-30 02:41:31.831533708 +0000 UTC m=+3.689008860"
Oct 30 02:41:31.850988 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.850779    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sm872" event={"ID":"bec335ab-48e3-4940-aeea-f8f46a184eed","Type":"ContainerStarted","Data":"d2444ea7c885c4958ef04cbcf4042aab78d8a77d3f235d54cf71d346e36b1d33"}
Oct 30 02:41:31.870340 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.869411    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kwkx5" event={"ID":"6c9c1786-1f61-4a8b-a780-19de703b790e","Type":"ContainerStarted","Data":"52ce237b0f14b3329fd2e1d0e7947be79fda363b4603fc28d595fb7596c4ef55"}
Oct 30 02:41:31.878564 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:31.878484    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bh824" event={"ID":"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39","Type":"ContainerStarted","Data":"93c3c75c581bd6f1d86ad0aca5a267191a11ef1ecb5eb7487c8246267174fc2e"}
Oct 30 02:41:32.273859 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:32.273141    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:32.273859 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:32.273193    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:32.273859 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:32.273299    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:41:32.273859 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:32.273360    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs podName:7f1c39ff-4766-4915-8cd2-2ff6730302fb nodeName:}" failed. No retries permitted until 2026-10-30 02:41:34.273347619 +0000 UTC m=+6.130822748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs") pod "network-metrics-daemon-nhkvm" (UID: "7f1c39ff-4766-4915-8cd2-2ff6730302fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:41:32.273859 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:32.273721    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:41:32.273859 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:32.273760    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret podName:f8cf619f-9892-48d5-911e-5f7432d945ec nodeName:}" failed. No retries permitted until 2026-10-30 02:41:34.273750197 +0000 UTC m=+6.131225340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret") pod "global-pull-secret-syncer-pb6zp" (UID: "f8cf619f-9892-48d5-911e-5f7432d945ec") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:41:32.374509 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:32.374466    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d\") pod \"network-check-target-jw4x2\" (UID: \"416971fa-0af3-448e-b81c-48c6d02bdbb5\") " pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:32.374713 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:32.374641    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:41:32.374713 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:32.374662    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:41:32.374713 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:32.374675    2543 projected.go:196] Error preparing data for projected volume kube-api-access-bx28d for pod openshift-network-diagnostics/network-check-target-jw4x2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:41:32.374875 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:32.374738    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d podName:416971fa-0af3-448e-b81c-48c6d02bdbb5 nodeName:}" failed. No retries permitted until 2026-10-30 02:41:34.374718012 +0000 UTC m=+6.232193147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bx28d" (UniqueName: "kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d") pod "network-check-target-jw4x2" (UID: "416971fa-0af3-448e-b81c-48c6d02bdbb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:41:32.600549 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:32.600449    2543 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 02:36:31 +0000 UTC" deadline="2028-08-15 21:42:33.242315314 +0000 UTC"
Oct 30 02:41:32.600549 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:32.600496    2543 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15739h1m0.641823674s"
Oct 30 02:41:32.681078 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:32.674711    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:32.681078 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:32.674858    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:32.681078 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:32.675267    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:32.681078 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:32.675392    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:32.898950 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:32.898815    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal" event={"ID":"7d8efc8ec06fad6f0d8086d712252ab5","Type":"ContainerStarted","Data":"e2df3916e29b41efca96050e847d2616a8923c19f0def337716c1c3d4e598848"}
Oct 30 02:41:33.672174 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:33.671588    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:33.672174 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:33.671747    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:33.914222 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:33.913724    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n9g9" event={"ID":"2291168b-f4ed-40e5-9767-afe1561cf5d5","Type":"ContainerStarted","Data":"856f8b9afb0381f141779479095830e67e111b490a676430e39a9544f08d0b6f"}
Oct 30 02:41:33.979667 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:33.979610    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal" podStartSLOduration=3.97959356 podStartE2EDuration="3.97959356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:41:32.937667512 +0000 UTC m=+4.795142665" watchObservedRunningTime="2026-10-30 02:41:33.97959356 +0000 UTC m=+5.837068712"
Oct 30 02:41:34.289721 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:34.289632    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:34.289896 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:34.289721    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:34.289896 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:34.289864    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:41:34.290011 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:34.289927    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs podName:7f1c39ff-4766-4915-8cd2-2ff6730302fb nodeName:}" failed. No retries permitted until 2026-10-30 02:41:38.28990777 +0000 UTC m=+10.147382913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs") pod "network-metrics-daemon-nhkvm" (UID: "7f1c39ff-4766-4915-8cd2-2ff6730302fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:41:34.290260 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:34.290240    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:41:34.290407 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:34.290284    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret podName:f8cf619f-9892-48d5-911e-5f7432d945ec nodeName:}" failed. No retries permitted until 2026-10-30 02:41:38.290274299 +0000 UTC m=+10.147749442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret") pod "global-pull-secret-syncer-pb6zp" (UID: "f8cf619f-9892-48d5-911e-5f7432d945ec") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:41:34.390837 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:34.390096    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d\") pod \"network-check-target-jw4x2\" (UID: \"416971fa-0af3-448e-b81c-48c6d02bdbb5\") " pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:34.390837 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:34.390310    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:41:34.390837 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:34.390357    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:41:34.390837 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:34.390375    2543 projected.go:196] Error preparing data for projected volume kube-api-access-bx28d for pod openshift-network-diagnostics/network-check-target-jw4x2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:41:34.390837 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:34.390443    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d podName:416971fa-0af3-448e-b81c-48c6d02bdbb5 nodeName:}" failed. No retries permitted until 2026-10-30 02:41:38.39042292 +0000 UTC m=+10.247898065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bx28d" (UniqueName: "kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d") pod "network-check-target-jw4x2" (UID: "416971fa-0af3-448e-b81c-48c6d02bdbb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:41:34.673633 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:34.673552    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:34.673633 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:34.673606    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:34.674198 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:34.673746    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:34.674198 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:34.674003    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:34.921259 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:34.920530    2543 generic.go:356] "Generic (PLEG): container finished" podID="2291168b-f4ed-40e5-9767-afe1561cf5d5" containerID="856f8b9afb0381f141779479095830e67e111b490a676430e39a9544f08d0b6f" exitCode=0
Oct 30 02:41:34.921259 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:34.920581    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n9g9" event={"ID":"2291168b-f4ed-40e5-9767-afe1561cf5d5","Type":"ContainerDied","Data":"856f8b9afb0381f141779479095830e67e111b490a676430e39a9544f08d0b6f"}
Oct 30 02:41:35.672616 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:35.672538    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:35.672777 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:35.672680    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:35.933009 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:35.932906    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h6mqn" event={"ID":"48a605d4-42c2-4362-b230-08a10ab9dec6","Type":"ContainerStarted","Data":"7b730981467179db336763dbe293f946de109bb417a87631113641b18d1e7560"}
Oct 30 02:41:35.971666 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:35.971256    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h6mqn" podStartSLOduration=2.890703759 podStartE2EDuration="6.971233467s" totalImagesPullingTime="4.080529708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:41:35.970366364 +0000 UTC m=+7.827841517" watchObservedRunningTime="2026-10-30 02:41:35.971233467 +0000 UTC m=+7.828708625"
Oct 30 02:41:36.673495 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:36.673410    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:36.673669 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:36.673548    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:36.674052 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:36.674031    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:36.674163 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:36.674128    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:36.939167 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:36.938898    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cz9ks" event={"ID":"87cca6f3-8578-41cd-ba4a-da8798608de9","Type":"ContainerStarted","Data":"8db14888747946291500592cc37c5395bab2fca21f081011256aa21e5f5ae6bc"}
Oct 30 02:41:36.974124 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:36.974060    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cz9ks" podStartSLOduration=2.617599159 podStartE2EDuration="7.974039953s" totalImagesPullingTime="5.356440794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:41:36.972886209 +0000 UTC m=+8.830361387" watchObservedRunningTime="2026-10-30 02:41:36.974039953 +0000 UTC m=+8.831515115"
Oct 30 02:41:37.672071 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:37.672021    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:37.672241 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:37.672134    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:37.947249 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:37.947118    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc" event={"ID":"8ed11453-6d18-4f24-a945-b312108cd664","Type":"ContainerStarted","Data":"d30bf48c11d9d80e9c969d6ceae10cbe156603848e188590de52e8aa9a088f95"}
Oct 30 02:41:38.327202 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:38.327126    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:38.327341 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:38.327218    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:38.327439 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:38.327380    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:41:38.327496 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:38.327453    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs podName:7f1c39ff-4766-4915-8cd2-2ff6730302fb nodeName:}" failed. No retries permitted until 2026-10-30 02:41:46.327430777 +0000 UTC m=+18.184905923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs") pod "network-metrics-daemon-nhkvm" (UID: "7f1c39ff-4766-4915-8cd2-2ff6730302fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:41:38.327910 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:38.327891    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:41:38.327995 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:38.327950    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret podName:f8cf619f-9892-48d5-911e-5f7432d945ec nodeName:}" failed. No retries permitted until 2026-10-30 02:41:46.327933361 +0000 UTC m=+18.185408509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret") pod "global-pull-secret-syncer-pb6zp" (UID: "f8cf619f-9892-48d5-911e-5f7432d945ec") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:41:38.428175 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:38.428141    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d\") pod \"network-check-target-jw4x2\" (UID: \"416971fa-0af3-448e-b81c-48c6d02bdbb5\") " pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:38.428351 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:38.428292    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:41:38.428351 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:38.428330    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:41:38.428351 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:38.428345    2543 projected.go:196] Error preparing data for projected volume kube-api-access-bx28d for pod openshift-network-diagnostics/network-check-target-jw4x2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:41:38.428486 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:38.428403    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d podName:416971fa-0af3-448e-b81c-48c6d02bdbb5 nodeName:}" failed. No retries permitted until 2026-10-30 02:41:46.428383718 +0000 UTC m=+18.285858872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bx28d" (UniqueName: "kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d") pod "network-check-target-jw4x2" (UID: "416971fa-0af3-448e-b81c-48c6d02bdbb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:41:38.672764 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:38.672577    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:38.672764 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:38.672628    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:38.672764 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:38.672715    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:38.673060 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:38.672775    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:38.865122 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:38.865062    2543 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 02:41:38.951803 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:38.951756    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bh824" event={"ID":"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39","Type":"ContainerStarted","Data":"59404568d42d62482796e1ba336de1158a3da13b0ea6b4f8111b6d84c1da6693"}
Oct 30 02:41:38.955101 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:38.955066    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc" event={"ID":"8ed11453-6d18-4f24-a945-b312108cd664","Type":"ContainerStarted","Data":"8893099a1a88e55292bb95bb7aec886a3e9c1a8909f61ccd7dc9fb3652c709e1"}
Oct 30 02:41:38.994365 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:38.994300    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-bh824" podStartSLOduration=2.337665846 podStartE2EDuration="9.994280079s" totalImagesPullingTime="7.656614233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:41:38.993002489 +0000 UTC m=+10.850477642" watchObservedRunningTime="2026-10-30 02:41:38.994280079 +0000 UTC m=+10.851755233"
Oct 30 02:41:39.604395 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:39.604261    2543 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T02:41:38.86507843Z","UUID":"bd5e80f2-5d74-4c79-a027-1326f291a7d0","Handler":null,"Name":"","Endpoint":""}
Oct 30 02:41:39.606534 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:39.606515    2543 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 02:41:39.606640 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:39.606543    2543 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 02:41:39.672147 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:39.671719    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:39.672147 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:39.671831    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:39.961244 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:39.961215    2543 generic.go:356] "Generic (PLEG): container finished" podID="2291168b-f4ed-40e5-9767-afe1561cf5d5" containerID="1df46a6daec16dcedad48ce23a41ab3a32ae743c287b6d673f6596a2e3a4f740" exitCode=0
Oct 30 02:41:39.961667 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:39.961530    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n9g9" event={"ID":"2291168b-f4ed-40e5-9767-afe1561cf5d5","Type":"ContainerDied","Data":"1df46a6daec16dcedad48ce23a41ab3a32ae743c287b6d673f6596a2e3a4f740"}
Oct 30 02:41:39.965448 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:39.964995    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sm872" event={"ID":"bec335ab-48e3-4940-aeea-f8f46a184eed","Type":"ContainerStarted","Data":"50bf01075e5dd1440c764be26e0d7bed1936e5bac6589a4825365839eb832feb"}
Oct 30 02:41:40.034433 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:40.034384    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-sm872" podStartSLOduration=2.573312422 podStartE2EDuration="11.034368903s" totalImagesPullingTime="8.461056481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:41:40.033591794 +0000 UTC m=+11.891066945" watchObservedRunningTime="2026-10-30 02:41:40.034368903 +0000 UTC m=+11.891844052"
Oct 30 02:41:40.510835 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:40.510764    2543 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:41:40.511452 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:40.511432    2543 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:41:40.672236 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:40.672005    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:40.672362 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:40.672053    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:40.672440 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:40.672376    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:40.672496 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:40.672467    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:40.969768 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:40.969727    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc" event={"ID":"8ed11453-6d18-4f24-a945-b312108cd664","Type":"ContainerStarted","Data":"c119bda66308d6172a4773f8556c5772b07ce785d52bbbf48c6c021b1972af28"}
Oct 30 02:41:40.972575 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:40.972537    2543 generic.go:356] "Generic (PLEG): container finished" podID="2291168b-f4ed-40e5-9767-afe1561cf5d5" containerID="84b7202c362feeb2edda2a58ee22c07b02e0aeeadc7c3d13b80c9d88a5371f96" exitCode=0
Oct 30 02:41:40.972719 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:40.972631    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n9g9" event={"ID":"2291168b-f4ed-40e5-9767-afe1561cf5d5","Type":"ContainerDied","Data":"84b7202c362feeb2edda2a58ee22c07b02e0aeeadc7c3d13b80c9d88a5371f96"}
Oct 30 02:41:40.978059 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:40.978029    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kwkx5" event={"ID":"6c9c1786-1f61-4a8b-a780-19de703b790e","Type":"ContainerStarted","Data":"815ce392b66f1017c48818e59348ec0a889d9b5be9d11a3894bd8480d973653e"}
Oct 30 02:41:41.039805 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:41.039739    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc" podStartSLOduration=3.483608936 podStartE2EDuration="12.039720554s" totalImagesPullingTime="8.556111618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:41:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:41:41.00700835 +0000 UTC m=+12.864483511" watchObservedRunningTime="2026-10-30 02:41:41.039720554 +0000 UTC m=+12.897195702"
Oct 30 02:41:41.079450 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:41.079394    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kwkx5" podStartSLOduration=3.977777353 podStartE2EDuration="12.079374374s" totalImagesPullingTime="8.101597021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:41:41.040389069 +0000 UTC m=+12.897864233" watchObservedRunningTime="2026-10-30 02:41:41.079374374 +0000 UTC m=+12.936849519"
Oct 30 02:41:41.672401 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:41.672364    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:41.672578 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:41.672502    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:41.983455 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:41.983369    2543 generic.go:356] "Generic (PLEG): container finished" podID="2291168b-f4ed-40e5-9767-afe1561cf5d5" containerID="c5034aba4c361a6fccdda990012d096c9cc0418fa2f5a3115fc9c3cfdde53913" exitCode=0
Oct 30 02:41:41.984213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:41.983469    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n9g9" event={"ID":"2291168b-f4ed-40e5-9767-afe1561cf5d5","Type":"ContainerDied","Data":"c5034aba4c361a6fccdda990012d096c9cc0418fa2f5a3115fc9c3cfdde53913"}
Oct 30 02:41:41.985385 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:41.985349    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lcpmf" event={"ID":"43923788-5bf7-4b82-b721-4ae9c7acf9e6","Type":"ContainerStarted","Data":"212351f1544dba9f0a9fd10fff473662ec4384c317d78f06c75423020b3dc309"}
Oct 30 02:41:42.672527 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:42.672482    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:42.672713 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:42.672490    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:42.672713 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:42.672627    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:42.672796 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:42.672704    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:43.671946 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:43.671907    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:43.672610 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:43.672026    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:43.993604 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:43.993564    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n9g9" event={"ID":"2291168b-f4ed-40e5-9767-afe1561cf5d5","Type":"ContainerStarted","Data":"3890022476d704e949d2f12802328bf8b59f5217a87d3bf5db56e0c900055905"}
Oct 30 02:41:44.059317 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:44.059243    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lcpmf" podStartSLOduration=4.619874465 podStartE2EDuration="15.059219432s" totalImagesPullingTime="10.439344967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:41:42.058831037 +0000 UTC m=+13.916306188" watchObservedRunningTime="2026-10-30 02:41:44.059219432 +0000 UTC m=+15.916694583"
Oct 30 02:41:44.672033 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:44.671997    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:44.672657 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:44.672152    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:44.672657 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:44.672192    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:44.672657 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:44.672338    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:44.999820 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:44.999566    2543 generic.go:356] "Generic (PLEG): container finished" podID="2291168b-f4ed-40e5-9767-afe1561cf5d5" containerID="3890022476d704e949d2f12802328bf8b59f5217a87d3bf5db56e0c900055905" exitCode=0
Oct 30 02:41:44.999820 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:44.999651    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n9g9" event={"ID":"2291168b-f4ed-40e5-9767-afe1561cf5d5","Type":"ContainerDied","Data":"3890022476d704e949d2f12802328bf8b59f5217a87d3bf5db56e0c900055905"}
Oct 30 02:41:45.672557 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:45.672526    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:45.672920 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:45.672633    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:46.005662 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:46.005632    2543 generic.go:356] "Generic (PLEG): container finished" podID="2291168b-f4ed-40e5-9767-afe1561cf5d5" containerID="0ea978e725489692a6aff274a6c883890a0a0e14930ed3e05de539351c3d74d3" exitCode=0
Oct 30 02:41:46.005769 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:46.005716    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n9g9" event={"ID":"2291168b-f4ed-40e5-9767-afe1561cf5d5","Type":"ContainerDied","Data":"0ea978e725489692a6aff274a6c883890a0a0e14930ed3e05de539351c3d74d3"}
Oct 30 02:41:46.007817 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:46.007794    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh" event={"ID":"e337e618-cdd3-4496-858f-4f61c4622859","Type":"ContainerStarted","Data":"5e308216f798d7b9befee75259dfe82df1cb5dc731f8b44eab2362631462ab0f"}
Oct 30 02:41:46.007915 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:46.007872    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh" event={"ID":"e337e618-cdd3-4496-858f-4f61c4622859","Type":"ContainerStarted","Data":"d64d2638c85e3ecdec7d5d8e29e2a83411a54611714d0d01ab8309cf27a1a714"}
Oct 30 02:41:46.391944 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:46.391762    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:46.392110 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:46.391962    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:46.392110 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:46.391908    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:41:46.392110 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:46.392056    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:41:46.392110 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:46.392065    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs podName:7f1c39ff-4766-4915-8cd2-2ff6730302fb nodeName:}" failed. No retries permitted until 2026-10-30 02:42:02.392049032 +0000 UTC m=+34.249524183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs") pod "network-metrics-daemon-nhkvm" (UID: "7f1c39ff-4766-4915-8cd2-2ff6730302fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:41:46.392110 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:46.392094    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret podName:f8cf619f-9892-48d5-911e-5f7432d945ec nodeName:}" failed. No retries permitted until 2026-10-30 02:42:02.392083912 +0000 UTC m=+34.249559067 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret") pod "global-pull-secret-syncer-pb6zp" (UID: "f8cf619f-9892-48d5-911e-5f7432d945ec") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:41:46.492463 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:46.492378    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d\") pod \"network-check-target-jw4x2\" (UID: \"416971fa-0af3-448e-b81c-48c6d02bdbb5\") " pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:46.492615 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:46.492530    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:41:46.492615 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:46.492551    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:41:46.492615 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:46.492560    2543 projected.go:196] Error preparing data for projected volume kube-api-access-bx28d for pod openshift-network-diagnostics/network-check-target-jw4x2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:41:46.492615 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:46.492608    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d podName:416971fa-0af3-448e-b81c-48c6d02bdbb5 nodeName:}" failed. No retries permitted until 2026-10-30 02:42:02.492595427 +0000 UTC m=+34.350070571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bx28d" (UniqueName: "kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d") pod "network-check-target-jw4x2" (UID: "416971fa-0af3-448e-b81c-48c6d02bdbb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:41:46.672234 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:46.672198    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:46.672234 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:46.672233    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:46.672455 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:46.672334    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:46.672455 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:46.672408    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:47.013291 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:47.013257    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh" event={"ID":"e337e618-cdd3-4496-858f-4f61c4622859","Type":"ContainerStarted","Data":"2116c8bfcd161989ae944a15762bbb5e6b73a1304b336d73f1dacc028ffd8939"}
Oct 30 02:41:47.013795 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:47.013350    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh" event={"ID":"e337e618-cdd3-4496-858f-4f61c4622859","Type":"ContainerStarted","Data":"f11c82aaea64df304480c25b81935287a12a4ce2db2132fdf1faa65f284de951"}
Oct 30 02:41:47.013795 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:47.013393    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh" event={"ID":"e337e618-cdd3-4496-858f-4f61c4622859","Type":"ContainerStarted","Data":"b7c8649821d608badcf931fe5c250f209f6e6dbcb23bce3798f39c468074adf5"}
Oct 30 02:41:47.013795 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:47.013423    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh" event={"ID":"e337e618-cdd3-4496-858f-4f61c4622859","Type":"ContainerStarted","Data":"97124a8a59d7f9cae6481d865a1b0f7abffe4fb3e1bbd6142cc6b8b29032b6df"}
Oct 30 02:41:47.016526 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:47.016494    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n9g9" event={"ID":"2291168b-f4ed-40e5-9767-afe1561cf5d5","Type":"ContainerStarted","Data":"82c2f3798d9948efdfd3f366ab2f848d791950b6dc37bee4c211d64b2ff55fca"}
Oct 30 02:41:47.057078 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:47.057021    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4n9g9" podStartSLOduration=7.580628359 podStartE2EDuration="18.057008901s" totalImagesPullingTime="10.476380542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:41:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:41:47.056944408 +0000 UTC m=+18.914419556" watchObservedRunningTime="2026-10-30 02:41:47.057008901 +0000 UTC m=+18.914484049"
Oct 30 02:41:47.672216 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:47.672180    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:47.672391 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:47.672307    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:48.673508 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:48.673468    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:48.673978 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:48.673514    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:48.673978 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:48.673599    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:48.673978 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:48.673705    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:49.025057 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:49.024966    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh" event={"ID":"e337e618-cdd3-4496-858f-4f61c4622859","Type":"ContainerStarted","Data":"fa8994b64f870294ed0953c9170138fffc7032ae8dbccae8fb7b9df90e4a3a58"}
Oct 30 02:41:49.671580 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:49.671532    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:49.671781 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:49.671655    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:50.672123 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:50.672093    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:50.672808 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:50.672236    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:50.672808 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:50.672306    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:50.672808 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:50.672399    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:51.032245 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:51.032167    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh" event={"ID":"e337e618-cdd3-4496-858f-4f61c4622859","Type":"ContainerStarted","Data":"9996c966681958cc659195f2e8fa8f5614af8e9a354b33c3e887735492208552"}
Oct 30 02:41:51.032461 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:51.032430    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:51.047872 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:51.047853    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:51.105439 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:51.105388    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh" podStartSLOduration=7.19161054 podStartE2EDuration="22.105372635s" totalImagesPullingTime="14.913762095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:41:51.104769217 +0000 UTC m=+22.962244379" watchObservedRunningTime="2026-10-30 02:41:51.105372635 +0000 UTC m=+22.962847786"
Oct 30 02:41:51.672020 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:51.671990    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:51.672265 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:51.672100    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:52.035760 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:52.035661    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:52.036114 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:52.036092    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:52.053260 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:52.053238    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:41:52.419092 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:52.419059    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pb6zp"]
Oct 30 02:41:52.419258 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:52.419173    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:52.419316 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:52.419252    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:52.423053 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:52.423024    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jw4x2"]
Oct 30 02:41:52.423180 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:52.423135    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:52.423248 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:52.423229    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:52.423651 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:52.423629    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nhkvm"]
Oct 30 02:41:52.423741 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:52.423714    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:52.423801 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:52.423787    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:53.671549 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:53.671519    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:53.672069 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:53.671654    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:54.023642 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:54.023553    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:41:54.023799 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:54.023692    2543 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:41:54.024172 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:54.024157    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:41:54.671914 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:54.671834    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:54.671914 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:54.671864    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:54.672350 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:54.671963    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:54.672350 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:54.672099    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:55.671575 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:55.671547    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:55.671825 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:55.671649    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:56.674491 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:56.674465    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:56.674909 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:56.674551    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:56.674909 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:56.674629    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:56.674909 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:56.674713    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:57.672271 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:57.672237    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:57.672439 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:57.672363    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:41:58.677103 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:58.677036    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:41:58.677554 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:58.677175    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:41:58.677554 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:58.677209    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:41:58.677554 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:58.677271    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:41:59.511520 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:59.511480    2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h6mqn_48a605d4-42c2-4362-b230-08a10ab9dec6/konnectivity-agent/0.log" limit=1024
Oct 30 02:41:59.672423 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:41:59.672396    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:41:59.672576 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:41:59.672501    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:42:00.672071 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:00.672033    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:00.672586 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:00.672037    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:00.672586 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:00.672171    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:42:00.672586 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:00.672237    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:42:01.465367 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:01.465339    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sm872_bec335ab-48e3-4940-aeea-f8f46a184eed/dns-node-resolver/0.log"
Oct 30 02:42:01.672275 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:01.672238    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:01.672658 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:01.672380    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:42:02.065566 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:02.065540    2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cz9ks_87cca6f3-8578-41cd-ba4a-da8798608de9/node-ca/0.log"
Oct 30 02:42:02.408685 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:02.408656    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:02.408803 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:02.408717    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:02.408863 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:02.408807    2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:42:02.408863 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:02.408842    2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 02:42:02.408956 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:02.408879    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs podName:7f1c39ff-4766-4915-8cd2-2ff6730302fb nodeName:}" failed. No retries permitted until 2026-10-30 02:42:34.408865453 +0000 UTC m=+66.266340580 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs") pod "network-metrics-daemon-nhkvm" (UID: "7f1c39ff-4766-4915-8cd2-2ff6730302fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 02:42:02.408956 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:02.408910    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret podName:f8cf619f-9892-48d5-911e-5f7432d945ec nodeName:}" failed. No retries permitted until 2026-10-30 02:42:34.408894377 +0000 UTC m=+66.266369507 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret") pod "global-pull-secret-syncer-pb6zp" (UID: "f8cf619f-9892-48d5-911e-5f7432d945ec") : object "kube-system"/"original-pull-secret" not registered
Oct 30 02:42:02.509065 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:02.509030    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d\") pod \"network-check-target-jw4x2\" (UID: \"416971fa-0af3-448e-b81c-48c6d02bdbb5\") " pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:02.509220 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:02.509143    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 02:42:02.509220 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:02.509156    2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 02:42:02.509220 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:02.509165    2543 projected.go:196] Error preparing data for projected volume kube-api-access-bx28d for pod openshift-network-diagnostics/network-check-target-jw4x2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:42:02.509355 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:02.509347    2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d podName:416971fa-0af3-448e-b81c-48c6d02bdbb5 nodeName:}" failed. No retries permitted until 2026-10-30 02:42:34.509326738 +0000 UTC m=+66.366801879 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bx28d" (UniqueName: "kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d") pod "network-check-target-jw4x2" (UID: "416971fa-0af3-448e-b81c-48c6d02bdbb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 02:42:02.672379 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:02.672297    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:02.672722 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:02.672429    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:42:02.672722 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:02.672478    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:02.672722 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:02.672556    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:42:03.671991 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:03.671959    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:03.672149 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:03.672067    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:42:04.671531 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:04.671507    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:04.671531 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:04.671541    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:04.671949 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:04.671619    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:42:04.671949 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:04.671732    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:42:05.671848 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:05.671823    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:05.672210 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:05.671922    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:42:06.671728 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:06.671693    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:06.671728 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:06.671718    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:06.672236 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:06.671808    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:42:06.672236 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:06.671950    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:42:07.672428 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:07.672397    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:07.672800 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:07.672505    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:42:08.673184 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:08.673159    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:08.673583 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:08.673236    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:42:08.673583 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:08.673326    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:08.673583 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:08.673408    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:42:09.672084 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:09.672046    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:09.672254 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:09.672163    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:42:10.671965 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:10.671895    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:10.671965 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:10.671921    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:10.672379 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:10.671983    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:42:10.672379 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:10.672146    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:42:11.671980 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:11.671950    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:11.672444 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:11.672050    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:42:12.671901 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:12.671870    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:12.672072 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:12.671879    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:12.672072 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:12.671961    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:42:12.672072 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:12.672045    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:42:13.671915 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:13.671886    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:13.672083 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:13.672000    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhkvm" podUID="7f1c39ff-4766-4915-8cd2-2ff6730302fb"
Oct 30 02:42:14.672016 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:14.671968    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:14.672016 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:14.672023    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:14.672463 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:14.672111    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pb6zp" podUID="f8cf619f-9892-48d5-911e-5f7432d945ec"
Oct 30 02:42:14.672463 ip-10-0-128-202 kubenswrapper[2543]: E1030 02:42:14.672189    2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jw4x2" podUID="416971fa-0af3-448e-b81c-48c6d02bdbb5"
Oct 30 02:42:15.401737 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.401713    2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeReady"
Oct 30 02:42:15.401895 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.401818    2543 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 02:42:15.453570 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.453546    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wjp42"]
Oct 30 02:42:15.455220 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.455207    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wjp42"
Oct 30 02:42:15.456840 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.456821    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nmmgn"]
Oct 30 02:42:15.458534 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.458520    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.473453 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.473379    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 02:42:15.473453 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.473409    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 02:42:15.473626 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.473470    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 02:42:15.473626 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.473472    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-mcz9c\""
Oct 30 02:42:15.474628 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.474605    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wjp42"]
Oct 30 02:42:15.475254 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.475237    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xgrln"]
Oct 30 02:42:15.475602 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.475582    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 02:42:15.475772 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.475755    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 02:42:15.475820 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.475812    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hbwgl\""
Oct 30 02:42:15.477013 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.476999    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.484514 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.484496    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nmmgn"]
Oct 30 02:42:15.499336 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.499310    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xgrln"]
Oct 30 02:42:15.506843 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.506816    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f13d6d8d-e290-450f-b648-1869845dd5a7-data-volume\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.506947 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.506849    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f13d6d8d-e290-450f-b648-1869845dd5a7-crio-socket\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.506947 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.506866    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f92b4266-f045-41d5-8694-ddec1b9fcdf5-config-volume\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.506947 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.506892    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f92b4266-f045-41d5-8694-ddec1b9fcdf5-metrics-tls\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.507056 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.507031    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzr4t\" (UniqueName: \"kubernetes.io/projected/f13d6d8d-e290-450f-b648-1869845dd5a7-kube-api-access-tzr4t\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.507087 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.507056    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f13d6d8d-e290-450f-b648-1869845dd5a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.507120 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.507087    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f13d6d8d-e290-450f-b648-1869845dd5a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.507148 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.507130    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92b4266-f045-41d5-8694-ddec1b9fcdf5-tmp-dir\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.507178 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.507157    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl6xs\" (UniqueName: \"kubernetes.io/projected/0dbab0f3-4bbd-4889-ae78-ddff0b995e72-kube-api-access-jl6xs\") pod \"ingress-canary-wjp42\" (UID: \"0dbab0f3-4bbd-4889-ae78-ddff0b995e72\") " pod="openshift-ingress-canary/ingress-canary-wjp42"
Oct 30 02:42:15.507178 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.507173    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klx67\" (UniqueName: \"kubernetes.io/projected/f92b4266-f045-41d5-8694-ddec1b9fcdf5-kube-api-access-klx67\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.507249 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.507196    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dbab0f3-4bbd-4889-ae78-ddff0b995e72-cert\") pod \"ingress-canary-wjp42\" (UID: \"0dbab0f3-4bbd-4889-ae78-ddff0b995e72\") " pod="openshift-ingress-canary/ingress-canary-wjp42"
Oct 30 02:42:15.574084 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.574056    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 02:42:15.574084 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.574057    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 02:42:15.574220 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.574059    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8z95j\""
Oct 30 02:42:15.574220 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.574065    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 02:42:15.574220 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.574120    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 02:42:15.607953 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.607928    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92b4266-f045-41d5-8694-ddec1b9fcdf5-tmp-dir\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.608038 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.607966    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl6xs\" (UniqueName: \"kubernetes.io/projected/0dbab0f3-4bbd-4889-ae78-ddff0b995e72-kube-api-access-jl6xs\") pod \"ingress-canary-wjp42\" (UID: \"0dbab0f3-4bbd-4889-ae78-ddff0b995e72\") " pod="openshift-ingress-canary/ingress-canary-wjp42"
Oct 30 02:42:15.608038 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.607982    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klx67\" (UniqueName: \"kubernetes.io/projected/f92b4266-f045-41d5-8694-ddec1b9fcdf5-kube-api-access-klx67\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.608038 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.608008    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dbab0f3-4bbd-4889-ae78-ddff0b995e72-cert\") pod \"ingress-canary-wjp42\" (UID: \"0dbab0f3-4bbd-4889-ae78-ddff0b995e72\") " pod="openshift-ingress-canary/ingress-canary-wjp42"
Oct 30 02:42:15.608186 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.608039    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f13d6d8d-e290-450f-b648-1869845dd5a7-data-volume\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.608186 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.608057    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f13d6d8d-e290-450f-b648-1869845dd5a7-crio-socket\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.608186 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.608070    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f92b4266-f045-41d5-8694-ddec1b9fcdf5-config-volume\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.608186 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.608092    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f92b4266-f045-41d5-8694-ddec1b9fcdf5-metrics-tls\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.608425 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.608323    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92b4266-f045-41d5-8694-ddec1b9fcdf5-tmp-dir\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.608425 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.608335    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f13d6d8d-e290-450f-b648-1869845dd5a7-crio-socket\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.608536 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.608489    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f13d6d8d-e290-450f-b648-1869845dd5a7-data-volume\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.608682 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.608664    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzr4t\" (UniqueName: \"kubernetes.io/projected/f13d6d8d-e290-450f-b648-1869845dd5a7-kube-api-access-tzr4t\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.608726 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.608706    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f13d6d8d-e290-450f-b648-1869845dd5a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.608726 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.608720    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f92b4266-f045-41d5-8694-ddec1b9fcdf5-config-volume\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.608792 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.608729    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f13d6d8d-e290-450f-b648-1869845dd5a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.609099 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.609070    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f13d6d8d-e290-450f-b648-1869845dd5a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.611925 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.611902    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f13d6d8d-e290-450f-b648-1869845dd5a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.612016 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.611970    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f92b4266-f045-41d5-8694-ddec1b9fcdf5-metrics-tls\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.612146 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.612130    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dbab0f3-4bbd-4889-ae78-ddff0b995e72-cert\") pod \"ingress-canary-wjp42\" (UID: \"0dbab0f3-4bbd-4889-ae78-ddff0b995e72\") " pod="openshift-ingress-canary/ingress-canary-wjp42"
Oct 30 02:42:15.625137 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.625117    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl6xs\" (UniqueName: \"kubernetes.io/projected/0dbab0f3-4bbd-4889-ae78-ddff0b995e72-kube-api-access-jl6xs\") pod \"ingress-canary-wjp42\" (UID: \"0dbab0f3-4bbd-4889-ae78-ddff0b995e72\") " pod="openshift-ingress-canary/ingress-canary-wjp42"
Oct 30 02:42:15.625325 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.625308    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klx67\" (UniqueName: \"kubernetes.io/projected/f92b4266-f045-41d5-8694-ddec1b9fcdf5-kube-api-access-klx67\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.625394 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.625329    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzr4t\" (UniqueName: \"kubernetes.io/projected/f13d6d8d-e290-450f-b648-1869845dd5a7-kube-api-access-tzr4t\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:15.672381 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.672320    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:15.685269 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.685253    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-czntg\""
Oct 30 02:42:15.685424 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.685409    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 02:42:15.766194 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.766160    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wjp42"
Oct 30 02:42:15.772835 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.772811    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:15.789760 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:15.789728    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:16.066210 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:16.066133    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wjp42"]
Oct 30 02:42:16.070253 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:16.070227    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbab0f3_4bbd_4889_ae78_ddff0b995e72.slice/crio-ba0f7dc469da0996cfe81cb6a45ed9f83319cf64d7a1ee4d174b23a8b769f6ec WatchSource:0}: Error finding container ba0f7dc469da0996cfe81cb6a45ed9f83319cf64d7a1ee4d174b23a8b769f6ec: Status 404 returned error can't find the container with id ba0f7dc469da0996cfe81cb6a45ed9f83319cf64d7a1ee4d174b23a8b769f6ec
Oct 30 02:42:16.077430 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:16.077368    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nmmgn"]
Oct 30 02:42:16.080209 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:16.080185    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92b4266_f045_41d5_8694_ddec1b9fcdf5.slice/crio-ced370fe6ecb30e3e6ab718aaa7eaadce32b87136f73972752ddc989f418596b WatchSource:0}: Error finding container ced370fe6ecb30e3e6ab718aaa7eaadce32b87136f73972752ddc989f418596b: Status 404 returned error can't find the container with id ced370fe6ecb30e3e6ab718aaa7eaadce32b87136f73972752ddc989f418596b
Oct 30 02:42:16.082538 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:16.082516    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wjp42" event={"ID":"0dbab0f3-4bbd-4889-ae78-ddff0b995e72","Type":"ContainerStarted","Data":"ba0f7dc469da0996cfe81cb6a45ed9f83319cf64d7a1ee4d174b23a8b769f6ec"}
Oct 30 02:42:16.090843 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:16.090807    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xgrln"]
Oct 30 02:42:16.094049 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:16.094025    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13d6d8d_e290_450f_b648_1869845dd5a7.slice/crio-9d4e4181fb125fa9ad61afe115a30701541f1ee66eaea08597562b9b9c82b369 WatchSource:0}: Error finding container 9d4e4181fb125fa9ad61afe115a30701541f1ee66eaea08597562b9b9c82b369: Status 404 returned error can't find the container with id 9d4e4181fb125fa9ad61afe115a30701541f1ee66eaea08597562b9b9c82b369
Oct 30 02:42:16.674620 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:16.674588    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:16.675096 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:16.675047    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:16.688751 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:16.688729    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 02:42:16.688847 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:16.688729    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 02:42:16.688847 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:16.688734    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-j74dx\""
Oct 30 02:42:16.688847 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:16.688831    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-d89pf\""
Oct 30 02:42:16.699132 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:16.699115    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 02:42:17.087610 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.087421    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xgrln" event={"ID":"f13d6d8d-e290-450f-b648-1869845dd5a7","Type":"ContainerStarted","Data":"795110642c46164008b54e794c3b2aad9183da5eb035a5168e83476cd8054333"}
Oct 30 02:42:17.087610 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.087495    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xgrln" event={"ID":"f13d6d8d-e290-450f-b648-1869845dd5a7","Type":"ContainerStarted","Data":"0c1b4eef3cba8c08553cf7656ed5c9fd003fda36922c019bfbd29bad8037b3a1"}
Oct 30 02:42:17.087610 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.087524    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xgrln" event={"ID":"f13d6d8d-e290-450f-b648-1869845dd5a7","Type":"ContainerStarted","Data":"9d4e4181fb125fa9ad61afe115a30701541f1ee66eaea08597562b9b9c82b369"}
Oct 30 02:42:17.088687 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.088658    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nmmgn" event={"ID":"f92b4266-f045-41d5-8694-ddec1b9fcdf5","Type":"ContainerStarted","Data":"ced370fe6ecb30e3e6ab718aaa7eaadce32b87136f73972752ddc989f418596b"}
Oct 30 02:42:17.346678 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.346552    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"]
Oct 30 02:42:17.348579 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.348556    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.361423 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.361399    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 02:42:17.361575 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.361556    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 02:42:17.372112 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.372054    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4mw8j\""
Oct 30 02:42:17.372222 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.372142    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 02:42:17.372276 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.372249    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 02:42:17.372394 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.372377    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 02:42:17.385006 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.384781    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"]
Oct 30 02:42:17.420554 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.420525    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53793bc8-ff97-4faa-aaf8-3d101fb8d646-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.420716 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.420607    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97t59\" (UniqueName: \"kubernetes.io/projected/53793bc8-ff97-4faa-aaf8-3d101fb8d646-kube-api-access-97t59\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.420716 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.420692    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53793bc8-ff97-4faa-aaf8-3d101fb8d646-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.420820 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.420720    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53793bc8-ff97-4faa-aaf8-3d101fb8d646-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.521462 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.521427    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53793bc8-ff97-4faa-aaf8-3d101fb8d646-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.521635 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.521472    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53793bc8-ff97-4faa-aaf8-3d101fb8d646-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.521635 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.521517    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53793bc8-ff97-4faa-aaf8-3d101fb8d646-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.521635 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.521542    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97t59\" (UniqueName: \"kubernetes.io/projected/53793bc8-ff97-4faa-aaf8-3d101fb8d646-kube-api-access-97t59\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.522918 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.522857    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53793bc8-ff97-4faa-aaf8-3d101fb8d646-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.525271 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.525248    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53793bc8-ff97-4faa-aaf8-3d101fb8d646-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.527239 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.527207    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53793bc8-ff97-4faa-aaf8-3d101fb8d646-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.545038 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.545017    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97t59\" (UniqueName: \"kubernetes.io/projected/53793bc8-ff97-4faa-aaf8-3d101fb8d646-kube-api-access-97t59\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.663426 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.663179    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:17.974417 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:17.974335    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"]
Oct 30 02:42:17.978758 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:17.978732    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53793bc8_ff97_4faa_aaf8_3d101fb8d646.slice/crio-4942e6304db3d72c9c51d7f5d1d6b05bf27a15fb60e5a7b7ef53be14c2a74da3 WatchSource:0}: Error finding container 4942e6304db3d72c9c51d7f5d1d6b05bf27a15fb60e5a7b7ef53be14c2a74da3: Status 404 returned error can't find the container with id 4942e6304db3d72c9c51d7f5d1d6b05bf27a15fb60e5a7b7ef53be14c2a74da3
Oct 30 02:42:18.098597 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:18.098563    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j" event={"ID":"53793bc8-ff97-4faa-aaf8-3d101fb8d646","Type":"ContainerStarted","Data":"4942e6304db3d72c9c51d7f5d1d6b05bf27a15fb60e5a7b7ef53be14c2a74da3"}
Oct 30 02:42:18.107923 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:18.107878    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nmmgn" event={"ID":"f92b4266-f045-41d5-8694-ddec1b9fcdf5","Type":"ContainerStarted","Data":"a9221e0f1116c723d2fc20adc3a53b069ac99efd395ce0eae220de41edfc1ecf"}
Oct 30 02:42:18.108659 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:18.108634    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:18.145249 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:18.145192    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-nmmgn" podStartSLOduration=1.336283856 podStartE2EDuration="3.145175732s" totalImagesPullingTime="1.808891876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:18.14448343 +0000 UTC m=+50.001958581" watchObservedRunningTime="2026-10-30 02:42:18.145175732 +0000 UTC m=+50.002650882"
Oct 30 02:42:19.112141 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:19.112108    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xgrln" event={"ID":"f13d6d8d-e290-450f-b648-1869845dd5a7","Type":"ContainerStarted","Data":"49dd6f5f504ffcdf7a190be23bc1063405ebc756c9b20919926c70c9a8e7b90c"}
Oct 30 02:42:19.114154 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:19.114118    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wjp42" event={"ID":"0dbab0f3-4bbd-4889-ae78-ddff0b995e72","Type":"ContainerStarted","Data":"a06a177762fd740cadecd1c94547ce238212e8daab404d202ff7681a4da5c459"}
Oct 30 02:42:19.116166 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:19.116131    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nmmgn" event={"ID":"f92b4266-f045-41d5-8694-ddec1b9fcdf5","Type":"ContainerStarted","Data":"aac09807c3d0c375e2e42e3c999cf0851a20ce2451e6a8d771c37f102b9f7fb4"}
Oct 30 02:42:19.148553 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:19.148514    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xgrln" podStartSLOduration=2.014318352 podStartE2EDuration="4.148501054s" totalImagesPullingTime="2.134182702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 02:42:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:19.147256563 +0000 UTC m=+51.004731723" watchObservedRunningTime="2026-10-30 02:42:19.148501054 +0000 UTC m=+51.005976200"
Oct 30 02:42:19.181904 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:19.181864    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wjp42" podStartSLOduration=1.362316182 podStartE2EDuration="4.181851047s" totalImagesPullingTime="2.819534865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:19.180664004 +0000 UTC m=+51.038139154" watchObservedRunningTime="2026-10-30 02:42:19.181851047 +0000 UTC m=+51.039326186"
Oct 30 02:42:20.120852 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:20.120815    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j" event={"ID":"53793bc8-ff97-4faa-aaf8-3d101fb8d646","Type":"ContainerStarted","Data":"4cdc872ed4173eebea37ce3dbfeea7a7e8883b96090b8a961ec460a3ce6762d7"}
Oct 30 02:42:20.121306 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:20.120876    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j" event={"ID":"53793bc8-ff97-4faa-aaf8-3d101fb8d646","Type":"ContainerStarted","Data":"885c70f120b391cbff5170562e394ef190a986449dbe8bedc104999ec1a77d85"}
Oct 30 02:42:20.156942 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:20.156890    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j" podStartSLOduration=2.047682313 podStartE2EDuration="3.156876683s" totalImagesPullingTime="1.10919437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:20.155628676 +0000 UTC m=+52.013103837" watchObservedRunningTime="2026-10-30 02:42:20.156876683 +0000 UTC m=+52.014351831"
Oct 30 02:42:21.944093 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:21.944059    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"]
Oct 30 02:42:21.946374 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:21.946359    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:21.962498 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:21.962480    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 02:42:21.972105 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:21.972081    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-99kpg\""
Oct 30 02:42:21.972105 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:21.972084    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 02:42:21.973227 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:21.973207    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"]
Oct 30 02:42:21.984934 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:21.984914    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"]
Oct 30 02:42:21.987000 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:21.986980    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:21.987693 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:21.987673    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zk2zh"]
Oct 30 02:42:21.989533 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:21.989515    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.007224 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.007205    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 02:42:22.007351 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.007335    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 02:42:22.011385 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.011329    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"]
Oct 30 02:42:22.034891 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.034869    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f69xl\""
Oct 30 02:42:22.034891 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.034875    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 02:42:22.035046 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.035034    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 02:42:22.035109 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.035073    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 02:42:22.035109 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.035110    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 02:42:22.035204 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.035142    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-znsn5\""
Oct 30 02:42:22.056020 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.055998    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjxsj\" (UniqueName: \"kubernetes.io/projected/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-api-access-gjxsj\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.056111 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056030    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-wtmp\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.056111 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056052    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-tls\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.056111 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056100    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36d0c7ea-c907-4088-aacd-dd7224bd896c-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.056221 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056122    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.056221 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056189    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.056338 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056314    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.056388 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056356    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36d0c7ea-c907-4088-aacd-dd7224bd896c-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.056452 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056439    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3237b03d-9c16-410e-b61e-7c5884f42e65-metrics-client-ca\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.056506 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056467    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a72ad10b-db47-41f9-bacf-ab880f332a7a-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.056506 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056498    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-sys\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.056571 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056539    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-accelerators-collector-config\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.056599 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056580    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72ad10b-db47-41f9-bacf-ab880f332a7a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.056629 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056597    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-root\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.056629 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056622    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.056699 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056640    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-textfile\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.056699 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056656    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbf7s\" (UniqueName: \"kubernetes.io/projected/3237b03d-9c16-410e-b61e-7c5884f42e65-kube-api-access-fbf7s\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.056758 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056741    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pth9k\" (UniqueName: \"kubernetes.io/projected/a72ad10b-db47-41f9-bacf-ab880f332a7a-kube-api-access-pth9k\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.056795 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.056782    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a72ad10b-db47-41f9-bacf-ab880f332a7a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.157218 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157192    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-wtmp\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.157328 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157222    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-tls\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.157328 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157242    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36d0c7ea-c907-4088-aacd-dd7224bd896c-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.157328 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157257    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.157328 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157307    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.157529 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157340    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.157529 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157365    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36d0c7ea-c907-4088-aacd-dd7224bd896c-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.157529 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157395    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3237b03d-9c16-410e-b61e-7c5884f42e65-metrics-client-ca\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.157529 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157406    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-wtmp\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.157529 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157419    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a72ad10b-db47-41f9-bacf-ab880f332a7a-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.157756 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157554    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-sys\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.157756 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157592    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-accelerators-collector-config\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.157756 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157646    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-sys\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.157756 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157655    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72ad10b-db47-41f9-bacf-ab880f332a7a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.157756 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157681    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-root\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.157756 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157736    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.158020 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157771    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-textfile\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.158020 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157795    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbf7s\" (UniqueName: \"kubernetes.io/projected/3237b03d-9c16-410e-b61e-7c5884f42e65-kube-api-access-fbf7s\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.158020 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157824    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pth9k\" (UniqueName: \"kubernetes.io/projected/a72ad10b-db47-41f9-bacf-ab880f332a7a-kube-api-access-pth9k\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.158020 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157865    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a72ad10b-db47-41f9-bacf-ab880f332a7a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.158020 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157896    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjxsj\" (UniqueName: \"kubernetes.io/projected/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-api-access-gjxsj\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.158233 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.158152    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3237b03d-9c16-410e-b61e-7c5884f42e65-metrics-client-ca\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.158233 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.157691    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36d0c7ea-c907-4088-aacd-dd7224bd896c-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.158233 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.158167    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a72ad10b-db47-41f9-bacf-ab880f332a7a-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.158233 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.158195    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-accelerators-collector-config\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.158534 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.158404    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-root\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.158534 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.158511    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-textfile\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.158627 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.158539    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.159545 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.159515    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36d0c7ea-c907-4088-aacd-dd7224bd896c-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.160571 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.160547    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.160752 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.160729    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-tls\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.160878 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.160856    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a72ad10b-db47-41f9-bacf-ab880f332a7a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.161115 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.161097    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.161207 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.161170    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.161438 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.161418    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72ad10b-db47-41f9-bacf-ab880f332a7a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.175643 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.175618    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjxsj\" (UniqueName: \"kubernetes.io/projected/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-api-access-gjxsj\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.175926 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.175901    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbf7s\" (UniqueName: \"kubernetes.io/projected/3237b03d-9c16-410e-b61e-7c5884f42e65-kube-api-access-fbf7s\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.176265 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.176246    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pth9k\" (UniqueName: \"kubernetes.io/projected/a72ad10b-db47-41f9-bacf-ab880f332a7a-kube-api-access-pth9k\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.258809 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.258743    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:22.301002 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.300973    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:22.305215 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.305196    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:22.315437 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:22.315394    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3237b03d_9c16_410e_b61e_7c5884f42e65.slice/crio-e611d6206fc9c864d1f2a0ecc6b20912200623eb5a71b7bd6dfdb06d97cc4aed WatchSource:0}: Error finding container e611d6206fc9c864d1f2a0ecc6b20912200623eb5a71b7bd6dfdb06d97cc4aed: Status 404 returned error can't find the container with id e611d6206fc9c864d1f2a0ecc6b20912200623eb5a71b7bd6dfdb06d97cc4aed
Oct 30 02:42:22.566802 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.566726    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"]
Oct 30 02:42:22.569897 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:22.569872    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72ad10b_db47_41f9_bacf_ab880f332a7a.slice/crio-ed1e9e37c1631837e2c58c5d06796faab5c25e34b44d12272917aaac06857248 WatchSource:0}: Error finding container ed1e9e37c1631837e2c58c5d06796faab5c25e34b44d12272917aaac06857248: Status 404 returned error can't find the container with id ed1e9e37c1631837e2c58c5d06796faab5c25e34b44d12272917aaac06857248
Oct 30 02:42:22.605405 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:22.605355    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"]
Oct 30 02:42:22.606937 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:22.606916    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d0c7ea_c907_4088_aacd_dd7224bd896c.slice/crio-69fcc74fbc29c7178db0472fbe714e3020de9bae9d8c214ea49ca3b602d6e974 WatchSource:0}: Error finding container 69fcc74fbc29c7178db0472fbe714e3020de9bae9d8c214ea49ca3b602d6e974: Status 404 returned error can't find the container with id 69fcc74fbc29c7178db0472fbe714e3020de9bae9d8c214ea49ca3b602d6e974
Oct 30 02:42:23.132217 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.132161    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zk2zh" event={"ID":"3237b03d-9c16-410e-b61e-7c5884f42e65","Type":"ContainerStarted","Data":"e611d6206fc9c864d1f2a0ecc6b20912200623eb5a71b7bd6dfdb06d97cc4aed"}
Oct 30 02:42:23.136910 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.136880    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8" event={"ID":"a72ad10b-db47-41f9-bacf-ab880f332a7a","Type":"ContainerStarted","Data":"42a2b49b390cab2834807c6f1484adacbfa902c0f973cb7041e94614c19b62b9"}
Oct 30 02:42:23.137001 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.136934    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8" event={"ID":"a72ad10b-db47-41f9-bacf-ab880f332a7a","Type":"ContainerStarted","Data":"03d9b00526cdf43feb8e2466c2d1553d39a06e0d8cf2a2ba0303d3364464a49b"}
Oct 30 02:42:23.137001 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.136954    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8" event={"ID":"a72ad10b-db47-41f9-bacf-ab880f332a7a","Type":"ContainerStarted","Data":"ed1e9e37c1631837e2c58c5d06796faab5c25e34b44d12272917aaac06857248"}
Oct 30 02:42:23.140900 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.140870    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds" event={"ID":"36d0c7ea-c907-4088-aacd-dd7224bd896c","Type":"ContainerStarted","Data":"69fcc74fbc29c7178db0472fbe714e3020de9bae9d8c214ea49ca3b602d6e974"}
Oct 30 02:42:23.438547 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.438515    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 02:42:23.441468 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.441439    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.455926 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.455896    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 02:42:23.456044 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.455981    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 02:42:23.456044 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.456019    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 02:42:23.456160 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.456107    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 02:42:23.456215 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.456172    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 02:42:23.456215 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.456210    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 02:42:23.456343 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.456276    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-99thg\""
Oct 30 02:42:23.456408 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.456375    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 02:42:23.459275 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.459246    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 02:42:23.459437 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.459413    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 02:42:23.469048 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469019    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddcm6\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-kube-api-access-ddcm6\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.469166 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469067    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.469166 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469100    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.469166 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469150    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.469340 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469184    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.469340 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469210    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-web-config\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.469340 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469229    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.469340 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469245    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-config-out\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.469469 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469272    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.469510 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469485    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.469549 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469535    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.469630 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469590    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.469720 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.469632    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.479119 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.479090    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 02:42:23.570986 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.570959    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-web-config\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.571115 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.571004    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.571457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.571432    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-config-out\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.571597 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.571503    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.571597 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.571547    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.571597 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.571577    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.571953 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.571603    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.572431 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.572354    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.572431 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.572418    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddcm6\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-kube-api-access-ddcm6\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.572617 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.572462    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.572617 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.572500    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.572617 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.572536    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.572617 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.572580    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.574504 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.573548    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.574504 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.573975    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.574741 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.574704    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.575923 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.575658    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.576694 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.576675    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.577054 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.577032    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.578010 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.577424    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.578010 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.577573    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-config-out\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.578010 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.577908    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.578010 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.577930    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-web-config\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.578010 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.577964    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.579221 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.579198    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.594663 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.594618    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddcm6\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-kube-api-access-ddcm6\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:23.760995 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:23.760925    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:24.054095 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.053383    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:24.080466 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.080434    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 02:42:24.147014 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.146978    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds" event={"ID":"36d0c7ea-c907-4088-aacd-dd7224bd896c","Type":"ContainerStarted","Data":"0d6e8b628aef55bf8e466500b09fdd13df57b28281f0809b05c4168e3e68d74b"}
Oct 30 02:42:24.147492 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.147047    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds" event={"ID":"36d0c7ea-c907-4088-aacd-dd7224bd896c","Type":"ContainerStarted","Data":"b0b3d2359604753f53b30f4f1a5867153095ea32f4b60448263058d913419179"}
Oct 30 02:42:24.147492 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.147074    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds" event={"ID":"36d0c7ea-c907-4088-aacd-dd7224bd896c","Type":"ContainerStarted","Data":"78a128db7e3d016179d0cd6ee9d814ab87adcfafe91278bd9dff3b0f7ded5537"}
Oct 30 02:42:24.148706 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.148677    2543 generic.go:356] "Generic (PLEG): container finished" podID="3237b03d-9c16-410e-b61e-7c5884f42e65" containerID="c7ef4106a63cda45e61e6ac88c5355a236038eb8f67d9f18049e08d33ab8e651" exitCode=0
Oct 30 02:42:24.148817 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.148766    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zk2zh" event={"ID":"3237b03d-9c16-410e-b61e-7c5884f42e65","Type":"ContainerDied","Data":"c7ef4106a63cda45e61e6ac88c5355a236038eb8f67d9f18049e08d33ab8e651"}
Oct 30 02:42:24.150063 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.150039    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerStarted","Data":"5fa7061a76ca3ec5649ad4ae2b81d35854b0fbcb63c9203094ba0164dcf77c9c"}
Oct 30 02:42:24.152304 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.152265    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8" event={"ID":"a72ad10b-db47-41f9-bacf-ab880f332a7a","Type":"ContainerStarted","Data":"06026822ad91e7d7bfed9a312696c0d4ab18e789e0c9a69bb1228b7233ee3485"}
Oct 30 02:42:24.218375 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.218336    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8" podStartSLOduration=2.358209251 podStartE2EDuration="3.218320151s" totalImagesPullingTime="860.1109ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:24.217764081 +0000 UTC m=+56.075239230" watchObservedRunningTime="2026-10-30 02:42:24.218320151 +0000 UTC m=+56.075795300"
Oct 30 02:42:24.218691 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.218665    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds" podStartSLOduration=1.9938122759999999 podStartE2EDuration="3.218656349s" totalImagesPullingTime="1.224844073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:24.182415348 +0000 UTC m=+56.039890498" watchObservedRunningTime="2026-10-30 02:42:24.218656349 +0000 UTC m=+56.076131497"
Oct 30 02:42:24.245230 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.245205    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"]
Oct 30 02:42:24.249536 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.249521    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.267538 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.267508    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 02:42:24.267538 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.267519    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 02:42:24.267538 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.267509    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 02:42:24.267736 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.267597    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cfgnp\""
Oct 30 02:42:24.267736 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.267692    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1deea0ri9bckt\""
Oct 30 02:42:24.272991 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.272771    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"]
Oct 30 02:42:24.279340 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.279319    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc15187f-0896-4775-a227-4633a4dc3734-tmp\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.279435 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.279356    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-grpc-tls\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.279639 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.279586    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.279714 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.279661    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc15187f-0896-4775-a227-4633a4dc3734-metrics-client-ca\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.279769 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.279740    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.279872 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.279851    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.280086 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.280066    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksbl2\" (UniqueName: \"kubernetes.io/projected/fc15187f-0896-4775-a227-4633a4dc3734-kube-api-access-ksbl2\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.280171 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.280101    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-tls\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.280239 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.280193    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.367407 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.367330    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 02:42:24.367407 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.367378    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 02:42:24.380851 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.380824    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksbl2\" (UniqueName: \"kubernetes.io/projected/fc15187f-0896-4775-a227-4633a4dc3734-kube-api-access-ksbl2\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.380960 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.380856    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-tls\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.380960 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.380894    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.380960 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.380921    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc15187f-0896-4775-a227-4633a4dc3734-tmp\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.381110 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.381072    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-grpc-tls\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.381198 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.381176    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.381258 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.381211    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc15187f-0896-4775-a227-4633a4dc3734-metrics-client-ca\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.381258 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.381250    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.381372 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.381314    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.381372 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.381356    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc15187f-0896-4775-a227-4633a4dc3734-tmp\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.382213 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.382186    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc15187f-0896-4775-a227-4633a4dc3734-metrics-client-ca\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.384029 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.384002    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.384456 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.384433    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.384528 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.384470    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.384681 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.384660    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-tls\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.384715 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.384676    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-grpc-tls\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.384781 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.384760    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.398042 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.398022    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksbl2\" (UniqueName: \"kubernetes.io/projected/fc15187f-0896-4775-a227-4633a4dc3734-kube-api-access-ksbl2\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.591136 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.591095    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:24.899456 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:24.899361    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"]
Oct 30 02:42:24.902162 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:24.902136    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc15187f_0896_4775_a227_4633a4dc3734.slice/crio-643b220f41021ff050d03365e09b6500f0db153bd622c58b6975bba451bf471a WatchSource:0}: Error finding container 643b220f41021ff050d03365e09b6500f0db153bd622c58b6975bba451bf471a: Status 404 returned error can't find the container with id 643b220f41021ff050d03365e09b6500f0db153bd622c58b6975bba451bf471a
Oct 30 02:42:25.158084 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:25.158014    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zk2zh" event={"ID":"3237b03d-9c16-410e-b61e-7c5884f42e65","Type":"ContainerStarted","Data":"cd05af78e1d96341fff1807769449cc8c6ae12e781b65c5cd992a16884caa21c"}
Oct 30 02:42:25.158457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:25.158116    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zk2zh" event={"ID":"3237b03d-9c16-410e-b61e-7c5884f42e65","Type":"ContainerStarted","Data":"40e1fe5462043a5dabba847bf6db09d4c660dce1022333daad4216546d700951"}
Oct 30 02:42:25.159642 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:25.159610    2543 generic.go:356] "Generic (PLEG): container finished" podID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerID="99f8df3bdfa329fd6208e9fbca0d11055d11375cb26b95b82a142e19df4f03bb" exitCode=0
Oct 30 02:42:25.159738 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:25.159698    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerDied","Data":"99f8df3bdfa329fd6208e9fbca0d11055d11375cb26b95b82a142e19df4f03bb"}
Oct 30 02:42:25.160951 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:25.160926    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h" event={"ID":"fc15187f-0896-4775-a227-4633a4dc3734","Type":"ContainerStarted","Data":"643b220f41021ff050d03365e09b6500f0db153bd622c58b6975bba451bf471a"}
Oct 30 02:42:25.196356 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:25.196304    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zk2zh" podStartSLOduration=3.291073998 podStartE2EDuration="4.196270992s" totalImagesPullingTime="818.792076ms" totalInitContainerRuntime="86.404918ms" isStatefulPod=true podCreationTimestamp="2026-10-30 02:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:25.195009962 +0000 UTC m=+57.052485111" watchObservedRunningTime="2026-10-30 02:42:25.196270992 +0000 UTC m=+57.053746140"
Oct 30 02:42:26.003058 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.003018    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7595648df5-ptz96"]
Oct 30 02:42:26.006627 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.006602    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.024800 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.024772    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 02:42:26.035452 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.035428    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z7sc4\""
Oct 30 02:42:26.035452 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.035444    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 02:42:26.035647 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.035605    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 02:42:26.035710 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.035661    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 02:42:26.035710 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.035693    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 02:42:26.035807 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.035737    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 02:42:26.035807 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.035744    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 02:42:26.038718 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.038697    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7595648df5-ptz96"]
Oct 30 02:42:26.096573 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.096537    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-oauth-config\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.096750 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.096587    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-config\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.096750 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.096720    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-tmp\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.096872 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.096769    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-oauth-serving-cert\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.096872 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.096835    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-service-ca\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.096972 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.096870    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-serving-cert\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.096972 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.096909    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx4tw\" (UniqueName: \"kubernetes.io/projected/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-kube-api-access-tx4tw\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.198152 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.198118    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-oauth-config\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.198600 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.198162    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-config\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.198600 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.198225    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-tmp\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.198600 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.198340    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-oauth-serving-cert\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.198600 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.198389    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-service-ca\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.198600 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.198428    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-serving-cert\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.198600 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.198468    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx4tw\" (UniqueName: \"kubernetes.io/projected/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-kube-api-access-tx4tw\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.198895 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.198705    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-tmp\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.198994 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.198977    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-config\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.199520 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.199501    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-oauth-serving-cert\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.199862 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.199837    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-service-ca\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.200812 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.200790    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-oauth-config\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.201261 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.201232    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-serving-cert\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.216294 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.216258    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx4tw\" (UniqueName: \"kubernetes.io/projected/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-kube-api-access-tx4tw\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.322111 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.321810    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:26.465231 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.465195    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-75b5f57486-2nn2p"]
Oct 30 02:42:26.469993 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.469965    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.484685 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.484657    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 02:42:26.485027 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.484748    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 02:42:26.492228 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.492167    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75b5f57486-2nn2p"]
Oct 30 02:42:26.494509 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.494480    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ztgz4\""
Oct 30 02:42:26.494614 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.494547    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 02:42:26.495378 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.495136    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c4lsnub1qqrho\""
Oct 30 02:42:26.495378 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.495207    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 02:42:26.602377 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.602276    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c1239074-11cc-456f-8ff1-242cb437f9a8-audit-log\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.602537 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.602404    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-secret-metrics-server-client-certs\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.602537 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.602495    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-client-ca-bundle\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.602639 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.602576    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-secret-metrics-server-tls\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.602639 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.602619    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1239074-11cc-456f-8ff1-242cb437f9a8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.602730 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.602699    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c1239074-11cc-456f-8ff1-242cb437f9a8-metrics-server-audit-profiles\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.602730 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.602723    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxdnn\" (UniqueName: \"kubernetes.io/projected/c1239074-11cc-456f-8ff1-242cb437f9a8-kube-api-access-zxdnn\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.625604 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.625572    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7595648df5-ptz96"]
Oct 30 02:42:26.629042 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:26.629010    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e82cf1_ddb2_4c8b_8e8f_d89055b4c30f.slice/crio-4010217157e70a308b2662cfd1b3a0bf1b8cac4a8806eeb552fa1e0d8acab4c3 WatchSource:0}: Error finding container 4010217157e70a308b2662cfd1b3a0bf1b8cac4a8806eeb552fa1e0d8acab4c3: Status 404 returned error can't find the container with id 4010217157e70a308b2662cfd1b3a0bf1b8cac4a8806eeb552fa1e0d8acab4c3
Oct 30 02:42:26.703345 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.703321    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c1239074-11cc-456f-8ff1-242cb437f9a8-audit-log\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.703454 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.703363    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-secret-metrics-server-client-certs\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.703454 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.703394    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-client-ca-bundle\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.703454 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.703440    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-secret-metrics-server-tls\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.703656 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.703489    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1239074-11cc-456f-8ff1-242cb437f9a8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.703656 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.703559    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c1239074-11cc-456f-8ff1-242cb437f9a8-metrics-server-audit-profiles\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.703656 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.703604    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxdnn\" (UniqueName: \"kubernetes.io/projected/c1239074-11cc-456f-8ff1-242cb437f9a8-kube-api-access-zxdnn\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.703781 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.703679    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c1239074-11cc-456f-8ff1-242cb437f9a8-audit-log\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.704822 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.704753    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1239074-11cc-456f-8ff1-242cb437f9a8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.705179 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.705153    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c1239074-11cc-456f-8ff1-242cb437f9a8-metrics-server-audit-profiles\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.706304 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.706266    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-secret-metrics-server-tls\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.707186 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.707160    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-secret-metrics-server-client-certs\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.711564 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.708473    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-client-ca-bundle\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.721195 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.721172    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxdnn\" (UniqueName: \"kubernetes.io/projected/c1239074-11cc-456f-8ff1-242cb437f9a8-kube-api-access-zxdnn\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.784407 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.784381    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:26.811228 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.810131    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"]
Oct 30 02:42:26.815722 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.814975    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:26.831104 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.829514    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 02:42:26.831104 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.830829    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-25r8f\""
Oct 30 02:42:26.834270 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.834201    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"]
Oct 30 02:42:26.905614 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.905585    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkfll\" (UniqueName: \"kubernetes.io/projected/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6-kube-api-access-hkfll\") pod \"monitoring-plugin-77f4f76594-28zrt\" (UID: \"b3b1c5be-f236-44d8-9168-1bdf3dd9dce6\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:26.905717 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:26.905688    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-28zrt\" (UID: \"b3b1c5be-f236-44d8-9168-1bdf3dd9dce6\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:27.006606 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.006575    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkfll\" (UniqueName: \"kubernetes.io/projected/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6-kube-api-access-hkfll\") pod \"monitoring-plugin-77f4f76594-28zrt\" (UID: \"b3b1c5be-f236-44d8-9168-1bdf3dd9dce6\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:27.006715 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.006647    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-28zrt\" (UID: \"b3b1c5be-f236-44d8-9168-1bdf3dd9dce6\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:27.009585 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.009560    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-28zrt\" (UID: \"b3b1c5be-f236-44d8-9168-1bdf3dd9dce6\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:27.027529 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.027492    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkfll\" (UniqueName: \"kubernetes.io/projected/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6-kube-api-access-hkfll\") pod \"monitoring-plugin-77f4f76594-28zrt\" (UID: \"b3b1c5be-f236-44d8-9168-1bdf3dd9dce6\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:27.092890 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.092599    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75b5f57486-2nn2p"]
Oct 30 02:42:27.096858 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:27.096826    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1239074_11cc_456f_8ff1_242cb437f9a8.slice/crio-78406bd43b1f16fce1bf2196199f85f4769a423f9af75a8b6a25a499bb40b35c WatchSource:0}: Error finding container 78406bd43b1f16fce1bf2196199f85f4769a423f9af75a8b6a25a499bb40b35c: Status 404 returned error can't find the container with id 78406bd43b1f16fce1bf2196199f85f4769a423f9af75a8b6a25a499bb40b35c
Oct 30 02:42:27.136074 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.135918    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:27.173386 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.173165    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerStarted","Data":"d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f"}
Oct 30 02:42:27.173386 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.173229    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerStarted","Data":"f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592"}
Oct 30 02:42:27.173386 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.173262    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerStarted","Data":"d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461"}
Oct 30 02:42:27.173386 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.173311    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerStarted","Data":"7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128"}
Oct 30 02:42:27.173386 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.173337    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerStarted","Data":"7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7"}
Oct 30 02:42:27.174768 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.174717    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7595648df5-ptz96" event={"ID":"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f","Type":"ContainerStarted","Data":"4010217157e70a308b2662cfd1b3a0bf1b8cac4a8806eeb552fa1e0d8acab4c3"}
Oct 30 02:42:27.176424 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.176372    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p" event={"ID":"c1239074-11cc-456f-8ff1-242cb437f9a8","Type":"ContainerStarted","Data":"78406bd43b1f16fce1bf2196199f85f4769a423f9af75a8b6a25a499bb40b35c"}
Oct 30 02:42:27.179930 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.179802    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h" event={"ID":"fc15187f-0896-4775-a227-4633a4dc3734","Type":"ContainerStarted","Data":"52a2e2032bfd0262c82a3b4683d21253e285fe1fb7e91d63bfcad310a08513c8"}
Oct 30 02:42:27.179930 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.179863    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h" event={"ID":"fc15187f-0896-4775-a227-4633a4dc3734","Type":"ContainerStarted","Data":"b6d98f999c1401e2858f6b86aade7ec97f8710b429ef2235b014195cb0f61277"}
Oct 30 02:42:27.179930 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.179888    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h" event={"ID":"fc15187f-0896-4775-a227-4633a4dc3734","Type":"ContainerStarted","Data":"796d2e5940943299574b1e1c098dea3d21ffcf960406d56da34910b02ab43002"}
Oct 30 02:42:27.435149 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:27.435116    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"]
Oct 30 02:42:27.439043 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:27.439018    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b1c5be_f236_44d8_9168_1bdf3dd9dce6.slice/crio-9f4506797d96652c34dd8beb3ad1d6d86b066b9716a74e9b421cb3c184306f24 WatchSource:0}: Error finding container 9f4506797d96652c34dd8beb3ad1d6d86b066b9716a74e9b421cb3c184306f24: Status 404 returned error can't find the container with id 9f4506797d96652c34dd8beb3ad1d6d86b066b9716a74e9b421cb3c184306f24
Oct 30 02:42:28.195514 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:28.193667    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h" event={"ID":"fc15187f-0896-4775-a227-4633a4dc3734","Type":"ContainerStarted","Data":"90fbff41cdbdeb5f03b2fa3bb0138c596f68f352a758cc588af0736c09a08668"}
Oct 30 02:42:28.195514 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:28.193740    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h" event={"ID":"fc15187f-0896-4775-a227-4633a4dc3734","Type":"ContainerStarted","Data":"83aa134ced028def486b674b51f9070c686dcd7ef3faff28a8518938ebde1e50"}
Oct 30 02:42:28.199531 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:28.199505    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt" event={"ID":"b3b1c5be-f236-44d8-9168-1bdf3dd9dce6","Type":"ContainerStarted","Data":"9f4506797d96652c34dd8beb3ad1d6d86b066b9716a74e9b421cb3c184306f24"}
Oct 30 02:42:28.985466 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:28.985396    2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 02:42:28.992631 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:28.990952    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.005803 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.005763    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 02:42:29.006230 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.006029    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 02:42:29.006230 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.006206    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 02:42:29.006664 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.006512    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 02:42:29.006664 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.006580    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 02:42:29.006664 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.006619    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 02:42:29.028927 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.028889    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 02:42:29.029082 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.028989    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 02:42:29.047171 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.047138    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 02:42:29.057754 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.057726    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 02:42:29.057882 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.057869    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 02:42:29.057972 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.057951    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 02:42:29.058025 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.058012    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 02:42:29.058138 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.058124    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m7t9x\""
Oct 30 02:42:29.058175 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.058148    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-71pugkl75onuk\""
Oct 30 02:42:29.058217 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.058194    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 02:42:29.060906 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.060881    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 02:42:29.123493 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.123470    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:29.129146 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129123    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129247 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129164    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129247 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129209    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129374 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129351    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129428 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129414    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129484 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129442    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129484 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129470    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129583 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129497    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129583 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129522    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129583 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129545    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74t8h\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-kube-api-access-74t8h\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129583 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129573    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129814 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129600    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129814 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129623    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129814 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129651    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129814 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129674    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129814 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129707    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129814 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129750    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.129814 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129786    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.130136 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129818    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.130136 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.129861    2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.207715 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.206479    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p" event={"ID":"c1239074-11cc-456f-8ff1-242cb437f9a8","Type":"ContainerStarted","Data":"da02ff796e62079fc7e0ba5a207b1c1f658cb2fbc0e68f9a5e53abfa9d65d9a4"}
Oct 30 02:42:29.211943 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.211045    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h" event={"ID":"fc15187f-0896-4775-a227-4633a4dc3734","Type":"ContainerStarted","Data":"a912c54cc9c95afe4028f67fce12a5cf12fba8ea5dd55d9b499713faaff91c11"}
Oct 30 02:42:29.211943 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.211869    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:29.215265 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.215244    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:29.216571 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.216423    2543 patch_prober.go:29] interesting pod/monitoring-plugin-77f4f76594-28zrt container/monitoring-plugin namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.134.0.16:9443/health\": dial tcp 10.134.0.16:9443: connect: connection refused" start-of-body=
Oct 30 02:42:29.216571 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.216462    2543 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt" podUID="b3b1c5be-f236-44d8-9168-1bdf3dd9dce6" containerName="monitoring-plugin" probeResult="failure" output="Get \"https://10.134.0.16:9443/health\": dial tcp 10.134.0.16:9443: connect: connection refused"
Oct 30 02:42:29.219659 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.219639    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerStarted","Data":"a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6"}
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230481    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230507    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230526    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230547    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230567    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230585    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230620    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230649    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230667    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230711    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230751    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230827    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230859    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230883    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230907    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230931    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.231457 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230954    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74t8h\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-kube-api-access-74t8h\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.232322 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.230982    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.232322 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.231007    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.232322 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.231031    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.233245 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.233025    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.233245 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.233154    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.233641 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.233617    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.235365 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.234560    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.235365 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.234670    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.235365 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.234835    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.235983 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.235957    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.236494 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.236472    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.238431 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.238396    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.242173 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.242066    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p" podStartSLOduration=1.44858735 podStartE2EDuration="3.242049967s" totalImagesPullingTime="1.793462617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:29.241191931 +0000 UTC m=+61.098667081" watchObservedRunningTime="2026-10-30 02:42:29.242049967 +0000 UTC m=+61.099525117"
Oct 30 02:42:29.242635 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.242554    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.242741 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.242703    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.242873 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.242833    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.243364 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.243324    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.243364 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.243336    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.243650 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.243633    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.243717 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.243686    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.244614 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.244595    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.244768 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.244749    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.246626 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.246605    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.252361 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.252341    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74t8h\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-kube-api-access-74t8h\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.282082 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.280718    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h" podStartSLOduration=2.383272766 podStartE2EDuration="5.280701266s" totalImagesPullingTime="2.8974285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:42:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:29.279719476 +0000 UTC m=+61.137194626" watchObservedRunningTime="2026-10-30 02:42:29.280701266 +0000 UTC m=+61.138176416"
Oct 30 02:42:29.323880 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.323823    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7815085010000002 podStartE2EDuration="6.323805711s" totalImagesPullingTime="3.528095408s" totalInitContainerRuntime="14.201802ms" isStatefulPod=false podCreationTimestamp="2026-10-30 02:42:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:29.322058251 +0000 UTC m=+61.179533402" watchObservedRunningTime="2026-10-30 02:42:29.323805711 +0000 UTC m=+61.181280861"
Oct 30 02:42:29.330015 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.329956    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:29.363730 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.363432    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt" podStartSLOduration=1.681087889 podStartE2EDuration="3.363416968s" totalImagesPullingTime="1.682329079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:29.362528352 +0000 UTC m=+61.220003501" watchObservedRunningTime="2026-10-30 02:42:29.363416968 +0000 UTC m=+61.220892113"
Oct 30 02:42:29.673711 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:29.673397    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 02:42:30.225825 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:30.225791    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt" event={"ID":"b3b1c5be-f236-44d8-9168-1bdf3dd9dce6","Type":"ContainerStarted","Data":"ab3144e69fabdaa605311713c2c5bd5594fe3d740341e17f3a2257e59a5ae0b2"}
Oct 30 02:42:30.230631 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:30.230599    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7595648df5-ptz96" event={"ID":"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f","Type":"ContainerStarted","Data":"4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717"}
Oct 30 02:42:30.231762 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:30.231739    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:30.234931 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:30.234909    2543 generic.go:356] "Generic (PLEG): container finished" podID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerID="9a4ed3b32e139a5b12c049e1c82d4d5879b32d56f004f0da0dade060711d4ecc" exitCode=0
Oct 30 02:42:30.235028 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:30.235003    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerDied","Data":"9a4ed3b32e139a5b12c049e1c82d4d5879b32d56f004f0da0dade060711d4ecc"}
Oct 30 02:42:30.235093 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:30.235072    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerStarted","Data":"6e27c1cb180cabda591cc34c418538e6ce76ae6f71dadc762e4aa36de31da7a3"}
Oct 30 02:42:30.267225 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:30.267184    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7595648df5-ptz96" podStartSLOduration=1.842913523 podStartE2EDuration="5.267173175s" totalImagesPullingTime="3.424259652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:30.266248661 +0000 UTC m=+62.123723817" watchObservedRunningTime="2026-10-30 02:42:30.267173175 +0000 UTC m=+62.124648324"
Oct 30 02:42:34.254215 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.254178    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerStarted","Data":"757fd6ab4373b614c8b7eaddc651c2aab58068ee8d76b03f7311026cc6863dc6"}
Oct 30 02:42:34.254603 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.254249    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerStarted","Data":"ac617b926cecb2909084363047d6a70ee48d2293a8c0ee2e9af6774afef34cfd"}
Oct 30 02:42:34.254603 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.254276    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerStarted","Data":"8667a8163e11c102b099019d2889b4d46d865f5c06249fcba699b871bf9ea987"}
Oct 30 02:42:34.254603 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.254332    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerStarted","Data":"a31e20be00cb182b8848d5dd3a5199512894817a5826d8c1a1d3ecc779dd32e4"}
Oct 30 02:42:34.254603 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.254360    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerStarted","Data":"a37fea907960a2a8bddaf086b9628a864292a52ea122c1380bb033cd8d47d712"}
Oct 30 02:42:34.254603 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.254384    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerStarted","Data":"615806f331e2ab9c139ef2689ea8c9251093747d9d0167418a2be0f328be2732"}
Oct 30 02:42:34.310256 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.310180    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.980132142 podStartE2EDuration="6.310111672s" totalImagesPullingTime="3.309543922s" totalInitContainerRuntime="20.435608ms" isStatefulPod=false podCreationTimestamp="2026-10-30 02:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:34.308301619 +0000 UTC m=+66.165776762" watchObservedRunningTime="2026-10-30 02:42:34.310111672 +0000 UTC m=+66.167586822"
Oct 30 02:42:34.330212 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.330180    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:34.486347 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.486274    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:34.486501 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.486377    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:34.498707 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.498684    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 02:42:34.498787 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.498772    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 02:42:34.509193 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.509116    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:34.509193 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.509164    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:34.586824 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.586800    2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d\") pod \"network-check-target-jw4x2\" (UID: \"416971fa-0af3-448e-b81c-48c6d02bdbb5\") " pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:34.594781 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.594765    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-czntg\""
Oct 30 02:42:34.598792 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.598779    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 02:42:34.602894 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.602879    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:34.619301 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.619271    2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 02:42:34.630756 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.630732    2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d\") pod \"network-check-target-jw4x2\" (UID: \"416971fa-0af3-448e-b81c-48c6d02bdbb5\") " pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:34.701774 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.701752    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-j74dx\""
Oct 30 02:42:34.710832 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.710812    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:34.728585 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.728566    2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-d89pf\""
Oct 30 02:42:34.737741 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.737720    2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:34.892257 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:34.892225    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nhkvm"]
Oct 30 02:42:34.895170 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:34.895145    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1c39ff_4766_4915_8cd2_2ff6730302fb.slice/crio-e60fcdc983a0d92a52f9c9879bba775cf6dd6bce228f7aede860c494dcb691e3 WatchSource:0}: Error finding container e60fcdc983a0d92a52f9c9879bba775cf6dd6bce228f7aede860c494dcb691e3: Status 404 returned error can't find the container with id e60fcdc983a0d92a52f9c9879bba775cf6dd6bce228f7aede860c494dcb691e3
Oct 30 02:42:35.000752 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:35.000728    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jw4x2"]
Oct 30 02:42:35.003073 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:35.003050    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416971fa_0af3_448e_b81c_48c6d02bdbb5.slice/crio-07684a580fc10ccb1a79b9e31804f527731e278cb09fcad15e9e06e19a4f5d90 WatchSource:0}: Error finding container 07684a580fc10ccb1a79b9e31804f527731e278cb09fcad15e9e06e19a4f5d90: Status 404 returned error can't find the container with id 07684a580fc10ccb1a79b9e31804f527731e278cb09fcad15e9e06e19a4f5d90
Oct 30 02:42:35.031684 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:35.031663    2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pb6zp"]
Oct 30 02:42:35.033835 ip-10-0-128-202 kubenswrapper[2543]: W1030 02:42:35.033813    2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8cf619f_9892_48d5_911e_5f7432d945ec.slice/crio-d5976872608317529f3834a6535867e4be1acff2d7d359ff8d1ba06acf8b2df9 WatchSource:0}: Error finding container d5976872608317529f3834a6535867e4be1acff2d7d359ff8d1ba06acf8b2df9: Status 404 returned error can't find the container with id d5976872608317529f3834a6535867e4be1acff2d7d359ff8d1ba06acf8b2df9
Oct 30 02:42:35.258844 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:35.258813    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pb6zp" event={"ID":"f8cf619f-9892-48d5-911e-5f7432d945ec","Type":"ContainerStarted","Data":"d5976872608317529f3834a6535867e4be1acff2d7d359ff8d1ba06acf8b2df9"}
Oct 30 02:42:35.260099 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:35.260077    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nhkvm" event={"ID":"7f1c39ff-4766-4915-8cd2-2ff6730302fb","Type":"ContainerStarted","Data":"e60fcdc983a0d92a52f9c9879bba775cf6dd6bce228f7aede860c494dcb691e3"}
Oct 30 02:42:35.261306 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:35.261268    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jw4x2" event={"ID":"416971fa-0af3-448e-b81c-48c6d02bdbb5","Type":"ContainerStarted","Data":"07684a580fc10ccb1a79b9e31804f527731e278cb09fcad15e9e06e19a4f5d90"}
Oct 30 02:42:36.246138 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:36.245726    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:36.268687 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:36.268649    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nhkvm" event={"ID":"7f1c39ff-4766-4915-8cd2-2ff6730302fb","Type":"ContainerStarted","Data":"9eaf0df7615fa89bf58c00d0a476b4c45249f9c1b23540a9720e1ee24b60f50e"}
Oct 30 02:42:36.269103 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:36.268728    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nhkvm" event={"ID":"7f1c39ff-4766-4915-8cd2-2ff6730302fb","Type":"ContainerStarted","Data":"0c417b5f3064d1df7b4cbaafdf7ae975b2d32033e407daed380ef8b5edad88c4"}
Oct 30 02:42:36.322297 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:36.322253    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:36.324254 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:36.324226    2543 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:36.330593 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:36.330560    2543 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:36.370982 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:36.370939    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nhkvm" podStartSLOduration=66.311441034 podStartE2EDuration="1m7.370925351s" totalImagesPullingTime="1.059484317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:36.335047569 +0000 UTC m=+68.192522719" watchObservedRunningTime="2026-10-30 02:42:36.370925351 +0000 UTC m=+68.228400490"
Oct 30 02:42:37.279171 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:37.279141    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:39.286180 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:39.286130    2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jw4x2" event={"ID":"416971fa-0af3-448e-b81c-48c6d02bdbb5","Type":"ContainerStarted","Data":"22ee53ef84089855f64cf7d723b7d65938d81a7e394ef54fea5d7c748529f62f"}
Oct 30 02:42:39.286736 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:39.286426    2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:39.320802 ip-10-0-128-202 kubenswrapper[2543]: I1030 02:42:39.320743    2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jw4x2" podStartSLOduration=66.931264213 podStartE2EDuration="1m10.320729374s" totalImagesPullingTime="3.389465161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 02:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:42:39.320502062 +0000 UTC m=+71.177977212" watchObservedRunningTime="2026-10-30 02:42:39.320729374 +0000 UTC m=+71.178204523"
Oct 30 02:42:40.094502 ip-10-0-128-202 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 02:42:40.111712 ip-10-0-128-202 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 02:42:40.111876 ip-10-0-128-202 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 02:42:40.111923 ip-10-0-128-202 systemd[1]: kubelet.service: Consumed 4.702s CPU time.
Oct 30 02:42:40.125899 ip-10-0-128-202 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 02:42:40.187133 ip-10-0-128-202 kubenswrapper[5981]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:42:40.187133 ip-10-0-128-202 kubenswrapper[5981]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 02:42:40.187133 ip-10-0-128-202 kubenswrapper[5981]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:42:40.187133 ip-10-0-128-202 kubenswrapper[5981]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 02:42:40.189091 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189019    5981 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:42:40.189091 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189092    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189096    5981 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189099    5981 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189102    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189105    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189107    5981 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189110    5981 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189112    5981 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189115    5981 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189118    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189121    5981 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189124    5981 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189132    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189135    5981 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189138    5981 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189141    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189143    5981 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189145    5981 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189148    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:42:40.189163 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189151    5981 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189153    5981 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189156    5981 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189160    5981 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189162    5981 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189165    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189168    5981 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189171    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189174    5981 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189177    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189179    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189182    5981 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189184    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189187    5981 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189189    5981 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189192    5981 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189194    5981 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189197    5981 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189199    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189202    5981 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:42:40.189681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189204    5981 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189206    5981 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189211    5981 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189215    5981 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189219    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189222    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189225    5981 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189228    5981 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189231    5981 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189233    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189236    5981 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189239    5981 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189241    5981 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189244    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189247    5981 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189249    5981 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189252    5981 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189254    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189257    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:42:40.190180 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189259    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189262    5981 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189264    5981 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189267    5981 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189269    5981 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189272    5981 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189275    5981 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189277    5981 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189299    5981 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189302    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189304    5981 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189307    5981 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189310    5981 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189312    5981 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189316    5981 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189320    5981 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189324    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189328    5981 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189330    5981 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189333    5981 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:42:40.190681 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189336    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189338    5981 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189341    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189344    5981 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189347    5981 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189349    5981 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189352    5981 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189354    5981 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189357    5981 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189359    5981 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189362    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189364    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189367    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189369    5981 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189372    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189374    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189377    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189380    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189382    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:42:40.191190 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189386    5981 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189388    5981 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189391    5981 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189393    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189396    5981 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189398    5981 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189401    5981 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.189403    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190135    5981 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190142    5981 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190146    5981 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190149    5981 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190152    5981 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190154    5981 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190157    5981 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190160    5981 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190163    5981 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190165    5981 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190168    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:42:40.191677 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190171    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190173    5981 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190176    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190178    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190181    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190184    5981 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190187    5981 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190190    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190192    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190195    5981 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190197    5981 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190200    5981 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190202    5981 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190205    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190208    5981 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190210    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190212    5981 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190215    5981 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190218    5981 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:42:40.192150 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190221    5981 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190225    5981 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190229    5981 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190233    5981 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190237    5981 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190240    5981 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190244    5981 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190246    5981 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190249    5981 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190252    5981 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190255    5981 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190257    5981 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190260    5981 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190262    5981 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190265    5981 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190267    5981 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190270    5981 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190273    5981 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190276    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:42:40.192649 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190297    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190302    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190306    5981 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190310    5981 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190316    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190319    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190321    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190324    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190326    5981 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190329    5981 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190332    5981 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190334    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190337    5981 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190339    5981 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190342    5981 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190344    5981 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190347    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190350    5981 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190352    5981 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190355    5981 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:42:40.193111 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190359    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190361    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190366    5981 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190369    5981 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190372    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190374    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190377    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190379    5981 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190381    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190384    5981 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190386    5981 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190389    5981 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190391    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190394    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190396    5981 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190399    5981 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190401    5981 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190404    5981 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190407    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:42:40.193619 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190409    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190412    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190414    5981 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190417    5981 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190419    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190421    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190424    5981 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190426    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190429    5981 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190431    5981 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190434    5981 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190436    5981 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190442    5981 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190445    5981 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190447    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190452    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190455    5981 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190457    5981 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190969    5981 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:42:40.194081 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190976    5981 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190980    5981 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190984    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190987    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190989    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190992    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190995    5981 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.190997    5981 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191000    5981 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191003    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191005    5981 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191008    5981 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191010    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191013    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191015    5981 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191018    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191020    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191023    5981 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191025    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191028    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:42:40.194573 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191030    5981 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191033    5981 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191035    5981 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191037    5981 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191040    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191044    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191049    5981 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191052    5981 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191057    5981 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191059    5981 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191061    5981 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191064    5981 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191066    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191069    5981 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191071    5981 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191074    5981 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191076    5981 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191079    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191081    5981 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191084    5981 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:42:40.195454 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191087    5981 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191089    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191091    5981 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191094    5981 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191096    5981 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191099    5981 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191101    5981 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191104    5981 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191106    5981 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191108    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191111    5981 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191113    5981 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191117    5981 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191121    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191124    5981 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191127    5981 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191130    5981 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191133    5981 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191135    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:42:40.196359 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191141    5981 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191145    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191148    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191150    5981 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191153    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191155    5981 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191158    5981 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191160    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191163    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191165    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191168    5981 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191170    5981 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191173    5981 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191175    5981 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191178    5981 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191180    5981 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191183    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191185    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191188    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191190    5981 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:42:40.197209 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191193    5981 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191196    5981 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191198    5981 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191201    5981 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191204    5981 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191206    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191208    5981 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191211    5981 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191213    5981 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191216    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191218    5981 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191221    5981 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191223    5981 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191232    5981 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191235    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191237    5981 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191239    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191242    5981 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191244    5981 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:42:40.198106 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191247    5981 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191249    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191252    5981 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191254    5981 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191256    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191259    5981 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191262    5981 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191365    5981 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191381    5981 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191392    5981 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191396    5981 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191400    5981 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191403    5981 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191407    5981 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191413    5981 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191416    5981 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191419    5981 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191423    5981 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191426    5981 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191429    5981 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191432    5981 flags.go:64] FLAG: --cgroup-root=""
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191435    5981 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 02:42:40.199052 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191438    5981 flags.go:64] FLAG: --client-ca-file=""
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191441    5981 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191444    5981 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191448    5981 flags.go:64] FLAG: --cluster-domain=""
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191451    5981 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191454    5981 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191457    5981 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191461    5981 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191465    5981 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191467    5981 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191471    5981 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191474    5981 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191477    5981 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191480    5981 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191483    5981 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191486    5981 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191489    5981 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191493    5981 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191496    5981 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191499    5981 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191501    5981 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191504    5981 flags.go:64] FLAG: --enable-server="true"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191507    5981 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191511    5981 flags.go:64] FLAG: --event-burst="100"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191516    5981 flags.go:64] FLAG: --event-qps="50"
Oct 30 02:42:40.200044 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191519    5981 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191522    5981 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191524    5981 flags.go:64] FLAG: --eviction-hard=""
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191529    5981 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191532    5981 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191534    5981 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191538    5981 flags.go:64] FLAG: --eviction-soft=""
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191541    5981 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191544    5981 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191547    5981 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191549    5981 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191552    5981 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191555    5981 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191559    5981 flags.go:64] FLAG: --feature-gates=""
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191563    5981 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191565    5981 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191569    5981 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191572    5981 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191575    5981 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191578    5981 flags.go:64] FLAG: --help="false"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191581    5981 flags.go:64] FLAG: --hostname-override="ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191584    5981 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191587    5981 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 02:42:40.201144 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191589    5981 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191593    5981 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191596    5981 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191599    5981 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191602    5981 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191604    5981 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191607    5981 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191610    5981 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191614    5981 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191617    5981 flags.go:64] FLAG: --kube-reserved=""
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191620    5981 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191623    5981 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191626    5981 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191629    5981 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191631    5981 flags.go:64] FLAG: --lock-file=""
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191634    5981 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191637    5981 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191640    5981 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191646    5981 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191649    5981 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191652    5981 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191654    5981 flags.go:64] FLAG: --logging-format="text"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191657    5981 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191661    5981 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 02:42:40.201830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191664    5981 flags.go:64] FLAG: --manifest-url=""
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191666    5981 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191670    5981 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191673    5981 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191678    5981 flags.go:64] FLAG: --max-pods="110"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191681    5981 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191684    5981 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191687    5981 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191690    5981 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191693    5981 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191696    5981 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191698    5981 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191705    5981 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191708    5981 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191711    5981 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191714    5981 flags.go:64] FLAG: --pod-cidr=""
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191718    5981 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191721    5981 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191724    5981 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191726    5981 flags.go:64] FLAG: --port="10250"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191729    5981 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191732    5981 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dffc18aa93e96ccc"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191736    5981 flags.go:64] FLAG: --qos-reserved=""
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191741    5981 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191744    5981 flags.go:64] FLAG: --register-node="true"
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191747    5981 flags.go:64] FLAG: --register-with-taints=""
Oct 30 02:42:40.202426 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191751    5981 flags.go:64] FLAG: --registry-burst="10"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191754    5981 flags.go:64] FLAG: --registry-qps="5"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191757    5981 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191760    5981 flags.go:64] FLAG: --reserved-memory=""
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191763    5981 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191766    5981 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191770    5981 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191773    5981 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191775    5981 flags.go:64] FLAG: --runonce="false"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191778    5981 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191781    5981 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191784    5981 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191787    5981 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191789    5981 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191792    5981 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191795    5981 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191798    5981 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191801    5981 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191804    5981 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191807    5981 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191810    5981 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191812    5981 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191817    5981 flags.go:64] FLAG: --system-cgroups=""
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191819    5981 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191824    5981 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 02:42:40.203104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191827    5981 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191830    5981 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191834    5981 flags.go:64] FLAG: --tls-min-version=""
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191837    5981 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191841    5981 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191844    5981 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191847    5981 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191850    5981 flags.go:64] FLAG: --v="2"
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191854    5981 flags.go:64] FLAG: --version="false"
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191858    5981 flags.go:64] FLAG: --vmodule=""
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191862    5981 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.191865    5981 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191991    5981 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191995    5981 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.191998    5981 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192001    5981 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192004    5981 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192006    5981 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192009    5981 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192011    5981 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192014    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192016    5981 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:42:40.203742 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192019    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192022    5981 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192024    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192027    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192030    5981 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192032    5981 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192035    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192039    5981 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192041    5981 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192044    5981 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192046    5981 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192049    5981 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192052    5981 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192054    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192059    5981 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192061    5981 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192064    5981 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192067    5981 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192070    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192072    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:42:40.204298 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192076    5981 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192079    5981 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192082    5981 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192084    5981 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192087    5981 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192090    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192093    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192096    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192098    5981 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192101    5981 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192103    5981 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192106    5981 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192108    5981 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192110    5981 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192113    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192116    5981 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192118    5981 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192121    5981 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192123    5981 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:42:40.204934 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192126    5981 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192129    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192132    5981 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192134    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192137    5981 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192140    5981 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192142    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192145    5981 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192148    5981 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192151    5981 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192153    5981 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192156    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192159    5981 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192162    5981 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192164    5981 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192167    5981 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192169    5981 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192172    5981 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192174    5981 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192177    5981 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:42:40.205616 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192180    5981 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192182    5981 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192185    5981 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192187    5981 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192190    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192192    5981 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192195    5981 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192197    5981 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192200    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192202    5981 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192206    5981 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192210    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192214    5981 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192217    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192220    5981 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192223    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192225    5981 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192228    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192231    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:42:40.208705 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192235    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192238    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192240    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192243    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192245    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192248    5981 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192251    5981 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192253    5981 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192256    5981 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192258    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192261    5981 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192263    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192266    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192268    5981 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192271    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192273    5981 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192276    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:42:40.209364 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192292    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.192319    5981 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192352    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192356    5981 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192359    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192362    5981 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192365    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192368    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192371    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192375    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192377    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192380    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192383    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192385    5981 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192388    5981 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192392    5981 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:42:40.209878 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192394    5981 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192396    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192399    5981 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192401    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192404    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192406    5981 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192409    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192411    5981 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192414    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192416    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192419    5981 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192422    5981 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192424    5981 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192427    5981 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192430    5981 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192432    5981 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192435    5981 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192437    5981 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192440    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:42:40.210294 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192442    5981 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192444    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192447    5981 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192450    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192452    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192455    5981 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192459    5981 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192461    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192464    5981 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192466    5981 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192469    5981 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192472    5981 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192475    5981 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192478    5981 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192480    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192483    5981 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192485    5981 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192488    5981 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192491    5981 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192493    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:42:40.210759 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192496    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192500    5981 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192503    5981 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192506    5981 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192509    5981 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192511    5981 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192514    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192517    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192520    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192522    5981 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192524    5981 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192527    5981 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192530    5981 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192532    5981 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192535    5981 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192538    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192540    5981 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192543    5981 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192549    5981 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:42:40.211261 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192552    5981 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192554    5981 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192557    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192559    5981 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192562    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192565    5981 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192568    5981 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192570    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192573    5981 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192576    5981 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192578    5981 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192581    5981 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192584    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192586    5981 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192589    5981 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192591    5981 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192594    5981 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192596    5981 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192599    5981 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192601    5981 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:42:40.211780 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192604    5981 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192607    5981 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192609    5981 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192612    5981 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192615    5981 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192617    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192620    5981 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192622    5981 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192625    5981 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192627    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192630    5981 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192635    5981 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192639    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.192642    5981 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.197676    5981 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.197696    5981 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.197716    5981 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.197723    5981 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197819    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:42:40.212263 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197827    5981 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197832    5981 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197837    5981 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197844    5981 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197850    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197854    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197859    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197863    5981 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197868    5981 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197872    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197877    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197881    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197886    5981 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197890    5981 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197894    5981 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197899    5981 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197903    5981 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197907    5981 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197912    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:42:40.212741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197916    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197920    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197924    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197929    5981 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197933    5981 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197940    5981 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197954    5981 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197959    5981 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197964    5981 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197968    5981 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197973    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197977    5981 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197982    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197987    5981 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197991    5981 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.197996    5981 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198000    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198004    5981 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:42:40.213198 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198008    5981 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198013    5981 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198017    5981 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198021    5981 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198026    5981 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198030    5981 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198034    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198038    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198043    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198047    5981 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198051    5981 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198055    5981 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198060    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198064    5981 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198069    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198073    5981 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198078    5981 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198083    5981 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198087    5981 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:42:40.213741 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198092    5981 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198096    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198112    5981 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198117    5981 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198121    5981 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198125    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198129    5981 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198133    5981 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198138    5981 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198143    5981 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198147    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198151    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198156    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198160    5981 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198164    5981 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198168    5981 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198173    5981 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198177    5981 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198181    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198186    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:42:40.214197 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198190    5981 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198194    5981 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198199    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198203    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198208    5981 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198212    5981 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198216    5981 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198221    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198225    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198229    5981 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198234    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198238    5981 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198243    5981 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198247    5981 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198251    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198263    5981 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198268    5981 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198272    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198277    5981 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198311    5981 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:42:40.214709 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198315    5981 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198319    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198323    5981 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198327    5981 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198330    5981 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198334    5981 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198338    5981 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198341    5981 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198345    5981 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.198387    5981 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198712    5981 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198721    5981 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198727    5981 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198731    5981 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198736    5981 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198741    5981 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:42:40.215230 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198746    5981 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198750    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198754    5981 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198759    5981 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198763    5981 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198767    5981 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198773    5981 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198780    5981 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198786    5981 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198791    5981 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198795    5981 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198800    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198812    5981 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198816    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198821    5981 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198825    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198830    5981 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198834    5981 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198838    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:42:40.215652 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198843    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198847    5981 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198851    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198855    5981 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198859    5981 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198863    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198867    5981 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198881    5981 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198886    5981 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198890    5981 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198894    5981 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198898    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198903    5981 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198907    5981 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198911    5981 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198915    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198919    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198924    5981 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198928    5981 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198932    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:42:40.216201 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198936    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198940    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198944    5981 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198948    5981 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198953    5981 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198957    5981 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198969    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198973    5981 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198978    5981 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198982    5981 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198987    5981 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198991    5981 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198995    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.198999    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199003    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199007    5981 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199011    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199016    5981 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199021    5981 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:42:40.216736 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199026    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199030    5981 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199035    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199039    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199043    5981 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199047    5981 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199051    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199055    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199058    5981 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199063    5981 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199066    5981 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199070    5981 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199074    5981 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199078    5981 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199083    5981 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199087    5981 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199091    5981 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199096    5981 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199100    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:42:40.217206 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199105    5981 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199117    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199122    5981 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199126    5981 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199130    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199134    5981 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199138    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199143    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199158    5981 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199164    5981 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199174    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199179    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199183    5981 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199188    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199192    5981 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199197    5981 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199201    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199205    5981 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199210    5981 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:42:40.217809 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199214    5981 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199218    5981 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199222    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199226    5981 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.199265    5981 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199345    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199353    5981 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199359    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199363    5981 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199368    5981 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199372    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199377    5981 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199381    5981 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199386    5981 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199390    5981 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199402    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 02:42:40.218466 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199406    5981 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199411    5981 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199415    5981 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199419    5981 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199423    5981 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199428    5981 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199432    5981 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199436    5981 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199444    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199448    5981 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199452    5981 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199457    5981 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199462    5981 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199468    5981 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199474    5981 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199478    5981 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199483    5981 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199487    5981 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199491    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 02:42:40.218946 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199495    5981 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199500    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199504    5981 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199508    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199513    5981 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199517    5981 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199522    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199526    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199530    5981 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199534    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199539    5981 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199543    5981 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199547    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199562    5981 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199567    5981 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199572    5981 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199576    5981 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199580    5981 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199584    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199589    5981 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 02:42:40.219587 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199593    5981 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199599    5981 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199604    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199608    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199621    5981 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199626    5981 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199630    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199635    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199639    5981 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199643    5981 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199647    5981 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199651    5981 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199656    5981 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199660    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199664    5981 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199668    5981 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199673    5981 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199677    5981 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199681    5981 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199686    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 02:42:40.220438 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199690    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199695    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199699    5981 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199703    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199707    5981 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199712    5981 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199724    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199729    5981 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199733    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199738    5981 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199742    5981 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199746    5981 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199750    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199756    5981 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199761    5981 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199765    5981 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199770    5981 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199774    5981 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199778    5981 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 02:42:40.221231 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199783    5981 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199787    5981 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199791    5981 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199795    5981 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199799    5981 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199803    5981 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199808    5981 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199812    5981 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199816    5981 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199821    5981 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199825    5981 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199829    5981 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199833    5981 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199838    5981 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199846    5981 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199852    5981 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:42:40.199858    5981 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.199948    5981 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.202185    5981 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 02:42:40.222022 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.202240    5981 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 02:42:40.223025 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.202451    5981 server.go:1014] "Starting client certificate rotation"
Oct 30 02:42:40.223025 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.202586    5981 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 02:42:40.223025 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.202630    5981 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 02:36:29 +0000 UTC" deadline="2028-08-08 03:40:37.768869004 +0000 UTC"
Oct 30 02:42:40.223025 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.202665    5981 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15552h57m57.566206271s"
Oct 30 02:42:40.223025 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.202896    5981 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 02:42:40.223025 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.204019    5981 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 02:42:40.223025 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.205099    5981 log.go:25] "Validated CRI v1 runtime API"
Oct 30 02:42:40.223025 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.208592    5981 log.go:25] "Validated CRI v1 image API"
Oct 30 02:42:40.223025 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.209502    5981 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 02:42:40.223025 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.211889    5981 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 db969b9d-dbdd-467e-9156-6ba8e20256d8:/dev/nvme0n1p3 e2b5786c-1779-4a87-9ca0-48cfa43c0c7d:/dev/nvme0n1p4]
Oct 30 02:42:40.223547 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.211908    5981 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0468b3905d84222e656fae1e5d1aa678e1e5287e43c7e972764e0766857dcbdd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0468b3905d84222e656fae1e5d1aa678e1e5287e43c7e972764e0766857dcbdd/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/07684a580fc10ccb1a79b9e31804f527731e278cb09fcad15e9e06e19a4f5d90/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/07684a580fc10ccb1a79b9e31804f527731e278cb09fcad15e9e06e19a4f5d90/userdata/shm major:0 minor:509 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0f15cd4316a0773284414e662b8dfe0049acdc57d31d7728671ab16b2b5a8d71/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0f15cd4316a0773284414e662b8dfe0049acdc57d31d7728671ab16b2b5a8d71/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2877d8a1b2bd48f629256a9211fcf68bfe798c7e04342c0eb490691961f4ae14/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2877d8a1b2bd48f629256a9211fcf68bfe798c7e04342c0eb490691961f4ae14/userdata/shm major:0 minor:79 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4010217157e70a308b2662cfd1b3a0bf1b8cac4a8806eeb552fa1e0d8acab4c3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4010217157e70a308b2662cfd1b3a0bf1b8cac4a8806eeb552fa1e0d8acab4c3/userdata/shm major:0 minor:359 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4942e6304db3d72c9c51d7f5d1d6b05bf27a15fb60e5a7b7ef53be14c2a74da3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4942e6304db3d72c9c51d7f5d1d6b05bf27a15fb60e5a7b7ef53be14c2a74da3/userdata/shm major:0 minor:231 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4a568a28b0ebde9bdbb7fb1d184b81676106192bba4199235a5731a1ef81d9eb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4a568a28b0ebde9bdbb7fb1d184b81676106192bba4199235a5731a1ef81d9eb/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/52a6f15272c962215f75146f627ad7913b9620f0581d32c45d417766b4ae9879/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/52a6f15272c962215f75146f627ad7913b9620f0581d32c45d417766b4ae9879/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/52ce237b0f14b3329fd2e1d0e7947be79fda363b4603fc28d595fb7596c4ef55/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/52ce237b0f14b3329fd2e1d0e7947be79fda363b4603fc28d595fb7596c4ef55/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5fa7061a76ca3ec5649ad4ae2b81d35854b0fbcb63c9203094ba0164dcf77c9c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5fa7061a76ca3ec5649ad4ae2b81d35854b0fbcb63c9203094ba0164dcf77c9c/userdata/shm major:0 minor:302 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/643b220f41021ff050d03365e09b6500f0db153bd622c58b6975bba451bf471a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/643b220f41021ff050d03365e09b6500f0db153bd622c58b6975bba451bf471a/userdata/shm major:0 minor:352 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/69fcc74fbc29c7178db0472fbe714e3020de9bae9d8c214ea49ca3b602d6e974/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/69fcc74fbc29c7178db0472fbe714e3020de9bae9d8c214ea49ca3b602d6e974/userdata/shm major:0 minor:279 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6c2a3fc39f445a1db2115843110f0dc5d7f729c32f2d4af779d94c6da55cc2f2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6c2a3fc39f445a1db2115843110f0dc5d7f729c32f2d4af779d94c6da55cc2f2/userdata/shm major:0 minor:93 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6e27c1cb180cabda591cc34c418538e6ce76ae6f71dadc762e4aa36de31da7a3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6e27c1cb180cabda591cc34c418538e6ce76ae6f71dadc762e4aa36de31da7a3/userdata/shm major:0 minor:463 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/78406bd43b1f16fce1bf2196199f85f4769a423f9af75a8b6a25a499bb40b35c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/78406bd43b1f16fce1bf2196199f85f4769a423f9af75a8b6a25a499bb40b35c/userdata/shm major:0 minor:375 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/799a05beabe541b1f12fac7abfab3b786d7d278467a29d04d8eeba1433a25b2a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/799a05beabe541b1f12fac7abfab3b786d7d278467a29d04d8eeba1433a25b2a/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/93c3c75c581bd6f1d86ad0aca5a267191a11ef1ecb5eb7487c8246267174fc2e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/93c3c75c581bd6f1d86ad0aca5a267191a11ef1ecb5eb7487c8246267174fc2e/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9d4e4181fb125fa9ad61afe115a30701541f1ee66eaea08597562b9b9c82b369/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9d4e4181fb125fa9ad61afe115a30701541f1ee66eaea08597562b9b9c82b369/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9f4506797d96652c34dd8beb3ad1d6d86b066b9716a74e9b421cb3c184306f24/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9f4506797d96652c34dd8beb3ad1d6d86b066b9716a74e9b421cb3c184306f24/userdata/shm major:0 minor:416 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ba0f7dc469da0996cfe81cb6a45ed9f83319cf64d7a1ee4d174b23a8b769f6ec/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ba0f7dc469da0996cfe81cb6a45ed9f83319cf64d7a1ee4d174b23a8b769f6ec/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ced370fe6ecb30e3e6ab718aaa7eaadce32b87136f73972752ddc989f418596b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ced370fe6ecb30e3e6ab718aaa7eaadce32b87136f73972752ddc989f418596b/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d2444ea7c885c4958ef04cbcf4042aab78d8a77d3f235d54cf71d346e36b1d33/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d2444ea7c885c4958ef04cbcf4042aab78d8a77d3f235d54cf71d346e36b1d33/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d5976872608317529f3834a6535867e4be1acff2d7d359ff8d1ba06acf8b2df9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d5976872608317529f3834a6535867e4be1acff2d7d359ff8d1ba06acf8b2df9/userdata/shm major:0 minor:511 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e60fcdc983a0d92a52f9c9879bba775cf6dd6bce228f7aede860c494dcb691e3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e60fcdc983a0d92a52f9c9879bba775cf6dd6bce228f7aede860c494dcb691e3/userdata/shm major:0 minor:506 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e611d6206fc9c864d1f2a0ecc6b20912200623eb5a71b7bd6dfdb06d97cc4aed/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e611d6206fc9c864d1f2a0ecc6b20912200623eb5a71b7bd6dfdb06d97cc4aed/userdata/shm major:0 minor:281 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ed1e9e37c1631837e2c58c5d06796faab5c25e34b44d12272917aaac06857248/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ed1e9e37c1631837e2c58c5d06796faab5c25e34b44d12272917aaac06857248/userdata/shm major:0 minor:277 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volume-subpaths/web-config/alertmanager/9 major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volume-subpaths/web-config/config-reloader/6 major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~empty-dir/config-out major:0 minor:305 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~projected/kube-api-access-ddcm6:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~projected/kube-api-access-ddcm6 major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~projected/tls-assets major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/config-volume major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:306 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/web-config major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0dbab0f3-4bbd-4889-ae78-ddff0b995e72/volumes/kubernetes.io~projected/kube-api-access-jl6xs:{mountpoint:/var/lib/kubelet/pods/0dbab0f3-4bbd-4889-ae78-ddff0b995e72/volumes/kubernetes.io~projected/kube-api-access-jl6xs major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0dbab0f3-4bbd-4889-ae78-ddff0b995e72/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/0dbab0f3-4bbd-4889-ae78-ddff0b995e72/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2291168b-f4ed-40e5-9767-afe1561cf5d5/volumes/kubernetes.io~projected/kube-api-access-vqzfw:{mountpoint:/var/lib/kubelet/pods/2291168b-f4ed-40e5-9767-afe1561cf5d5/volumes/kubernetes.io~projected/kube-api-access-vqzfw major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3237b03d-9c16-410e-b61e-7c5884f42e65/volumes/kubernetes.io~projected/kube-api-access-fbf7s:{mountpoint:/var/lib/kubelet/pods/3237b03d-9c16-410e-b61e-7c5884f42e65/volumes/kubernetes.io~projected/kube-api-access-fbf7s major:0 minor:275 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3237b03d-9c16-410e-b61e-7c5884f42e65/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/3237b03d-9c16-410e-b61e-7c5884f42e65/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:272 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3237b03d-9c16-410e-b61e-7c5884f42e65/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/3237b03d-9c16-410e-b61e-7c5884f42e65/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36d0c7ea-c907-4088-aacd-dd7224bd896c/volumes/kubernetes.io~projected/kube-api-access-gjxsj:{mountpoint:/var/lib/kubelet/pods/36d0c7ea-c907-4088-aacd-dd7224bd896c/volumes/kubernetes.io~projected/kube-api-access-gjxsj major:0 minor:274 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36d0c7ea-c907-4088-aacd-dd7224bd896c/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/36d0c7ea-c907-4088-aacd-dd7224bd896c/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36d0c7ea-c907-4088-aacd-dd7224bd896c/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/36d0c7ea-c907-4088-aacd-dd7224bd896c/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:271 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/416971fa-0af3-448e-b81c-48c6d02bdbb5/volumes/kubernetes.io~projected/kube-api-access-bx28d:{mountpoint:/var/lib/kubelet/pods/416971fa-0af3-448e-b81c-48c6d02bdbb5/volumes/kubernetes.io~projected/kube-api-access-bx28d major:0 minor:508 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/43923788-5bf7-4b82-b721-4ae9c7acf9e6/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/43923788-5bf7-4b82-b721-4ae9c7acf9e6/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/43923788-5bf7-4b82-b721-4ae9c7acf9e6/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/43923788-5bf7-4b82-b721-4ae9c7acf9e6/volumes/kubernetes.io~empty-dir/tmp major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/43923788-5bf7-4b82-b721-4ae9c7acf9e6/volumes/kubernetes.io~projected/kube-api-access-prxbd:{mountpoint:/var/lib/kubelet/pods/43923788-5bf7-4b82-b721-4ae9c7acf9e6/volumes/kubernetes.io~projected/kube-api-access-prxbd major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/48a605d4-42c2-4362-b230-08a10ab9dec6/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/48a605d4-42c2-4362-b230-08a10ab9dec6/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/53793bc8-ff97-4faa-aaf8-3d101fb8d646/volumes/kubernetes.io~projected/kube-api-access-97t59:{mountpoint:/var/lib/kubelet/pods/53793bc8-ff97-4faa-aaf8-3d101fb8d646/volumes/kubernetes.io~projected/kube-api-access-97t59 major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/53793bc8-ff97-4faa-aaf8-3d101fb8d646/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/53793bc8-ff97-4faa-aaf8-3d101fb8d646/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/53793bc8-ff97-4faa-aaf8-3d101fb8d646/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/53793bc8-ff97-4faa-aaf8-3d101fb8d646/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6c9c1786-1f61-4a8b-a780-19de703b790e/volumes/kubernetes.io~projected/kube-api-access-jzcqx:{mountpoint:/var/lib/kubelet/pods/6c9c1786-1f61-4a8b-a780-19de703b790e/volumes/kubernetes.io~projected/kube-api-access-jzcqx major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f1c39ff-4766-4915-8cd2-2ff6730302fb/volumes/kubernetes.io~projected/kube-api-access-6cc2t:{mountpoint:/var/lib/kubelet/pods/7f1c39ff-4766-4915-8cd2-2ff6730302fb/volumes/kubernetes.io~projected/kube-api-access-6cc2t major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f1c39ff-4766-4915-8cd2-2ff6730302fb/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/7f1c39ff-4766-4915-8cd2-2ff6730302fb/volumes/kubernetes.io~secret/metrics-certs major:0 minor:505 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87cca6f3-8578-41cd-ba4a-da8798608de9/volumes/kubernetes.io~projected/kube-api-access-pscxj:{mountpoint:/var/lib/kubelet/pods/87cca6f3-8578-41cd-ba4a-da8798608de9/volumes/kubernetes.io~projected/kube-api-access-pscxj major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ed11453-6d18-4f24-a945-b312108cd664/volumes/kubernetes.io~projected/kube-api-access-7djkd:{mountpoint:/var/lib/kubelet/pods/8ed11453-6d18-4f24-a945-b312108cd664/volumes/kubernetes.io~projected/kube-api-access-7djkd major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a72ad10b-db47-41f9-bacf-ab880f332a7a/volumes/kubernetes.io~projected/kube-api-access-pth9k:{mountpoint:/var/lib/kubelet/pods/a72ad10b-db47-41f9-bacf-ab880f332a7a/volumes/kubernetes.io~projected/kube-api-access-pth9k major:0 minor:276 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a72ad10b-db47-41f9-bacf-ab880f332a7a/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/a72ad10b-db47-41f9-bacf-ab880f332a7a/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a72ad10b-db47-41f9-bacf-ab880f332a7a/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/a72ad10b-db47-41f9-bacf-ab880f332a7a/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:273 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39/volumes/kubernetes.io~projected/kube-api-access-b5476:{mountpoint:/var/lib/kubelet/pods/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39/volumes/kubernetes.io~projected/kube-api-access-b5476 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6/volumes/kubernetes.io~projected/kube-api-access-hkfll:{mountpoint:/var/lib/kubelet/pods/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6/volumes/kubernetes.io~projected/kube-api-access-hkfll major:0 minor:402 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:393 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volume-subpaths/web-config/config-reloader/2 major:0 minor:458 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:458 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volume-subpaths/web-config/prometheus/15 major:0 minor:458 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~empty-dir/config-out major:0 minor:457 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~projected/kube-api-access-74t8h:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~projected/kube-api-access-74t8h major:0 minor:462 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~projected/tls-assets major:0 minor:452 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/config major:0 minor:454 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:460 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:461 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:447 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:453 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:459 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:456 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:455 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/web-config major:0 minor:458 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bec335ab-48e3-4940-aeea-f8f46a184eed/volumes/kubernetes.io~projected/kube-api-access-k2rzs:{mountpoint:/var/lib/kubelet/pods/bec335ab-48e3-4940-aeea-f8f46a184eed/volumes/kubernetes.io~projected/kube-api-access-k2rzs major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1239074-11cc-456f-8ff1-242cb437f9a8/volumes/kubernetes.io~projected/kube-api-access-zxdnn:{mountpoint:/var/lib/kubelet/pods/c1239074-11cc-456f-8ff1-242cb437f9a8/volumes/kubernetes.io~projected/kube-api-access-zxdnn major:0 minor:368 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1239074-11cc-456f-8ff1-242cb437f9a8/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/c1239074-11cc-456f-8ff1-242cb437f9a8/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:365 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1239074-11cc-456f-8ff1-242cb437f9a8/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/c1239074-11cc-456f-8ff1-242cb437f9a8/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:364 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1239074-11cc-456f-8ff1-242cb437f9a8/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/c1239074-11cc-456f-8ff1-242cb437f9a8/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f/volumes/kubernetes.io~projected/kube-api-access-tx4tw:{mountpoint:/var/lib/kubelet/pods/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f/volumes/kubernetes.io~projected/kube-api-access-tx4tw major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:356 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e337e618-cdd3-4496-858f-4f61c4622859/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/e337e618-cdd3-4496-858f-4f61c4622859/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e337e618-cdd3-4496-858f-4f61c4622859/volumes/kubernetes.io~projected/kube-api-access-qb2tr:{mountpoint:/var/lib/kubelet/pods/e337e618-cdd3-4496-858f-4f61c4622859/volumes/kubernetes.io~projected/kube-api-access-qb2tr major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e337e618-cdd3-4496-858f-4f61c4622859/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/e337e618-cdd3-4496-858f-4f61c4622859/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f13d6d8d-e290-450f-b648-1869845dd5a7/volumes/kubernetes.io~projected/kube-api-access-tzr4t:{mountpoint:/var/lib/kubelet/pods/f13d6d8d-e290-450f-b648-1869845dd5a7/volumes/kubernetes.io~projected/kube-api-access-tzr4t major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f13d6d8d-e290-450f-b648-1869845dd5a7/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/f13d6d8d-e290-450f-b648-1869845dd5a7/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f8cf619f-9892-48d5-911e-5f7432d945ec/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/f8cf619f-9892-48d5-911e-5f7432d945ec/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:501 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f92b4266-f045-41d5-8694-ddec1b9fcdf5/volumes/kubernetes.io~projected/kube-api-access-klx67:{mountpoint:/var/lib/kubelet/pods/f92b4266-f045-41d5-8694-ddec1b9fcdf5/volumes/kubernetes.io~projected/kube-api-access-klx67 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f92b4266-f045-41d5-8694-ddec1b9fcdf5/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/f92b4266-f045-41d5-8694-ddec1b9fcdf5/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~projected/kube-api-access-ksbl2:{mountpoint:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~projected/kube-api-access-ksbl2 major:0 minor:351 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:349 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:348 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:350 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:347 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:346 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/26040926ce1ac2fc079d3f273bdafb5d7f238a9fca392df81751cdf18046c33f/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/b2527e297da81410d3254434f558fa91de2ec70a079f28f7e7544bd35a0dc30c/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/96639e0ce7e6ef706f76c59b75b8be4d8f086af521b1118082aedfd4a0d84d5c/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/4556bb5b9c06247296b182f072e19127e53b95281a2b987d238c3d420edca1fc/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/26728a68b4c0ab2f8cece526c0f950fdbf04dea2e8273f8aa518acdfcdedbb6c/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/dcbfdc519e1829a60777da42c90e965dd8f5b8737466acd1d55aa62856e7b5ed/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/ba5ce087e638926f16461670a61125105c675cac25c7306360676b5d7752ac0a/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/f5775f5c0d7568920018dadaa268a593ec55d603700b3c0633c463325e791464/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/e3de797456cdcbaf2c6a410c8f8167f981bd14ed1c15bb39b3e6acd0e0a6df76/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/a3a05663914e4e97a06cf4bc07d74b07a27824dc9aba225f51b9fc6792d5af54/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/ae76e59ce72fb0c7c11a9211c88f031c17d2df58d4b1e7908fbeaa9a86117461/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-140:{mountpoint:/var/lib/containers/storage/overlay/2a6dcefbdc04c32dc550c85347d0446df0335f961b5737e57c12e9bcbcf05b5a/merged major:0 minor:140 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/95cd9ebde87c4e344cd8106abce3d5e973c74af4958289829f383b63ca795052/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/1f122cc2ca14fc63a8e212a2564c841143bafaf248f46411ac3356e6adce72af/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/a6628c0e82e510cf2235311244ae81dc4f285a42b30169698e1880732fc6d0cc/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/6186dea746e6e39adfc2b8e431643f70e332082afbdb5842c3fb2daedf531278/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/d4f8d4a2e120d479a5470e2fdad8e6a913a67db4f2a177d05279350fb618e0b7/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-178:{mountpoint:/var/lib/containers/storage/overlay/cb2565d828a47b5bdee15b2954a32489327527eba49c89fbd70f78dd58767d9f/merged major:0 minor:178 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/44f5783a80cdaa7b11521ad9e4e7292da79cbd40f717f38008a17bfcdeeff179/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/f87c5a39325d65c4add582ae56759e517f5f553baeab582297d18c7ed83fd0a6/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/82e7ef8ccfd1b00bc0a08d3a62bfebb0b0767770f602960fc78056db14a27b65/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/5943803c521e12017ef4e3ef9b0c56dec93dc46e97c318de8edd41722117e393/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/fbc1a79e268c7d6ead691c11c62d42289f95eed7498aad60656fc60a06945f88/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/e705afbeda85b022041fc0748c7e733dd8638b02224a9e52f0de15b688a7e73b/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/eec39f36dcbf458856afe05b571feb892135dcbf9b7eb1392e7e98891ec0e4ed/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/9af8edf71a8886d987c4193a3393c4b778ab774701e9a7d96151a8bbe86dac9a/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-233:{mountpoint:/var/lib/containers/storage/overlay/450964844f5a214f73e861017b97c796191983c7f8b342e3ddd7ee78d0e3a741/merged major:0 minor:233 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/04826db996aa1c1b74c68b121ed79c4a40226576c08145e90c42b0924c641986/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-240:{mountpoint:/var/lib/containers/storage/overlay/71cf4adf97bd1b5c2aa0dca30d57270c8e5e1cf2725fa0fbbe52ead4ed650bb8/merged major:0 minor:240 fsType:overlay blockSize:0} overlay_0-243:{mountpoint:/var/lib/containers/storage/overlay/e0c637e0b16d81b097234b44bfd53a0daa9284bbecd7f4c73420c4252ef52dc9/merged major:0 minor:243 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/36f682e314a25591582e006164ff8c3ac1bc3e02aadbaedc4fe18fa9756a36a7/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/faf5e6cfcfe8a32716fce0cd13798dc7d7a8b8ce2eb9561d430b1e2eb87f215f/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/630290270a9d0eabaf7464d20343fce9f417fe9817e182d86208851729bb9b4f/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-283:{mountpoint:/var/lib/containers/storage/overlay/e566df8098b90488b216442103d55cd19199717d81944e9b1d515455272403bc/merged major:0 minor:283 fsType:overlay blockSize:0} overlay_0-285:{mountpoint:/var/lib/containers/storage/overlay/3effe8e1ee18c2550fa9fef0d14781cf2a1a20eef2e414c72bf9ca6d4a17d232/merged major:0 minor:285 fsType:overlay blockSize:0} overlay_0-287:{mountpoint:/var/lib/containers/storage/overlay/c253c3fd541d0c16c4b1c29bd39e5c81572adf693bb0629e3ca0df94cdb1a80d/merged major:0 minor:287 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/6750885da13fab380323619fdcc6de1c2aba65b7c72c8ae56a2f09f711322860/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/4a2d41f3959ed7308aa7b6587211bdbe746459db26296ce3c74310ce21325f78/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-297:{mountpoint:/var/lib/containers/storage/overlay/a4fba03700b4ec9ec28e2915ecc7a68eccf653bccedfcfbf4742af75823d25a4/merged major:0 minor:297 fsType:overlay blockSize:0} overlay_0-317:{mountpoint:/var/lib/containers/storage/overlay/00753b65f19975f13d48c177695b51819d1205be2e442ccb5eb0f009911375c7/merged major:0 minor:317 fsType:overlay blockSize:0} overlay_0-319:{mountpoint:/var/lib/containers/storage/overlay/1a70276277c2f2acdae431b5d533cbe0586557c7a435ab75a3360b8fafc4fe11/merged major:0 minor:319 fsType:overlay blockSize:0} overlay_0-325:{mountpoint:/var/lib/containers/storage/overlay/0e0a298e1475280bfec020b12f431fb38cb73a0e33915e8a1e1f3d3109d0cfa2/merged major:0 minor:325 fsType:overlay blockSize:0} overlay_0-330:{mountpoint:/var/lib/containers/storage/overlay/b02a4c63f710fcf216faf192c1cc34f4b670ac6fd5e0a3f7a1665831bc3a9c3d/merged major:0 minor:330 fsType:overlay blockSize:0} overlay_0-335:{mountpoint:/var/lib/containers/storage/overlay/3e770b4a6068c0fb75874d0a693361e41f2ec73c72e4c070cf97642d26bde20a/merged major:0 minor:335 fsType:overlay blockSize:0} overlay_0-337:{mountpoint:/var/lib/containers/storage/overlay/b2c221dae770d3b9d6172c51698e1e9b98b0c0b90461359177cb5eec42db50b0/merged major:0 minor:337 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/c67ce0ebe5fe3fd790c4f72360b0b0c0fc1013271a4acc2158cd522e03be60e8/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/b3e239e5903d4a7e3be4811d5552bbbf25db87edb37ae1de40b19b136e1989d4/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/a5230b631c1f3538c20ca6b5b8c10230fc81f063ba58d9195a8409a5bf2a4c6f/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-369:{mountpoint:/var/lib/containers/storage/overlay/db70e6281c0d034b906d12d8673f3901b78e620b9b07ceb9d5ff004c6c8748a7/merged major:0 minor:369 fsType:overlay blockSize:0} overlay_0-377:{mountpoint:/var/lib/containers/storage/overlay/4ae06e4996e6c2a032b5c647a312acdfefd61754ccad358b6950300a14e2134d/merged major:0 minor:377 fsType:overlay blockSize:0} overlay_0-382:{mountpoint:/var/lib/containers/storage/overlay/d74e463b968a85e23ed32289dda948a390699cff038be995bd092aaedaea4803/merged major:0 minor:382 fsType:overlay blockSize:0} overlay_0-388:{mountpoint:/var/lib/containers/storage/overlay/3d7ffdbd06bb1e8effb26951bdc603f2f754ba0306d01483306cd22657a2421a/merged major:0 minor:388 fsType:overlay blockSize:0} overlay_0-397:{mountpoint:/var/lib/containers/storage/overlay/64fa60bff691ae980044b82d17c72e00272d32fd3dc3122f62c6ae7320def2b1/merged major:0 minor:397 fsType:overlay blockSize:0} overlay_0-399:{mountpoint:/var/lib/containers/storage/overlay/c61722f021aae24d44ae9014f8c6a38f3bf34f9870a975c3befc07f81c8c8098/merged major:0 minor:399 fsType:overlay blockSize:0} overlay_0-400:{mountpoint:/var/lib/containers/storage/overlay/a028aa85cc701bb90f60dcc3c85f81b7937fdafb9708167744d31e8ce2447647/merged major:0 minor:400 fsType:overlay blockSize:0} overlay_0-410:{mountpoint:/var/lib/containers/storage/overlay/72289e89c1190443bcc33bb078adce06755eeab58d8c6d0c7a87fbf9ce179dc3/merged major:0 minor:410 fsType:overlay blockSize:0} overlay_0-412:{mountpoint:/var/lib/containers/storage/overlay/d8ad1a5f1722c5daef86c47496001fbba9683733cbab5d95c6227fdac43d6184/merged major:0 minor:412 fsType:overlay blockSize:0} overlay_0-419:{mountpoint:/var/lib/containers/storage/overlay/67c95992eb01f9516ad38ddcd47b1bf3c733976a9fcc4ff2206ab969c49f7370/merged major:0 minor:419 fsType:overlay blockSize:0} overlay_0-421:{mountpoint:/var/lib/containers/storage/overlay/17361bba87b0b7c64973f34c717092385709fdc31bdbc6a721e7a002e8f44a08/merged major:0 minor:421 fsType:overlay blockSize:0} overlay_0-426:{mountpoint:/var/lib/containers/storage/overlay/ed1ae0bb713ef4be98b92dd0eda1bd46f89a95860f514170e64e800018637901/merged major:0 minor:426 fsType:overlay blockSize:0} overlay_0-431:{mountpoint:/var/lib/containers/storage/overlay/40f7bfcf03fd11880a5137f47e01b882a0adc05cc40a53bc17779f763d66a748/merged major:0 minor:431 fsType:overlay blockSize:0} overlay_0-433:{mountpoint:/var/lib/containers/storage/overlay/12beb513d5ef157b11eb5c56d2b55a6b0bc664c1baff11499934644016aaea9c/merged major:0 minor:433 fsType:overlay blockSize:0} overlay_0-441:{mountpoint:/var/lib/containers/storage/overlay/4df9b65cc891f31c40240b78bed89e9ac52c4c3df7a6bddb4ab848d6f4131d80/merged major:0 minor:441 fsType:overlay blockSize:0} overlay_0-465:{mountpoint:/var/lib/containers/storage/overlay/d797142f257de437dba886eddc139962245643af3d6babe5376d9ccf426d29a5/merged major:0 minor:465 fsType:overlay blockSize:0} overlay_0-467:{mountpoint:/var/lib/containers/storage/overlay/7996407f3cc29abc9c7b5ded55dd2229616d4f1a2148c168e75e6c7282ef9546/merged major:0 minor:467 fsType:overlay blockSize:0} overlay_0-469:{mountpoint:/var/lib/containers/storage/overlay/9f45d157c3f88efa2eb5ed043ba9822439b4c732b2761b64bda54a7f3e0a40f3/merged major:0 minor:469 fsType:overlay blockSize:0} overlay_0-475:{mountpoint:/var/lib/containers/storage/overlay/56cb2d157c39079dcdf5cdcef9001df0c0307815b3213b61ca66e41b17374b3f/merged major:0 minor:475 fsType:overlay blockSize:0} overlay_0-481:{mountpoint:/var/lib/containers/storage/overlay/d6b5d757aa473ecedb364418e9ed8b7153168fab9d36970f120ccd58ff047d31/merged major:0 minor:481 fsType:overlay blockSize:0} overlay_0-486:{mountpoint:/var/lib/containers/storage/overlay/30905a00f6f771c48ce1ca504286acde1b2518b4ed43c4f012009a726597672f/merged major:0 minor:486 fsType:overlay blockSize:0} overlay_0-491:{mountpoint:/var/lib/containers/storage/overlay/8b6a381a6b3abb5d96077e42503ba4ffe4b1e70dee68738e13b7cad9f3e1cfa7/merged major:0 minor:491 fsType:overlay blockSize:0} overlay_0-496:{mountpoint:/var/lib/containers/storage/overlay/180dfd31d6547b893bc9d9706bf5c39898fe288bff3b818a01fe3b21934e4f85/merged major:0 minor:496 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/2b65d3b724d37c88db8d38ebbf0bb73cc48b2927200c28f38899cfd1d353a959/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-513:{mountpoint:/var/lib/containers/storage/overlay/f24f3a2b3b96a3c68853fc1309e1370510267aa45aca4774bf7b1035acb0dada/merged major:0 minor:513 fsType:overlay blockSize:0} overlay_0-515:{mountpoint:/var/lib/containers/storage/overlay/cbe4bd9f4f0b52ba88366ce6aea3bb42d4fc85156bc9cfdb0e44a1b8d096f96c/merged major:0 minor:515 fsType:overlay blockSize:0} overlay_0-517:{mountpoint:/var/lib/containers/storage/overlay/e60f58d1a7f74dd564860829d6226b5e46c8602876bdfcf52939e58ed097c150/merged major:0 minor:517 fsType:overlay blockSize:0} overlay_0-519:{mountpoint:/var/lib/containers/storage/overlay/2f5d63f4f7c01d9275424412ced5c18fa9ced04dcbb654c2a459ddd0bb3403e3/merged major:0 minor:519 fsType:overlay blockSize:0} overlay_0-521:{mountpoint:/var/lib/containers/storage/overlay/758dbece729b69677939ad18a624d4d61ae364259f39ae25d6a295dd72e2e8f8/merged major:0 minor:521 fsType:overlay blockSize:0} overlay_0-527:{mountpoint:/var/lib/containers/storage/overlay/392b9640bf545fa21cb8e8c28f919bba466769532796d57b9bf502f034c9afa1/merged major:0 minor:527 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/21306bc281d41bddc3c770a18afae8414d7af174fd4347832316eaaa3d18d193/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-532:{mountpoint:/var/lib/containers/storage/overlay/62d11a04fb44ceb0583c61a880dcaf2a326f2b753d47ac8ae5db3a3ed6b836aa/merged major:0 minor:532 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/9e2085a63f2e8473e1c8274595b2371c076cd782d7f5c9cb0ce0de4bf18f9f64/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/a9fc30e172de2560940adccd3e964f1a712ac879a927b7314e0432eaf45b1819/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/be124765113facfbe8fb0c47608e9e97b16858e108039bf5fba7bd15284a5c03/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/febcee76cffc3e859daf72b00c8a19e50d59f23db542941cc3fd72c1af62b9bd/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-87:{mountpoint:/var/lib/containers/storage/overlay/edd0378aac31750aa60c04f54965211679f7bc0c9c74d612936938c9b2d2ea25/merged major:0 minor:87 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/317658f6fc489926d747c121ca589c86b59b60f3c7834c1187a55844bc515b50/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/6f2b3c2ae8d1cea0fa411b1a6e61ad9e38af851f3aacd44ce20477079bc9cc6d/merged major:0 minor:96 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/f4d8be70e96f91523abb52ba6017d1c7ace6be3eb2cb28cf43d870e9f1a76e1f/merged major:0 minor:98 fsType:overlay blockSize:0}]
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.221666    5981 manager.go:217] Machine: {Timestamp:2026-10-30 02:42:40.220460523 +0000 UTC m=+0.062706963 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3135744 MemoryCapacity:32812011520 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ae21d24e2653e50e65ff16d20b756 SystemUUID:ec2ae21d-24e2-653e-50e6-5ff16d20b756 BootID:737f32ff-2577-4b1a-9960-226050d0c06e Filesystems:[{Device:/run/containers/storage/overlay-containers/4010217157e70a308b2662cfd1b3a0bf1b8cac4a8806eeb552fa1e0d8acab4c3/userdata/shm DeviceMajor:0 DeviceMinor:359 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-517 DeviceMajor:0 DeviceMinor:517 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7f1c39ff-4766-4915-8cd2-2ff6730302fb/volumes/kubernetes.io~projected/kube-api-access-6cc2t DeviceMajor:0 DeviceMinor:62 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39/volumes/kubernetes.io~projected/kube-api-access-b5476 DeviceMajor:0 DeviceMinor:67 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-240 DeviceMajor:0 DeviceMinor:240 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-297 DeviceMajor:0 DeviceMinor:297 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c1239074-11cc-456f-8ff1-242cb437f9a8/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:364 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-178 DeviceMajor:0 DeviceMinor:178 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/53793bc8-ff97-4faa-aaf8-3d101fb8d646/volumes/kubernetes.io~projected/kube-api-access-97t59 DeviceMajor:0 DeviceMinor:230 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/36d0c7ea-c907-4088-aacd-dd7224bd896c/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:271 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e611d6206fc9c864d1f2a0ecc6b20912200623eb5a71b7bd6dfdb06d97cc4aed/userdata/shm DeviceMajor:0 DeviceMinor:281 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-369 DeviceMajor:0 DeviceMinor:369 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-388 DeviceMajor:0 DeviceMinor:388 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6e27c1cb180cabda591cc34c418538e6ce76ae6f71dadc762e4aa36de31da7a3/userdata/shm DeviceMajor:0 DeviceMinor:463 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/52ce237b0f14b3329fd2e1d0e7947be79fda363b4603fc28d595fb7596c4ef55/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-399 DeviceMajor:0 DeviceMinor:399 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:458 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:458 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-513 DeviceMajor:0 DeviceMinor:513 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/87cca6f3-8578-41cd-ba4a-da8798608de9/volumes/kubernetes.io~projected/kube-api-access-pscxj DeviceMajor:0 DeviceMinor:65 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/e337e618-cdd3-4496-858f-4f61c4622859/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/53793bc8-ff97-4faa-aaf8-3d101fb8d646/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:229 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-285 DeviceMajor:0 DeviceMinor:285 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:314 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/78406bd43b1f16fce1bf2196199f85f4769a423f9af75a8b6a25a499bb40b35c/userdata/shm DeviceMajor:0 DeviceMinor:375 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-426 DeviceMajor:0 DeviceMinor:426 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-469 DeviceMajor:0 DeviceMinor:469 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2877d8a1b2bd48f629256a9211fcf68bfe798c7e04342c0eb490691961f4ae14/userdata/shm DeviceMajor:0 DeviceMinor:79 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-233 DeviceMajor:0 DeviceMinor:233 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/36d0c7ea-c907-4088-aacd-dd7224bd896c/volumes/kubernetes.io~projected/kube-api-access-gjxsj DeviceMajor:0 DeviceMinor:274 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-287 DeviceMajor:0 DeviceMinor:287 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6/volumes/kubernetes.io~projected/kube-api-access-hkfll DeviceMajor:0 DeviceMinor:402 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:458 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:357 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/c1239074-11cc-456f-8ff1-242cb437f9a8/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:365 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:454 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/36d0c7ea-c907-4088-aacd-dd7224bd896c/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:265 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ed1e9e37c1631837e2c58c5d06796faab5c25e34b44d12272917aaac06857248/userdata/shm DeviceMajor:0 DeviceMinor:277 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:310 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-412 DeviceMajor:0 DeviceMinor:412 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-475 DeviceMajor:0 DeviceMinor:475 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-496 DeviceMajor:0 DeviceMinor:496 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e337e618-cdd3-4496-858f-4f61c4622859/volumes/kubernetes.io~projected/kube-api-access-qb2tr DeviceMajor:0 DeviceMinor:63 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-87 DeviceMajor:0 DeviceMinor:87 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:304 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/07684a580fc10ccb1a79b9e31804f527731e278cb09fcad15e9e06e19a4f5d90/userdata/shm DeviceMajor:0 DeviceMinor:509 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-532 DeviceMajor:0 DeviceMinor:532 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406003712 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/69fcc74fbc29c7178db0472fbe714e3020de9bae9d8c214ea49ca3b602d6e974/userdata/shm DeviceMajor:0 DeviceMinor:279 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:311 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:393 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/799a05beabe541b1f12fac7abfab3b786d7d278467a29d04d8eeba1433a25b2a/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-243 DeviceMajor:0 DeviceMinor:243 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-419 DeviceMajor:0 DeviceMinor:419 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:447 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:453 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:455 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-521 DeviceMajor:0 DeviceMinor:521 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ced370fe6ecb30e3e6ab718aaa7eaadce32b87136f73972752ddc989f418596b/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:313 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:348 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-431 DeviceMajor:0 DeviceMinor:431 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-441 DeviceMajor:0 DeviceMinor:441 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-527 DeviceMajor:0 DeviceMinor:527 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9d4e4181fb125fa9ad61afe115a30701541f1ee66eaea08597562b9b9c82b369/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/643b220f41021ff050d03365e09b6500f0db153bd622c58b6975bba451bf471a/userdata/shm DeviceMajor:0 DeviceMinor:352 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f13d6d8d-e290-450f-b648-1869845dd5a7/volumes/kubernetes.io~projected/kube-api-access-tzr4t DeviceMajor:0 DeviceMinor:203 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/f92b4266-f045-41d5-8694-ddec1b9fcdf5/volumes/kubernetes.io~projected/kube-api-access-klx67 DeviceMajor:0 DeviceMinor:204 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/a72ad10b-db47-41f9-bacf-ab880f332a7a/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:273 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~projected/kube-api-access-ddcm6 DeviceMajor:0 DeviceMinor:315 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-317 DeviceMajor:0 DeviceMinor:317 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:342 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9f4506797d96652c34dd8beb3ad1d6d86b066b9716a74e9b421cb3c184306f24/userdata/shm DeviceMajor:0 DeviceMinor:416 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:303 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:356 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:452 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e60fcdc983a0d92a52f9c9879bba775cf6dd6bce228f7aede860c494dcb691e3/userdata/shm DeviceMajor:0 DeviceMinor:506 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:350 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/c1239074-11cc-456f-8ff1-242cb437f9a8/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:363 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d5976872608317529f3834a6535867e4be1acff2d7d359ff8d1ba06acf8b2df9/userdata/shm DeviceMajor:0 DeviceMinor:511 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-515 DeviceMajor:0 DeviceMinor:515 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/2291168b-f4ed-40e5-9767-afe1561cf5d5/volumes/kubernetes.io~projected/kube-api-access-vqzfw DeviceMajor:0 DeviceMinor:66 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-283 DeviceMajor:0 DeviceMinor:283 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-382 DeviceMajor:0 DeviceMinor:382 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-465 DeviceMajor:0 DeviceMinor:465 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/48a605d4-42c2-4362-b230-08a10ab9dec6/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/8ed11453-6d18-4f24-a945-b312108cd664/volumes/kubernetes.io~projected/kube-api-access-7djkd DeviceMajor:0 DeviceMinor:61 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3237b03d-9c16-410e-b61e-7c5884f42e65/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:272 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:310 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-397 DeviceMajor:0 DeviceMinor:397 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:312 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~projected/kube-api-access-74t8h DeviceMajor:0 DeviceMinor:462 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-467 DeviceMajor:0 DeviceMinor:467 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-491 DeviceMajor:0 DeviceMinor:491 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/416971fa-0af3-448e-b81c-48c6d02bdbb5/volumes/kubernetes.io~projected/kube-api-access-bx28d DeviceMajor:0 DeviceMinor:508 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4a568a28b0ebde9bdbb7fb1d184b81676106192bba4199235a5731a1ef81d9eb/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:305 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:346 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:310 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-481 DeviceMajor:0 DeviceMinor:481 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0dbab0f3-4bbd-4889-ae78-ddff0b995e72/volumes/kubernetes.io~projected/kube-api-access-jl6xs DeviceMajor:0 DeviceMinor:202 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-325 DeviceMajor:0 DeviceMinor:325 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f/volumes/kubernetes.io~projected/kube-api-access-tx4tw DeviceMajor:0 DeviceMinor:358 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-377 DeviceMajor:0 DeviceMinor:377 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bec335ab-48e3-4940-aeea-f8f46a184eed/volumes/kubernetes.io~projected/kube-api-access-k2rzs DeviceMajor:0 DeviceMinor:59 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/6c9c1786-1f61-4a8b-a780-19de703b790e/volumes/kubernetes.io~projected/kube-api-access-jzcqx DeviceMajor:0 DeviceMinor:60 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a72ad10b-db47-41f9-bacf-ab880f332a7a/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:270 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-330 DeviceMajor:0 DeviceMinor:330 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~projected/kube-api-access-ksbl2 DeviceMajor:0 DeviceMinor:351 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:456 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562402304 Type:vfs Inodes:819200 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/52a6f15272c962215f75146f627ad7913b9620f0581d32c45d417766b4ae9879/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d2444ea7c885c4958ef04cbcf4042aab78d8a77d3f235d54cf71d346e36b1d33/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/53793bc8-ff97-4faa-aaf8-3d101fb8d646/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:225 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-337 DeviceMajor:0 DeviceMinor:337 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:347 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4942e6304db3d72c9c51d7f5d1d6b05bf27a15fb60e5a7b7ef53be14c2a74da3/userdata/shm DeviceMajor:0 DeviceMinor:231 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-400 DeviceMajor:0 DeviceMinor:400 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-421 DeviceMajor:0 DeviceMinor:421 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-433 DeviceMajor:0 DeviceMinor:433 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:460 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-519 DeviceMajor:0 DeviceMinor:519 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e337e618-cdd3-4496-858f-4f61c4622859/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-335 DeviceMajor:0 DeviceMinor:335 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-486 DeviceMajor:0 DeviceMinor:486 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0f15cd4316a0773284414e662b8dfe0049acdc57d31d7728671ab16b2b5a8d71/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-140 DeviceMajor:0 DeviceMinor:140 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:312 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-319 DeviceMajor:0 DeviceMinor:319 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c1239074-11cc-456f-8ff1-242cb437f9a8/volumes/kubernetes.io~projected/kube-api-access-zxdnn DeviceMajor:0 DeviceMinor:368 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/f13d6d8d-e290-450f-b648-1869845dd5a7/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:461 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/43923788-5bf7-4b82-b721-4ae9c7acf9e6/volumes/kubernetes.io~projected/kube-api-access-prxbd DeviceMajor:0 DeviceMinor:64 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:310 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-410 DeviceMajor:0 DeviceMinor:410 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7f1c39ff-4766-4915-8cd2-2ff6730302fb/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:505 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/43923788-5bf7-4b82-b721-4ae9c7acf9e6/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:57 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/43923788-5bf7-4b82-b721-4ae9c7acf9e6/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:58 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6c2a3fc39f445a1db2115843110f0dc5d7f729c32f2d4af779d94c6da55cc2f2/userdata/shm DeviceMajor:0 DeviceMinor:93 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/a72ad10b-db47-41f9-bacf-ab880f332a7a/volumes/kubernetes.io~projected/kube-api-access-pth9k DeviceMajor:0 DeviceMinor:276 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:457 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:459 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/93c3c75c581bd6f1d86ad0aca5a267191a11ef1ecb5eb7487c8246267174fc2e/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f92b4266-f045-41d5-8694-ddec1b9fcdf5/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/3237b03d-9c16-410e-b61e-7c5884f42e65/volumes/kubernetes.io~projected/kube-api-access-fbf7s DeviceMajor:0 DeviceMinor:275 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:306 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5fa7061a76ca3ec5649ad4ae2b81d35854b0fbcb63c9203094ba0164dcf77c9c/userdata/shm DeviceMajor:0 DeviceMinor:302 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:458 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/var/lib/kubelet/pods/f8cf619f-9892-48d5-911e-5f7432d945ec/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:501 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0468b3905d84222e656fae1e5d1aa678e1e5287e43c7e972764e0766857dcbdd/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3237b03d-9c16-410e-b61e-7c5884f42e65/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:269 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0dbab0f3-4bbd-4889-ae78-ddff0b995e72/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ba0f7dc469da0996cfe81cb6a45ed9f83319cf64d7a1ee4d174b23a8b769f6ec/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005372 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fc15187f-0896-4775-a227-4633a4dc3734/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:349 Capacity:31633412096 Type:vfs Inodes:4005372 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:07684a580fc10cc MacAddress:ca:b8:63:0c:f7:90 Speed:10000 Mtu:8901} {Name:4010217157e70a3 MacAddress:42:85:d0:38:51:6a Speed:10000 Mtu:8901} {Name:4942e6304db3d72 MacAddress:16:bd:cb:61:62:f4 Speed:10000 Mtu:8901} {Name:5fa7061a76ca3ec MacAddress:9a:cd:13:e2:a5:b4 Speed:10000 Mtu:8901} {Name:643b220f41021ff MacAddress:86:b0:19:76:e8:84 Speed:10000 Mtu:8901} {Name:69fcc74fbc29c71 MacAddress:06:69:03:76:66:37 Speed:10000 Mtu:8901} {Name:6e27c1cb180cabd MacAddress:b6:29:58:4d:c0:7c Speed:10000 Mtu:8901} {Name:78406bd43b1f16f MacAddress:96:6b:f1:e4:14:7c Speed:10000 Mtu:8901} {Name:9d4e4181fb125fa MacAddress:b6:9d:2f:62:85:ac Speed:10000 Mtu:8901} {Name:9f4506797d96652 MacAddress:e6:04:6b:16:d0:b9 Speed:10000 Mtu:8901} {Name:ba0f7dc469da099 MacAddress:52:8c:f9:f6:ad:c9 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:cc:af:f4:c1 Speed:0 Mtu:9001} {Name:br-int MacAddress:0e:a3:ca:3a:1a:ff Speed:0 Mtu:8901} {Name:ced370fe6ecb30e MacAddress:9e:de:5f:61:da:3b Speed:10000 Mtu:8901} {Name:d59768726083175 MacAddress:f2:0c:73:1e:8a:ca Speed:10000 Mtu:8901} {Name:e60fcdc983a0d92 MacAddress:da:28:a9:8e:08:78 Speed:10000 Mtu:8901} {Name:ed1e9e37c163183 MacAddress:d2:20:f9:7c:b0:41 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:cc:af:f4:c1 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:fe:07:2e:98:95:cc Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:12:e4:6b:54:98:bd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812011520 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.222479    5981 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.222542    5981 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.222849    5981 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.222886    5981 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.223068    5981 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.223081    5981 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.223094    5981 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.223123    5981 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.223223    5981 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.223448    5981 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.223590    5981 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.223680    5981 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.223699    5981 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.223713    5981 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.223727    5981 kubelet.go:405] "Adding apiserver pod source"
Oct 30 02:42:40.224041 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.223738    5981 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 02:42:40.225111 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.224698    5981 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 02:42:40.225111 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.224712    5981 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 02:42:40.225226 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.225210    5981 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 02:42:40.228061 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228045    5981 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 02:42:40.228061 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228060    5981 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 02:42:40.228177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228168    5981 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 02:42:40.228382 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228370    5981 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 02:42:40.228464 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228400    5981 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 02:42:40.228518 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228509    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 02:42:40.228547 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228524    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 02:42:40.228547 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228531    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 02:42:40.228547 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228545    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 02:42:40.228625 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228554    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 02:42:40.228625 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228563    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 02:42:40.228625 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228569    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 02:42:40.228625 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228574    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 02:42:40.228625 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228581    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 02:42:40.228625 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228586    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 02:42:40.228625 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228599    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 02:42:40.228625 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228608    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 02:42:40.228872 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228632    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 02:42:40.228872 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.228640    5981 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 02:42:40.231994 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.231978    5981 server.go:1263] "Started kubelet"
Oct 30 02:42:40.232076 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.232014    5981 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 02:42:40.232691 ip-10-0-128-202 systemd[1]: Started Kubernetes Kubelet.
Oct 30 02:42:40.233393 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.233270    5981 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 02:42:40.238711 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.233932    5981 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 02:42:40.238711 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.236430    5981 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 02:42:40.238711 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.236738    5981 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 02:42:40.241013 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.240987    5981 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 02:42:40.241096 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.241037    5981 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 02:42:40.241224 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.241201    5981 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 02:42:40.241271 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.241225    5981 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 02:42:40.241347 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.241319    5981 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 02:36:31 +0000 UTC" deadline="2028-07-06 15:25:01.826830194 +0000 UTC"
Oct 30 02:42:40.241347 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.241336    5981 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 02:42:40.241347 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.241339    5981 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14772h42m21.585494443s"
Oct 30 02:42:40.241837 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.241815    5981 factory.go:55] Registering systemd factory
Oct 30 02:42:40.241920 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.241840    5981 factory.go:223] Registration of the systemd container factory successfully
Oct 30 02:42:40.241980 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:42:40.241920    5981 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-202.ec2.internal\" not found"
Oct 30 02:42:40.244488 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244460    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f13d6d8d-e290-450f-b648-1869845dd5a7" volumeName="kubernetes.io/empty-dir/f13d6d8d-e290-450f-b648-1869845dd5a7-data-volume" seLinuxMountContext=""
Oct 30 02:42:40.244488 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244480    5981 factory.go:153] Registering CRI-O factory
Oct 30 02:42:40.244488 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244489    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3237b03d-9c16-410e-b61e-7c5884f42e65" volumeName="kubernetes.io/empty-dir/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-textfile" seLinuxMountContext=""
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244497    5981 factory.go:223] Registration of the crio container factory successfully
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244498    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a72ad10b-db47-41f9-bacf-ab880f332a7a" volumeName="kubernetes.io/secret/a72ad10b-db47-41f9-bacf-ab880f332a7a-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244507    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e337e618-cdd3-4496-858f-4f61c4622859" volumeName="kubernetes.io/secret/e337e618-cdd3-4496-858f-4f61c4622859-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244515    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f92b4266-f045-41d5-8694-ddec1b9fcdf5" volumeName="kubernetes.io/configmap/f92b4266-f045-41d5-8694-ddec1b9fcdf5-config-volume" seLinuxMountContext=""
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244523    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244532    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d0c7ea-c907-4088-aacd-dd7224bd896c" volumeName="kubernetes.io/secret/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-tls" seLinuxMountContext=""
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244539    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="416971fa-0af3-448e-b81c-48c6d02bdbb5" volumeName="kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d" seLinuxMountContext=""
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244551    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f13d6d8d-e290-450f-b648-1869845dd5a7" volumeName="kubernetes.io/projected/f13d6d8d-e290-450f-b648-1869845dd5a7-kube-api-access-tzr4t" seLinuxMountContext=""
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244568    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc15187f-0896-4775-a227-4633a4dc3734" volumeName="kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244639    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc15187f-0896-4775-a227-4633a4dc3734" volumeName="kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-grpc-tls" seLinuxMountContext=""
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244654    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="53793bc8-ff97-4faa-aaf8-3d101fb8d646" volumeName="kubernetes.io/projected/53793bc8-ff97-4faa-aaf8-3d101fb8d646-kube-api-access-97t59" seLinuxMountContext=""
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244562    5981 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 02:42:40.244674 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244667    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f1c39ff-4766-4915-8cd2-2ff6730302fb" volumeName="kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244693    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-db" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244710    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-grpc-tls" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244723    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-tls-assets" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244735    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-cluster-tls-config" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244748    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3237b03d-9c16-410e-b61e-7c5884f42e65" volumeName="kubernetes.io/configmap/3237b03d-9c16-410e-b61e-7c5884f42e65-metrics-client-ca" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244760    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="43923788-5bf7-4b82-b721-4ae9c7acf9e6" volumeName="kubernetes.io/projected/43923788-5bf7-4b82-b721-4ae9c7acf9e6-kube-api-access-prxbd" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244773    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac93e0d1-bf8a-40f3-90b6-c9dad1418e39" volumeName="kubernetes.io/configmap/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-cni-binary-copy" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244784    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-config-volume" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244796    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244809    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8cf619f-9892-48d5-911e-5f7432d945ec" volumeName="kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244821    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc15187f-0896-4775-a227-4633a4dc3734" volumeName="kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-tls" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244841    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244856    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244869    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1239074-11cc-456f-8ff1-242cb437f9a8" volumeName="kubernetes.io/configmap/c1239074-11cc-456f-8ff1-242cb437f9a8-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244881    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1239074-11cc-456f-8ff1-242cb437f9a8" volumeName="kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-secret-metrics-server-client-certs" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244898    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc15187f-0896-4775-a227-4633a4dc3734" volumeName="kubernetes.io/empty-dir/fc15187f-0896-4775-a227-4633a4dc3734-tmp" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244929    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87cca6f3-8578-41cd-ba4a-da8798608de9" volumeName="kubernetes.io/projected/87cca6f3-8578-41cd-ba4a-da8798608de9-kube-api-access-pscxj" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244942    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bec335ab-48e3-4940-aeea-f8f46a184eed" volumeName="kubernetes.io/projected/bec335ab-48e3-4940-aeea-f8f46a184eed-kube-api-access-k2rzs" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244953    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="48a605d4-42c2-4362-b230-08a10ab9dec6" volumeName="kubernetes.io/secret/48a605d4-42c2-4362-b230-08a10ab9dec6-agent-certs" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244964    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c9c1786-1f61-4a8b-a780-19de703b790e" volumeName="kubernetes.io/projected/6c9c1786-1f61-4a8b-a780-19de703b790e-kube-api-access-jzcqx" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244975    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-tls-assets" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244987    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f92b4266-f045-41d5-8694-ddec1b9fcdf5" volumeName="kubernetes.io/empty-dir/f92b4266-f045-41d5-8694-ddec1b9fcdf5-tmp-dir" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244999    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0dbab0f3-4bbd-4889-ae78-ddff0b995e72" volumeName="kubernetes.io/projected/0dbab0f3-4bbd-4889-ae78-ddff0b995e72-kube-api-access-jl6xs" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245011    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="53793bc8-ff97-4faa-aaf8-3d101fb8d646" volumeName="kubernetes.io/configmap/53793bc8-ff97-4faa-aaf8-3d101fb8d646-metrics-client-ca" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245022    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="53793bc8-ff97-4faa-aaf8-3d101fb8d646" volumeName="kubernetes.io/secret/53793bc8-ff97-4faa-aaf8-3d101fb8d646-prometheus-operator-tls" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245034    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a72ad10b-db47-41f9-bacf-ab880f332a7a" volumeName="kubernetes.io/projected/a72ad10b-db47-41f9-bacf-ab880f332a7a-kube-api-access-pth9k" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245046    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3b1c5be-f236-44d8-9168-1bdf3dd9dce6" volumeName="kubernetes.io/secret/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6-monitoring-plugin-cert" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245057    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245068    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc15187f-0896-4775-a227-4633a4dc3734" volumeName="kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245082    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2291168b-f4ed-40e5-9767-afe1561cf5d5" volumeName="kubernetes.io/projected/2291168b-f4ed-40e5-9767-afe1561cf5d5-kube-api-access-vqzfw" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245096    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245108    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e337e618-cdd3-4496-858f-4f61c4622859" volumeName="kubernetes.io/projected/e337e618-cdd3-4496-858f-4f61c4622859-kube-api-access-qb2tr" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245120    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f92b4266-f045-41d5-8694-ddec1b9fcdf5" volumeName="kubernetes.io/projected/f92b4266-f045-41d5-8694-ddec1b9fcdf5-kube-api-access-klx67" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245133    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc15187f-0896-4775-a227-4633a4dc3734" volumeName="kubernetes.io/configmap/fc15187f-0896-4775-a227-4633a4dc3734-metrics-client-ca" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245149    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-kube-api-access-ddcm6" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245161    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0dbab0f3-4bbd-4889-ae78-ddff0b995e72" volumeName="kubernetes.io/secret/0dbab0f3-4bbd-4889-ae78-ddff0b995e72-cert" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245172    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d0c7ea-c907-4088-aacd-dd7224bd896c" volumeName="kubernetes.io/secret/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245184    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.244682    5981 factory.go:103] Registering Raw factory
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245198    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-metrics-client-ca" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245210    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d0c7ea-c907-4088-aacd-dd7224bd896c" volumeName="kubernetes.io/configmap/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245215    5981 manager.go:1199] Started watching for new ooms in manager
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245222    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e337e618-cdd3-4496-858f-4f61c4622859" volumeName="kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245237    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f13d6d8d-e290-450f-b648-1869845dd5a7" volumeName="kubernetes.io/configmap/f13d6d8d-e290-450f-b648-1869845dd5a7-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245249    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-metrics-client-ca" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245270    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f1c39ff-4766-4915-8cd2-2ff6730302fb" volumeName="kubernetes.io/projected/7f1c39ff-4766-4915-8cd2-2ff6730302fb-kube-api-access-6cc2t" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245301    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" volumeName="kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-config" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245314    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245325    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="53793bc8-ff97-4faa-aaf8-3d101fb8d646" volumeName="kubernetes.io/secret/53793bc8-ff97-4faa-aaf8-3d101fb8d646-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245337    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3b1c5be-f236-44d8-9168-1bdf3dd9dce6" volumeName="kubernetes.io/projected/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6-kube-api-access-hkfll" seLinuxMountContext=""
Oct 30 02:42:40.245332 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245350    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245363    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2291168b-f4ed-40e5-9767-afe1561cf5d5" volumeName="kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-cni-binary-copy" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245389    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3237b03d-9c16-410e-b61e-7c5884f42e65" volumeName="kubernetes.io/secret/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-tls" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245400    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a72ad10b-db47-41f9-bacf-ab880f332a7a" volumeName="kubernetes.io/configmap/a72ad10b-db47-41f9-bacf-ab880f332a7a-metrics-client-ca" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245413    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-tls" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245424    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f13d6d8d-e290-450f-b648-1869845dd5a7" volumeName="kubernetes.io/secret/f13d6d8d-e290-450f-b648-1869845dd5a7-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245436    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-config-out" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245448    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3237b03d-9c16-410e-b61e-7c5884f42e65" volumeName="kubernetes.io/configmap/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245463    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6c9c1786-1f61-4a8b-a780-19de703b790e" volumeName="kubernetes.io/configmap/6c9c1786-1f61-4a8b-a780-19de703b790e-iptables-alerter-script" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245475    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc15187f-0896-4775-a227-4633a4dc3734" volumeName="kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245488    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-web-config" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245500    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ed11453-6d18-4f24-a945-b312108cd664" volumeName="kubernetes.io/projected/8ed11453-6d18-4f24-a945-b312108cd664-kube-api-access-7djkd" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245511    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-thanos-prometheus-http-client-file" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245523    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1239074-11cc-456f-8ff1-242cb437f9a8" volumeName="kubernetes.io/projected/c1239074-11cc-456f-8ff1-242cb437f9a8-kube-api-access-zxdnn" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245535    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="43923788-5bf7-4b82-b721-4ae9c7acf9e6" volumeName="kubernetes.io/empty-dir/43923788-5bf7-4b82-b721-4ae9c7acf9e6-tmp" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245546    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-metrics-client-certs" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245558    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-web-config" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245571    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" volumeName="kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-serving-cert" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245582    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc15187f-0896-4775-a227-4633a4dc3734" volumeName="kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245594    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config-out" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245605    5981 manager.go:319] Starting recovery of all containers
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245609    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc15187f-0896-4775-a227-4633a4dc3734" volumeName="kubernetes.io/projected/fc15187f-0896-4775-a227-4633a4dc3734-kube-api-access-ksbl2" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245621    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" volumeName="kubernetes.io/projected/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-kube-api-access-tx4tw" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245632    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" volumeName="kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-oauth-config" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245644    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d0c7ea-c907-4088-aacd-dd7224bd896c" volumeName="kubernetes.io/configmap/36d0c7ea-c907-4088-aacd-dd7224bd896c-metrics-client-ca" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245656    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87cca6f3-8578-41cd-ba4a-da8798608de9" volumeName="kubernetes.io/configmap/87cca6f3-8578-41cd-ba4a-da8798608de9-serviceca" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245670    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" volumeName="kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-oauth-serving-cert" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245683    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-main-db" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245695    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f92b4266-f045-41d5-8694-ddec1b9fcdf5" volumeName="kubernetes.io/secret/f92b4266-f045-41d5-8694-ddec1b9fcdf5-metrics-tls" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245707    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245719    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bec335ab-48e3-4940-aeea-f8f46a184eed" volumeName="kubernetes.io/empty-dir/bec335ab-48e3-4940-aeea-f8f46a184eed-tmp-dir" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245730    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e337e618-cdd3-4496-858f-4f61c4622859" volumeName="kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-ovnkube-config" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245741    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="43923788-5bf7-4b82-b721-4ae9c7acf9e6" volumeName="kubernetes.io/empty-dir/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-tuned" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245752    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1239074-11cc-456f-8ff1-242cb437f9a8" volumeName="kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-client-ca-bundle" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245764    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e337e618-cdd3-4496-858f-4f61c4622859" volumeName="kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-env-overrides" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245777    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-main-tls" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245789    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d0c7ea-c907-4088-aacd-dd7224bd896c" volumeName="kubernetes.io/projected/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-api-access-gjxsj" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245800    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="48a605d4-42c2-4362-b230-08a10ab9dec6" volumeName="kubernetes.io/configmap/48a605d4-42c2-4362-b230-08a10ab9dec6-konnectivity-ca" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245814    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-kube-api-access-74t8h" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245826    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1239074-11cc-456f-8ff1-242cb437f9a8" volumeName="kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-secret-metrics-server-tls" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245838    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" volumeName="kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-service-ca" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245849    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac93e0d1-bf8a-40f3-90b6-c9dad1418e39" volumeName="kubernetes.io/configmap/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-daemon-config" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245861    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1239074-11cc-456f-8ff1-242cb437f9a8" volumeName="kubernetes.io/empty-dir/c1239074-11cc-456f-8ff1-242cb437f9a8-audit-log" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245873    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245883    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a72ad10b-db47-41f9-bacf-ab880f332a7a" volumeName="kubernetes.io/secret/a72ad10b-db47-41f9-bacf-ab880f332a7a-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245894    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d0c7ea-c907-4088-aacd-dd7224bd896c" volumeName="kubernetes.io/empty-dir/36d0c7ea-c907-4088-aacd-dd7224bd896c-volume-directive-shadow" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245906    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ce764bc-8e37-40fd-8019-44a3a798febc" volumeName="kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245917    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3237b03d-9c16-410e-b61e-7c5884f42e65" volumeName="kubernetes.io/projected/3237b03d-9c16-410e-b61e-7c5884f42e65-kube-api-access-fbf7s" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245933    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3237b03d-9c16-410e-b61e-7c5884f42e65" volumeName="kubernetes.io/secret/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245945    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac93e0d1-bf8a-40f3-90b6-c9dad1418e39" volumeName="kubernetes.io/projected/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-kube-api-access-b5476" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245956    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" volumeName="kubernetes.io/empty-dir/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-tmp" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245967    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2291168b-f4ed-40e5-9767-afe1561cf5d5" volumeName="kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.245995    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2291168b-f4ed-40e5-9767-afe1561cf5d5" volumeName="kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.246006    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.246017    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" volumeName="kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.246028    5981 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1239074-11cc-456f-8ff1-242cb437f9a8" volumeName="kubernetes.io/configmap/c1239074-11cc-456f-8ff1-242cb437f9a8-metrics-server-audit-profiles" seLinuxMountContext=""
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.246041    5981 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 02:42:40.248187 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.246048    5981 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 02:42:40.267222 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.267188    5981 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 02:42:40.269810 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.268681    5981 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 02:42:40.269810 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.268701    5981 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 02:42:40.269810 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.268721    5981 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 02:42:40.269810 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:42:40.268765    5981 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 02:42:40.286396 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.286373    5981 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:42:40.286496 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.286459    5981 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:42:40.286555 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.286542    5981 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 02:42:40.294113 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.294089    5981 generic.go:356] "Generic (PLEG): container finished" podID="7d8efc8ec06fad6f0d8086d712252ab5" containerID="0540b99e2771264e27653ae227fca9b23db84864249bd6034683a84a81e5e116" exitCode=0
Oct 30 02:42:40.299712 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.299682    5981 generic.go:356] "Generic (PLEG): container finished" podID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerID="9a4ed3b32e139a5b12c049e1c82d4d5879b32d56f004f0da0dade060711d4ecc" exitCode=0
Oct 30 02:42:40.300016 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.299992    5981 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:42:40.303695 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.303673    5981 generic.go:356] "Generic (PLEG): container finished" podID="3237b03d-9c16-410e-b61e-7c5884f42e65" containerID="c7ef4106a63cda45e61e6ac88c5355a236038eb8f67d9f18049e08d33ab8e651" exitCode=0
Oct 30 02:42:40.312253 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.312228    5981 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 02:42:40.336988 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.336961    5981 generic.go:356] "Generic (PLEG): container finished" podID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerID="99f8df3bdfa329fd6208e9fbca0d11055d11375cb26b95b82a142e19df4f03bb" exitCode=0
Oct 30 02:42:40.350141 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.350121    5981 generic.go:356] "Generic (PLEG): container finished" podID="2291168b-f4ed-40e5-9767-afe1561cf5d5" containerID="0ea978e725489692a6aff274a6c883890a0a0e14930ed3e05de539351c3d74d3" exitCode=0
Oct 30 02:42:40.350141 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.350139    5981 generic.go:356] "Generic (PLEG): container finished" podID="2291168b-f4ed-40e5-9767-afe1561cf5d5" containerID="3890022476d704e949d2f12802328bf8b59f5217a87d3bf5db56e0c900055905" exitCode=0
Oct 30 02:42:40.350244 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.350146    5981 generic.go:356] "Generic (PLEG): container finished" podID="2291168b-f4ed-40e5-9767-afe1561cf5d5" containerID="c5034aba4c361a6fccdda990012d096c9cc0418fa2f5a3115fc9c3cfdde53913" exitCode=0
Oct 30 02:42:40.350244 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.350152    5981 generic.go:356] "Generic (PLEG): container finished" podID="2291168b-f4ed-40e5-9767-afe1561cf5d5" containerID="84b7202c362feeb2edda2a58ee22c07b02e0aeeadc7c3d13b80c9d88a5371f96" exitCode=0
Oct 30 02:42:40.350244 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.350158    5981 generic.go:356] "Generic (PLEG): container finished" podID="2291168b-f4ed-40e5-9767-afe1561cf5d5" containerID="1df46a6daec16dcedad48ce23a41ab3a32ae743c287b6d673f6596a2e3a4f740" exitCode=0
Oct 30 02:42:40.350244 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.350163    5981 generic.go:356] "Generic (PLEG): container finished" podID="2291168b-f4ed-40e5-9767-afe1561cf5d5" containerID="856f8b9afb0381f141779479095830e67e111b490a676430e39a9544f08d0b6f" exitCode=0
Oct 30 02:42:40.368893 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:42:40.368838    5981 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 02:42:40.374592 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.374577    5981 manager.go:324] Recovery completed
Oct 30 02:42:40.400803 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.400778    5981 cpu_manager.go:226] "Starting" policy="none"
Oct 30 02:42:40.400803 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.400795    5981 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 02:42:40.400939 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.400816    5981 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 02:42:40.401372 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.401356    5981 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 02:42:40.401446 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.401373    5981 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 02:42:40.401446 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.401396    5981 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 02:42:40.401446 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.401404    5981 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 02:42:40.401446 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.401412    5981 policy_none.go:50] "Start"
Oct 30 02:42:40.401446 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.401425    5981 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 02:42:40.401446 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.401438    5981 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 02:42:40.401733 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.401623    5981 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 02:42:40.401733 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.401634    5981 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 02:42:40.401733 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.401642    5981 policy_none.go:44] "Start"
Oct 30 02:42:40.406520 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.406497    5981 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 02:42:40.409259 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.409243    5981 manager.go:341] "Starting Device Plugin manager"
Oct 30 02:42:40.421515 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:42:40.409273    5981 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 02:42:40.421515 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.409300    5981 server.go:87] "Starting device plugin registration server"
Oct 30 02:42:40.421515 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.410690    5981 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 02:42:40.421515 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.410704    5981 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 02:42:40.421515 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.411486    5981 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 02:42:40.421515 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.411567    5981 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 02:42:40.421515 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.411597    5981 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 02:42:40.421515 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.411603    5981 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 02:42:40.421515 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.411675    5981 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T02:42:40.411588752Z","UUID":"6d7494cc-3f76-408d-87af-c12b4a051e43","Handler":null,"Name":"","Endpoint":""}
Oct 30 02:42:40.432295 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:42:40.430755    5981 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 02:42:40.432997 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.432975    5981 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 02:42:40.433084 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.433015    5981 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 02:42:40.511481 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.511446    5981 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 02:42:40.513351 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.513332    5981 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 02:42:40.513433 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.513365    5981 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 02:42:40.513433 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.513375    5981 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-202.ec2.internal" event="NodeHasSufficientPID"
Oct 30 02:42:40.513433 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.513419    5981 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.553377 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.553357    5981 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.553444 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.553413    5981 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.569830 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.569796    5981 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"]
Oct 30 02:42:40.570501 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.570479    5981 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.570563 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.570463    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal" event={"ID":"7d8efc8ec06fad6f0d8086d712252ab5","Type":"ContainerStarted","Data":"e2df3916e29b41efca96050e847d2616a8923c19f0def337716c1c3d4e598848"}
Oct 30 02:42:40.570563 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.570557    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal" event={"ID":"7d8efc8ec06fad6f0d8086d712252ab5","Type":"ContainerDied","Data":"0540b99e2771264e27653ae227fca9b23db84864249bd6034683a84a81e5e116"}
Oct 30 02:42:40.570637 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.570580    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal" event={"ID":"7d8efc8ec06fad6f0d8086d712252ab5","Type":"ContainerStarted","Data":"0468b3905d84222e656fae1e5d1aa678e1e5287e43c7e972764e0766857dcbdd"}
Oct 30 02:42:40.570637 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.570598    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal" event={"ID":"3ce1fe095f8980ce35b373b8b077959e","Type":"ContainerStarted","Data":"dbc5a84f46f78ed57442b15af0fa4163dd55b8bd22e234c58ba824a0e9c3bbbf"}
Oct 30 02:42:40.570637 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.570618    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal" event={"ID":"3ce1fe095f8980ce35b373b8b077959e","Type":"ContainerStarted","Data":"52a6f15272c962215f75146f627ad7913b9620f0581d32c45d417766b4ae9879"}
Oct 30 02:42:40.570744 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.570656    5981 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.597164 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.597138    5981 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:42:40.597235 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:42:40.597180    5981 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-202.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.597607 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.597594    5981 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:42:40.597646 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:42:40.597627    5981 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.688859 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.688841    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d8efc8ec06fad6f0d8086d712252ab5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" (UID: \"7d8efc8ec06fad6f0d8086d712252ab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.688936 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.688864    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d8efc8ec06fad6f0d8086d712252ab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" (UID: \"7d8efc8ec06fad6f0d8086d712252ab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.688936 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.688881    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ce1fe095f8980ce35b373b8b077959e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-202.ec2.internal\" (UID: \"3ce1fe095f8980ce35b373b8b077959e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.789425 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.789403    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d8efc8ec06fad6f0d8086d712252ab5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" (UID: \"7d8efc8ec06fad6f0d8086d712252ab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.789516 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.789455    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d8efc8ec06fad6f0d8086d712252ab5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" (UID: \"7d8efc8ec06fad6f0d8086d712252ab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.789516 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.789491    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d8efc8ec06fad6f0d8086d712252ab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" (UID: \"7d8efc8ec06fad6f0d8086d712252ab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.789593 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.789515    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ce1fe095f8980ce35b373b8b077959e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-202.ec2.internal\" (UID: \"3ce1fe095f8980ce35b373b8b077959e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.789593 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.789548    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ce1fe095f8980ce35b373b8b077959e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-202.ec2.internal\" (UID: \"3ce1fe095f8980ce35b373b8b077959e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:40.789593 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:40.789562    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d8efc8ec06fad6f0d8086d712252ab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" (UID: \"7d8efc8ec06fad6f0d8086d712252ab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:41.224876 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.224846    5981 apiserver.go:52] "Watching apiserver"
Oct 30 02:42:41.281850 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.281823    5981 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 02:42:41.282629 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.282599    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-28zrt","openshift-multus/multus-additional-cni-plugins-4n9g9","openshift-cluster-node-tuning-operator/tuned-lcpmf","openshift-monitoring/metrics-server-75b5f57486-2nn2p","openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j","openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h","kube-system/konnectivity-agent-h6mqn","openshift-console/console-7595648df5-ptz96","openshift-dns/dns-default-nmmgn","openshift-image-registry/node-ca-cz9ks","openshift-insights/insights-runtime-extractor-xgrln","openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8","openshift-monitoring/prometheus-k8s-0","kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal","openshift-network-diagnostics/network-check-target-jw4x2","openshift-network-operator/iptables-alerter-kwkx5","openshift-dns/node-resolver-sm872","openshift-multus/multus-bh824","openshift-ingress-canary/ingress-canary-wjp42","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal","openshift-monitoring/alertmanager-main-0","kube-system/global-pull-secret-syncer-pb6zp","openshift-monitoring/node-exporter-zk2zh","openshift-ovn-kubernetes/ovnkube-node-76fqh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc","openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds","openshift-multus/network-metrics-daemon-nhkvm"]
Oct 30 02:42:41.304962 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.304937    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 02:42:41.304962 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.304938    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 02:42:41.304962 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.304938    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 02:42:41.305229 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.304945    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:42:41.305229 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.305180    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 02:42:41.305229 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.305198    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 02:42:41.306201 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306183    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 02:42:41.306201 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306198    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 02:42:41.306406 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306377    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 02:42:41.306406 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306401    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 02:42:41.306517 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306433    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 02:42:41.306517 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306475    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-stwqd\""
Oct 30 02:42:41.306517 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306480    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-czntg\""
Oct 30 02:42:41.306517 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306482    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6bd55\""
Oct 30 02:42:41.306517 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306508    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zm8vf\""
Oct 30 02:42:41.306719 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306524    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 02:42:41.306719 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306537    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-29rqz\""
Oct 30 02:42:41.306719 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306588    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vzqmp\""
Oct 30 02:42:41.306719 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.306634    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 02:42:41.315382 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.315364    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 02:42:41.325389 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.325374    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 02:42:41.325656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.325644    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ztgz4\""
Oct 30 02:42:41.325961 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.325947    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-j74dx\""
Oct 30 02:42:41.326020 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.325975    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 02:42:41.336902 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.336881    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f69xl\""
Oct 30 02:42:41.336902 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.336887    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 02:42:41.337186 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.337162    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 02:42:41.337186 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.337173    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 02:42:41.337186 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.337184    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-99thg\""
Oct 30 02:42:41.337451 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.337437    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 02:42:41.337679 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.337662    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-99kpg\""
Oct 30 02:42:41.338800 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.338785    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 02:42:41.339310 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.339276    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 02:42:41.340928 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.340908    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hjgzr\""
Oct 30 02:42:41.340928 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.340922    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 02:42:41.341070 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.340950    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 02:42:41.341070 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.340965    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 02:42:41.341243 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341211    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 02:42:41.341243 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341227    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 02:42:41.341243 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341233    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 02:42:41.341425 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341251    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 02:42:41.341425 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341259    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 02:42:41.341425 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341261    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 02:42:41.341425 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341325    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1deea0ri9bckt\""
Oct 30 02:42:41.341425 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341217    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-mcz9c\""
Oct 30 02:42:41.341425 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341335    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 02:42:41.341425 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341218    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 02:42:41.341425 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341332    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 02:42:41.341695 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341628    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8z95j\""
Oct 30 02:42:41.341807 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.341788    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4mw8j\""
Oct 30 02:42:41.342515 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342495    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 02:42:41.342606 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342515    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 02:42:41.342606 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342526    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 02:42:41.342606 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342505    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 02:42:41.342606 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342505    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 02:42:41.342606 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342561    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 02:42:41.342606 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342595    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 02:42:41.342606 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342601    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342622    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342648    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342669    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z7sc4\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342679    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342701    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-71pugkl75onuk\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342712    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cfgnp\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342701    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342732    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zz8vj\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342740    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342744    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342769    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342783    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2wtbz\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342834    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-znsn5\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342848    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 02:42:41.342918 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342926    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m7t9x\""
Oct 30 02:42:41.343427 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342961    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-25r8f\""
Oct 30 02:42:41.343427 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.342988    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 02:42:41.343427 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.343054    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 02:42:41.343427 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.343127    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 02:42:41.343568 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.343552    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c4lsnub1qqrho\""
Oct 30 02:42:41.343949 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.343935    5981 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 02:42:41.346714 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.346698    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 02:42:41.346757 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.346700    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-d89pf\""
Oct 30 02:42:41.346757 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.346720    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-kxfcp\""
Oct 30 02:42:41.346757 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.346717    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hbwgl\""
Oct 30 02:42:41.352462 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352444    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 02:42:41.352562 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352547    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 02:42:41.352611 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352564    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 02:42:41.352870 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352854    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 02:42:41.352921 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352867    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 02:42:41.352921 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352885    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 02:42:41.352921 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352893    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 02:42:41.352921 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352905    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 02:42:41.352921 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352918    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 02:42:41.353129 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352926    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 02:42:41.353129 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352906    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 02:42:41.353129 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352949    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 02:42:41.353129 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.352998    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 02:42:41.353129 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.353014    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 02:42:41.353129 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.353031    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 02:42:41.353129 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.353037    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 02:42:41.353129 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.353062    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 02:42:41.355126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.355106    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 02:42:41.355126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.355122    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 02:42:41.355342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.355132    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 02:42:41.355342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.355124    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 02:42:41.355342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.355176    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 02:42:41.355342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.355212    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 02:42:41.355342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.355251    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 02:42:41.355342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.355344    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 02:42:41.355684 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.355387    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 02:42:41.355883 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.355865    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 02:42:41.355924 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.355886    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 02:42:41.356163 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.356145    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 02:42:41.356476 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.356451    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 02:42:41.356476 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.356465    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 02:42:41.356623 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.356597    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 02:42:41.357721 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.357697    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 02:42:41.358159 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.358134    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 02:42:41.358562 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.358544    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 02:42:41.362167 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.362149    5981 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:41.362297 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.362271    5981 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:41.366532 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.366517    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 02:42:41.366620 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.366584    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 02:42:41.366620 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.366591    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 02:42:41.366690 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.366639    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 02:42:41.385347 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.385329    5981 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:42:41.385407 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:42:41.385388    5981 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-202.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:41.391096 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391081    5981 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 02:42:41.391155 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:42:41.391118    5981 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-202.ec2.internal"
Oct 30 02:42:41.391155 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391139    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-serving-cert\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.391215 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391158    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.391215 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391178    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-registration-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.391215 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391194    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.391350 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391216    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.391350 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391241    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-secret-metrics-server-tls\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.391350 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391278    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-tls\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.391350 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391327    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.391512 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391414    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pscxj\" (UniqueName: \"kubernetes.io/projected/87cca6f3-8578-41cd-ba4a-da8798608de9-kube-api-access-pscxj\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:42:41.391565 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391539    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-secret-metrics-server-tls\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.391565 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391549    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:41.391565 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391553    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-serving-cert\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.391695 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391538    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.391695 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391633    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-tls\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.391695 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391643    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-sys\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.391801 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391720    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.391801 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391764    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-sys-fs\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.391898 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391796    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:41.391898 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391819    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1239074-11cc-456f-8ff1-242cb437f9a8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.391898 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391852    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87cca6f3-8578-41cd-ba4a-da8798608de9-host\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:42:41.391898 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391880    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-system-cni-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.392034 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391942    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:41.392034 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391964    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.392034 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.391974    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-systemd\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.392034 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392000    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.392034 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392024    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1239074-11cc-456f-8ff1-242cb437f9a8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.392239 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392073    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-system-cni-dir\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.392239 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392108    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:41.392239 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392119    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-run-netns\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.392239 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392149    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-run-ovn-kubernetes\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.392239 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392174    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-modprobe-d\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.392239 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392205    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.392239 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392213    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pth9k\" (UniqueName: \"kubernetes.io/projected/a72ad10b-db47-41f9-bacf-ab880f332a7a-kube-api-access-pth9k\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:41.392239 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392238    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-device-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392267    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl6xs\" (UniqueName: \"kubernetes.io/projected/0dbab0f3-4bbd-4889-ae78-ddff0b995e72-kube-api-access-jl6xs\") pod \"ingress-canary-wjp42\" (UID: \"0dbab0f3-4bbd-4889-ae78-ddff0b995e72\") " pod="openshift-ingress-canary/ingress-canary-wjp42"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392315    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392341    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjxsj\" (UniqueName: \"kubernetes.io/projected/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-api-access-gjxsj\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392365    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-var-lib-kubelet\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392386    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-host\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392411    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392440    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzcqx\" (UniqueName: \"kubernetes.io/projected/6c9c1786-1f61-4a8b-a780-19de703b790e-kube-api-access-jzcqx\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392469    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392488    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392504    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc15187f-0896-4775-a227-4633a4dc3734-metrics-client-ca\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392516    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392531    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8cf619f-9892-48d5-911e-5f7432d945ec-kubelet-config\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:41.392610 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392555    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-netns\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392618    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-ovnkube-config\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392647    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dbab0f3-4bbd-4889-ae78-ddff0b995e72-cert\") pod \"ingress-canary-wjp42\" (UID: \"0dbab0f3-4bbd-4889-ae78-ddff0b995e72\") " pod="openshift-ingress-canary/ingress-canary-wjp42"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392662    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87cca6f3-8578-41cd-ba4a-da8798608de9-serviceca\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392679    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392694    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392695    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc15187f-0896-4775-a227-4633a4dc3734-metrics-client-ca\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392714    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392720    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392815    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-ovnkube-config\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392829    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392888    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43923788-5bf7-4b82-b721-4ae9c7acf9e6-tmp\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392908    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dbab0f3-4bbd-4889-ae78-ddff0b995e72-cert\") pod \"ingress-canary-wjp42\" (UID: \"0dbab0f3-4bbd-4889-ae78-ddff0b995e72\") " pod="openshift-ingress-canary/ingress-canary-wjp42"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392955    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43923788-5bf7-4b82-b721-4ae9c7acf9e6-tmp\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392951    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-oauth-config\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.392988    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-oauth-serving-cert\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393013    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec335ab-48e3-4940-aeea-f8f46a184eed-tmp-dir\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393038    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c1239074-11cc-456f-8ff1-242cb437f9a8-metrics-server-audit-profiles\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393066    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:41.393126 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393132    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec335ab-48e3-4940-aeea-f8f46a184eed-tmp-dir\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393139    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-oauth-serving-cert\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393166    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72ad10b-db47-41f9-bacf-ab880f332a7a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393187    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48a605d4-42c2-4362-b230-08a10ab9dec6-konnectivity-ca\") pod \"konnectivity-agent-h6mqn\" (UID: \"48a605d4-42c2-4362-b230-08a10ab9dec6\") " pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393203    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-oauth-config\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393202    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393255    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-grpc-tls\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393262    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393307    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-cni-binary-copy\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393408    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393436    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a72ad10b-db47-41f9-bacf-ab880f332a7a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393442    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/87cca6f3-8578-41cd-ba4a-da8798608de9-serviceca\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393462    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48a605d4-42c2-4362-b230-08a10ab9dec6-konnectivity-ca\") pod \"konnectivity-agent-h6mqn\" (UID: \"48a605d4-42c2-4362-b230-08a10ab9dec6\") " pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393451    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c1239074-11cc-456f-8ff1-242cb437f9a8-metrics-server-audit-profiles\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393475    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-cni-binary-copy\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393483    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-conf-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393518    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-accelerators-collector-config\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393522    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393559    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a72ad10b-db47-41f9-bacf-ab880f332a7a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393612    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-grpc-tls\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393646    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-config\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393677    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-accelerators-collector-config\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393720    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393756    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a72ad10b-db47-41f9-bacf-ab880f332a7a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393782    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-cnibin\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393815    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.393840 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393849    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-tuned\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393869    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-config\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393878    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393895    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-systemd-units\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393908    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-tuned\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393909    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393911    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-etc-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393939    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-cni-bin\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393957    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2tr\" (UniqueName: \"kubernetes.io/projected/e337e618-cdd3-4496-858f-4f61c4622859-kube-api-access-qb2tr\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393972    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393987    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.393995    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394027    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-kubelet\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394055    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prxbd\" (UniqueName: \"kubernetes.io/projected/43923788-5bf7-4b82-b721-4ae9c7acf9e6-kube-api-access-prxbd\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394147    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394164    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394167    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7djkd\" (UniqueName: \"kubernetes.io/projected/8ed11453-6d18-4f24-a945-b312108cd664-kube-api-access-7djkd\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394195    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-node-log\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394217    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-cnibin\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394297    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92b4266-f045-41d5-8694-ddec1b9fcdf5-tmp-dir\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394298    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8cf619f-9892-48d5-911e-5f7432d945ec-original-pull-secret\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394345    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36d0c7ea-c907-4088-aacd-dd7224bd896c-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394374    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92b4266-f045-41d5-8694-ddec1b9fcdf5-tmp-dir\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394415    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-run\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394433    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394434    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36d0c7ea-c907-4088-aacd-dd7224bd896c-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394451    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqzfw\" (UniqueName: \"kubernetes.io/projected/2291168b-f4ed-40e5-9767-afe1561cf5d5-kube-api-access-vqzfw\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394472    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394622    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394645    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-systemd\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.394706 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394694    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-etc-kubernetes\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394716    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394725    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53793bc8-ff97-4faa-aaf8-3d101fb8d646-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394760    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysctl-d\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394791    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e337e618-cdd3-4496-858f-4f61c4622859-ovn-node-metrics-cert\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394814    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzr4t\" (UniqueName: \"kubernetes.io/projected/f13d6d8d-e290-450f-b648-1869845dd5a7-kube-api-access-tzr4t\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394840    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddcm6\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-kube-api-access-ddcm6\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394859    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c1239074-11cc-456f-8ff1-242cb437f9a8-audit-log\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394874    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53793bc8-ff97-4faa-aaf8-3d101fb8d646-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394932    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-cni-bin\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.394962    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c1239074-11cc-456f-8ff1-242cb437f9a8-audit-log\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395065    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395097    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e337e618-cdd3-4496-858f-4f61c4622859-ovn-node-metrics-cert\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395101    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395151    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395178    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-hostroot\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395203    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5476\" (UniqueName: \"kubernetes.io/projected/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-kube-api-access-b5476\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395223    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395312    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d\") pod \"network-check-target-jw4x2\" (UID: \"416971fa-0af3-448e-b81c-48c6d02bdbb5\") " pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395346    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bec335ab-48e3-4940-aeea-f8f46a184eed-hosts-file\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395377    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395408    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395383    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395456    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-tls\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395508    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395538    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395559    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395585    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74t8h\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-kube-api-access-74t8h\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395777    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395780    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-tls\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395804    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cc2t\" (UniqueName: \"kubernetes.io/projected/7f1c39ff-4766-4915-8cd2-2ff6730302fb-kube-api-access-6cc2t\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395817    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395838    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-socket-dir-parent\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395884    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-lib-modules\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395935    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a72ad10b-db47-41f9-bacf-ab880f332a7a-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395955    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395969    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc15187f-0896-4775-a227-4633a4dc3734-tmp\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.395985    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-socket-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396001    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-daemon-config\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.396017 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396017    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36d0c7ea-c907-4088-aacd-dd7224bd896c-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396048    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396066    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-secret-metrics-server-client-certs\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396082    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-kubernetes\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396097    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2rzs\" (UniqueName: \"kubernetes.io/projected/bec335ab-48e3-4940-aeea-f8f46a184eed-kube-api-access-k2rzs\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396111    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8cf619f-9892-48d5-911e-5f7432d945ec-dbus\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396126    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-k8s-cni-cncf-io\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396141    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klx67\" (UniqueName: \"kubernetes.io/projected/f92b4266-f045-41d5-8694-ddec1b9fcdf5-kube-api-access-klx67\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396154    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-sys\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396164    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396169    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-wtmp\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396194    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396211    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396230    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-cni-netd\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396245    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396263    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396278    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396317    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkfll\" (UniqueName: \"kubernetes.io/projected/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6-kube-api-access-hkfll\") pod \"monitoring-plugin-77f4f76594-28zrt\" (UID: \"b3b1c5be-f236-44d8-9168-1bdf3dd9dce6\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396370    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-cni-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396381    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a72ad10b-db47-41f9-bacf-ab880f332a7a-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396433    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc15187f-0896-4775-a227-4633a4dc3734-tmp\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396548    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396569    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396582    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396627    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-multus-certs\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396642    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396659    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396700    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-root\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396728    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-service-ca\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396728    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-daemon-config\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396777    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396807    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-secret-metrics-server-client-certs\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396849    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36d0c7ea-c907-4088-aacd-dd7224bd896c-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396915    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-service-ca\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396916    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396916    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396956    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f92b4266-f045-41d5-8694-ddec1b9fcdf5-metrics-tls\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.396992    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-ovnkube-script-lib\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397023    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397150    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397170    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397187    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-var-lib-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397213    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f92b4266-f045-41d5-8694-ddec1b9fcdf5-metrics-tls\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397348    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-ovn\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397376    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-textfile\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397346    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2291168b-f4ed-40e5-9767-afe1561cf5d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397395    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397405    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-ovnkube-script-lib\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397431    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f92b4266-f045-41d5-8694-ddec1b9fcdf5-config-volume\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397457    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48a605d4-42c2-4362-b230-08a10ab9dec6-agent-certs\") pod \"konnectivity-agent-h6mqn\" (UID: \"48a605d4-42c2-4362-b230-08a10ab9dec6\") " pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397460    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-textfile\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397496    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c9c1786-1f61-4a8b-a780-19de703b790e-iptables-alerter-script\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397495    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397584    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397664    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c9c1786-1f61-4a8b-a780-19de703b790e-iptables-alerter-script\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397665    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f92b4266-f045-41d5-8694-ddec1b9fcdf5-config-volume\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:41.397656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397689    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48a605d4-42c2-4362-b230-08a10ab9dec6-agent-certs\") pod \"konnectivity-agent-h6mqn\" (UID: \"48a605d4-42c2-4362-b230-08a10ab9dec6\") " pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397671    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c9c1786-1f61-4a8b-a780-19de703b790e-host-slash\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397746    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397769    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-log-socket\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397812    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f13d6d8d-e290-450f-b648-1869845dd5a7-data-volume\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397896    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f13d6d8d-e290-450f-b648-1869845dd5a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397924    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc15187f-0896-4775-a227-4633a4dc3734-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397928    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97t59\" (UniqueName: \"kubernetes.io/projected/53793bc8-ff97-4faa-aaf8-3d101fb8d646-kube-api-access-97t59\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397970    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysctl-conf\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.397994    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-etc-selinux\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398019    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-kubelet\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398068    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-env-overrides\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398098    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f13d6d8d-e290-450f-b648-1869845dd5a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398118    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f13d6d8d-e290-450f-b648-1869845dd5a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398136    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f13d6d8d-e290-450f-b648-1869845dd5a7-data-volume\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398238    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e337e618-cdd3-4496-858f-4f61c4622859-env-overrides\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398298    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-config-out\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398313    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f13d6d8d-e290-450f-b648-1869845dd5a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398337    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-web-config\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398379    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-config-out\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398401    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398432    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53793bc8-ff97-4faa-aaf8-3d101fb8d646-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398459    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysconfig\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398481    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-tmp\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398504    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398528    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f13d6d8d-e290-450f-b648-1869845dd5a7-crio-socket\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398553    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-28zrt\" (UID: \"b3b1c5be-f236-44d8-9168-1bdf3dd9dce6\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398561    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1c39ff-4766-4915-8cd2-2ff6730302fb-metrics-certs\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398578    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbf7s\" (UniqueName: \"kubernetes.io/projected/3237b03d-9c16-410e-b61e-7c5884f42e65-kube-api-access-fbf7s\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398587    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-web-config\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398605    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx4tw\" (UniqueName: \"kubernetes.io/projected/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-kube-api-access-tx4tw\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398610    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-tmp\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398646    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398814    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398892    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-28zrt\" (UID: \"b3b1c5be-f236-44d8-9168-1bdf3dd9dce6\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398928    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-slash\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.398956    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399003    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-client-ca-bundle\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399035    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-cni-multus\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399048    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53793bc8-ff97-4faa-aaf8-3d101fb8d646-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399074    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53793bc8-ff97-4faa-aaf8-3d101fb8d646-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399115    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3237b03d-9c16-410e-b61e-7c5884f42e65-metrics-client-ca\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399163    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksbl2\" (UniqueName: \"kubernetes.io/projected/fc15187f-0896-4775-a227-4633a4dc3734-kube-api-access-ksbl2\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399190    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxdnn\" (UniqueName: \"kubernetes.io/projected/c1239074-11cc-456f-8ff1-242cb437f9a8-kube-api-access-zxdnn\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399327    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1239074-11cc-456f-8ff1-242cb437f9a8-client-ca-bundle\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399469    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53793bc8-ff97-4faa-aaf8-3d101fb8d646-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399510    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399523    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399645    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.400012 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.399704    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3237b03d-9c16-410e-b61e-7c5884f42e65-metrics-client-ca\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.410531 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.410512    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pscxj\" (UniqueName: \"kubernetes.io/projected/87cca6f3-8578-41cd-ba4a-da8798608de9-kube-api-access-pscxj\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:42:41.410999 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.410980    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzcqx\" (UniqueName: \"kubernetes.io/projected/6c9c1786-1f61-4a8b-a780-19de703b790e-kube-api-access-jzcqx\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:42:41.410999 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.410994    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl6xs\" (UniqueName: \"kubernetes.io/projected/0dbab0f3-4bbd-4889-ae78-ddff0b995e72-kube-api-access-jl6xs\") pod \"ingress-canary-wjp42\" (UID: \"0dbab0f3-4bbd-4889-ae78-ddff0b995e72\") " pod="openshift-ingress-canary/ingress-canary-wjp42"
Oct 30 02:42:41.411095 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.411044    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjxsj\" (UniqueName: \"kubernetes.io/projected/36d0c7ea-c907-4088-aacd-dd7224bd896c-kube-api-access-gjxsj\") pod \"kube-state-metrics-5dc8d7d89b-58tds\" (UID: \"36d0c7ea-c907-4088-aacd-dd7224bd896c\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-58tds"
Oct 30 02:42:41.411526 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.411506    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pth9k\" (UniqueName: \"kubernetes.io/projected/a72ad10b-db47-41f9-bacf-ab880f332a7a-kube-api-access-pth9k\") pod \"openshift-state-metrics-7bd7489957-z7zz8\" (UID: \"a72ad10b-db47-41f9-bacf-ab880f332a7a\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-z7zz8"
Oct 30 02:42:41.412129 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.412113    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb2tr\" (UniqueName: \"kubernetes.io/projected/e337e618-cdd3-4496-858f-4f61c4622859-kube-api-access-qb2tr\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.414687 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.414671    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5476\" (UniqueName: \"kubernetes.io/projected/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-kube-api-access-b5476\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.415393 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.415267    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzr4t\" (UniqueName: \"kubernetes.io/projected/f13d6d8d-e290-450f-b648-1869845dd5a7-kube-api-access-tzr4t\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:41.415393 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.415336    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7djkd\" (UniqueName: \"kubernetes.io/projected/8ed11453-6d18-4f24-a945-b312108cd664-kube-api-access-7djkd\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.415393 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.415372    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqzfw\" (UniqueName: \"kubernetes.io/projected/2291168b-f4ed-40e5-9767-afe1561cf5d5-kube-api-access-vqzfw\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.415571 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.415451    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cc2t\" (UniqueName: \"kubernetes.io/projected/7f1c39ff-4766-4915-8cd2-2ff6730302fb-kube-api-access-6cc2t\") pod \"network-metrics-daemon-nhkvm\" (UID: \"7f1c39ff-4766-4915-8cd2-2ff6730302fb\") " pod="openshift-multus/network-metrics-daemon-nhkvm"
Oct 30 02:42:41.415571 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.415526    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2rzs\" (UniqueName: \"kubernetes.io/projected/bec335ab-48e3-4940-aeea-f8f46a184eed-kube-api-access-k2rzs\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:42:41.415792 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.415768    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/416971fa-0af3-448e-b81c-48c6d02bdbb5-kube-api-access-bx28d\") pod \"network-check-target-jw4x2\" (UID: \"416971fa-0af3-448e-b81c-48c6d02bdbb5\") " pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:41.416000 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.415981    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkfll\" (UniqueName: \"kubernetes.io/projected/b3b1c5be-f236-44d8-9168-1bdf3dd9dce6-kube-api-access-hkfll\") pod \"monitoring-plugin-77f4f76594-28zrt\" (UID: \"b3b1c5be-f236-44d8-9168-1bdf3dd9dce6\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:41.416412 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.416397    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klx67\" (UniqueName: \"kubernetes.io/projected/f92b4266-f045-41d5-8694-ddec1b9fcdf5-kube-api-access-klx67\") pod \"dns-default-nmmgn\" (UID: \"f92b4266-f045-41d5-8694-ddec1b9fcdf5\") " pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:41.416900 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.416881    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97t59\" (UniqueName: \"kubernetes.io/projected/53793bc8-ff97-4faa-aaf8-3d101fb8d646-kube-api-access-97t59\") pod \"prometheus-operator-9cd89b74c-c7f7j\" (UID: \"53793bc8-ff97-4faa-aaf8-3d101fb8d646\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-c7f7j"
Oct 30 02:42:41.416976 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.416963    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddcm6\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-kube-api-access-ddcm6\") pod \"alertmanager-main-0\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:42:41.417401 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.417382    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74t8h\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-kube-api-access-74t8h\") pod \"prometheus-k8s-0\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:41.417675 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.417654    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbf7s\" (UniqueName: \"kubernetes.io/projected/3237b03d-9c16-410e-b61e-7c5884f42e65-kube-api-access-fbf7s\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.417738 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.417720    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prxbd\" (UniqueName: \"kubernetes.io/projected/43923788-5bf7-4b82-b721-4ae9c7acf9e6-kube-api-access-prxbd\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.417872 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.417857    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx4tw\" (UniqueName: \"kubernetes.io/projected/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-kube-api-access-tx4tw\") pod \"console-7595648df5-ptz96\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") " pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:41.418320 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.418273    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxdnn\" (UniqueName: \"kubernetes.io/projected/c1239074-11cc-456f-8ff1-242cb437f9a8-kube-api-access-zxdnn\") pod \"metrics-server-75b5f57486-2nn2p\" (UID: \"c1239074-11cc-456f-8ff1-242cb437f9a8\") " pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:41.418656 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.418640    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksbl2\" (UniqueName: \"kubernetes.io/projected/fc15187f-0896-4775-a227-4633a4dc3734-kube-api-access-ksbl2\") pod \"thanos-querier-5bc4965dc5-zgf5h\" (UID: \"fc15187f-0896-4775-a227-4633a4dc3734\") " pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:41.499791 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499721    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c9c1786-1f61-4a8b-a780-19de703b790e-host-slash\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:42:41.499791 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499761    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-log-socket\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.499791 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499788    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysctl-conf\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.499995 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499806    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c9c1786-1f61-4a8b-a780-19de703b790e-host-slash\") pod \"iptables-alerter-kwkx5\" (UID: \"6c9c1786-1f61-4a8b-a780-19de703b790e\") " pod="openshift-network-operator/iptables-alerter-kwkx5"
Oct 30 02:42:41.499995 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499845    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-log-socket\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.499995 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499811    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-etc-selinux\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.499995 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499870    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-etc-selinux\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.499995 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499897    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-kubelet\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.499995 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499935    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysconfig\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.499995 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499955    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-kubelet\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.499995 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499961    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f13d6d8d-e290-450f-b648-1869845dd5a7-crio-socket\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:41.499995 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499983    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysctl-conf\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.499995 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499988    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-slash\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.499995 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.499989    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysconfig\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500015    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-cni-multus\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500027    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f13d6d8d-e290-450f-b648-1869845dd5a7-crio-socket\") pod \"insights-runtime-extractor-xgrln\" (UID: \"f13d6d8d-e290-450f-b648-1869845dd5a7\") " pod="openshift-insights/insights-runtime-extractor-xgrln"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500044    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-registration-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500053    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-cni-multus\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500038    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-slash\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500069    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500098    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-sys\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500101    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-registration-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500123    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-sys-fs\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500141    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-sys\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500145    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87cca6f3-8578-41cd-ba4a-da8798608de9-host\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500166    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/87cca6f3-8578-41cd-ba4a-da8798608de9-host\") pod \"node-ca-cz9ks\" (UID: \"87cca6f3-8578-41cd-ba4a-da8798608de9\") " pod="openshift-image-registry/node-ca-cz9ks"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500169    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-system-cni-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500173    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-sys-fs\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500110    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500193    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-systemd\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500225    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-system-cni-dir\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500228    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-systemd\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500242    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-system-cni-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500260    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-run-netns\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500301    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-run-ovn-kubernetes\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500318    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-run-netns\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500326    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-modprobe-d\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500332    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-run-ovn-kubernetes\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500301    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-system-cni-dir\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500352    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-device-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500384    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-var-lib-kubelet\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500393    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-device-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500410    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-host\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500430    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8cf619f-9892-48d5-911e-5f7432d945ec-kubelet-config\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500445    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-netns\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500467    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500471    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-var-lib-kubelet\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500496    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-host\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.500482 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500501    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-conf-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500520    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-netns\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500385    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-modprobe-d\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500528    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-cnibin\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500542    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500562    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-conf-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500563    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500776    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-systemd-units\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500569    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-cnibin\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500610    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8cf619f-9892-48d5-911e-5f7432d945ec-kubelet-config\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500638    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500804    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-etc-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500975    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-cni-bin\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501006    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-kubelet\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501028    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-node-log\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501049    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-cnibin\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501073    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-run\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501097    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-systemd\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501117    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-etc-kubernetes\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501139    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysctl-d\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501164    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-cni-bin\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501190    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-hostroot\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501212    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bec335ab-48e3-4940-aeea-f8f46a184eed-hosts-file\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501238    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-socket-dir-parent\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501260    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-lib-modules\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501315    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-socket-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501344    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-kubernetes\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501366    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8cf619f-9892-48d5-911e-5f7432d945ec-dbus\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501389    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-k8s-cni-cncf-io\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501410    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-sys\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501443    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-wtmp\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501468    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-cni-netd\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501493    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501518    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-cni-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501539    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-multus-certs\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501563    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-root\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501595    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-var-lib-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501619    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-ovn\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501640    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bec335ab-48e3-4940-aeea-f8f46a184eed-hosts-file\") pod \"node-resolver-sm872\" (UID: \"bec335ab-48e3-4940-aeea-f8f46a184eed\") " pod="openshift-dns/node-resolver-sm872"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500847    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-etc-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.500853    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-systemd-units\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501699    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-node-log\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501721    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-socket-dir-parent\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.501716 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501744    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-cnibin\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501791    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-run\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501792    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8cf619f-9892-48d5-911e-5f7432d945ec-dbus\") pod \"global-pull-secret-syncer-pb6zp\" (UID: \"f8cf619f-9892-48d5-911e-5f7432d945ec\") " pod="kube-system/global-pull-secret-syncer-pb6zp"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501827    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-k8s-cni-cncf-io\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501832    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-sys\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501866    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-systemd\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501910    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-etc-kubernetes\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501920    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-cni-bin\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501951    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-hostroot\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501962    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2291168b-f4ed-40e5-9767-afe1561cf5d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4n9g9\" (UID: \"2291168b-f4ed-40e5-9767-afe1561cf5d5\") " pod="openshift-multus/multus-additional-cni-plugins-4n9g9"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.501989    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-var-lib-openvswitch\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.502027    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-multus-cni-dir\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.502054    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-run-ovn\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.502069    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-sysctl-d\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.502086    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-cni-bin\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.502117    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-var-lib-kubelet\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.502143    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-lib-modules\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.502151    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac93e0d1-bf8a-40f3-90b6-c9dad1418e39-host-run-multus-certs\") pod \"multus-bh824\" (UID: \"ac93e0d1-bf8a-40f3-90b6-c9dad1418e39\") " pod="openshift-multus/multus-bh824"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.502187    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ed11453-6d18-4f24-a945-b312108cd664-socket-dir\") pod \"aws-ebs-csi-driver-node-7rslc\" (UID: \"8ed11453-6d18-4f24-a945-b312108cd664\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rslc"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.502190    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-root\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.502226    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43923788-5bf7-4b82-b721-4ae9c7acf9e6-etc-kubernetes\") pod \"tuned-lcpmf\" (UID: \"43923788-5bf7-4b82-b721-4ae9c7acf9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-lcpmf"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.502235    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3237b03d-9c16-410e-b61e-7c5884f42e65-node-exporter-wtmp\") pod \"node-exporter-zk2zh\" (UID: \"3237b03d-9c16-410e-b61e-7c5884f42e65\") " pod="openshift-monitoring/node-exporter-zk2zh"
Oct 30 02:42:41.503177 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.502263    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e337e618-cdd3-4496-858f-4f61c4622859-host-cni-netd\") pod \"ovnkube-node-76fqh\" (UID: \"e337e618-cdd3-4496-858f-4f61c4622859\") " pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:41.768941 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:41.768870    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:42:42.701739 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:42.701713    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5bc4965dc5-zgf5h"
Oct 30 02:42:42.834139 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:42.834112    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:42.850358 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:42.850332    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:42:43.581616 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:43.581587    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-28zrt"
Oct 30 02:42:44.117948 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:44.117918    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:44.325318 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:44.325269    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nmmgn"
Oct 30 02:42:44.367848 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:42:44.367817    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:42:45.204966 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:45.204939    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:42:45.205419 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:45.205181    5981 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 02:42:46.464053 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:46.464017    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7595648df5-ptz96"]
Oct 30 02:42:50.228466 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:50.228431    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:42:53.045158 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:53.045126    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-75b5f57486-2nn2p"
Oct 30 02:42:53.855194 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:53.855161    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h6mqn"
Oct 30 02:42:58.697753 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:58.697719    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 02:42:58.698159 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:58.698021    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="alertmanager" containerID="cri-o://7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7" gracePeriod=120
Oct 30 02:42:58.698159 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:58.698068    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="kube-rbac-proxy-metric" containerID="cri-o://d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f" gracePeriod=120
Oct 30 02:42:58.698159 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:58.698086    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="kube-rbac-proxy-web" containerID="cri-o://d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461" gracePeriod=120
Oct 30 02:42:58.698279 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:58.698089    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="kube-rbac-proxy" containerID="cri-o://f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592" gracePeriod=120
Oct 30 02:42:58.698279 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:58.698140    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="config-reloader" containerID="cri-o://7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128" gracePeriod=120
Oct 30 02:42:58.698279 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:58.698224    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="prom-label-proxy" containerID="cri-o://a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6" gracePeriod=120
Oct 30 02:42:59.435996 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:59.435963    5981 generic.go:356] "Generic (PLEG): container finished" podID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerID="a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6" exitCode=0
Oct 30 02:42:59.435996 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:59.435987    5981 generic.go:356] "Generic (PLEG): container finished" podID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerID="d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f" exitCode=0
Oct 30 02:42:59.435996 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:59.435994    5981 generic.go:356] "Generic (PLEG): container finished" podID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerID="f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592" exitCode=0
Oct 30 02:42:59.435996 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:59.436002    5981 generic.go:356] "Generic (PLEG): container finished" podID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerID="7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128" exitCode=0
Oct 30 02:42:59.436267 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:59.436008    5981 generic.go:356] "Generic (PLEG): container finished" podID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerID="7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7" exitCode=0
Oct 30 02:42:59.436267 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:59.436035    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerDied","Data":"a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6"}
Oct 30 02:42:59.436267 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:59.436097    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerDied","Data":"d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f"}
Oct 30 02:42:59.436267 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:59.436126    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerDied","Data":"f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592"}
Oct 30 02:42:59.436267 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:59.436152    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerDied","Data":"7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128"}
Oct 30 02:42:59.436267 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:59.436175    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerDied","Data":"7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7"}
Oct 30 02:42:59.970272 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:42:59.970244    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.157958 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.157926    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-web\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.158122 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.157975    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-web-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-web-config\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.158122 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.158000    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-main-db\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.158122 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.158032    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-kube-api-access-ddcm6\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-kube-api-access-ddcm6\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.158122 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.158073    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-config-out\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.158122 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.158109    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.158424 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.158150    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-trusted-ca-bundle\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.158424 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.158183    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-main-tls\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.158528 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.158415    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-main-db" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 02:43:00.159246 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.158780    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-metrics-client-ca\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.159246 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.158846    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-cluster-tls-config\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.159246 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.158884    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-tls-assets\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-tls-assets\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.159246 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.158936    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.159246 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.158985    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-config-volume\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-config-volume\") pod \"0ce764bc-8e37-40fd-8019-44a3a798febc\" (UID: \"0ce764bc-8e37-40fd-8019-44a3a798febc\") "
Oct 30 02:43:00.159246 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.159009    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-trusted-ca-bundle" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:43:00.160984 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.160956    5981 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.161096 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.160990    5981 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-alertmanager-main-db\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.161455 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.161415    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-metric" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:00.162000 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.161963    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-metrics-client-ca" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:43:00.162163 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.162143    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-kube-api-access-ddcm6" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "kube-api-access-ddcm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:43:00.162455 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.162194    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-main-tls" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:00.163916 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.163887    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-tls-assets" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:43:00.167325 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.165428    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-web" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:00.168535 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.168492    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:00.168872 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.168851    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-config-volume" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:00.169037 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.168970    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-config-out" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 02:43:00.170171 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.170147    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-cluster-tls-config" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:00.177979 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.177958    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-web-config" pod "0ce764bc-8e37-40fd-8019-44a3a798febc" (UID: "0ce764bc-8e37-40fd-8019-44a3a798febc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:00.261724 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.261702    5981 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.261724 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.261723    5981 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-config-volume\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.261845 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.261750    5981 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.261845 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.261760    5981 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-web-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.261845 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.261768    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddcm6\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-kube-api-access-ddcm6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.261845 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.261776    5981 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ce764bc-8e37-40fd-8019-44a3a798febc-config-out\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.261845 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.261784    5981 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.261845 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.261793    5981 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-secret-alertmanager-main-tls\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.261845 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.261801    5981 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ce764bc-8e37-40fd-8019-44a3a798febc-metrics-client-ca\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.261845 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.261809    5981 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ce764bc-8e37-40fd-8019-44a3a798febc-cluster-tls-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.261845 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.261817    5981 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ce764bc-8e37-40fd-8019-44a3a798febc-tls-assets\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:00.442224 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.442171    5981 generic.go:356] "Generic (PLEG): container finished" podID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerID="d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461" exitCode=0
Oct 30 02:43:00.442224 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.442226    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerDied","Data":"d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461"}
Oct 30 02:43:00.442381 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.442267    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.442381 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.442295    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ce764bc-8e37-40fd-8019-44a3a798febc","Type":"ContainerDied","Data":"5fa7061a76ca3ec5649ad4ae2b81d35854b0fbcb63c9203094ba0164dcf77c9c"}
Oct 30 02:43:00.442381 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.442330    5981 scope.go:122] "RemoveContainer" containerID="a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6"
Oct 30 02:43:00.450051 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.450033    5981 scope.go:122] "RemoveContainer" containerID="d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f"
Oct 30 02:43:00.456692 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.456668    5981 scope.go:122] "RemoveContainer" containerID="f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592"
Oct 30 02:43:00.463086 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.463064    5981 scope.go:122] "RemoveContainer" containerID="d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461"
Oct 30 02:43:00.469429 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.469411    5981 scope.go:122] "RemoveContainer" containerID="7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128"
Oct 30 02:43:00.476164 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.476149    5981 scope.go:122] "RemoveContainer" containerID="7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7"
Oct 30 02:43:00.483202 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.483186    5981 scope.go:122] "RemoveContainer" containerID="99f8df3bdfa329fd6208e9fbca0d11055d11375cb26b95b82a142e19df4f03bb"
Oct 30 02:43:00.489785 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.489770    5981 scope.go:122] "RemoveContainer" containerID="a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6"
Oct 30 02:43:00.490031 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:43:00.490010    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6\": container with ID starting with a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6 not found: ID does not exist" containerID="a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6"
Oct 30 02:43:00.490092 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.490041    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6"} err="failed to get container status \"a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6\": rpc error: code = NotFound desc = could not find container \"a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6\": container with ID starting with a6a807e5eded228ec6f8fadaa91903aa127031bf89245fe0c8d925d2d93bf7e6 not found: ID does not exist"
Oct 30 02:43:00.490092 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.490074    5981 scope.go:122] "RemoveContainer" containerID="d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f"
Oct 30 02:43:00.490336 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:43:00.490318    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f\": container with ID starting with d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f not found: ID does not exist" containerID="d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f"
Oct 30 02:43:00.490380 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.490342    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f"} err="failed to get container status \"d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f\": rpc error: code = NotFound desc = could not find container \"d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f\": container with ID starting with d6cbfd573ddfd56b67b7a3504e98806cb56f22b01b3f0b352ad566c917ec989f not found: ID does not exist"
Oct 30 02:43:00.490380 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.490357    5981 scope.go:122] "RemoveContainer" containerID="f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592"
Oct 30 02:43:00.490572 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:43:00.490557    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592\": container with ID starting with f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592 not found: ID does not exist" containerID="f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592"
Oct 30 02:43:00.490628 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.490575    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592"} err="failed to get container status \"f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592\": rpc error: code = NotFound desc = could not find container \"f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592\": container with ID starting with f7cc3838497bb7fd221f13e14bd6673b7bc4380f653c6d8031e266fa304b7592 not found: ID does not exist"
Oct 30 02:43:00.490628 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.490587    5981 scope.go:122] "RemoveContainer" containerID="d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461"
Oct 30 02:43:00.490813 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:43:00.490795    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461\": container with ID starting with d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461 not found: ID does not exist" containerID="d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461"
Oct 30 02:43:00.490851 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.490817    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461"} err="failed to get container status \"d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461\": rpc error: code = NotFound desc = could not find container \"d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461\": container with ID starting with d471a8c2a7468dee8107454f93e1ffa2b4a8000c986e883db0206c6245728461 not found: ID does not exist"
Oct 30 02:43:00.490851 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.490829    5981 scope.go:122] "RemoveContainer" containerID="7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128"
Oct 30 02:43:00.491072 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:43:00.491056    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128\": container with ID starting with 7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128 not found: ID does not exist" containerID="7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128"
Oct 30 02:43:00.491118 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.491075    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128"} err="failed to get container status \"7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128\": rpc error: code = NotFound desc = could not find container \"7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128\": container with ID starting with 7edf4442d8a65d8ffac8df499bac0666d30e15942666c5d6fe47d2e6bfd18128 not found: ID does not exist"
Oct 30 02:43:00.491118 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.491087    5981 scope.go:122] "RemoveContainer" containerID="7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7"
Oct 30 02:43:00.491345 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:43:00.491328    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7\": container with ID starting with 7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7 not found: ID does not exist" containerID="7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7"
Oct 30 02:43:00.491396 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.491349    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7"} err="failed to get container status \"7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7\": rpc error: code = NotFound desc = could not find container \"7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7\": container with ID starting with 7273aeca4cb7af395da795ac92e7a3d840c098b35a2487b2d4042e722da055b7 not found: ID does not exist"
Oct 30 02:43:00.491396 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.491362    5981 scope.go:122] "RemoveContainer" containerID="99f8df3bdfa329fd6208e9fbca0d11055d11375cb26b95b82a142e19df4f03bb"
Oct 30 02:43:00.491587 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:43:00.491572    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99f8df3bdfa329fd6208e9fbca0d11055d11375cb26b95b82a142e19df4f03bb\": container with ID starting with 99f8df3bdfa329fd6208e9fbca0d11055d11375cb26b95b82a142e19df4f03bb not found: ID does not exist" containerID="99f8df3bdfa329fd6208e9fbca0d11055d11375cb26b95b82a142e19df4f03bb"
Oct 30 02:43:00.491625 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.491590    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f8df3bdfa329fd6208e9fbca0d11055d11375cb26b95b82a142e19df4f03bb"} err="failed to get container status \"99f8df3bdfa329fd6208e9fbca0d11055d11375cb26b95b82a142e19df4f03bb\": rpc error: code = NotFound desc = could not find container \"99f8df3bdfa329fd6208e9fbca0d11055d11375cb26b95b82a142e19df4f03bb\": container with ID starting with 99f8df3bdfa329fd6208e9fbca0d11055d11375cb26b95b82a142e19df4f03bb not found: ID does not exist"
Oct 30 02:43:00.502078 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.502058    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 02:43:00.511297 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.511265    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 02:43:00.526853 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.526837    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 02:43:00.527149 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527130    5981 cpu_manager.go:414] "containerMap: removing container" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="prom-label-proxy"
Oct 30 02:43:00.527264 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527248    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="prom-label-proxy"
Oct 30 02:43:00.527362 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527270    5981 cpu_manager.go:414] "containerMap: removing container" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="kube-rbac-proxy-metric"
Oct 30 02:43:00.527362 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527277    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="kube-rbac-proxy-metric"
Oct 30 02:43:00.527362 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527306    5981 cpu_manager.go:414] "containerMap: removing container" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="kube-rbac-proxy-web"
Oct 30 02:43:00.527362 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527311    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="kube-rbac-proxy-web"
Oct 30 02:43:00.527362 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527320    5981 cpu_manager.go:414] "containerMap: removing container" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="alertmanager"
Oct 30 02:43:00.527362 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527326    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="alertmanager"
Oct 30 02:43:00.527362 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527331    5981 cpu_manager.go:414] "containerMap: removing container" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="init-config-reloader"
Oct 30 02:43:00.527362 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527336    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="init-config-reloader"
Oct 30 02:43:00.527362 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527347    5981 cpu_manager.go:414] "containerMap: removing container" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="config-reloader"
Oct 30 02:43:00.527362 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527353    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="config-reloader"
Oct 30 02:43:00.527686 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527369    5981 cpu_manager.go:414] "containerMap: removing container" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="kube-rbac-proxy"
Oct 30 02:43:00.527686 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527373    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="kube-rbac-proxy"
Oct 30 02:43:00.527686 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527430    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="kube-rbac-proxy-metric"
Oct 30 02:43:00.527686 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527437    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="kube-rbac-proxy-web"
Oct 30 02:43:00.527686 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527444    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="alertmanager"
Oct 30 02:43:00.527686 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527448    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="init-config-reloader"
Oct 30 02:43:00.527686 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527454    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="config-reloader"
Oct 30 02:43:00.527686 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527461    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="kube-rbac-proxy"
Oct 30 02:43:00.527686 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.527471    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" containerName="prom-label-proxy"
Oct 30 02:43:00.549730 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.549709    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.558639 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.558618    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 02:43:00.564994 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.564976    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4cwt\" (UniqueName: \"kubernetes.io/projected/df01f296-d148-442f-a228-22862bb3c543-kube-api-access-m4cwt\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.565075 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.565008    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.565075 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.565048    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/df01f296-d148-442f-a228-22862bb3c543-tls-assets\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.565218 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.565195    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df01f296-d148-442f-a228-22862bb3c543-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.565294 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.565263    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/df01f296-d148-442f-a228-22862bb3c543-config-out\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.565349 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.565334    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/df01f296-d148-442f-a228-22862bb3c543-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.565386 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.565362    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df01f296-d148-442f-a228-22862bb3c543-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.565418 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.565390    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.565480 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.565455    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-config-volume\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.565510 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.565490    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-web-config\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.565539 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.565517    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.565599 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.565581    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.565649 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.565634    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.568799 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.568778    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 02:43:00.568936 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.568822    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 02:43:00.569153 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.569132    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 02:43:00.569314 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.569159    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-99thg\""
Oct 30 02:43:00.569436 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.569165    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 02:43:00.569436 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.569174    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 02:43:00.569595 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.569190    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 02:43:00.569595 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.569202    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 02:43:00.569595 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.569296    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 02:43:00.581905 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.581884    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 02:43:00.666059 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666036    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/df01f296-d148-442f-a228-22862bb3c543-tls-assets\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666183 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666066    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df01f296-d148-442f-a228-22862bb3c543-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666183 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666084    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/df01f296-d148-442f-a228-22862bb3c543-config-out\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666183 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666102    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/df01f296-d148-442f-a228-22862bb3c543-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666183 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666116    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df01f296-d148-442f-a228-22862bb3c543-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666183 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666130    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666183 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666149    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-config-volume\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666183 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666172    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-web-config\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666512 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666204    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666512 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666229    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666512 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666269    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666512 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666306    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4cwt\" (UniqueName: \"kubernetes.io/projected/df01f296-d148-442f-a228-22862bb3c543-kube-api-access-m4cwt\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666512 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666340    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.666512 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666425    5981 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 02:43:00.666812 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.666662    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/df01f296-d148-442f-a228-22862bb3c543-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.667058 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.667031    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df01f296-d148-442f-a228-22862bb3c543-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.667924 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.667902    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df01f296-d148-442f-a228-22862bb3c543-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.669390 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.669367    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/df01f296-d148-442f-a228-22862bb3c543-tls-assets\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.669630 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.669500    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-config-volume\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.669630 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.669577    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.669630 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.669609    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.669824 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.669732    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-web-config\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.669824 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.669754    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.669887 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.669829    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.670238 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.670223    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/df01f296-d148-442f-a228-22862bb3c543-config-out\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.671430 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.671414    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/df01f296-d148-442f-a228-22862bb3c543-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.689927 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.689907    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4cwt\" (UniqueName: \"kubernetes.io/projected/df01f296-d148-442f-a228-22862bb3c543-kube-api-access-m4cwt\") pod \"alertmanager-main-0\" (UID: \"df01f296-d148-442f-a228-22862bb3c543\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:00.957628 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:00.957597    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 02:43:01.305904 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:01.305878    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 02:43:01.308137 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:43:01.308112    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf01f296_d148_442f_a228_22862bb3c543.slice/crio-b2d941f2e9ba5081ef886c87176475d2138351d4b26aa0b7cc09cf704124bcee WatchSource:0}: Error finding container b2d941f2e9ba5081ef886c87176475d2138351d4b26aa0b7cc09cf704124bcee: Status 404 returned error can't find the container with id b2d941f2e9ba5081ef886c87176475d2138351d4b26aa0b7cc09cf704124bcee
Oct 30 02:43:01.447303 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:01.447254    5981 generic.go:356] "Generic (PLEG): container finished" podID="df01f296-d148-442f-a228-22862bb3c543" containerID="6e00f78b4e74fcef210a0bfa837a3f223d4888613609648094ea5508804d667e" exitCode=0
Oct 30 02:43:01.447404 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:01.447338    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df01f296-d148-442f-a228-22862bb3c543","Type":"ContainerDied","Data":"6e00f78b4e74fcef210a0bfa837a3f223d4888613609648094ea5508804d667e"}
Oct 30 02:43:01.447461 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:01.447444    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df01f296-d148-442f-a228-22862bb3c543","Type":"ContainerStarted","Data":"b2d941f2e9ba5081ef886c87176475d2138351d4b26aa0b7cc09cf704124bcee"}
Oct 30 02:43:02.274793 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:02.274758    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ce764bc-8e37-40fd-8019-44a3a798febc" path="/var/lib/kubelet/pods/0ce764bc-8e37-40fd-8019-44a3a798febc/volumes"
Oct 30 02:43:02.456269 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:02.456237    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df01f296-d148-442f-a228-22862bb3c543","Type":"ContainerStarted","Data":"4ccf373b72b2bcdc7b6f9e1ffce2dfed107f21421e6bcfd1df6396645006e551"}
Oct 30 02:43:02.456693 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:02.456330    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df01f296-d148-442f-a228-22862bb3c543","Type":"ContainerStarted","Data":"fee63e49fda4ea650b9507c7a3fc04e75ee06b7fb9231d5f2e456e59cd37ca08"}
Oct 30 02:43:02.456693 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:02.456360    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df01f296-d148-442f-a228-22862bb3c543","Type":"ContainerStarted","Data":"c3633f61db81b6931b1acd78c361a3a44639402c6da9fd2cfcda0878237966c5"}
Oct 30 02:43:02.456693 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:02.456384    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df01f296-d148-442f-a228-22862bb3c543","Type":"ContainerStarted","Data":"9d3895b6b24c00e82bf354f8c04d143662e4e77e0f9f1177ee739d967f95aec0"}
Oct 30 02:43:02.456693 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:02.456406    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df01f296-d148-442f-a228-22862bb3c543","Type":"ContainerStarted","Data":"ce631fe5675562052e6f8a261d95239187632f884aebe0b261ad6ef3eb0df0ae"}
Oct 30 02:43:02.456693 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:02.456428    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df01f296-d148-442f-a228-22862bb3c543","Type":"ContainerStarted","Data":"d5dd005755615a298f304bd1ecd03a6d24195cb018efb2cea3ba29d3986c7379"}
Oct 30 02:43:02.520892 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:02.520842    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.513638706 podStartE2EDuration="2.520827817s" totalImagesPullingTime="0s" totalInitContainerRuntime="7.189111ms" isStatefulPod=false podCreationTimestamp="2026-10-30 02:43:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:43:02.519849949 +0000 UTC m=+22.362096442" watchObservedRunningTime="2026-10-30 02:43:02.520827817 +0000 UTC m=+22.363074263"
Oct 30 02:43:03.311584 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.311550    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 02:43:03.311868 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.311844    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="prometheus" containerID="cri-o://615806f331e2ab9c139ef2689ea8c9251093747d9d0167418a2be0f328be2732" gracePeriod=600
Oct 30 02:43:03.312153 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.312134    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://757fd6ab4373b614c8b7eaddc651c2aab58068ee8d76b03f7311026cc6863dc6" gracePeriod=600
Oct 30 02:43:03.312225 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.312212    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="kube-rbac-proxy" containerID="cri-o://ac617b926cecb2909084363047d6a70ee48d2293a8c0ee2e9af6774afef34cfd" gracePeriod=600
Oct 30 02:43:03.312273 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.312262    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="kube-rbac-proxy-web" containerID="cri-o://8667a8163e11c102b099019d2889b4d46d865f5c06249fcba699b871bf9ea987" gracePeriod=600
Oct 30 02:43:03.312361 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.312328    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="thanos-sidecar" containerID="cri-o://a31e20be00cb182b8848d5dd3a5199512894817a5826d8c1a1d3ecc779dd32e4" gracePeriod=600
Oct 30 02:43:03.312413 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.312385    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="config-reloader" containerID="cri-o://a37fea907960a2a8bddaf086b9628a864292a52ea122c1380bb033cd8d47d712" gracePeriod=600
Oct 30 02:43:03.463771 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.463741    5981 generic.go:356] "Generic (PLEG): container finished" podID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerID="757fd6ab4373b614c8b7eaddc651c2aab58068ee8d76b03f7311026cc6863dc6" exitCode=0
Oct 30 02:43:03.463771 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.463765    5981 generic.go:356] "Generic (PLEG): container finished" podID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerID="ac617b926cecb2909084363047d6a70ee48d2293a8c0ee2e9af6774afef34cfd" exitCode=0
Oct 30 02:43:03.463771 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.463772    5981 generic.go:356] "Generic (PLEG): container finished" podID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerID="8667a8163e11c102b099019d2889b4d46d865f5c06249fcba699b871bf9ea987" exitCode=0
Oct 30 02:43:03.463771 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.463777    5981 generic.go:356] "Generic (PLEG): container finished" podID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerID="a31e20be00cb182b8848d5dd3a5199512894817a5826d8c1a1d3ecc779dd32e4" exitCode=0
Oct 30 02:43:03.463771 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.463783    5981 generic.go:356] "Generic (PLEG): container finished" podID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerID="a37fea907960a2a8bddaf086b9628a864292a52ea122c1380bb033cd8d47d712" exitCode=0
Oct 30 02:43:03.463771 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.463788    5981 generic.go:356] "Generic (PLEG): container finished" podID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerID="615806f331e2ab9c139ef2689ea8c9251093747d9d0167418a2be0f328be2732" exitCode=0
Oct 30 02:43:03.464252 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.463817    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerDied","Data":"757fd6ab4373b614c8b7eaddc651c2aab58068ee8d76b03f7311026cc6863dc6"}
Oct 30 02:43:03.464252 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.463893    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerDied","Data":"ac617b926cecb2909084363047d6a70ee48d2293a8c0ee2e9af6774afef34cfd"}
Oct 30 02:43:03.464252 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.463929    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerDied","Data":"8667a8163e11c102b099019d2889b4d46d865f5c06249fcba699b871bf9ea987"}
Oct 30 02:43:03.464252 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.463953    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerDied","Data":"a31e20be00cb182b8848d5dd3a5199512894817a5826d8c1a1d3ecc779dd32e4"}
Oct 30 02:43:03.464252 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.463977    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerDied","Data":"a37fea907960a2a8bddaf086b9628a864292a52ea122c1380bb033cd8d47d712"}
Oct 30 02:43:03.464252 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.464000    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerDied","Data":"615806f331e2ab9c139ef2689ea8c9251093747d9d0167418a2be0f328be2732"}
Oct 30 02:43:03.569102 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.569035    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:03.600086 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600052    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-kube-api-access-74t8h\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-kube-api-access-74t8h\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600245 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600097    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-grpc-tls\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600245 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600141    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-1\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600378 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600339    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-kube-rbac-proxy\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600436 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600384    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600436 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600421    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-tls\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600533 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600453    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config-out\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600533 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600496    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-1" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:43:03.600533 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600502    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600685 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600574    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-trusted-ca-bundle\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600685 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600629    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-0\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600685 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600671    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-serving-certs-ca-bundle\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600835 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600699    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-tls-assets\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-tls-assets\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600835 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600730    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-kubelet-serving-ca-bundle\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600835 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600759    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-2\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.600835 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600796    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.601046 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600928    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-metrics-client-ca\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.601046 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.600974    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-web-config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-web-config\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.601046 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.601007    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-db\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.601190 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.601057    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-metrics-client-certs\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.601594 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.601537    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-serving-certs-ca-bundle" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:43:03.601769 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.601723    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-kubelet-serving-ca-bundle" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:43:03.602303 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.601905    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-2" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:43:03.602303 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.601964    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-metrics-client-ca" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:43:03.602663 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.601103    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-thanos-prometheus-http-client-file\") pod \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\" (UID: \"b48d06ef-1241-42fb-b7e8-b21ffda12a6f\") "
Oct 30 02:43:03.602871 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.602840    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-0" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:43:03.603162 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.603135    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-db" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 02:43:03.603428 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.603409    5981 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.604365 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.604349    5981 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.604514 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.604499    5981 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.604627 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.604613    5981 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.604727 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.604712    5981 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.604812 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.604788    5981 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-configmap-metrics-client-ca\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.604812 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.604806    5981 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-k8s-db\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.604927 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.603585    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-trusted-ca-bundle" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:43:03.604927 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.604383    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config-out" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 02:43:03.604927 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.604437    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:03.604927 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.604543    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-kube-rbac-proxy" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:03.604927 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.604709    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-tls" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:03.604927 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.604791    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-kube-api-access-74t8h" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "kube-api-access-74t8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:43:03.604927 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.604910    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-grpc-tls" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:03.605541 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.605517    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-kube-rbac-proxy-web" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:03.605924 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.605905    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-tls-assets" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:43:03.606417 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.606398    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-metrics-client-certs" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:03.606629 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.606610    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-thanos-sidecar-tls" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:03.606702 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.606668    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-thanos-prometheus-http-client-file" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:03.616839 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.616817    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-web-config" pod "b48d06ef-1241-42fb-b7e8-b21ffda12a6f" (UID: "b48d06ef-1241-42fb-b7e8-b21ffda12a6f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:03.706387 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706358    5981 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.706387 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706384    5981 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-web-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.706387 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706395    5981 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-metrics-client-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.706681 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706403    5981 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.706681 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706413    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74t8h\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-kube-api-access-74t8h\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.706681 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706421    5981 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-grpc-tls\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.706681 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706430    5981 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-kube-rbac-proxy\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.706681 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706438    5981 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.706681 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706446    5981 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.706681 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706455    5981 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config-out\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.706681 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706463    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.706681 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706471    5981 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:03.706681 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:03.706479    5981 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b48d06ef-1241-42fb-b7e8-b21ffda12a6f-tls-assets\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:04.471028 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.470996    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48d06ef-1241-42fb-b7e8-b21ffda12a6f","Type":"ContainerDied","Data":"6e27c1cb180cabda591cc34c418538e6ce76ae6f71dadc762e4aa36de31da7a3"}
Oct 30 02:43:04.471400 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.471078    5981 scope.go:122] "RemoveContainer" containerID="757fd6ab4373b614c8b7eaddc651c2aab58068ee8d76b03f7311026cc6863dc6"
Oct 30 02:43:04.471400 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.471012    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.478851 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.478833    5981 scope.go:122] "RemoveContainer" containerID="ac617b926cecb2909084363047d6a70ee48d2293a8c0ee2e9af6774afef34cfd"
Oct 30 02:43:04.486066 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.486049    5981 scope.go:122] "RemoveContainer" containerID="8667a8163e11c102b099019d2889b4d46d865f5c06249fcba699b871bf9ea987"
Oct 30 02:43:04.492895 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.492876    5981 scope.go:122] "RemoveContainer" containerID="a31e20be00cb182b8848d5dd3a5199512894817a5826d8c1a1d3ecc779dd32e4"
Oct 30 02:43:04.501480 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.501463    5981 scope.go:122] "RemoveContainer" containerID="a37fea907960a2a8bddaf086b9628a864292a52ea122c1380bb033cd8d47d712"
Oct 30 02:43:04.508066 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.508045    5981 scope.go:122] "RemoveContainer" containerID="615806f331e2ab9c139ef2689ea8c9251093747d9d0167418a2be0f328be2732"
Oct 30 02:43:04.514967 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.514945    5981 scope.go:122] "RemoveContainer" containerID="9a4ed3b32e139a5b12c049e1c82d4d5879b32d56f004f0da0dade060711d4ecc"
Oct 30 02:43:04.542068 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.542025    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 02:43:04.555150 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.555126    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 02:43:04.602992 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.602971    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 02:43:04.603259 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603248    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="kube-rbac-proxy-thanos"
Oct 30 02:43:04.603342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603261    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="kube-rbac-proxy-thanos"
Oct 30 02:43:04.603342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603294    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="config-reloader"
Oct 30 02:43:04.603342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603301    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="config-reloader"
Oct 30 02:43:04.603342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603316    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="kube-rbac-proxy"
Oct 30 02:43:04.603342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603321    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="kube-rbac-proxy"
Oct 30 02:43:04.603342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603327    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="kube-rbac-proxy-web"
Oct 30 02:43:04.603342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603332    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="kube-rbac-proxy-web"
Oct 30 02:43:04.603342 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603343    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="prometheus"
Oct 30 02:43:04.603585 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603347    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="prometheus"
Oct 30 02:43:04.603585 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603374    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="thanos-sidecar"
Oct 30 02:43:04.603585 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603379    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="thanos-sidecar"
Oct 30 02:43:04.603585 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603388    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="init-config-reloader"
Oct 30 02:43:04.603585 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603393    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="init-config-reloader"
Oct 30 02:43:04.603585 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603481    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="kube-rbac-proxy-thanos"
Oct 30 02:43:04.603585 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603493    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="config-reloader"
Oct 30 02:43:04.603585 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603498    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="kube-rbac-proxy"
Oct 30 02:43:04.603585 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603504    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="kube-rbac-proxy-web"
Oct 30 02:43:04.603585 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603509    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="prometheus"
Oct 30 02:43:04.603585 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603516    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="thanos-sidecar"
Oct 30 02:43:04.603585 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.603522    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" containerName="init-config-reloader"
Oct 30 02:43:04.607570 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.607555    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.623748 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.623727    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 02:43:04.623917 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.623900    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 02:43:04.623983 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.623967    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 02:43:04.624104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.624059    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 02:43:04.624104 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.624101    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 02:43:04.624265 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.624137    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 02:43:04.624442 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.624427    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 02:43:04.624544 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.624460    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 02:43:04.624544 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.624485    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 02:43:04.624544 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.624489    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-71pugkl75onuk\""
Oct 30 02:43:04.624544 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.624505    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 02:43:04.624544 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.624500    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m7t9x\""
Oct 30 02:43:04.624544 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.624523    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 02:43:04.624544 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.624526    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 02:43:04.638465 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.638430    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 02:43:04.638572 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.638557    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 02:43:04.639204 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.639186    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 02:43:04.713981 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.713953    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714081 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714006    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714148 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714078    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714148 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714137    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714228 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714159    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714228 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714175    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714228 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714189    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7td7j\" (UniqueName: \"kubernetes.io/projected/eb9f8167-1a90-4e53-a0d6-a50097c2facc-kube-api-access-7td7j\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714228 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714205    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714228 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714223    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714430 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714260    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-config\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714430 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714375    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb9f8167-1a90-4e53-a0d6-a50097c2facc-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714491 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714425    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714491 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714478    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714549 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714502    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714549 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714524    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb9f8167-1a90-4e53-a0d6-a50097c2facc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714549 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714539    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714757 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714565    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714757 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714587    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714757 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714618    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.714757 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.714636    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.815099 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815031    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.815099 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815066    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.815099 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815096    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.815354 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815141    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.815354 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815170    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.815354 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815203    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.815476 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815356    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.815476 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815432    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.815476 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815458    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7td7j\" (UniqueName: \"kubernetes.io/projected/eb9f8167-1a90-4e53-a0d6-a50097c2facc-kube-api-access-7td7j\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.815624 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815543    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.816118 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.816085    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.816118 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.816113    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.816275 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815847    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.816275 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.816146    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-config\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.816275 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.816177    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb9f8167-1a90-4e53-a0d6-a50097c2facc-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.816275 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.816204    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.816275 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.816266    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.816843 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.816817    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.816909 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815919    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.816909 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.816882    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.817023 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.816921    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb9f8167-1a90-4e53-a0d6-a50097c2facc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.817023 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.816946    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.817023 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.816972    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.817023 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.817002    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.819068 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.818664    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.819068 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.818780    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.819068 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.815792    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.819068 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.818867    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.819341 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.819173    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.819341 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.819175    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.819780 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.819756    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.819884 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.819779    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.819884 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.819799    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb9f8167-1a90-4e53-a0d6-a50097c2facc-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.820065 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.820043    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.820441 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.820414    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb9f8167-1a90-4e53-a0d6-a50097c2facc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.821265 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.821239    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb9f8167-1a90-4e53-a0d6-a50097c2facc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.821756 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.821733    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.822182 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.822165    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-config\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.822639 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.822621    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb9f8167-1a90-4e53-a0d6-a50097c2facc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.835785 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.835766    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7td7j\" (UniqueName: \"kubernetes.io/projected/eb9f8167-1a90-4e53-a0d6-a50097c2facc-kube-api-access-7td7j\") pod \"prometheus-k8s-0\" (UID: \"eb9f8167-1a90-4e53-a0d6-a50097c2facc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:04.924930 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:04.924911    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:05.242606 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:05.242581    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 02:43:05.244152 ip-10-0-128-202 kubenswrapper[5981]: W1030 02:43:05.244127    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9f8167_1a90_4e53_a0d6_a50097c2facc.slice/crio-726779e4ebacab2dea98d40fca7cef4316a61b6e61dea2744659c0671db18ec6 WatchSource:0}: Error finding container 726779e4ebacab2dea98d40fca7cef4316a61b6e61dea2744659c0671db18ec6: Status 404 returned error can't find the container with id 726779e4ebacab2dea98d40fca7cef4316a61b6e61dea2744659c0671db18ec6
Oct 30 02:43:05.481399 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:05.481363    5981 generic.go:356] "Generic (PLEG): container finished" podID="eb9f8167-1a90-4e53-a0d6-a50097c2facc" containerID="a4651c6fa363e251fef25ab6ceb255a8829e94091aba13068ebc9e469a597c4f" exitCode=0
Oct 30 02:43:05.481720 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:05.481448    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb9f8167-1a90-4e53-a0d6-a50097c2facc","Type":"ContainerDied","Data":"a4651c6fa363e251fef25ab6ceb255a8829e94091aba13068ebc9e469a597c4f"}
Oct 30 02:43:05.481720 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:05.481537    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb9f8167-1a90-4e53-a0d6-a50097c2facc","Type":"ContainerStarted","Data":"726779e4ebacab2dea98d40fca7cef4316a61b6e61dea2744659c0671db18ec6"}
Oct 30 02:43:06.274629 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:06.274603    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b48d06ef-1241-42fb-b7e8-b21ffda12a6f" path="/var/lib/kubelet/pods/b48d06ef-1241-42fb-b7e8-b21ffda12a6f/volumes"
Oct 30 02:43:06.488263 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:06.488229    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb9f8167-1a90-4e53-a0d6-a50097c2facc","Type":"ContainerStarted","Data":"2f5562e88b5661b197e894872b0d0d77ee633b4378d2f56c340d9bb10fa2fce2"}
Oct 30 02:43:06.488702 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:06.488312    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb9f8167-1a90-4e53-a0d6-a50097c2facc","Type":"ContainerStarted","Data":"870f68b50091cdf0598bbf29349c7f36e770da57118688816ea97cf430d9bb93"}
Oct 30 02:43:06.488702 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:06.488346    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb9f8167-1a90-4e53-a0d6-a50097c2facc","Type":"ContainerStarted","Data":"29e9f981264f63e43c5d9b3bd9ca253bbd5b7e7622c82c4a9a81bd2f802cc7c3"}
Oct 30 02:43:06.488702 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:06.488370    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb9f8167-1a90-4e53-a0d6-a50097c2facc","Type":"ContainerStarted","Data":"7904d3916fc5a85a3f525db72bc79e01edeb233ade6d103037f08d2f805a4521"}
Oct 30 02:43:06.488702 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:06.488404    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb9f8167-1a90-4e53-a0d6-a50097c2facc","Type":"ContainerStarted","Data":"3b3bac5d52b26dbb97200ca2b6f51cecace9c001cd14ad8d66de30ae6a64d341"}
Oct 30 02:43:06.488702 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:06.488426    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb9f8167-1a90-4e53-a0d6-a50097c2facc","Type":"ContainerStarted","Data":"c2a6d9b985b94defc6e9c0d830431c5548b891c313c7abace2476dda598416f9"}
Oct 30 02:43:06.553663 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:06.553581    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.534952292 podStartE2EDuration="2.553567799s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.615507ms" isStatefulPod=false podCreationTimestamp="2026-10-30 02:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 02:43:06.552610765 +0000 UTC m=+26.394857221" watchObservedRunningTime="2026-10-30 02:43:06.553567799 +0000 UTC m=+26.395814235"
Oct 30 02:43:09.925145 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:09.925111    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:10.231003 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:10.230918    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jw4x2"
Oct 30 02:43:11.074925 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.074895    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76fqh"
Oct 30 02:43:11.484428 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.484364    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-7595648df5-ptz96" podUID="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" containerName="console" containerID="cri-o://4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717" gracePeriod=15
Oct 30 02:43:11.728521 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.728501    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:43:11.775118 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.775050    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-service-ca\") pod \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") "
Oct 30 02:43:11.775118 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.775101    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-oauth-config\") pod \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") "
Oct 30 02:43:11.775321 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.775148    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-config\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-config\") pod \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") "
Oct 30 02:43:11.775321 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.775204    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-kube-api-access-tx4tw\" (UniqueName: \"kubernetes.io/projected/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-kube-api-access-tx4tw\") pod \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") "
Oct 30 02:43:11.775321 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.775245    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-tmp\") pod \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") "
Oct 30 02:43:11.775321 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.775313    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-oauth-serving-cert\") pod \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") "
Oct 30 02:43:11.775528 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.775396    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-serving-cert\") pod \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\" (UID: \"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f\") "
Oct 30 02:43:11.775528 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.775479    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-service-ca" pod "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" (UID: "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:43:11.775712 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.775638    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-tmp" pod "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" (UID: "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 02:43:11.775712 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.775646    5981 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-service-ca\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:11.775978 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.775952    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-config" pod "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" (UID: "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:43:11.776059 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.776028    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-oauth-serving-cert" pod "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" (UID: "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 02:43:11.777913 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.777886    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-kube-api-access-tx4tw" pod "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" (UID: "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f"). InnerVolumeSpecName "kube-api-access-tx4tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 02:43:11.778127 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.778109    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-serving-cert" pod "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" (UID: "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:11.778183 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.778160    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-oauth-config" pod "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" (UID: "c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 02:43:11.876030 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.876003    5981 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-serving-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:11.876030 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.876025    5981 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-oauth-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:11.876158 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.876035    5981 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-console-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:11.876158 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.876043    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx4tw\" (UniqueName: \"kubernetes.io/projected/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-kube-api-access-tx4tw\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:11.876158 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.876052    5981 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-tmp\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:11.876158 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:11.876060    5981 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f-oauth-serving-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 02:43:12.512831 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:12.512797    5981 generic.go:356] "Generic (PLEG): container finished" podID="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" containerID="4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717" exitCode=0
Oct 30 02:43:12.513345 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:12.512839    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7595648df5-ptz96"
Oct 30 02:43:12.513345 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:12.512867    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7595648df5-ptz96" event={"ID":"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f","Type":"ContainerDied","Data":"4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717"}
Oct 30 02:43:12.513345 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:12.512903    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7595648df5-ptz96" event={"ID":"c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f","Type":"ContainerDied","Data":"4010217157e70a308b2662cfd1b3a0bf1b8cac4a8806eeb552fa1e0d8acab4c3"}
Oct 30 02:43:12.513345 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:12.512921    5981 scope.go:122] "RemoveContainer" containerID="4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717"
Oct 30 02:43:12.521032 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:12.521011    5981 scope.go:122] "RemoveContainer" containerID="4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717"
Oct 30 02:43:12.521312 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:43:12.521277    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717\": container with ID starting with 4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717 not found: ID does not exist" containerID="4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717"
Oct 30 02:43:12.521380 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:12.521322    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717"} err="failed to get container status \"4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717\": rpc error: code = NotFound desc = could not find container \"4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717\": container with ID starting with 4100bc579e6aa891c3f92d9683184754c43069974ac2909fdb155bfea8be8717 not found: ID does not exist"
Oct 30 02:43:12.564982 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:12.564931    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7595648df5-ptz96"]
Oct 30 02:43:12.569762 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:12.569736    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7595648df5-ptz96"]
Oct 30 02:43:14.273411 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:14.273376    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" path="/var/lib/kubelet/pods/c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f/volumes"
Oct 30 02:43:14.367560 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:43:14.367524    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:43:29.410120 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:29.410084    5981 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:29.426190 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:29.426170    5981 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:29.594138 ip-10-0-128-202 kubenswrapper[5981]: I1030 02:43:29.594109    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 02:43:44.367595 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:43:44.367560    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:44:14.368818 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:44:14.368778    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:44:44.369063 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:44:44.369024    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:45:14.368717 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:45:14.368675    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:45:44.369308 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:45:44.369249    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:46:14.367857 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:46:14.367811    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:46:44.368617 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:46:44.368571    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:47:14.368476 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:47:14.368435    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:47:44.368903 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:47:44.368858    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:48:14.369852 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:48:14.369784    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:48:44.369063 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:48:44.369022    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:49:14.368687 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:49:14.368600    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:49:44.368482 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:49:44.368441    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:50:14.368857 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:50:14.368808    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:50:44.368660 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:50:44.368620    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:51:14.368908 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:51:14.368869    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:51:44.368333 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:51:44.368269    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:52:14.368926 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:52:14.368849    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:52:44.369622 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:52:44.369567    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:53:14.368544 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:53:14.368509    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:53:44.369214 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:53:44.369175    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:54:14.369188 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:54:14.369145    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:54:44.369738 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:54:44.369700    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:55:14.369341 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:55:14.369245    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:55:44.369685 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:55:44.369646    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:56:14.369008 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:56:14.368969    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:56:44.369777 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:56:44.369736    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:57:14.371176 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:57:14.371058    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:57:44.370953 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:57:44.370901    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:58:14.370331 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:58:14.370231    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:58:44.371324 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:58:44.371254    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:59:14.370334 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:59:14.370272    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 02:59:44.370113 ip-10-0-128-202 kubenswrapper[5981]: E1030 02:59:44.370064    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:00:14.371126 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:00:14.371082    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:00:44.369821 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:00:44.369779    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:01:14.369401 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:01:14.369314    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:01:44.371653 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:01:44.371611    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:02:14.368930 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:02:14.368886    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:02:44.369971 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:02:44.369934    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:03:14.368956 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:03:14.368916    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:03:44.368907 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:03:44.368867    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:04:14.368105 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:04:14.368028    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:04:44.368517 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:04:44.368478    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:05:14.368268 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:05:14.368226    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:05:44.368673 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:05:44.368631    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:06:14.369763 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:06:14.369723    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:06:44.370078 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:06:44.370038    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:07:14.368453 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:07:14.368376    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:07:44.368392 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:07:44.368349    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:08:14.368476 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:08:14.368438    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:08:44.368673 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:08:44.368639    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:09:14.369338 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:09:14.369296    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:09:17.607243 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.607205    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-fq9pl"]
Oct 30 03:09:17.607658 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.607561    5981 cpu_manager.go:414] "containerMap: removing container" podUID="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" containerName="console"
Oct 30 03:09:17.607658 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.607573    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" containerName="console"
Oct 30 03:09:17.607658 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.607639    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8e82cf1-ddb2-4c8b-8e8f-d89055b4c30f" containerName="console"
Oct 30 03:09:17.610537 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.610520    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-fq9pl"
Oct 30 03:09:17.628790 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.628765    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-fq9pl"]
Oct 30 03:09:17.641154 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.641124    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 03:09:17.641154 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.641144    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 03:09:17.641434 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.641230    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-sc9bf\""
Oct 30 03:09:17.776633 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.776596    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-682zr\" (UniqueName: \"kubernetes.io/projected/d6a50ef1-8d1a-4ebe-85ab-056f472018c4-kube-api-access-682zr\") pod \"cert-manager-597b95cb84-fq9pl\" (UID: \"d6a50ef1-8d1a-4ebe-85ab-056f472018c4\") " pod="cert-manager/cert-manager-597b95cb84-fq9pl"
Oct 30 03:09:17.776819 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.776647    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6a50ef1-8d1a-4ebe-85ab-056f472018c4-bound-sa-token\") pod \"cert-manager-597b95cb84-fq9pl\" (UID: \"d6a50ef1-8d1a-4ebe-85ab-056f472018c4\") " pod="cert-manager/cert-manager-597b95cb84-fq9pl"
Oct 30 03:09:17.877898 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.877803    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6a50ef1-8d1a-4ebe-85ab-056f472018c4-bound-sa-token\") pod \"cert-manager-597b95cb84-fq9pl\" (UID: \"d6a50ef1-8d1a-4ebe-85ab-056f472018c4\") " pod="cert-manager/cert-manager-597b95cb84-fq9pl"
Oct 30 03:09:17.877898 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.877888    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-682zr\" (UniqueName: \"kubernetes.io/projected/d6a50ef1-8d1a-4ebe-85ab-056f472018c4-kube-api-access-682zr\") pod \"cert-manager-597b95cb84-fq9pl\" (UID: \"d6a50ef1-8d1a-4ebe-85ab-056f472018c4\") " pod="cert-manager/cert-manager-597b95cb84-fq9pl"
Oct 30 03:09:17.898200 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.898162    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6a50ef1-8d1a-4ebe-85ab-056f472018c4-bound-sa-token\") pod \"cert-manager-597b95cb84-fq9pl\" (UID: \"d6a50ef1-8d1a-4ebe-85ab-056f472018c4\") " pod="cert-manager/cert-manager-597b95cb84-fq9pl"
Oct 30 03:09:17.898351 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.898234    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-682zr\" (UniqueName: \"kubernetes.io/projected/d6a50ef1-8d1a-4ebe-85ab-056f472018c4-kube-api-access-682zr\") pod \"cert-manager-597b95cb84-fq9pl\" (UID: \"d6a50ef1-8d1a-4ebe-85ab-056f472018c4\") " pod="cert-manager/cert-manager-597b95cb84-fq9pl"
Oct 30 03:09:17.934375 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:17.934353    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-fq9pl"
Oct 30 03:09:18.225207 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:18.225027    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-fq9pl"]
Oct 30 03:09:18.227720 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:09:18.227694    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6a50ef1_8d1a_4ebe_85ab_056f472018c4.slice/crio-014243016cfe2794331ecd11710b335c3485b11093a713470d451422052eb20f WatchSource:0}: Error finding container 014243016cfe2794331ecd11710b335c3485b11093a713470d451422052eb20f: Status 404 returned error can't find the container with id 014243016cfe2794331ecd11710b335c3485b11093a713470d451422052eb20f
Oct 30 03:09:18.230107 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:18.230088    5981 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 03:09:18.252556 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:18.252530    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-fq9pl" event={"ID":"d6a50ef1-8d1a-4ebe-85ab-056f472018c4","Type":"ContainerStarted","Data":"014243016cfe2794331ecd11710b335c3485b11093a713470d451422052eb20f"}
Oct 30 03:09:23.273725 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:23.273694    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-fq9pl" event={"ID":"d6a50ef1-8d1a-4ebe-85ab-056f472018c4","Type":"ContainerStarted","Data":"d753ff7d2e606b57041ac8af8a5558effef6fb44dfe7651774e22b6c978178ac"}
Oct 30 03:09:23.320158 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:09:23.320099    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-fq9pl" podStartSLOduration=2.024183078 podStartE2EDuration="6.320079444s" totalImagesPullingTime="4.295896366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:09:23.319133558 +0000 UTC m=+1603.161380003" watchObservedRunningTime="2026-10-30 03:09:23.320079444 +0000 UTC m=+1603.162325892"
Oct 30 03:09:44.369547 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:09:44.369506    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:10:14.369696 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:10:14.369655    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:10:44.368250 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:10:44.368211    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:11:14.369512 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:11:14.369476    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:11:44.369770 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:11:44.369734    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:11:59.661983 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.661944    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"]
Oct 30 03:11:59.665443 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.665423    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:11:59.689956 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.689930    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-opentelemetry-operator\"/\"openshift-service-ca.crt\""
Oct 30 03:11:59.690121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.690101    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-opentelemetry-operator\"/\"kube-root-ca.crt\""
Oct 30 03:11:59.712373 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.712346    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"]
Oct 30 03:11:59.746080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.746054    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-opentelemetry-operator\"/\"opentelemetry-operator-webhook-service-cert\""
Oct 30 03:11:59.746080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.746063    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-opentelemetry-operator\"/\"opentelemetry-operator-controller-manager-dockercfg-j5t2z\""
Oct 30 03:11:59.750477 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.750447    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-apiservice-cert\") pod \"opentelemetry-operator-webhook-bfcd6dc79-9xzps\" (UID: \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:11:59.750592 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.750479    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-webhook-cert\") pod \"opentelemetry-operator-webhook-bfcd6dc79-9xzps\" (UID: \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:11:59.750592 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.750531    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5cb8\" (UniqueName: \"kubernetes.io/projected/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-kube-api-access-k5cb8\") pod \"opentelemetry-operator-webhook-bfcd6dc79-9xzps\" (UID: \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:11:59.851681 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.851652    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-apiservice-cert\") pod \"opentelemetry-operator-webhook-bfcd6dc79-9xzps\" (UID: \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:11:59.851681 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.851681    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-webhook-cert\") pod \"opentelemetry-operator-webhook-bfcd6dc79-9xzps\" (UID: \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:11:59.851887 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.851718    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5cb8\" (UniqueName: \"kubernetes.io/projected/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-kube-api-access-k5cb8\") pod \"opentelemetry-operator-webhook-bfcd6dc79-9xzps\" (UID: \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:11:59.854302 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.854266    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-apiservice-cert\") pod \"opentelemetry-operator-webhook-bfcd6dc79-9xzps\" (UID: \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:11:59.854417 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.854319    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-webhook-cert\") pod \"opentelemetry-operator-webhook-bfcd6dc79-9xzps\" (UID: \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:11:59.875399 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.875372    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5cb8\" (UniqueName: \"kubernetes.io/projected/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-kube-api-access-k5cb8\") pod \"opentelemetry-operator-webhook-bfcd6dc79-9xzps\" (UID: \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:11:59.977347 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:11:59.977260    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:12:00.302986 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:00.302901    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"]
Oct 30 03:12:00.315628 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:12:00.315598    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod399d37ad_bd49_4c87_ada6_ceb26a7db0d2.slice/crio-3468cce00ad48a58b2e18b3ba6286c329cae33ead909559c37f820d7df5f253c WatchSource:0}: Error finding container 3468cce00ad48a58b2e18b3ba6286c329cae33ead909559c37f820d7df5f253c: Status 404 returned error can't find the container with id 3468cce00ad48a58b2e18b3ba6286c329cae33ead909559c37f820d7df5f253c
Oct 30 03:12:00.851668 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:00.851623    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps" event={"ID":"399d37ad-bd49-4c87-ada6-ceb26a7db0d2","Type":"ContainerStarted","Data":"3468cce00ad48a58b2e18b3ba6286c329cae33ead909559c37f820d7df5f253c"}
Oct 30 03:12:02.861776 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:02.861736    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps" event={"ID":"399d37ad-bd49-4c87-ada6-ceb26a7db0d2","Type":"ContainerStarted","Data":"fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58"}
Oct 30 03:12:02.862180 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:02.861860    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:12:02.970345 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:02.970258    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps" podStartSLOduration=2.250963306 podStartE2EDuration="3.970239947s" totalImagesPullingTime="1.719276641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:12:02.956365748 +0000 UTC m=+1762.798646597" watchObservedRunningTime="2026-10-30 03:12:02.970239947 +0000 UTC m=+1762.812486393"
Oct 30 03:12:03.782854 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:03.782814    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"]
Oct 30 03:12:04.869096 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:04.869050    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps" podUID="399d37ad-bd49-4c87-ada6-ceb26a7db0d2" containerName="webhook" containerID="cri-o://fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58" gracePeriod=30
Oct 30 03:12:05.115679 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.115651    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:12:05.202175 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.202143    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-kube-api-access-k5cb8\" (UniqueName: \"kubernetes.io/projected/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-kube-api-access-k5cb8\") pod \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\" (UID: \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\") "
Oct 30 03:12:05.202359 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.202218    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-apiservice-cert\" (UniqueName: \"kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-apiservice-cert\") pod \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\" (UID: \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\") "
Oct 30 03:12:05.202359 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.202255    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-webhook-cert\" (UniqueName: \"kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-webhook-cert\") pod \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\" (UID: \"399d37ad-bd49-4c87-ada6-ceb26a7db0d2\") "
Oct 30 03:12:05.204586 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.204555    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-apiservice-cert" pod "399d37ad-bd49-4c87-ada6-ceb26a7db0d2" (UID: "399d37ad-bd49-4c87-ada6-ceb26a7db0d2"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:12:05.204696 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.204594    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-webhook-cert" pod "399d37ad-bd49-4c87-ada6-ceb26a7db0d2" (UID: "399d37ad-bd49-4c87-ada6-ceb26a7db0d2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:12:05.204696 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.204629    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-kube-api-access-k5cb8" pod "399d37ad-bd49-4c87-ada6-ceb26a7db0d2" (UID: "399d37ad-bd49-4c87-ada6-ceb26a7db0d2"). InnerVolumeSpecName "kube-api-access-k5cb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:12:05.303275 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.303241    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5cb8\" (UniqueName: \"kubernetes.io/projected/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-kube-api-access-k5cb8\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:05.303275 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.303268    5981 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-apiservice-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:05.303275 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.303278    5981 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/399d37ad-bd49-4c87-ada6-ceb26a7db0d2-webhook-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:05.874342 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.874304    5981 generic.go:356] "Generic (PLEG): container finished" podID="399d37ad-bd49-4c87-ada6-ceb26a7db0d2" containerID="fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58" exitCode=0
Oct 30 03:12:05.874831 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.874361    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"
Oct 30 03:12:05.874831 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.874367    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps" event={"ID":"399d37ad-bd49-4c87-ada6-ceb26a7db0d2","Type":"ContainerDied","Data":"fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58"}
Oct 30 03:12:05.874831 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.874419    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps" event={"ID":"399d37ad-bd49-4c87-ada6-ceb26a7db0d2","Type":"ContainerDied","Data":"3468cce00ad48a58b2e18b3ba6286c329cae33ead909559c37f820d7df5f253c"}
Oct 30 03:12:05.874831 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.874446    5981 scope.go:122] "RemoveContainer" containerID="fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58"
Oct 30 03:12:05.883412 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.883390    5981 scope.go:122] "RemoveContainer" containerID="fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58"
Oct 30 03:12:05.883675 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:12:05.883656    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58\": container with ID starting with fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58 not found: ID does not exist" containerID="fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58"
Oct 30 03:12:05.883716 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.883687    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58"} err="failed to get container status \"fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58\": rpc error: code = NotFound desc = could not find container \"fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58\": container with ID starting with fcf58900f020862ea507d06477e6b4667e72d94d10230347dd7ae908632c9c58 not found: ID does not exist"
Oct 30 03:12:05.959810 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.959781    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"]
Oct 30 03:12:05.973024 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:05.973000    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-bfcd6dc79-9xzps"]
Oct 30 03:12:06.274750 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:06.274712    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="399d37ad-bd49-4c87-ada6-ceb26a7db0d2" path="/var/lib/kubelet/pods/399d37ad-bd49-4c87-ada6-ceb26a7db0d2/volumes"
Oct 30 03:12:14.368182 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:12:14.368145    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:12:15.433329 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.433268    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"]
Oct 30 03:12:15.433750 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.433607    5981 cpu_manager.go:414] "containerMap: removing container" podUID="399d37ad-bd49-4c87-ada6-ceb26a7db0d2" containerName="webhook"
Oct 30 03:12:15.433750 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.433618    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="399d37ad-bd49-4c87-ada6-ceb26a7db0d2" containerName="webhook"
Oct 30 03:12:15.433750 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.433685    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="399d37ad-bd49-4c87-ada6-ceb26a7db0d2" containerName="webhook"
Oct 30 03:12:15.437980 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.437960    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.455719 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.455691    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"]
Oct 30 03:12:15.467968 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.467937    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators-redhat\"/\"loki-operator-controller-manager-service-cert\""
Oct 30 03:12:15.468122 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.468030    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators-redhat\"/\"loki-operator-controller-manager-dockercfg-jwh2d\""
Oct 30 03:12:15.468122 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.468082    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators-redhat\"/\"kube-root-ca.crt\""
Oct 30 03:12:15.468122 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.468091    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators-redhat\"/\"openshift-service-ca.crt\""
Oct 30 03:12:15.468122 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.468100    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators-redhat\"/\"loki-operator-manager-config\""
Oct 30 03:12:15.468263 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.468143    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators-redhat\"/\"loki-operator-metrics\""
Oct 30 03:12:15.489556 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.489516    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-webhook-cert\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.489644 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.489566    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"loki-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-loki-operator-metrics-cert\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.489680 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.489645    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjrnn\" (UniqueName: \"kubernetes.io/projected/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-kube-api-access-jjrnn\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.489753 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.489718    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-manager-config\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.489790 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.489767    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-apiservice-cert\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.590765 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.590732    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-manager-config\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.590951 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.590777    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-apiservice-cert\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.590951 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.590825    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-webhook-cert\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.590951 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.590864    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"loki-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-loki-operator-metrics-cert\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.590951 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.590908    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjrnn\" (UniqueName: \"kubernetes.io/projected/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-kube-api-access-jjrnn\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.591454 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.591428    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-manager-config\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.593497 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.593476    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-webhook-cert\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.593677 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.593655    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-apiservice-cert\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.593746 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.593655    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"loki-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-loki-operator-metrics-cert\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.613982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.613959    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjrnn\" (UniqueName: \"kubernetes.io/projected/e7c51bfa-baa7-479b-97a2-dd16bb9b4032-kube-api-access-jjrnn\") pod \"loki-operator-controller-manager-75cc486f67-ld99t\" (UID: \"e7c51bfa-baa7-479b-97a2-dd16bb9b4032\") " pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:15.750064 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:15.749969    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:16.086767 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:16.086669    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"]
Oct 30 03:12:16.089157 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:12:16.089124    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7c51bfa_baa7_479b_97a2_dd16bb9b4032.slice/crio-f2a5d76705b181759b8beb764f2da9e14d0bb46cabdeb66ea7d582e6705be7d4 WatchSource:0}: Error finding container f2a5d76705b181759b8beb764f2da9e14d0bb46cabdeb66ea7d582e6705be7d4: Status 404 returned error can't find the container with id f2a5d76705b181759b8beb764f2da9e14d0bb46cabdeb66ea7d582e6705be7d4
Oct 30 03:12:16.923810 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:16.923771    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t" event={"ID":"e7c51bfa-baa7-479b-97a2-dd16bb9b4032","Type":"ContainerStarted","Data":"f2a5d76705b181759b8beb764f2da9e14d0bb46cabdeb66ea7d582e6705be7d4"}
Oct 30 03:12:19.941202 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:19.941161    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t" event={"ID":"e7c51bfa-baa7-479b-97a2-dd16bb9b4032","Type":"ContainerStarted","Data":"24f760eb2410b2c16dd803c231b86afa17e63b91df29beb9bf4de1c5fb1df928"}
Oct 30 03:12:19.941797 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:19.941278    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:20.019954 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:20.019895    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t" podStartSLOduration=2.065323171 podStartE2EDuration="5.019881608s" totalImagesPullingTime="2.954558437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:12:20.006548547 +0000 UTC m=+1779.848794994" watchObservedRunningTime="2026-10-30 03:12:20.019881608 +0000 UTC m=+1779.862128053"
Oct 30 03:12:30.948241 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:30.948210    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators-redhat/loki-operator-controller-manager-75cc486f67-ld99t"
Oct 30 03:12:42.318165 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.318134    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:12:42.321771 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.321751    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:42.340518 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.340493    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:12:42.352536 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.352502    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 03:12:42.352536 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.352502    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 03:12:42.352701 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.352584    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 03:12:42.352701 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.352652    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 03:12:42.428959 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.428926    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6j9z\" (UniqueName: \"kubernetes.io/projected/680adb63-ecd2-45cd-bc31-0377a3524543-kube-api-access-f6j9z\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:42.429106 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.428974    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/680adb63-ecd2-45cd-bc31-0377a3524543-config\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:42.429106 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.429083    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/680adb63-ecd2-45cd-bc31-0377a3524543-plugins\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:42.530238 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.530198    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6j9z\" (UniqueName: \"kubernetes.io/projected/680adb63-ecd2-45cd-bc31-0377a3524543-kube-api-access-f6j9z\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:42.530428 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.530250    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/680adb63-ecd2-45cd-bc31-0377a3524543-config\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:42.530428 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.530303    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/680adb63-ecd2-45cd-bc31-0377a3524543-plugins\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:42.530773 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.530754    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/680adb63-ecd2-45cd-bc31-0377a3524543-plugins\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:42.530916 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.530895    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/680adb63-ecd2-45cd-bc31-0377a3524543-config\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:42.551102 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:42.551081    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6j9z\" (UniqueName: \"kubernetes.io/projected/680adb63-ecd2-45cd-bc31-0377a3524543-kube-api-access-f6j9z\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:44.369745 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:12:44.369656    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:12:47.979672 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:47.979628    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:48.010375 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:48.010342    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:48.080927 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:48.080888    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:48.081117 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:48.081096    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:48.096180 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:48.096153    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:48.285531 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:48.285504    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:48.310969 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:48.310935    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:48.332729 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:48.332693    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:48.623945 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:48.623920    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:12:48.626132 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:12:48.626106    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod680adb63_ecd2_45cd_bc31_0377a3524543.slice/crio-56a6cdbeacd9ce49a25f7167ba0cef40d6cd53a8de58cb52465da217f4dbdbc7 WatchSource:0}: Error finding container 56a6cdbeacd9ce49a25f7167ba0cef40d6cd53a8de58cb52465da217f4dbdbc7: Status 404 returned error can't find the container with id 56a6cdbeacd9ce49a25f7167ba0cef40d6cd53a8de58cb52465da217f4dbdbc7
Oct 30 03:12:49.067975 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:49.067939    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"680adb63-ecd2-45cd-bc31-0377a3524543","Type":"ContainerStarted","Data":"56a6cdbeacd9ce49a25f7167ba0cef40d6cd53a8de58cb52465da217f4dbdbc7"}
Oct 30 03:12:52.083218 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:52.083152    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"680adb63-ecd2-45cd-bc31-0377a3524543","Type":"ContainerStarted","Data":"7f5de992d436f8f8464125af9117f881ac6cb2d73b2055c99295d955b22853ac"}
Oct 30 03:12:52.083218 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:52.083208    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:52.132611 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:52.132503    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=9.883660497 podStartE2EDuration="13.132489404s" totalImagesPullingTime="3.248828907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:12:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:12:52.13191013 +0000 UTC m=+1811.974156605" watchObservedRunningTime="2026-10-30 03:12:52.132489404 +0000 UTC m=+1811.974735845"
Oct 30 03:12:57.985063 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:57.985022    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:12:57.985535 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:57.985236    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="680adb63-ecd2-45cd-bc31-0377a3524543" containerName="perses" containerID="cri-o://7f5de992d436f8f8464125af9117f881ac6cb2d73b2055c99295d955b22853ac" gracePeriod=30
Oct 30 03:12:58.111934 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.111894    5981 generic.go:356] "Generic (PLEG): container finished" podID="680adb63-ecd2-45cd-bc31-0377a3524543" containerID="7f5de992d436f8f8464125af9117f881ac6cb2d73b2055c99295d955b22853ac" exitCode=0
Oct 30 03:12:58.112081 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.111968    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"680adb63-ecd2-45cd-bc31-0377a3524543","Type":"ContainerDied","Data":"7f5de992d436f8f8464125af9117f881ac6cb2d73b2055c99295d955b22853ac"}
Oct 30 03:12:58.231982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.231953    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:58.271760 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.271650    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"680adb63-ecd2-45cd-bc31-0377a3524543\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") "
Oct 30 03:12:58.271760 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.271751    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/680adb63-ecd2-45cd-bc31-0377a3524543-kube-api-access-f6j9z\" (UniqueName: \"kubernetes.io/projected/680adb63-ecd2-45cd-bc31-0377a3524543-kube-api-access-f6j9z\") pod \"680adb63-ecd2-45cd-bc31-0377a3524543\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") "
Oct 30 03:12:58.271990 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.271803    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/680adb63-ecd2-45cd-bc31-0377a3524543-plugins\" (UniqueName: \"kubernetes.io/empty-dir/680adb63-ecd2-45cd-bc31-0377a3524543-plugins\") pod \"680adb63-ecd2-45cd-bc31-0377a3524543\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") "
Oct 30 03:12:58.271990 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.271928    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/680adb63-ecd2-45cd-bc31-0377a3524543-config\" (UniqueName: \"kubernetes.io/configmap/680adb63-ecd2-45cd-bc31-0377a3524543-config\") pod \"680adb63-ecd2-45cd-bc31-0377a3524543\" (UID: \"680adb63-ecd2-45cd-bc31-0377a3524543\") "
Oct 30 03:12:58.273206 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.272523    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/680adb63-ecd2-45cd-bc31-0377a3524543-config" pod "680adb63-ecd2-45cd-bc31-0377a3524543" (UID: "680adb63-ecd2-45cd-bc31-0377a3524543"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:12:58.275635 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.275603    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/680adb63-ecd2-45cd-bc31-0377a3524543-kube-api-access-f6j9z" pod "680adb63-ecd2-45cd-bc31-0377a3524543" (UID: "680adb63-ecd2-45cd-bc31-0377a3524543"). InnerVolumeSpecName "kube-api-access-f6j9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:12:58.284930 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.284904    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "680adb63-ecd2-45cd-bc31-0377a3524543" (UID: "680adb63-ecd2-45cd-bc31-0377a3524543"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 03:12:58.373390 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.373351    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 03:12:58.373390 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.373392    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6j9z\" (UniqueName: \"kubernetes.io/projected/680adb63-ecd2-45cd-bc31-0377a3524543-kube-api-access-f6j9z\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:58.373595 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.373407    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/680adb63-ecd2-45cd-bc31-0377a3524543-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:58.389485 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.389462    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 03:12:58.410003 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.409966    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/680adb63-ecd2-45cd-bc31-0377a3524543-plugins" pod "680adb63-ecd2-45cd-bc31-0377a3524543" (UID: "680adb63-ecd2-45cd-bc31-0377a3524543"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:12:58.474480 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.474432    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 03:12:58.474480 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:58.474471    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/680adb63-ecd2-45cd-bc31-0377a3524543-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:12:59.117043 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:59.117000    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"680adb63-ecd2-45cd-bc31-0377a3524543","Type":"ContainerDied","Data":"56a6cdbeacd9ce49a25f7167ba0cef40d6cd53a8de58cb52465da217f4dbdbc7"}
Oct 30 03:12:59.117043 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:59.117019    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:12:59.117043 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:59.117053    5981 scope.go:122] "RemoveContainer" containerID="7f5de992d436f8f8464125af9117f881ac6cb2d73b2055c99295d955b22853ac"
Oct 30 03:12:59.169620 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:59.169590    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:12:59.182791 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:12:59.182754    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:13:00.274883 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:00.274846    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="680adb63-ecd2-45cd-bc31-0377a3524543" path="/var/lib/kubelet/pods/680adb63-ecd2-45cd-bc31-0377a3524543/volumes"
Oct 30 03:13:03.643913 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.643879    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"]
Oct 30 03:13:03.644542 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.644415    5981 cpu_manager.go:414] "containerMap: removing container" podUID="680adb63-ecd2-45cd-bc31-0377a3524543" containerName="perses"
Oct 30 03:13:03.644542 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.644435    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="680adb63-ecd2-45cd-bc31-0377a3524543" containerName="perses"
Oct 30 03:13:03.644666 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.644550    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="680adb63-ecd2-45cd-bc31-0377a3524543" containerName="perses"
Oct 30 03:13:03.646419 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.646395    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"
Oct 30 03:13:03.664466 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.664436    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"]
Oct 30 03:13:03.676794 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.676752    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 03:13:03.676794 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.676784    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 03:13:03.677020 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.676801    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 03:13:03.717683 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.717645    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dclc\" (UniqueName: \"kubernetes.io/projected/4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139-kube-api-access-7dclc\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m\" (UID: \"4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"
Oct 30 03:13:03.819115 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.819073    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dclc\" (UniqueName: \"kubernetes.io/projected/4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139-kube-api-access-7dclc\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m\" (UID: \"4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"
Oct 30 03:13:03.840239 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.840202    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dclc\" (UniqueName: \"kubernetes.io/projected/4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139-kube-api-access-7dclc\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m\" (UID: \"4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"
Oct 30 03:13:03.956655 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:03.956593    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"
Oct 30 03:13:04.245717 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.245685    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"]
Oct 30 03:13:04.247906 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:13:04.247877    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d9e37b0_dc3f_4be0_a2b9_0f224f7c6139.slice/crio-dd92ebe4c0a6c5293a4e6c725347d086185fdf5841945c34b8bdc9d34c495956 WatchSource:0}: Error finding container dd92ebe4c0a6c5293a4e6c725347d086185fdf5841945c34b8bdc9d34c495956: Status 404 returned error can't find the container with id dd92ebe4c0a6c5293a4e6c725347d086185fdf5841945c34b8bdc9d34c495956
Oct 30 03:13:04.714479 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.714447    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:13:04.717641 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.717621    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:04.735653 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.735628    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:13:04.782611 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.782581    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 03:13:04.792748 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.792716    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"]
Oct 30 03:13:04.794931 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.794911    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:04.818143 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.818058    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 03:13:04.818340 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.818230    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-qvz5h\""
Oct 30 03:13:04.819470 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.819444    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"]
Oct 30 03:13:04.827466 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.827444    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n8z5\" (UniqueName: \"kubernetes.io/projected/14ce6f89-f91e-4216-8fde-ea10050adc4b-kube-api-access-9n8z5\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:04.827568 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.827495    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14ce6f89-f91e-4216-8fde-ea10050adc4b-config\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:04.827568 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.827516    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/14ce6f89-f91e-4216-8fde-ea10050adc4b-plugins\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:04.884431 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.884394    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 03:13:04.928973 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.928941    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n8z5\" (UniqueName: \"kubernetes.io/projected/14ce6f89-f91e-4216-8fde-ea10050adc4b-kube-api-access-9n8z5\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:04.929148 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.929025    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1084b447-cdb2-4130-9769-335b528c2596-ta-internal\") pod \"data-science-collector-targetallocator-fdfb95769-fjpq4\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:04.929148 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.929059    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k95hj\" (UniqueName: \"kubernetes.io/projected/1084b447-cdb2-4130-9769-335b528c2596-kube-api-access-k95hj\") pod \"data-science-collector-targetallocator-fdfb95769-fjpq4\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:04.929148 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.929089    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14ce6f89-f91e-4216-8fde-ea10050adc4b-config\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:04.929333 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.929309    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/14ce6f89-f91e-4216-8fde-ea10050adc4b-plugins\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:04.929390 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.929354    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-fdfb95769-fjpq4\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:04.929726 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.929705    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/14ce6f89-f91e-4216-8fde-ea10050adc4b-plugins\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:04.929793 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.929729    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14ce6f89-f91e-4216-8fde-ea10050adc4b-config\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:04.950497 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:04.950469    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n8z5\" (UniqueName: \"kubernetes.io/projected/14ce6f89-f91e-4216-8fde-ea10050adc4b-kube-api-access-9n8z5\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:05.031026 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:05.030419    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1084b447-cdb2-4130-9769-335b528c2596-ta-internal\") pod \"data-science-collector-targetallocator-fdfb95769-fjpq4\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:05.031026 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:05.030471    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95hj\" (UniqueName: \"kubernetes.io/projected/1084b447-cdb2-4130-9769-335b528c2596-kube-api-access-k95hj\") pod \"data-science-collector-targetallocator-fdfb95769-fjpq4\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:05.031026 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:05.030511    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-fdfb95769-fjpq4\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:05.031026 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:13:05.030706    5981 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-ta-server-cert: secret "data-science-collector-ta-server-cert" not found
Oct 30 03:13:05.031026 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:13:05.030791    5981 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert podName:1084b447-cdb2-4130-9769-335b528c2596 nodeName:}" failed. No retries permitted until 2026-10-30 03:13:05.53076888 +0000 UTC m=+1825.373015319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "data-science-collector-ta-server-cert" (UniqueName: "kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert") pod "data-science-collector-targetallocator-fdfb95769-fjpq4" (UID: "1084b447-cdb2-4130-9769-335b528c2596") : secret "data-science-collector-ta-server-cert" not found
Oct 30 03:13:05.031355 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:05.031220    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1084b447-cdb2-4130-9769-335b528c2596-ta-internal\") pod \"data-science-collector-targetallocator-fdfb95769-fjpq4\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:05.052446 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:05.052371    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k95hj\" (UniqueName: \"kubernetes.io/projected/1084b447-cdb2-4130-9769-335b528c2596-kube-api-access-k95hj\") pod \"data-science-collector-targetallocator-fdfb95769-fjpq4\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:05.150444 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:05.150404    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m" event={"ID":"4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139","Type":"ContainerStarted","Data":"dd92ebe4c0a6c5293a4e6c725347d086185fdf5841945c34b8bdc9d34c495956"}
Oct 30 03:13:05.538447 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:05.538350    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-fdfb95769-fjpq4\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:05.538646 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:13:05.538502    5981 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-ta-server-cert: secret "data-science-collector-ta-server-cert" not found
Oct 30 03:13:05.538646 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:13:05.538576    5981 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert podName:1084b447-cdb2-4130-9769-335b528c2596 nodeName:}" failed. No retries permitted until 2026-10-30 03:13:06.538554666 +0000 UTC m=+1826.380801107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "data-science-collector-ta-server-cert" (UniqueName: "kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert") pod "data-science-collector-targetallocator-fdfb95769-fjpq4" (UID: "1084b447-cdb2-4130-9769-335b528c2596") : secret "data-science-collector-ta-server-cert" not found
Oct 30 03:13:06.549045 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:06.548995    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-fdfb95769-fjpq4\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:06.549560 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:13:06.549108    5981 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-ta-server-cert: secret "data-science-collector-ta-server-cert" not found
Oct 30 03:13:06.549560 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:13:06.549189    5981 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert podName:1084b447-cdb2-4130-9769-335b528c2596 nodeName:}" failed. No retries permitted until 2026-10-30 03:13:08.549167363 +0000 UTC m=+1828.391413803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "data-science-collector-ta-server-cert" (UniqueName: "kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert") pod "data-science-collector-targetallocator-fdfb95769-fjpq4" (UID: "1084b447-cdb2-4130-9769-335b528c2596") : secret "data-science-collector-ta-server-cert" not found
Oct 30 03:13:07.160740 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:07.160701    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m" event={"ID":"4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139","Type":"ContainerStarted","Data":"cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1"}
Oct 30 03:13:07.200728 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:07.200677    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m" podStartSLOduration=1.40246095 podStartE2EDuration="4.20065879s" totalImagesPullingTime="2.79819784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:13:07.200082518 +0000 UTC m=+1827.042328963" watchObservedRunningTime="2026-10-30 03:13:07.20065879 +0000 UTC m=+1827.042905226"
Oct 30 03:13:07.358396 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:07.358313    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"]
Oct 30 03:13:07.360560 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:07.360543    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"
Oct 30 03:13:07.378375 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:07.378346    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"]
Oct 30 03:13:07.458117 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:07.458071    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q78j6\" (UniqueName: \"kubernetes.io/projected/aa6422cf-86bc-4b8c-8cb3-61ef74158516-kube-api-access-q78j6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr\" (UID: \"aa6422cf-86bc-4b8c-8cb3-61ef74158516\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"
Oct 30 03:13:07.559136 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:07.559099    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q78j6\" (UniqueName: \"kubernetes.io/projected/aa6422cf-86bc-4b8c-8cb3-61ef74158516-kube-api-access-q78j6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr\" (UID: \"aa6422cf-86bc-4b8c-8cb3-61ef74158516\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"
Oct 30 03:13:07.580184 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:07.580148    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q78j6\" (UniqueName: \"kubernetes.io/projected/aa6422cf-86bc-4b8c-8cb3-61ef74158516-kube-api-access-q78j6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr\" (UID: \"aa6422cf-86bc-4b8c-8cb3-61ef74158516\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"
Oct 30 03:13:07.671516 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:07.671485    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"
Oct 30 03:13:07.960441 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:07.960390    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"]
Oct 30 03:13:07.962659 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:13:07.962616    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa6422cf_86bc_4b8c_8cb3_61ef74158516.slice/crio-5a537448d9c51f24514530f75193f1027009caab2a78f78e198fbff683d360c2 WatchSource:0}: Error finding container 5a537448d9c51f24514530f75193f1027009caab2a78f78e198fbff683d360c2: Status 404 returned error can't find the container with id 5a537448d9c51f24514530f75193f1027009caab2a78f78e198fbff683d360c2
Oct 30 03:13:08.168972 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.168936    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr" event={"ID":"aa6422cf-86bc-4b8c-8cb3-61ef74158516","Type":"ContainerStarted","Data":"db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719"}
Oct 30 03:13:08.168972 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.168980    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr" event={"ID":"aa6422cf-86bc-4b8c-8cb3-61ef74158516","Type":"ContainerStarted","Data":"5a537448d9c51f24514530f75193f1027009caab2a78f78e198fbff683d360c2"}
Oct 30 03:13:08.225817 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.224991    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr" podStartSLOduration=1.224973026 podStartE2EDuration="1.224973026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:13:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:13:08.224786057 +0000 UTC m=+1828.067032503" watchObservedRunningTime="2026-10-30 03:13:08.224973026 +0000 UTC m=+1828.067219472"
Oct 30 03:13:08.256346 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.256257    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"]
Oct 30 03:13:08.266615 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.265729    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:08.301367 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.301337    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:08.368106 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.368067    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:08.368303 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.368187    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:08.384050 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.384024    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:08.491124 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.491050    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:08.517056 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.517027    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:08.569440 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.569404    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-fdfb95769-fjpq4\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:08.572079 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.572058    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-fdfb95769-fjpq4\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:08.629070 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.629031    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:08.705781 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.705744    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:08.919509 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.919487    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:13:08.922014 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:13:08.921985    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14ce6f89_f91e_4216_8fde_ea10050adc4b.slice/crio-3692166c7f8fb11eb9be506159ecb3ce27f24c98a4b619353e61253355f7bb28 WatchSource:0}: Error finding container 3692166c7f8fb11eb9be506159ecb3ce27f24c98a4b619353e61253355f7bb28: Status 404 returned error can't find the container with id 3692166c7f8fb11eb9be506159ecb3ce27f24c98a4b619353e61253355f7bb28
Oct 30 03:13:08.995247 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:08.995226    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"]
Oct 30 03:13:08.997774 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:13:08.997746    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1084b447_cdb2_4130_9769_335b528c2596.slice/crio-334d16b636970beef6f097db6f98907b2029c4999b2b6cb512c642823e911616 WatchSource:0}: Error finding container 334d16b636970beef6f097db6f98907b2029c4999b2b6cb512c642823e911616: Status 404 returned error can't find the container with id 334d16b636970beef6f097db6f98907b2029c4999b2b6cb512c642823e911616
Oct 30 03:13:09.174702 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:09.174660    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"14ce6f89-f91e-4216-8fde-ea10050adc4b","Type":"ContainerStarted","Data":"61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa"}
Oct 30 03:13:09.174702 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:09.174707    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"14ce6f89-f91e-4216-8fde-ea10050adc4b","Type":"ContainerStarted","Data":"3692166c7f8fb11eb9be506159ecb3ce27f24c98a4b619353e61253355f7bb28"}
Oct 30 03:13:09.174956 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:09.174765    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:09.176033 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:09.176009    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4" event={"ID":"1084b447-cdb2-4130-9769-335b528c2596","Type":"ContainerStarted","Data":"334d16b636970beef6f097db6f98907b2029c4999b2b6cb512c642823e911616"}
Oct 30 03:13:09.176141 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:09.176099    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m" podUID="4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139" containerName="thanos-querier" containerID="cri-o://cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1" gracePeriod=30
Oct 30 03:13:09.214433 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:09.214381    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=5.21435508 podStartE2EDuration="5.21435508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:13:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:13:09.213965711 +0000 UTC m=+1829.056212160" watchObservedRunningTime="2026-10-30 03:13:09.21435508 +0000 UTC m=+1829.056601582"
Oct 30 03:13:09.428191 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:09.428131    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"
Oct 30 03:13:09.579359 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:09.579328    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139-kube-api-access-7dclc\" (UniqueName: \"kubernetes.io/projected/4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139-kube-api-access-7dclc\") pod \"4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139\" (UID: \"4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139\") "
Oct 30 03:13:09.581812 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:09.581785    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139-kube-api-access-7dclc" pod "4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139" (UID: "4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139"). InnerVolumeSpecName "kube-api-access-7dclc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:13:09.680877 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:09.680796    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dclc\" (UniqueName: \"kubernetes.io/projected/4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139-kube-api-access-7dclc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:13:10.182637 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:10.182591    5981 generic.go:356] "Generic (PLEG): container finished" podID="4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139" containerID="cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1" exitCode=0
Oct 30 03:13:10.182825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:10.182648    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"
Oct 30 03:13:10.182825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:10.182654    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m" event={"ID":"4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139","Type":"ContainerDied","Data":"cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1"}
Oct 30 03:13:10.182825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:10.182734    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m" event={"ID":"4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139","Type":"ContainerDied","Data":"dd92ebe4c0a6c5293a4e6c725347d086185fdf5841945c34b8bdc9d34c495956"}
Oct 30 03:13:10.182825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:10.182760    5981 scope.go:122] "RemoveContainer" containerID="cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1"
Oct 30 03:13:10.195354 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:10.195333    5981 scope.go:122] "RemoveContainer" containerID="cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1"
Oct 30 03:13:10.195732 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:13:10.195712    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1\": container with ID starting with cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1 not found: ID does not exist" containerID="cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1"
Oct 30 03:13:10.195831 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:10.195739    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1"} err="failed to get container status \"cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1\": rpc error: code = NotFound desc = could not find container \"cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1\": container with ID starting with cc568140df5a56921c132a53c03e7a3653242ea16dbd7dff870e43a8fe1b1ac1 not found: ID does not exist"
Oct 30 03:13:10.234398 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:10.234367    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"]
Oct 30 03:13:10.238235 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:10.238198    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fbw8m"]
Oct 30 03:13:10.275600 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:10.275568    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139" path="/var/lib/kubelet/pods/4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139/volumes"
Oct 30 03:13:11.006520 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:11.004919    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:13:11.006520 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:11.005026    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:13:11.191173 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:11.191125    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4" event={"ID":"1084b447-cdb2-4130-9769-335b528c2596","Type":"ContainerStarted","Data":"2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8"}
Oct 30 03:13:11.192734 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:11.191611    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:11.192886 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:11.192850    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4" podUID="1084b447-cdb2-4130-9769-335b528c2596" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.26:8080/readyz\": dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 03:13:11.232702 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:11.232643    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4" podStartSLOduration=5.229049258 podStartE2EDuration="7.232624934s" totalImagesPullingTime="2.003575676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:13:11.232157274 +0000 UTC m=+1831.074403721" watchObservedRunningTime="2026-10-30 03:13:11.232624934 +0000 UTC m=+1831.074871380"
Oct 30 03:13:12.196767 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:12.196740    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:14.368906 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:13:14.368796    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:13:20.184927 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:20.184892    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:13:44.368648 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:13:44.368613    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:13:44.789082 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.789045    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"]
Oct 30 03:13:44.789449 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.789435    5981 cpu_manager.go:414] "containerMap: removing container" podUID="4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139" containerName="thanos-querier"
Oct 30 03:13:44.789449 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.789449    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139" containerName="thanos-querier"
Oct 30 03:13:44.789548 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.789505    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d9e37b0-dc3f-4be0-a2b9-0f224f7c6139" containerName="thanos-querier"
Oct 30 03:13:44.792785 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.792766    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:44.822788 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.822747    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"]
Oct 30 03:13:44.892798 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.892768    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5600b0fb-f874-4244-944e-a144ec37d018-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-cf8747844-vkhxp\" (UID: \"5600b0fb-f874-4244-944e-a144ec37d018\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:44.892935 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.892852    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nflvv\" (UniqueName: \"kubernetes.io/projected/5600b0fb-f874-4244-944e-a144ec37d018-kube-api-access-nflvv\") pod \"data-science-collector-targetallocator-cf8747844-vkhxp\" (UID: \"5600b0fb-f874-4244-944e-a144ec37d018\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:44.892935 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.892917    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5600b0fb-f874-4244-944e-a144ec37d018-ta-internal\") pod \"data-science-collector-targetallocator-cf8747844-vkhxp\" (UID: \"5600b0fb-f874-4244-944e-a144ec37d018\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:44.993868 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.993829    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5600b0fb-f874-4244-944e-a144ec37d018-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-cf8747844-vkhxp\" (UID: \"5600b0fb-f874-4244-944e-a144ec37d018\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:44.993868 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.993880    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nflvv\" (UniqueName: \"kubernetes.io/projected/5600b0fb-f874-4244-944e-a144ec37d018-kube-api-access-nflvv\") pod \"data-science-collector-targetallocator-cf8747844-vkhxp\" (UID: \"5600b0fb-f874-4244-944e-a144ec37d018\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:44.994146 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.993924    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5600b0fb-f874-4244-944e-a144ec37d018-ta-internal\") pod \"data-science-collector-targetallocator-cf8747844-vkhxp\" (UID: \"5600b0fb-f874-4244-944e-a144ec37d018\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:44.994638 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.994612    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5600b0fb-f874-4244-944e-a144ec37d018-ta-internal\") pod \"data-science-collector-targetallocator-cf8747844-vkhxp\" (UID: \"5600b0fb-f874-4244-944e-a144ec37d018\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:44.996546 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:44.996521    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5600b0fb-f874-4244-944e-a144ec37d018-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-cf8747844-vkhxp\" (UID: \"5600b0fb-f874-4244-944e-a144ec37d018\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:45.014203 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:45.014170    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nflvv\" (UniqueName: \"kubernetes.io/projected/5600b0fb-f874-4244-944e-a144ec37d018-kube-api-access-nflvv\") pod \"data-science-collector-targetallocator-cf8747844-vkhxp\" (UID: \"5600b0fb-f874-4244-944e-a144ec37d018\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:45.103188 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:45.103118    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:45.394221 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:45.394190    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"]
Oct 30 03:13:45.395667 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:13:45.395637    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5600b0fb_f874_4244_944e_a144ec37d018.slice/crio-d773283c25a3c4d025ded2d78ac506c9a16dcc7338673ef128400fbf96dec0b1 WatchSource:0}: Error finding container d773283c25a3c4d025ded2d78ac506c9a16dcc7338673ef128400fbf96dec0b1: Status 404 returned error can't find the container with id d773283c25a3c4d025ded2d78ac506c9a16dcc7338673ef128400fbf96dec0b1
Oct 30 03:13:45.398056 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:45.398016    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:13:45.398127 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:45.398095    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:13:46.349234 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.349194    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp" event={"ID":"5600b0fb-f874-4244-944e-a144ec37d018","Type":"ContainerStarted","Data":"3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7"}
Oct 30 03:13:46.349234 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.349235    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp" event={"ID":"5600b0fb-f874-4244-944e-a144ec37d018","Type":"ContainerStarted","Data":"d773283c25a3c4d025ded2d78ac506c9a16dcc7338673ef128400fbf96dec0b1"}
Oct 30 03:13:46.349629 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.349392    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:46.351099 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.351076    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:13:46.389483 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.389438    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp" podStartSLOduration=2.38942556 podStartE2EDuration="2.38942556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:13:46.389378823 +0000 UTC m=+1866.231625268" watchObservedRunningTime="2026-10-30 03:13:46.38942556 +0000 UTC m=+1866.231672005"
Oct 30 03:13:46.458791 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.458758    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"]
Oct 30 03:13:46.459264 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.458938    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4" podUID="1084b447-cdb2-4130-9769-335b528c2596" containerName="ta-container" containerID="cri-o://2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8" gracePeriod=30
Oct 30 03:13:46.698549 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.698522    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:46.809571 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.809531    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1084b447-cdb2-4130-9769-335b528c2596-kube-api-access-k95hj\" (UniqueName: \"kubernetes.io/projected/1084b447-cdb2-4130-9769-335b528c2596-kube-api-access-k95hj\") pod \"1084b447-cdb2-4130-9769-335b528c2596\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") "
Oct 30 03:13:46.809571 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.809581    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1084b447-cdb2-4130-9769-335b528c2596-ta-internal\" (UniqueName: \"kubernetes.io/configmap/1084b447-cdb2-4130-9769-335b528c2596-ta-internal\") pod \"1084b447-cdb2-4130-9769-335b528c2596\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") "
Oct 30 03:13:46.809851 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.809612    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert\") pod \"1084b447-cdb2-4130-9769-335b528c2596\" (UID: \"1084b447-cdb2-4130-9769-335b528c2596\") "
Oct 30 03:13:46.810004 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.809981    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1084b447-cdb2-4130-9769-335b528c2596-ta-internal" pod "1084b447-cdb2-4130-9769-335b528c2596" (UID: "1084b447-cdb2-4130-9769-335b528c2596"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:13:46.811876 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.811851    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert" pod "1084b447-cdb2-4130-9769-335b528c2596" (UID: "1084b447-cdb2-4130-9769-335b528c2596"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:13:46.812018 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.812002    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1084b447-cdb2-4130-9769-335b528c2596-kube-api-access-k95hj" pod "1084b447-cdb2-4130-9769-335b528c2596" (UID: "1084b447-cdb2-4130-9769-335b528c2596"). InnerVolumeSpecName "kube-api-access-k95hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:13:46.911161 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.911125    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k95hj\" (UniqueName: \"kubernetes.io/projected/1084b447-cdb2-4130-9769-335b528c2596-kube-api-access-k95hj\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:13:46.911161 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.911155    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1084b447-cdb2-4130-9769-335b528c2596-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:13:46.911161 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:46.911165    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1084b447-cdb2-4130-9769-335b528c2596-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:13:47.354925 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:47.354833    5981 generic.go:356] "Generic (PLEG): container finished" podID="1084b447-cdb2-4130-9769-335b528c2596" containerID="2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8" exitCode=0
Oct 30 03:13:47.354925 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:47.354877    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"
Oct 30 03:13:47.354925 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:47.354916    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4" event={"ID":"1084b447-cdb2-4130-9769-335b528c2596","Type":"ContainerDied","Data":"2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8"}
Oct 30 03:13:47.355208 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:47.354960    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4" event={"ID":"1084b447-cdb2-4130-9769-335b528c2596","Type":"ContainerDied","Data":"334d16b636970beef6f097db6f98907b2029c4999b2b6cb512c642823e911616"}
Oct 30 03:13:47.355208 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:47.354987    5981 scope.go:122] "RemoveContainer" containerID="2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8"
Oct 30 03:13:47.365649 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:47.365622    5981 scope.go:122] "RemoveContainer" containerID="2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8"
Oct 30 03:13:47.366014 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:13:47.365985    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8\": container with ID starting with 2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8 not found: ID does not exist" containerID="2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8"
Oct 30 03:13:47.366065 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:47.366030    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8"} err="failed to get container status \"2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8\": rpc error: code = NotFound desc = could not find container \"2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8\": container with ID starting with 2448586df8b1fb48bfb80b789e8b2302d27e624a4a5c15928f94cdebb9fd63e8 not found: ID does not exist"
Oct 30 03:13:47.406960 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:47.406917    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"]
Oct 30 03:13:47.419719 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:47.419684    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-fdfb95769-fjpq4"]
Oct 30 03:13:48.277603 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:13:48.277561    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1084b447-cdb2-4130-9769-335b528c2596" path="/var/lib/kubelet/pods/1084b447-cdb2-4130-9769-335b528c2596/volumes"
Oct 30 03:14:14.369169 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:14:14.369130    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:14:44.368412 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:14:44.368369    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:14:57.802540 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:14:57.802505    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e33038f18ce675"]
Oct 30 03:14:57.803039 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:14:57.802839    5981 cpu_manager.go:414] "containerMap: removing container" podUID="1084b447-cdb2-4130-9769-335b528c2596" containerName="ta-container"
Oct 30 03:14:57.803039 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:14:57.802851    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1084b447-cdb2-4130-9769-335b528c2596" containerName="ta-container"
Oct 30 03:14:57.803039 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:14:57.802925    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="1084b447-cdb2-4130-9769-335b528c2596" containerName="ta-container"
Oct 30 03:14:57.807071 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:14:57.807054    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-ingress-18e33038f18ce675"
Oct 30 03:14:57.817731 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:14:57.817711    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-ingress-18e33038f18ce675"
Oct 30 03:14:57.824764 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:14:57.821491    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e33038f18ce675"]
Oct 30 03:14:58.108167 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:14:58.108141    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e33038f18ce675"]
Oct 30 03:14:58.110139 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:14:58.110115    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5346cca1_d298_4320_8d84_200f9a4b75b1.slice/crio-49bd6463f38bb34bfe41efe2b1632eafc192965116b5f8dc31584e02ef8e028d WatchSource:0}: Error finding container 49bd6463f38bb34bfe41efe2b1632eafc192965116b5f8dc31584e02ef8e028d: Status 404 returned error can't find the container with id 49bd6463f38bb34bfe41efe2b1632eafc192965116b5f8dc31584e02ef8e028d
Oct 30 03:14:58.112205 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:14:58.112187    5981 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 03:14:58.658012 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:14:58.657978    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-ingress-18e33038f18ce675" event={"ID":"5346cca1-d298-4320-8d84-200f9a4b75b1","Type":"ContainerStarted","Data":"49bd6463f38bb34bfe41efe2b1632eafc192965116b5f8dc31584e02ef8e028d"}
Oct 30 03:14:59.663241 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:14:59.663210    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-ingress-18e33038f18ce675" event={"ID":"5346cca1-d298-4320-8d84-200f9a4b75b1","Type":"ContainerStarted","Data":"2ca84c1bfe5a9df10f6a66143832da797a1657f8d3c5c4203552df92247befce"}
Oct 30 03:15:04.686573 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:04.686531    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-ingress-18e33038f18ce675" event={"ID":"5346cca1-d298-4320-8d84-200f9a4b75b1","Type":"ContainerDied","Data":"2ca84c1bfe5a9df10f6a66143832da797a1657f8d3c5c4203552df92247befce"}
Oct 30 03:15:04.687036 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:04.686621    5981 generic.go:356] "Generic (PLEG): container finished" podID="5346cca1-d298-4320-8d84-200f9a4b75b1" containerID="2ca84c1bfe5a9df10f6a66143832da797a1657f8d3c5c4203552df92247befce" exitCode=0
Oct 30 03:15:05.827084 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:05.827057    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-ingress-18e33038f18ce675"
Oct 30 03:15:05.888055 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:05.888014    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e33038f18ce675"]
Oct 30 03:15:05.892184 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:05.892152    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e33038f18ce675"]
Oct 30 03:15:06.274893 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:06.274857    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5346cca1-d298-4320-8d84-200f9a4b75b1" path="/var/lib/kubelet/pods/5346cca1-d298-4320-8d84-200f9a4b75b1/volumes"
Oct 30 03:15:06.695758 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:06.695726    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-ingress-18e33038f18ce675"
Oct 30 03:15:06.695928 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:06.695766    5981 scope.go:122] "RemoveContainer" containerID="2ca84c1bfe5a9df10f6a66143832da797a1657f8d3c5c4203552df92247befce"
Oct 30 03:15:11.018006 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.017971    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"]
Oct 30 03:15:11.018426 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.018370    5981 cpu_manager.go:414] "containerMap: removing container" podUID="5346cca1-d298-4320-8d84-200f9a4b75b1" containerName="curl"
Oct 30 03:15:11.018426 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.018383    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5346cca1-d298-4320-8d84-200f9a4b75b1" containerName="curl"
Oct 30 03:15:11.018498 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.018451    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="5346cca1-d298-4320-8d84-200f9a4b75b1" containerName="curl"
Oct 30 03:15:11.022710 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.022686    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:11.039481 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.039449    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"]
Oct 30 03:15:11.115696 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.115663    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69vlz\" (UniqueName: \"kubernetes.io/projected/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-kube-api-access-69vlz\") pod \"data-science-collector-targetallocator-5f6b75747f-wnrpz\" (UID: \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:11.115881 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.115754    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5f6b75747f-wnrpz\" (UID: \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:11.115881 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.115811    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-ta-internal\") pod \"data-science-collector-targetallocator-5f6b75747f-wnrpz\" (UID: \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:11.216175 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.216137    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69vlz\" (UniqueName: \"kubernetes.io/projected/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-kube-api-access-69vlz\") pod \"data-science-collector-targetallocator-5f6b75747f-wnrpz\" (UID: \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:11.216363 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.216199    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5f6b75747f-wnrpz\" (UID: \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:11.216363 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.216249    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-ta-internal\") pod \"data-science-collector-targetallocator-5f6b75747f-wnrpz\" (UID: \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:11.216850 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.216819    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-ta-internal\") pod \"data-science-collector-targetallocator-5f6b75747f-wnrpz\" (UID: \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:11.218888 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.218858    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5f6b75747f-wnrpz\" (UID: \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:11.236885 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.236859    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69vlz\" (UniqueName: \"kubernetes.io/projected/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-kube-api-access-69vlz\") pod \"data-science-collector-targetallocator-5f6b75747f-wnrpz\" (UID: \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:11.334746 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.334670    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:11.625027 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.625001    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"]
Oct 30 03:15:11.627516 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:15:11.627488    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe870b0c_f76a_4deb_ae35_f04a2d4b70f6.slice/crio-5122aea464d1f08cc13338efd15f7ca7f722ce07c3749e1d9434dcc589adad9f WatchSource:0}: Error finding container 5122aea464d1f08cc13338efd15f7ca7f722ce07c3749e1d9434dcc589adad9f: Status 404 returned error can't find the container with id 5122aea464d1f08cc13338efd15f7ca7f722ce07c3749e1d9434dcc589adad9f
Oct 30 03:15:11.630472 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.630437    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:15:11.630558 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.630507    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:15:11.718660 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.718631    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz" event={"ID":"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6","Type":"ContainerStarted","Data":"c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57"}
Oct 30 03:15:11.718802 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.718669    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz" event={"ID":"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6","Type":"ContainerStarted","Data":"5122aea464d1f08cc13338efd15f7ca7f722ce07c3749e1d9434dcc589adad9f"}
Oct 30 03:15:11.718891 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.718860    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:11.720254 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.720226    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz" podUID="fe870b0c-f76a-4deb-ae35-f04a2d4b70f6" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.30:8080/readyz\": dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 03:15:11.760239 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:11.760164    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz" podStartSLOduration=1.760139792 podStartE2EDuration="1.760139792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:15:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:15:11.759714385 +0000 UTC m=+1951.601960851" watchObservedRunningTime="2026-10-30 03:15:11.760139792 +0000 UTC m=+1951.602386238"
Oct 30 03:15:12.723931 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:12.723904    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:12.794728 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:12.794692    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"]
Oct 30 03:15:12.794914 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:12.794878    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp" podUID="5600b0fb-f874-4244-944e-a144ec37d018" containerName="ta-container" containerID="cri-o://3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7" gracePeriod=30
Oct 30 03:15:13.034765 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.034742    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:15:13.129044 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.129013    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5600b0fb-f874-4244-944e-a144ec37d018-ta-internal\" (UniqueName: \"kubernetes.io/configmap/5600b0fb-f874-4244-944e-a144ec37d018-ta-internal\") pod \"5600b0fb-f874-4244-944e-a144ec37d018\" (UID: \"5600b0fb-f874-4244-944e-a144ec37d018\") "
Oct 30 03:15:13.129222 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.129064    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5600b0fb-f874-4244-944e-a144ec37d018-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5600b0fb-f874-4244-944e-a144ec37d018-data-science-collector-ta-server-cert\") pod \"5600b0fb-f874-4244-944e-a144ec37d018\" (UID: \"5600b0fb-f874-4244-944e-a144ec37d018\") "
Oct 30 03:15:13.129451 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.129428    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5600b0fb-f874-4244-944e-a144ec37d018-ta-internal" pod "5600b0fb-f874-4244-944e-a144ec37d018" (UID: "5600b0fb-f874-4244-944e-a144ec37d018"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:15:13.131260 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.131241    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5600b0fb-f874-4244-944e-a144ec37d018-data-science-collector-ta-server-cert" pod "5600b0fb-f874-4244-944e-a144ec37d018" (UID: "5600b0fb-f874-4244-944e-a144ec37d018"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:15:13.230402 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.230361    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5600b0fb-f874-4244-944e-a144ec37d018-kube-api-access-nflvv\" (UniqueName: \"kubernetes.io/projected/5600b0fb-f874-4244-944e-a144ec37d018-kube-api-access-nflvv\") pod \"5600b0fb-f874-4244-944e-a144ec37d018\" (UID: \"5600b0fb-f874-4244-944e-a144ec37d018\") "
Oct 30 03:15:13.230683 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.230665    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5600b0fb-f874-4244-944e-a144ec37d018-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:13.230750 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.230688    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5600b0fb-f874-4244-944e-a144ec37d018-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:13.232654 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.232631    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5600b0fb-f874-4244-944e-a144ec37d018-kube-api-access-nflvv" pod "5600b0fb-f874-4244-944e-a144ec37d018" (UID: "5600b0fb-f874-4244-944e-a144ec37d018"). InnerVolumeSpecName "kube-api-access-nflvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:15:13.332131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.332056    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nflvv\" (UniqueName: \"kubernetes.io/projected/5600b0fb-f874-4244-944e-a144ec37d018-kube-api-access-nflvv\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:13.728686 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.728654    5981 generic.go:356] "Generic (PLEG): container finished" podID="5600b0fb-f874-4244-944e-a144ec37d018" containerID="3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7" exitCode=0
Oct 30 03:15:13.729106 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.728699    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"
Oct 30 03:15:13.729106 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.728739    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp" event={"ID":"5600b0fb-f874-4244-944e-a144ec37d018","Type":"ContainerDied","Data":"3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7"}
Oct 30 03:15:13.729106 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.728775    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp" event={"ID":"5600b0fb-f874-4244-944e-a144ec37d018","Type":"ContainerDied","Data":"d773283c25a3c4d025ded2d78ac506c9a16dcc7338673ef128400fbf96dec0b1"}
Oct 30 03:15:13.729106 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.728793    5981 scope.go:122] "RemoveContainer" containerID="3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7"
Oct 30 03:15:13.737786 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.737771    5981 scope.go:122] "RemoveContainer" containerID="3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7"
Oct 30 03:15:13.738041 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:15:13.738022    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7\": container with ID starting with 3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7 not found: ID does not exist" containerID="3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7"
Oct 30 03:15:13.738086 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.738050    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7"} err="failed to get container status \"3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7\": rpc error: code = NotFound desc = could not find container \"3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7\": container with ID starting with 3dfd076fb8c86d46f560c021c57e181a32a7484cc0326f6688af94c31aefded7 not found: ID does not exist"
Oct 30 03:15:13.782113 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.782086    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"]
Oct 30 03:15:13.794710 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:13.794690    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cf8747844-vkhxp"]
Oct 30 03:15:14.275404 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:14.275368    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5600b0fb-f874-4244-944e-a144ec37d018" path="/var/lib/kubelet/pods/5600b0fb-f874-4244-944e-a144ec37d018/volumes"
Oct 30 03:15:14.369244 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:15:14.369208    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:15:20.589111 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.589072    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"]
Oct 30 03:15:20.589587 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.589496    5981 cpu_manager.go:414] "containerMap: removing container" podUID="5600b0fb-f874-4244-944e-a144ec37d018" containerName="ta-container"
Oct 30 03:15:20.589587 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.589514    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5600b0fb-f874-4244-944e-a144ec37d018" containerName="ta-container"
Oct 30 03:15:20.589710 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.589631    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="5600b0fb-f874-4244-944e-a144ec37d018" containerName="ta-container"
Oct 30 03:15:20.594130 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.594109    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:20.636230 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.636200    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"]
Oct 30 03:15:20.698407 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.698374    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqlv2\" (UniqueName: \"kubernetes.io/projected/f12a4de5-8620-4d97-9669-be777edd1f9b-kube-api-access-bqlv2\") pod \"data-science-collector-targetallocator-5dc554f6bb-7rl9w\" (UID: \"f12a4de5-8620-4d97-9669-be777edd1f9b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:20.698540 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.698487    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f12a4de5-8620-4d97-9669-be777edd1f9b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5dc554f6bb-7rl9w\" (UID: \"f12a4de5-8620-4d97-9669-be777edd1f9b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:20.698540 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.698530    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f12a4de5-8620-4d97-9669-be777edd1f9b-ta-internal\") pod \"data-science-collector-targetallocator-5dc554f6bb-7rl9w\" (UID: \"f12a4de5-8620-4d97-9669-be777edd1f9b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:20.799177 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.799139    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f12a4de5-8620-4d97-9669-be777edd1f9b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5dc554f6bb-7rl9w\" (UID: \"f12a4de5-8620-4d97-9669-be777edd1f9b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:20.799379 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.799192    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f12a4de5-8620-4d97-9669-be777edd1f9b-ta-internal\") pod \"data-science-collector-targetallocator-5dc554f6bb-7rl9w\" (UID: \"f12a4de5-8620-4d97-9669-be777edd1f9b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:20.799379 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.799232    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqlv2\" (UniqueName: \"kubernetes.io/projected/f12a4de5-8620-4d97-9669-be777edd1f9b-kube-api-access-bqlv2\") pod \"data-science-collector-targetallocator-5dc554f6bb-7rl9w\" (UID: \"f12a4de5-8620-4d97-9669-be777edd1f9b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:20.799881 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.799861    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f12a4de5-8620-4d97-9669-be777edd1f9b-ta-internal\") pod \"data-science-collector-targetallocator-5dc554f6bb-7rl9w\" (UID: \"f12a4de5-8620-4d97-9669-be777edd1f9b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:20.801742 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.801720    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f12a4de5-8620-4d97-9669-be777edd1f9b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5dc554f6bb-7rl9w\" (UID: \"f12a4de5-8620-4d97-9669-be777edd1f9b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:20.820605 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.820575    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqlv2\" (UniqueName: \"kubernetes.io/projected/f12a4de5-8620-4d97-9669-be777edd1f9b-kube-api-access-bqlv2\") pod \"data-science-collector-targetallocator-5dc554f6bb-7rl9w\" (UID: \"f12a4de5-8620-4d97-9669-be777edd1f9b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:20.906399 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:20.906379    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:21.201799 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:21.201762    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"]
Oct 30 03:15:21.204070 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:15:21.204041    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf12a4de5_8620_4d97_9669_be777edd1f9b.slice/crio-0c2d7966b955e0a18a138417edaf9776b77d18b1a152086732022174592ea122 WatchSource:0}: Error finding container 0c2d7966b955e0a18a138417edaf9776b77d18b1a152086732022174592ea122: Status 404 returned error can't find the container with id 0c2d7966b955e0a18a138417edaf9776b77d18b1a152086732022174592ea122
Oct 30 03:15:21.206038 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:21.206008    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:15:21.206127 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:21.206061    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:15:21.764264 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:21.764226    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w" event={"ID":"f12a4de5-8620-4d97-9669-be777edd1f9b","Type":"ContainerStarted","Data":"7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8"}
Oct 30 03:15:21.764264 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:21.764269    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w" event={"ID":"f12a4de5-8620-4d97-9669-be777edd1f9b","Type":"ContainerStarted","Data":"0c2d7966b955e0a18a138417edaf9776b77d18b1a152086732022174592ea122"}
Oct 30 03:15:21.764709 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:21.764457    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:21.766130 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:21.766109    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:21.803615 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:21.803559    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w" podStartSLOduration=1.8035392799999999 podStartE2EDuration="1.80353928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:15:21.803144461 +0000 UTC m=+1961.645390906" watchObservedRunningTime="2026-10-30 03:15:21.80353928 +0000 UTC m=+1961.645785726"
Oct 30 03:15:21.883130 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:21.883092    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"]
Oct 30 03:15:21.883338 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:21.883259    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz" podUID="fe870b0c-f76a-4deb-ae35-f04a2d4b70f6" containerName="ta-container" containerID="cri-o://c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57" gracePeriod=30
Oct 30 03:15:22.133104 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.133075    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:22.212886 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.212849    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-ta-internal\" (UniqueName: \"kubernetes.io/configmap/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-ta-internal\") pod \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\" (UID: \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\") "
Oct 30 03:15:22.213054 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.212979    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-kube-api-access-69vlz\" (UniqueName: \"kubernetes.io/projected/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-kube-api-access-69vlz\") pod \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\" (UID: \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\") "
Oct 30 03:15:22.213054 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.213039    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-data-science-collector-ta-server-cert\") pod \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\" (UID: \"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6\") "
Oct 30 03:15:22.213316 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.213263    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-ta-internal" pod "fe870b0c-f76a-4deb-ae35-f04a2d4b70f6" (UID: "fe870b0c-f76a-4deb-ae35-f04a2d4b70f6"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:15:22.215193 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.215171    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-data-science-collector-ta-server-cert" pod "fe870b0c-f76a-4deb-ae35-f04a2d4b70f6" (UID: "fe870b0c-f76a-4deb-ae35-f04a2d4b70f6"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:15:22.215493 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.215474    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-kube-api-access-69vlz" pod "fe870b0c-f76a-4deb-ae35-f04a2d4b70f6" (UID: "fe870b0c-f76a-4deb-ae35-f04a2d4b70f6"). InnerVolumeSpecName "kube-api-access-69vlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:15:22.313866 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.313775    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69vlz\" (UniqueName: \"kubernetes.io/projected/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-kube-api-access-69vlz\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:22.313866 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.313810    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:22.313866 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.313823    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:22.769271 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.769233    5981 generic.go:356] "Generic (PLEG): container finished" podID="fe870b0c-f76a-4deb-ae35-f04a2d4b70f6" containerID="c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57" exitCode=0
Oct 30 03:15:22.769702 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.769279    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"
Oct 30 03:15:22.769702 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.769334    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz" event={"ID":"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6","Type":"ContainerDied","Data":"c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57"}
Oct 30 03:15:22.769702 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.769378    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz" event={"ID":"fe870b0c-f76a-4deb-ae35-f04a2d4b70f6","Type":"ContainerDied","Data":"5122aea464d1f08cc13338efd15f7ca7f722ce07c3749e1d9434dcc589adad9f"}
Oct 30 03:15:22.769702 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.769399    5981 scope.go:122] "RemoveContainer" containerID="c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57"
Oct 30 03:15:22.777698 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.777681    5981 scope.go:122] "RemoveContainer" containerID="c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57"
Oct 30 03:15:22.777953 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:15:22.777934    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57\": container with ID starting with c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57 not found: ID does not exist" containerID="c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57"
Oct 30 03:15:22.777998 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.777961    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57"} err="failed to get container status \"c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57\": rpc error: code = NotFound desc = could not find container \"c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57\": container with ID starting with c3b0d0b840d27705582bcd72425ca8bf75f05a956921168690d3353380e8ad57 not found: ID does not exist"
Oct 30 03:15:22.823778 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.823745    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"]
Oct 30 03:15:22.836764 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:22.836723    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5f6b75747f-wnrpz"]
Oct 30 03:15:24.275599 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:24.275565    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fe870b0c-f76a-4deb-ae35-f04a2d4b70f6" path="/var/lib/kubelet/pods/fe870b0c-f76a-4deb-ae35-f04a2d4b70f6/volumes"
Oct 30 03:15:29.524704 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.524667    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"]
Oct 30 03:15:29.525202 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.525048    5981 cpu_manager.go:414] "containerMap: removing container" podUID="fe870b0c-f76a-4deb-ae35-f04a2d4b70f6" containerName="ta-container"
Oct 30 03:15:29.525202 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.525060    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe870b0c-f76a-4deb-ae35-f04a2d4b70f6" containerName="ta-container"
Oct 30 03:15:29.525202 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.525137    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe870b0c-f76a-4deb-ae35-f04a2d4b70f6" containerName="ta-container"
Oct 30 03:15:29.529373 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.529350    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:29.558505 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.558470    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"]
Oct 30 03:15:29.576957 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.576921    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0d9ddd56-95ec-4dca-bada-c812e4b43148-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-cc847757c-4qmbf\" (UID: \"0d9ddd56-95ec-4dca-bada-c812e4b43148\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:29.577119 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.576972    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg8qz\" (UniqueName: \"kubernetes.io/projected/0d9ddd56-95ec-4dca-bada-c812e4b43148-kube-api-access-qg8qz\") pod \"data-science-collector-targetallocator-cc847757c-4qmbf\" (UID: \"0d9ddd56-95ec-4dca-bada-c812e4b43148\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:29.577119 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.577049    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0d9ddd56-95ec-4dca-bada-c812e4b43148-ta-internal\") pod \"data-science-collector-targetallocator-cc847757c-4qmbf\" (UID: \"0d9ddd56-95ec-4dca-bada-c812e4b43148\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:29.678413 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.678365    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0d9ddd56-95ec-4dca-bada-c812e4b43148-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-cc847757c-4qmbf\" (UID: \"0d9ddd56-95ec-4dca-bada-c812e4b43148\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:29.678413 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.678420    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg8qz\" (UniqueName: \"kubernetes.io/projected/0d9ddd56-95ec-4dca-bada-c812e4b43148-kube-api-access-qg8qz\") pod \"data-science-collector-targetallocator-cc847757c-4qmbf\" (UID: \"0d9ddd56-95ec-4dca-bada-c812e4b43148\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:29.678686 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.678465    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0d9ddd56-95ec-4dca-bada-c812e4b43148-ta-internal\") pod \"data-science-collector-targetallocator-cc847757c-4qmbf\" (UID: \"0d9ddd56-95ec-4dca-bada-c812e4b43148\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:29.679096 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.679073    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0d9ddd56-95ec-4dca-bada-c812e4b43148-ta-internal\") pod \"data-science-collector-targetallocator-cc847757c-4qmbf\" (UID: \"0d9ddd56-95ec-4dca-bada-c812e4b43148\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:29.681053 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.681032    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0d9ddd56-95ec-4dca-bada-c812e4b43148-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-cc847757c-4qmbf\" (UID: \"0d9ddd56-95ec-4dca-bada-c812e4b43148\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:29.702031 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.702002    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg8qz\" (UniqueName: \"kubernetes.io/projected/0d9ddd56-95ec-4dca-bada-c812e4b43148-kube-api-access-qg8qz\") pod \"data-science-collector-targetallocator-cc847757c-4qmbf\" (UID: \"0d9ddd56-95ec-4dca-bada-c812e4b43148\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:29.841084 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:29.840993    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:30.133619 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:30.133592    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"]
Oct 30 03:15:30.136012 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:15:30.135982    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d9ddd56_95ec_4dca_bada_c812e4b43148.slice/crio-c1e23a9e6ddd0f7a793a667903a532fb8e91459b8ebcf6842bce981d796e16af WatchSource:0}: Error finding container c1e23a9e6ddd0f7a793a667903a532fb8e91459b8ebcf6842bce981d796e16af: Status 404 returned error can't find the container with id c1e23a9e6ddd0f7a793a667903a532fb8e91459b8ebcf6842bce981d796e16af
Oct 30 03:15:30.138240 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:30.138209    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:15:30.138376 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:30.138277    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:15:30.806130 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:30.806094    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf" event={"ID":"0d9ddd56-95ec-4dca-bada-c812e4b43148","Type":"ContainerStarted","Data":"182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff"}
Oct 30 03:15:30.806545 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:30.806140    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf" event={"ID":"0d9ddd56-95ec-4dca-bada-c812e4b43148","Type":"ContainerStarted","Data":"c1e23a9e6ddd0f7a793a667903a532fb8e91459b8ebcf6842bce981d796e16af"}
Oct 30 03:15:30.806545 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:30.806263    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:30.807815 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:30.807790    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:30.847147 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:30.847087    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf" podStartSLOduration=1.847068868 podStartE2EDuration="1.847068868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:15:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:15:30.846432026 +0000 UTC m=+1970.688678498" watchObservedRunningTime="2026-10-30 03:15:30.847068868 +0000 UTC m=+1970.689315313"
Oct 30 03:15:30.919505 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:30.919476    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"]
Oct 30 03:15:30.919694 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:30.919650    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w" podUID="f12a4de5-8620-4d97-9669-be777edd1f9b" containerName="ta-container" containerID="cri-o://7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8" gracePeriod=30
Oct 30 03:15:31.159567 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.159537    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:31.291721 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.291689    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f12a4de5-8620-4d97-9669-be777edd1f9b-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f12a4de5-8620-4d97-9669-be777edd1f9b-data-science-collector-ta-server-cert\") pod \"f12a4de5-8620-4d97-9669-be777edd1f9b\" (UID: \"f12a4de5-8620-4d97-9669-be777edd1f9b\") "
Oct 30 03:15:31.291888 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.291741    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f12a4de5-8620-4d97-9669-be777edd1f9b-ta-internal\" (UniqueName: \"kubernetes.io/configmap/f12a4de5-8620-4d97-9669-be777edd1f9b-ta-internal\") pod \"f12a4de5-8620-4d97-9669-be777edd1f9b\" (UID: \"f12a4de5-8620-4d97-9669-be777edd1f9b\") "
Oct 30 03:15:31.291888 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.291803    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f12a4de5-8620-4d97-9669-be777edd1f9b-kube-api-access-bqlv2\" (UniqueName: \"kubernetes.io/projected/f12a4de5-8620-4d97-9669-be777edd1f9b-kube-api-access-bqlv2\") pod \"f12a4de5-8620-4d97-9669-be777edd1f9b\" (UID: \"f12a4de5-8620-4d97-9669-be777edd1f9b\") "
Oct 30 03:15:31.292166 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.292141    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f12a4de5-8620-4d97-9669-be777edd1f9b-ta-internal" pod "f12a4de5-8620-4d97-9669-be777edd1f9b" (UID: "f12a4de5-8620-4d97-9669-be777edd1f9b"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:15:31.293974 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.293946    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f12a4de5-8620-4d97-9669-be777edd1f9b-data-science-collector-ta-server-cert" pod "f12a4de5-8620-4d97-9669-be777edd1f9b" (UID: "f12a4de5-8620-4d97-9669-be777edd1f9b"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:15:31.294095 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.294034    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f12a4de5-8620-4d97-9669-be777edd1f9b-kube-api-access-bqlv2" pod "f12a4de5-8620-4d97-9669-be777edd1f9b" (UID: "f12a4de5-8620-4d97-9669-be777edd1f9b"). InnerVolumeSpecName "kube-api-access-bqlv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:15:31.393057 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.392984    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f12a4de5-8620-4d97-9669-be777edd1f9b-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:31.393057 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.393012    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f12a4de5-8620-4d97-9669-be777edd1f9b-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:31.393057 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.393023    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqlv2\" (UniqueName: \"kubernetes.io/projected/f12a4de5-8620-4d97-9669-be777edd1f9b-kube-api-access-bqlv2\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:31.811657 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.811623    5981 generic.go:356] "Generic (PLEG): container finished" podID="f12a4de5-8620-4d97-9669-be777edd1f9b" containerID="7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8" exitCode=0
Oct 30 03:15:31.812121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.811670    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"
Oct 30 03:15:31.812121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.811717    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w" event={"ID":"f12a4de5-8620-4d97-9669-be777edd1f9b","Type":"ContainerDied","Data":"7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8"}
Oct 30 03:15:31.812121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.811768    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w" event={"ID":"f12a4de5-8620-4d97-9669-be777edd1f9b","Type":"ContainerDied","Data":"0c2d7966b955e0a18a138417edaf9776b77d18b1a152086732022174592ea122"}
Oct 30 03:15:31.812121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.811793    5981 scope.go:122] "RemoveContainer" containerID="7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8"
Oct 30 03:15:31.821342 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.821323    5981 scope.go:122] "RemoveContainer" containerID="7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8"
Oct 30 03:15:31.821621 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:15:31.821601    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8\": container with ID starting with 7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8 not found: ID does not exist" containerID="7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8"
Oct 30 03:15:31.821680 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.821635    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8"} err="failed to get container status \"7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8\": rpc error: code = NotFound desc = could not find container \"7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8\": container with ID starting with 7766d5d38ec480d5fd3b79952c634edd54d6c0f6ffd9eebee989882843e568b8 not found: ID does not exist"
Oct 30 03:15:31.864576 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.864543    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"]
Oct 30 03:15:31.877376 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:31.877345    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dc554f6bb-7rl9w"]
Oct 30 03:15:32.274684 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:32.274650    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f12a4de5-8620-4d97-9669-be777edd1f9b" path="/var/lib/kubelet/pods/f12a4de5-8620-4d97-9669-be777edd1f9b/volumes"
Oct 30 03:15:38.387956 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.387921    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"]
Oct 30 03:15:38.388370 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.388278    5981 cpu_manager.go:414] "containerMap: removing container" podUID="f12a4de5-8620-4d97-9669-be777edd1f9b" containerName="ta-container"
Oct 30 03:15:38.388370 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.388304    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f12a4de5-8620-4d97-9669-be777edd1f9b" containerName="ta-container"
Oct 30 03:15:38.388370 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.388369    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="f12a4de5-8620-4d97-9669-be777edd1f9b" containerName="ta-container"
Oct 30 03:15:38.391372 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.391356    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:38.422681 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.422644    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"]
Oct 30 03:15:38.462271 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.462236    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/331919ab-cea3-40a6-ad12-05b4c52138b1-ta-internal\") pod \"data-science-collector-targetallocator-55f8d78f68-bw6mz\" (UID: \"331919ab-cea3-40a6-ad12-05b4c52138b1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:38.462444 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.462373    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/331919ab-cea3-40a6-ad12-05b4c52138b1-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-55f8d78f68-bw6mz\" (UID: \"331919ab-cea3-40a6-ad12-05b4c52138b1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:38.462444 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.462404    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp4jx\" (UniqueName: \"kubernetes.io/projected/331919ab-cea3-40a6-ad12-05b4c52138b1-kube-api-access-zp4jx\") pod \"data-science-collector-targetallocator-55f8d78f68-bw6mz\" (UID: \"331919ab-cea3-40a6-ad12-05b4c52138b1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:38.563699 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.563664    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/331919ab-cea3-40a6-ad12-05b4c52138b1-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-55f8d78f68-bw6mz\" (UID: \"331919ab-cea3-40a6-ad12-05b4c52138b1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:38.563699 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.563699    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp4jx\" (UniqueName: \"kubernetes.io/projected/331919ab-cea3-40a6-ad12-05b4c52138b1-kube-api-access-zp4jx\") pod \"data-science-collector-targetallocator-55f8d78f68-bw6mz\" (UID: \"331919ab-cea3-40a6-ad12-05b4c52138b1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:38.563958 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.563904    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/331919ab-cea3-40a6-ad12-05b4c52138b1-ta-internal\") pod \"data-science-collector-targetallocator-55f8d78f68-bw6mz\" (UID: \"331919ab-cea3-40a6-ad12-05b4c52138b1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:38.564512 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.564492    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/331919ab-cea3-40a6-ad12-05b4c52138b1-ta-internal\") pod \"data-science-collector-targetallocator-55f8d78f68-bw6mz\" (UID: \"331919ab-cea3-40a6-ad12-05b4c52138b1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:38.566385 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.566365    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/331919ab-cea3-40a6-ad12-05b4c52138b1-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-55f8d78f68-bw6mz\" (UID: \"331919ab-cea3-40a6-ad12-05b4c52138b1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:38.584149 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.584124    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp4jx\" (UniqueName: \"kubernetes.io/projected/331919ab-cea3-40a6-ad12-05b4c52138b1-kube-api-access-zp4jx\") pod \"data-science-collector-targetallocator-55f8d78f68-bw6mz\" (UID: \"331919ab-cea3-40a6-ad12-05b4c52138b1\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:38.703102 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.703062    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:38.992958 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.992928    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"]
Oct 30 03:15:38.995429 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:15:38.995401    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod331919ab_cea3_40a6_ad12_05b4c52138b1.slice/crio-22d0b8c12c59232b422ddb819a174a615c352d6f08ac7818dbc84372c567acce WatchSource:0}: Error finding container 22d0b8c12c59232b422ddb819a174a615c352d6f08ac7818dbc84372c567acce: Status 404 returned error can't find the container with id 22d0b8c12c59232b422ddb819a174a615c352d6f08ac7818dbc84372c567acce
Oct 30 03:15:38.997582 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.997548    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:15:38.997665 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:38.997621    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:15:39.855774 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:39.855738    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz" event={"ID":"331919ab-cea3-40a6-ad12-05b4c52138b1","Type":"ContainerStarted","Data":"e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466"}
Oct 30 03:15:39.855774 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:39.855783    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz" event={"ID":"331919ab-cea3-40a6-ad12-05b4c52138b1","Type":"ContainerStarted","Data":"22d0b8c12c59232b422ddb819a174a615c352d6f08ac7818dbc84372c567acce"}
Oct 30 03:15:39.856212 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:39.855914    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:39.857639 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:39.857618    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:39.897514 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:39.897468    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz" podStartSLOduration=1.8974572520000001 podStartE2EDuration="1.897457252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:15:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:15:39.896781286 +0000 UTC m=+1979.739027733" watchObservedRunningTime="2026-10-30 03:15:39.897457252 +0000 UTC m=+1979.739703694"
Oct 30 03:15:39.961961 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:39.961930    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"]
Oct 30 03:15:39.962158 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:39.962137    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf" podUID="0d9ddd56-95ec-4dca-bada-c812e4b43148" containerName="ta-container" containerID="cri-o://182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff" gracePeriod=30
Oct 30 03:15:40.202761 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.202737    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:40.279457 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.279423    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0d9ddd56-95ec-4dca-bada-c812e4b43148-ta-internal\" (UniqueName: \"kubernetes.io/configmap/0d9ddd56-95ec-4dca-bada-c812e4b43148-ta-internal\") pod \"0d9ddd56-95ec-4dca-bada-c812e4b43148\" (UID: \"0d9ddd56-95ec-4dca-bada-c812e4b43148\") "
Oct 30 03:15:40.279618 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.279493    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0d9ddd56-95ec-4dca-bada-c812e4b43148-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0d9ddd56-95ec-4dca-bada-c812e4b43148-data-science-collector-ta-server-cert\") pod \"0d9ddd56-95ec-4dca-bada-c812e4b43148\" (UID: \"0d9ddd56-95ec-4dca-bada-c812e4b43148\") "
Oct 30 03:15:40.279618 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.279568    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d9ddd56-95ec-4dca-bada-c812e4b43148-kube-api-access-qg8qz\" (UniqueName: \"kubernetes.io/projected/0d9ddd56-95ec-4dca-bada-c812e4b43148-kube-api-access-qg8qz\") pod \"0d9ddd56-95ec-4dca-bada-c812e4b43148\" (UID: \"0d9ddd56-95ec-4dca-bada-c812e4b43148\") "
Oct 30 03:15:40.279812 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.279787    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9ddd56-95ec-4dca-bada-c812e4b43148-ta-internal" pod "0d9ddd56-95ec-4dca-bada-c812e4b43148" (UID: "0d9ddd56-95ec-4dca-bada-c812e4b43148"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:15:40.281559 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.281537    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d9ddd56-95ec-4dca-bada-c812e4b43148-data-science-collector-ta-server-cert" pod "0d9ddd56-95ec-4dca-bada-c812e4b43148" (UID: "0d9ddd56-95ec-4dca-bada-c812e4b43148"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:15:40.281757 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.281737    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d9ddd56-95ec-4dca-bada-c812e4b43148-kube-api-access-qg8qz" pod "0d9ddd56-95ec-4dca-bada-c812e4b43148" (UID: "0d9ddd56-95ec-4dca-bada-c812e4b43148"). InnerVolumeSpecName "kube-api-access-qg8qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:15:40.380597 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.380522    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0d9ddd56-95ec-4dca-bada-c812e4b43148-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:40.380597 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.380548    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0d9ddd56-95ec-4dca-bada-c812e4b43148-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:40.380597 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.380558    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg8qz\" (UniqueName: \"kubernetes.io/projected/0d9ddd56-95ec-4dca-bada-c812e4b43148-kube-api-access-qg8qz\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:40.862133 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.862101    5981 generic.go:356] "Generic (PLEG): container finished" podID="0d9ddd56-95ec-4dca-bada-c812e4b43148" containerID="182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff" exitCode=0
Oct 30 03:15:40.862592 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.862141    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"
Oct 30 03:15:40.862592 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.862190    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf" event={"ID":"0d9ddd56-95ec-4dca-bada-c812e4b43148","Type":"ContainerDied","Data":"182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff"}
Oct 30 03:15:40.862592 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.862230    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf" event={"ID":"0d9ddd56-95ec-4dca-bada-c812e4b43148","Type":"ContainerDied","Data":"c1e23a9e6ddd0f7a793a667903a532fb8e91459b8ebcf6842bce981d796e16af"}
Oct 30 03:15:40.862592 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.862251    5981 scope.go:122] "RemoveContainer" containerID="182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff"
Oct 30 03:15:40.871089 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.871074    5981 scope.go:122] "RemoveContainer" containerID="182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff"
Oct 30 03:15:40.871379 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:15:40.871358    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff\": container with ID starting with 182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff not found: ID does not exist" containerID="182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff"
Oct 30 03:15:40.871459 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.871387    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff"} err="failed to get container status \"182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff\": rpc error: code = NotFound desc = could not find container \"182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff\": container with ID starting with 182041756cd270422a35e272a20f396cd1e03c61021be52302c706df231276ff not found: ID does not exist"
Oct 30 03:15:40.914414 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.914388    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"]
Oct 30 03:15:40.927137 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:40.927113    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cc847757c-4qmbf"]
Oct 30 03:15:42.275935 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:42.275896    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d9ddd56-95ec-4dca-bada-c812e4b43148" path="/var/lib/kubelet/pods/0d9ddd56-95ec-4dca-bada-c812e4b43148/volumes"
Oct 30 03:15:44.369669 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:15:44.369634    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:15:46.728218 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.728163    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"]
Oct 30 03:15:46.728750 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.728727    5981 cpu_manager.go:414] "containerMap: removing container" podUID="0d9ddd56-95ec-4dca-bada-c812e4b43148" containerName="ta-container"
Oct 30 03:15:46.728816 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.728754    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d9ddd56-95ec-4dca-bada-c812e4b43148" containerName="ta-container"
Oct 30 03:15:46.728865 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.728851    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d9ddd56-95ec-4dca-bada-c812e4b43148" containerName="ta-container"
Oct 30 03:15:46.732782 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.732759    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:46.763348 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.763311    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"]
Oct 30 03:15:46.835318 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.835266    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a9d666a-8017-4895-b253-99a522e6703b-ta-internal\") pod \"data-science-collector-targetallocator-7bd988f764-tk8zk\" (UID: \"8a9d666a-8017-4895-b253-99a522e6703b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:46.835318 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.835329    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74m55\" (UniqueName: \"kubernetes.io/projected/8a9d666a-8017-4895-b253-99a522e6703b-kube-api-access-74m55\") pod \"data-science-collector-targetallocator-7bd988f764-tk8zk\" (UID: \"8a9d666a-8017-4895-b253-99a522e6703b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:46.835524 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.835418    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a9d666a-8017-4895-b253-99a522e6703b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7bd988f764-tk8zk\" (UID: \"8a9d666a-8017-4895-b253-99a522e6703b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:46.936449 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.936412    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a9d666a-8017-4895-b253-99a522e6703b-ta-internal\") pod \"data-science-collector-targetallocator-7bd988f764-tk8zk\" (UID: \"8a9d666a-8017-4895-b253-99a522e6703b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:46.936616 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.936455    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74m55\" (UniqueName: \"kubernetes.io/projected/8a9d666a-8017-4895-b253-99a522e6703b-kube-api-access-74m55\") pod \"data-science-collector-targetallocator-7bd988f764-tk8zk\" (UID: \"8a9d666a-8017-4895-b253-99a522e6703b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:46.936616 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.936485    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a9d666a-8017-4895-b253-99a522e6703b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7bd988f764-tk8zk\" (UID: \"8a9d666a-8017-4895-b253-99a522e6703b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:46.937177 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.937150    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a9d666a-8017-4895-b253-99a522e6703b-ta-internal\") pod \"data-science-collector-targetallocator-7bd988f764-tk8zk\" (UID: \"8a9d666a-8017-4895-b253-99a522e6703b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:46.939227 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.939198    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a9d666a-8017-4895-b253-99a522e6703b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7bd988f764-tk8zk\" (UID: \"8a9d666a-8017-4895-b253-99a522e6703b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:46.957307 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:46.957272    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74m55\" (UniqueName: \"kubernetes.io/projected/8a9d666a-8017-4895-b253-99a522e6703b-kube-api-access-74m55\") pod \"data-science-collector-targetallocator-7bd988f764-tk8zk\" (UID: \"8a9d666a-8017-4895-b253-99a522e6703b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:47.044438 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:47.044371    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:47.336468 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:47.336442    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"]
Oct 30 03:15:47.338556 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:15:47.338528    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a9d666a_8017_4895_b253_99a522e6703b.slice/crio-db2e4916ba6760ea5de79e581037ffc57cd0a9b6db7c5c39370520023a3d3a4f WatchSource:0}: Error finding container db2e4916ba6760ea5de79e581037ffc57cd0a9b6db7c5c39370520023a3d3a4f: Status 404 returned error can't find the container with id db2e4916ba6760ea5de79e581037ffc57cd0a9b6db7c5c39370520023a3d3a4f
Oct 30 03:15:47.340904 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:47.340868    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:15:47.341009 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:47.340939    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:15:47.900661 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:47.900625    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk" event={"ID":"8a9d666a-8017-4895-b253-99a522e6703b","Type":"ContainerStarted","Data":"06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b"}
Oct 30 03:15:47.900661 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:47.900668    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk" event={"ID":"8a9d666a-8017-4895-b253-99a522e6703b","Type":"ContainerStarted","Data":"db2e4916ba6760ea5de79e581037ffc57cd0a9b6db7c5c39370520023a3d3a4f"}
Oct 30 03:15:47.901162 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:47.900818    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:47.902668 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:47.902647    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:47.941364 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:47.941311    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk" podStartSLOduration=1.9412699089999998 podStartE2EDuration="1.941269909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:15:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:15:47.940680069 +0000 UTC m=+1987.782926539" watchObservedRunningTime="2026-10-30 03:15:47.941269909 +0000 UTC m=+1987.783516355"
Oct 30 03:15:48.006222 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.006191    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"]
Oct 30 03:15:48.006406 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.006381    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz" podUID="331919ab-cea3-40a6-ad12-05b4c52138b1" containerName="ta-container" containerID="cri-o://e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466" gracePeriod=30
Oct 30 03:15:48.248268 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.248239    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:48.348737 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.348702    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/331919ab-cea3-40a6-ad12-05b4c52138b1-kube-api-access-zp4jx\" (UniqueName: \"kubernetes.io/projected/331919ab-cea3-40a6-ad12-05b4c52138b1-kube-api-access-zp4jx\") pod \"331919ab-cea3-40a6-ad12-05b4c52138b1\" (UID: \"331919ab-cea3-40a6-ad12-05b4c52138b1\") "
Oct 30 03:15:48.348917 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.348768    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/331919ab-cea3-40a6-ad12-05b4c52138b1-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/331919ab-cea3-40a6-ad12-05b4c52138b1-data-science-collector-ta-server-cert\") pod \"331919ab-cea3-40a6-ad12-05b4c52138b1\" (UID: \"331919ab-cea3-40a6-ad12-05b4c52138b1\") "
Oct 30 03:15:48.348917 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.348832    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/331919ab-cea3-40a6-ad12-05b4c52138b1-ta-internal\" (UniqueName: \"kubernetes.io/configmap/331919ab-cea3-40a6-ad12-05b4c52138b1-ta-internal\") pod \"331919ab-cea3-40a6-ad12-05b4c52138b1\" (UID: \"331919ab-cea3-40a6-ad12-05b4c52138b1\") "
Oct 30 03:15:48.349205 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.349182    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331919ab-cea3-40a6-ad12-05b4c52138b1-ta-internal" pod "331919ab-cea3-40a6-ad12-05b4c52138b1" (UID: "331919ab-cea3-40a6-ad12-05b4c52138b1"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:15:48.351076 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.351051    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/331919ab-cea3-40a6-ad12-05b4c52138b1-kube-api-access-zp4jx" pod "331919ab-cea3-40a6-ad12-05b4c52138b1" (UID: "331919ab-cea3-40a6-ad12-05b4c52138b1"). InnerVolumeSpecName "kube-api-access-zp4jx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:15:48.351151 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.351076    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331919ab-cea3-40a6-ad12-05b4c52138b1-data-science-collector-ta-server-cert" pod "331919ab-cea3-40a6-ad12-05b4c52138b1" (UID: "331919ab-cea3-40a6-ad12-05b4c52138b1"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:15:48.449709 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.449632    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/331919ab-cea3-40a6-ad12-05b4c52138b1-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:48.449709 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.449665    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/331919ab-cea3-40a6-ad12-05b4c52138b1-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:48.449709 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.449675    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp4jx\" (UniqueName: \"kubernetes.io/projected/331919ab-cea3-40a6-ad12-05b4c52138b1-kube-api-access-zp4jx\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:48.906249 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.906211    5981 generic.go:356] "Generic (PLEG): container finished" podID="331919ab-cea3-40a6-ad12-05b4c52138b1" containerID="e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466" exitCode=0
Oct 30 03:15:48.906674 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.906260    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"
Oct 30 03:15:48.906674 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.906310    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz" event={"ID":"331919ab-cea3-40a6-ad12-05b4c52138b1","Type":"ContainerDied","Data":"e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466"}
Oct 30 03:15:48.906674 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.906371    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz" event={"ID":"331919ab-cea3-40a6-ad12-05b4c52138b1","Type":"ContainerDied","Data":"22d0b8c12c59232b422ddb819a174a615c352d6f08ac7818dbc84372c567acce"}
Oct 30 03:15:48.906674 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.906399    5981 scope.go:122] "RemoveContainer" containerID="e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466"
Oct 30 03:15:48.918672 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.918650    5981 scope.go:122] "RemoveContainer" containerID="e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466"
Oct 30 03:15:48.918976 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:15:48.918948    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466\": container with ID starting with e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466 not found: ID does not exist" containerID="e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466"
Oct 30 03:15:48.919051 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.918984    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466"} err="failed to get container status \"e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466\": rpc error: code = NotFound desc = could not find container \"e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466\": container with ID starting with e769cec2b4b0cb379629c7ee32762a81e437d25d41e4800b45ec09e946679466 not found: ID does not exist"
Oct 30 03:15:48.961478 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.961453    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"]
Oct 30 03:15:48.974215 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:48.974190    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55f8d78f68-bw6mz"]
Oct 30 03:15:50.274317 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:50.274263    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="331919ab-cea3-40a6-ad12-05b4c52138b1" path="/var/lib/kubelet/pods/331919ab-cea3-40a6-ad12-05b4c52138b1/volumes"
Oct 30 03:15:55.040742 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.040706    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"]
Oct 30 03:15:55.041241 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.041220    5981 cpu_manager.go:414] "containerMap: removing container" podUID="331919ab-cea3-40a6-ad12-05b4c52138b1" containerName="ta-container"
Oct 30 03:15:55.041347 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.041244    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="331919ab-cea3-40a6-ad12-05b4c52138b1" containerName="ta-container"
Oct 30 03:15:55.041403 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.041387    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="331919ab-cea3-40a6-ad12-05b4c52138b1" containerName="ta-container"
Oct 30 03:15:55.045459 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.045436    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:55.079118 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.079091    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"]
Oct 30 03:15:55.108263 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.108232    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b4232a8f-074c-4d64-9c86-de8e0bb21f66-ta-internal\") pod \"data-science-collector-targetallocator-bc59544cc-4z65z\" (UID: \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:55.108417 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.108272    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b4232a8f-074c-4d64-9c86-de8e0bb21f66-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-bc59544cc-4z65z\" (UID: \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:55.108417 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.108375    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjzxh\" (UniqueName: \"kubernetes.io/projected/b4232a8f-074c-4d64-9c86-de8e0bb21f66-kube-api-access-zjzxh\") pod \"data-science-collector-targetallocator-bc59544cc-4z65z\" (UID: \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:55.209507 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.209476    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b4232a8f-074c-4d64-9c86-de8e0bb21f66-ta-internal\") pod \"data-science-collector-targetallocator-bc59544cc-4z65z\" (UID: \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:55.209507 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.209515    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b4232a8f-074c-4d64-9c86-de8e0bb21f66-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-bc59544cc-4z65z\" (UID: \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:55.209712 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.209537    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjzxh\" (UniqueName: \"kubernetes.io/projected/b4232a8f-074c-4d64-9c86-de8e0bb21f66-kube-api-access-zjzxh\") pod \"data-science-collector-targetallocator-bc59544cc-4z65z\" (UID: \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:55.210373 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.210347    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b4232a8f-074c-4d64-9c86-de8e0bb21f66-ta-internal\") pod \"data-science-collector-targetallocator-bc59544cc-4z65z\" (UID: \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:55.212295 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.212261    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b4232a8f-074c-4d64-9c86-de8e0bb21f66-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-bc59544cc-4z65z\" (UID: \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:55.230231 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.230204    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjzxh\" (UniqueName: \"kubernetes.io/projected/b4232a8f-074c-4d64-9c86-de8e0bb21f66-kube-api-access-zjzxh\") pod \"data-science-collector-targetallocator-bc59544cc-4z65z\" (UID: \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:55.357536 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.357446    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:55.650043 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.650015    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"]
Oct 30 03:15:55.651572 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:15:55.651544    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4232a8f_074c_4d64_9c86_de8e0bb21f66.slice/crio-39a00de435a942ee165deff22545fba45525a5341af4b08105983678b98e4b44 WatchSource:0}: Error finding container 39a00de435a942ee165deff22545fba45525a5341af4b08105983678b98e4b44: Status 404 returned error can't find the container with id 39a00de435a942ee165deff22545fba45525a5341af4b08105983678b98e4b44
Oct 30 03:15:55.653694 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.653660    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:15:55.653766 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.653717    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:15:55.943769 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.943680    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z" event={"ID":"b4232a8f-074c-4d64-9c86-de8e0bb21f66","Type":"ContainerStarted","Data":"20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5"}
Oct 30 03:15:55.943769 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.943725    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z" event={"ID":"b4232a8f-074c-4d64-9c86-de8e0bb21f66","Type":"ContainerStarted","Data":"39a00de435a942ee165deff22545fba45525a5341af4b08105983678b98e4b44"}
Oct 30 03:15:55.944001 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.943826    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:55.944929 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.944903    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z" podUID="b4232a8f-074c-4d64-9c86-de8e0bb21f66" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.35:8080/readyz\": dial tcp 10.134.0.35:8080: connect: connection refused"
Oct 30 03:15:55.991003 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:55.990958    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z" podStartSLOduration=0.990935487 podStartE2EDuration="990.935487ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:15:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:15:55.990383094 +0000 UTC m=+1995.832629553" watchObservedRunningTime="2026-10-30 03:15:55.990935487 +0000 UTC m=+1995.833181934"
Oct 30 03:15:56.949816 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:56.949774    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:15:57.018180 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.018147    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"]
Oct 30 03:15:57.018374 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.018341    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk" podUID="8a9d666a-8017-4895-b253-99a522e6703b" containerName="ta-container" containerID="cri-o://06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b" gracePeriod=30
Oct 30 03:15:57.256830 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.256805    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:57.328846 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.328818    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a9d666a-8017-4895-b253-99a522e6703b-kube-api-access-74m55\" (UniqueName: \"kubernetes.io/projected/8a9d666a-8017-4895-b253-99a522e6703b-kube-api-access-74m55\") pod \"8a9d666a-8017-4895-b253-99a522e6703b\" (UID: \"8a9d666a-8017-4895-b253-99a522e6703b\") "
Oct 30 03:15:57.329002 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.328925    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8a9d666a-8017-4895-b253-99a522e6703b-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a9d666a-8017-4895-b253-99a522e6703b-data-science-collector-ta-server-cert\") pod \"8a9d666a-8017-4895-b253-99a522e6703b\" (UID: \"8a9d666a-8017-4895-b253-99a522e6703b\") "
Oct 30 03:15:57.329002 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.328961    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a9d666a-8017-4895-b253-99a522e6703b-ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a9d666a-8017-4895-b253-99a522e6703b-ta-internal\") pod \"8a9d666a-8017-4895-b253-99a522e6703b\" (UID: \"8a9d666a-8017-4895-b253-99a522e6703b\") "
Oct 30 03:15:57.329393 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.329368    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9d666a-8017-4895-b253-99a522e6703b-ta-internal" pod "8a9d666a-8017-4895-b253-99a522e6703b" (UID: "8a9d666a-8017-4895-b253-99a522e6703b"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:15:57.330989 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.330958    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9d666a-8017-4895-b253-99a522e6703b-kube-api-access-74m55" pod "8a9d666a-8017-4895-b253-99a522e6703b" (UID: "8a9d666a-8017-4895-b253-99a522e6703b"). InnerVolumeSpecName "kube-api-access-74m55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:15:57.331108 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.331095    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a9d666a-8017-4895-b253-99a522e6703b-data-science-collector-ta-server-cert" pod "8a9d666a-8017-4895-b253-99a522e6703b" (UID: "8a9d666a-8017-4895-b253-99a522e6703b"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:15:57.430046 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.430003    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a9d666a-8017-4895-b253-99a522e6703b-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:57.430046 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.430041    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a9d666a-8017-4895-b253-99a522e6703b-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:57.430046 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.430053    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74m55\" (UniqueName: \"kubernetes.io/projected/8a9d666a-8017-4895-b253-99a522e6703b-kube-api-access-74m55\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:15:57.953130 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.953092    5981 generic.go:356] "Generic (PLEG): container finished" podID="8a9d666a-8017-4895-b253-99a522e6703b" containerID="06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b" exitCode=0
Oct 30 03:15:57.953606 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.953136    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"
Oct 30 03:15:57.953606 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.953179    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk" event={"ID":"8a9d666a-8017-4895-b253-99a522e6703b","Type":"ContainerDied","Data":"06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b"}
Oct 30 03:15:57.953606 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.953216    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk" event={"ID":"8a9d666a-8017-4895-b253-99a522e6703b","Type":"ContainerDied","Data":"db2e4916ba6760ea5de79e581037ffc57cd0a9b6db7c5c39370520023a3d3a4f"}
Oct 30 03:15:57.953606 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.953238    5981 scope.go:122] "RemoveContainer" containerID="06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b"
Oct 30 03:15:57.962376 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.962358    5981 scope.go:122] "RemoveContainer" containerID="06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b"
Oct 30 03:15:57.962629 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:15:57.962611    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b\": container with ID starting with 06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b not found: ID does not exist" containerID="06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b"
Oct 30 03:15:57.962677 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:57.962640    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b"} err="failed to get container status \"06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b\": rpc error: code = NotFound desc = could not find container \"06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b\": container with ID starting with 06adde1f1955d7b930c27fb7528d055423bff7c1ed8b6126d00d72a35096e31b not found: ID does not exist"
Oct 30 03:15:58.004139 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:58.004115    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"]
Oct 30 03:15:58.017155 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:58.017131    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7bd988f764-tk8zk"]
Oct 30 03:15:58.275142 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:15:58.275052    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a9d666a-8017-4895-b253-99a522e6703b" path="/var/lib/kubelet/pods/8a9d666a-8017-4895-b253-99a522e6703b/volumes"
Oct 30 03:16:03.669052 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.669019    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"]
Oct 30 03:16:03.669590 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.669382    5981 cpu_manager.go:414] "containerMap: removing container" podUID="8a9d666a-8017-4895-b253-99a522e6703b" containerName="ta-container"
Oct 30 03:16:03.669590 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.669399    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a9d666a-8017-4895-b253-99a522e6703b" containerName="ta-container"
Oct 30 03:16:03.669590 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.669475    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a9d666a-8017-4895-b253-99a522e6703b" containerName="ta-container"
Oct 30 03:16:03.672323 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.672303    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:03.692241 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.692216    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"]
Oct 30 03:16:03.789899 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.789862    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/30fab99c-f0ea-4441-9d51-4b647aa4fdda-ta-internal\") pod \"data-science-collector-targetallocator-6f6b7ddd5d-2rkzh\" (UID: \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:03.790056 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.789910    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/30fab99c-f0ea-4441-9d51-4b647aa4fdda-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6f6b7ddd5d-2rkzh\" (UID: \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:03.790056 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.790031    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z87gn\" (UniqueName: \"kubernetes.io/projected/30fab99c-f0ea-4441-9d51-4b647aa4fdda-kube-api-access-z87gn\") pod \"data-science-collector-targetallocator-6f6b7ddd5d-2rkzh\" (UID: \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:03.890848 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.890800    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/30fab99c-f0ea-4441-9d51-4b647aa4fdda-ta-internal\") pod \"data-science-collector-targetallocator-6f6b7ddd5d-2rkzh\" (UID: \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:03.890848 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.890864    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/30fab99c-f0ea-4441-9d51-4b647aa4fdda-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6f6b7ddd5d-2rkzh\" (UID: \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:03.891080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.891020    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z87gn\" (UniqueName: \"kubernetes.io/projected/30fab99c-f0ea-4441-9d51-4b647aa4fdda-kube-api-access-z87gn\") pod \"data-science-collector-targetallocator-6f6b7ddd5d-2rkzh\" (UID: \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:03.891590 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.891569    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/30fab99c-f0ea-4441-9d51-4b647aa4fdda-ta-internal\") pod \"data-science-collector-targetallocator-6f6b7ddd5d-2rkzh\" (UID: \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:03.893592 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.893563    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/30fab99c-f0ea-4441-9d51-4b647aa4fdda-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6f6b7ddd5d-2rkzh\" (UID: \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:03.912345 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.912322    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z87gn\" (UniqueName: \"kubernetes.io/projected/30fab99c-f0ea-4441-9d51-4b647aa4fdda-kube-api-access-z87gn\") pod \"data-science-collector-targetallocator-6f6b7ddd5d-2rkzh\" (UID: \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:03.983378 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:03.983316    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:04.277110 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:04.277084    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"]
Oct 30 03:16:04.279120 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:16:04.279089    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30fab99c_f0ea_4441_9d51_4b647aa4fdda.slice/crio-9d079b2174fc2b32bf4ca5191918f3af1460bc26a00b98a20ce86b1bb4fb7bd2 WatchSource:0}: Error finding container 9d079b2174fc2b32bf4ca5191918f3af1460bc26a00b98a20ce86b1bb4fb7bd2: Status 404 returned error can't find the container with id 9d079b2174fc2b32bf4ca5191918f3af1460bc26a00b98a20ce86b1bb4fb7bd2
Oct 30 03:16:04.281251 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:04.281221    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:16:04.281366 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:04.281279    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:16:04.986829 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:04.986796    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh" event={"ID":"30fab99c-f0ea-4441-9d51-4b647aa4fdda","Type":"ContainerStarted","Data":"e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6"}
Oct 30 03:16:04.986829 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:04.986835    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh" event={"ID":"30fab99c-f0ea-4441-9d51-4b647aa4fdda","Type":"ContainerStarted","Data":"9d079b2174fc2b32bf4ca5191918f3af1460bc26a00b98a20ce86b1bb4fb7bd2"}
Oct 30 03:16:04.987272 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:04.986979    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:04.988955 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:04.988929    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:05.072640 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.072580    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh" podStartSLOduration=2.072566026 podStartE2EDuration="2.072566026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:16:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:16:05.030381224 +0000 UTC m=+2004.872627669" watchObservedRunningTime="2026-10-30 03:16:05.072566026 +0000 UTC m=+2004.914812462"
Oct 30 03:16:05.099450 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.099417    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"]
Oct 30 03:16:05.099601 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.099582    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z" podUID="b4232a8f-074c-4d64-9c86-de8e0bb21f66" containerName="ta-container" containerID="cri-o://20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5" gracePeriod=30
Oct 30 03:16:05.339165 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.339141    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:16:05.506532 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.506500    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b4232a8f-074c-4d64-9c86-de8e0bb21f66-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b4232a8f-074c-4d64-9c86-de8e0bb21f66-data-science-collector-ta-server-cert\") pod \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\" (UID: \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\") "
Oct 30 03:16:05.506698 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.506615    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b4232a8f-074c-4d64-9c86-de8e0bb21f66-ta-internal\" (UniqueName: \"kubernetes.io/configmap/b4232a8f-074c-4d64-9c86-de8e0bb21f66-ta-internal\") pod \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\" (UID: \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\") "
Oct 30 03:16:05.506698 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.506665    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4232a8f-074c-4d64-9c86-de8e0bb21f66-kube-api-access-zjzxh\" (UniqueName: \"kubernetes.io/projected/b4232a8f-074c-4d64-9c86-de8e0bb21f66-kube-api-access-zjzxh\") pod \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\" (UID: \"b4232a8f-074c-4d64-9c86-de8e0bb21f66\") "
Oct 30 03:16:05.506972 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.506934    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4232a8f-074c-4d64-9c86-de8e0bb21f66-ta-internal" pod "b4232a8f-074c-4d64-9c86-de8e0bb21f66" (UID: "b4232a8f-074c-4d64-9c86-de8e0bb21f66"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:16:05.508779 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.508757    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4232a8f-074c-4d64-9c86-de8e0bb21f66-data-science-collector-ta-server-cert" pod "b4232a8f-074c-4d64-9c86-de8e0bb21f66" (UID: "b4232a8f-074c-4d64-9c86-de8e0bb21f66"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:16:05.508870 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.508840    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4232a8f-074c-4d64-9c86-de8e0bb21f66-kube-api-access-zjzxh" pod "b4232a8f-074c-4d64-9c86-de8e0bb21f66" (UID: "b4232a8f-074c-4d64-9c86-de8e0bb21f66"). InnerVolumeSpecName "kube-api-access-zjzxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:16:05.607521 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.607490    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b4232a8f-074c-4d64-9c86-de8e0bb21f66-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:05.607666 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.607525    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjzxh\" (UniqueName: \"kubernetes.io/projected/b4232a8f-074c-4d64-9c86-de8e0bb21f66-kube-api-access-zjzxh\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:05.607666 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.607544    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b4232a8f-074c-4d64-9c86-de8e0bb21f66-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:05.991924 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.991886    5981 generic.go:356] "Generic (PLEG): container finished" podID="b4232a8f-074c-4d64-9c86-de8e0bb21f66" containerID="20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5" exitCode=0
Oct 30 03:16:05.992420 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.991928    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"
Oct 30 03:16:05.992420 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.991974    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z" event={"ID":"b4232a8f-074c-4d64-9c86-de8e0bb21f66","Type":"ContainerDied","Data":"20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5"}
Oct 30 03:16:05.992420 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.992005    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z" event={"ID":"b4232a8f-074c-4d64-9c86-de8e0bb21f66","Type":"ContainerDied","Data":"39a00de435a942ee165deff22545fba45525a5341af4b08105983678b98e4b44"}
Oct 30 03:16:05.992420 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:05.992024    5981 scope.go:122] "RemoveContainer" containerID="20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5"
Oct 30 03:16:06.000853 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:06.000837    5981 scope.go:122] "RemoveContainer" containerID="20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5"
Oct 30 03:16:06.001107 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:16:06.001090    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5\": container with ID starting with 20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5 not found: ID does not exist" containerID="20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5"
Oct 30 03:16:06.001152 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:06.001117    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5"} err="failed to get container status \"20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5\": rpc error: code = NotFound desc = could not find container \"20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5\": container with ID starting with 20f1499743e60c1340daf8249a725c962b8cea3daa706811062050f1880ed7b5 not found: ID does not exist"
Oct 30 03:16:06.042315 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:06.042276    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"]
Oct 30 03:16:06.055226 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:06.055205    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-bc59544cc-4z65z"]
Oct 30 03:16:06.275159 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:06.275075    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b4232a8f-074c-4d64-9c86-de8e0bb21f66" path="/var/lib/kubelet/pods/b4232a8f-074c-4d64-9c86-de8e0bb21f66/volumes"
Oct 30 03:16:13.121589 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.121552    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"]
Oct 30 03:16:13.121967 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.121867    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b4232a8f-074c-4d64-9c86-de8e0bb21f66" containerName="ta-container"
Oct 30 03:16:13.121967 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.121877    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4232a8f-074c-4d64-9c86-de8e0bb21f66" containerName="ta-container"
Oct 30 03:16:13.121967 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.121958    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4232a8f-074c-4d64-9c86-de8e0bb21f66" containerName="ta-container"
Oct 30 03:16:13.126221 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.126199    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:13.155770 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.155743    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"]
Oct 30 03:16:13.175455 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.175418    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b47aba03-a343-47f3-ab12-25aa7ac25189-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-c4994b75f-fmh7k\" (UID: \"b47aba03-a343-47f3-ab12-25aa7ac25189\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:13.175623 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.175460    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b47aba03-a343-47f3-ab12-25aa7ac25189-ta-internal\") pod \"data-science-collector-targetallocator-c4994b75f-fmh7k\" (UID: \"b47aba03-a343-47f3-ab12-25aa7ac25189\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:13.175623 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.175572    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcbm7\" (UniqueName: \"kubernetes.io/projected/b47aba03-a343-47f3-ab12-25aa7ac25189-kube-api-access-kcbm7\") pod \"data-science-collector-targetallocator-c4994b75f-fmh7k\" (UID: \"b47aba03-a343-47f3-ab12-25aa7ac25189\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:13.276337 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.276274    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcbm7\" (UniqueName: \"kubernetes.io/projected/b47aba03-a343-47f3-ab12-25aa7ac25189-kube-api-access-kcbm7\") pod \"data-science-collector-targetallocator-c4994b75f-fmh7k\" (UID: \"b47aba03-a343-47f3-ab12-25aa7ac25189\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:13.276512 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.276396    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b47aba03-a343-47f3-ab12-25aa7ac25189-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-c4994b75f-fmh7k\" (UID: \"b47aba03-a343-47f3-ab12-25aa7ac25189\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:13.276512 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.276418    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b47aba03-a343-47f3-ab12-25aa7ac25189-ta-internal\") pod \"data-science-collector-targetallocator-c4994b75f-fmh7k\" (UID: \"b47aba03-a343-47f3-ab12-25aa7ac25189\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:13.277018 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.276993    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b47aba03-a343-47f3-ab12-25aa7ac25189-ta-internal\") pod \"data-science-collector-targetallocator-c4994b75f-fmh7k\" (UID: \"b47aba03-a343-47f3-ab12-25aa7ac25189\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:13.278992 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.278967    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b47aba03-a343-47f3-ab12-25aa7ac25189-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-c4994b75f-fmh7k\" (UID: \"b47aba03-a343-47f3-ab12-25aa7ac25189\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:13.297131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.297106    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcbm7\" (UniqueName: \"kubernetes.io/projected/b47aba03-a343-47f3-ab12-25aa7ac25189-kube-api-access-kcbm7\") pod \"data-science-collector-targetallocator-c4994b75f-fmh7k\" (UID: \"b47aba03-a343-47f3-ab12-25aa7ac25189\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:13.437978 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.437935    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:13.728971 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.728946    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"]
Oct 30 03:16:13.730871 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:16:13.730838    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb47aba03_a343_47f3_ab12_25aa7ac25189.slice/crio-784e29d55e2b051dda205929356c274f7252d48d7a37ad7540c4aa07ad3429b7 WatchSource:0}: Error finding container 784e29d55e2b051dda205929356c274f7252d48d7a37ad7540c4aa07ad3429b7: Status 404 returned error can't find the container with id 784e29d55e2b051dda205929356c274f7252d48d7a37ad7540c4aa07ad3429b7
Oct 30 03:16:13.733000 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.732966    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:16:13.733095 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:13.733021    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:16:14.037864 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:14.037763    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k" event={"ID":"b47aba03-a343-47f3-ab12-25aa7ac25189","Type":"ContainerStarted","Data":"bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705"}
Oct 30 03:16:14.037864 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:14.037828    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:14.037864 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:14.037841    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k" event={"ID":"b47aba03-a343-47f3-ab12-25aa7ac25189","Type":"ContainerStarted","Data":"784e29d55e2b051dda205929356c274f7252d48d7a37ad7540c4aa07ad3429b7"}
Oct 30 03:16:14.038980 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:14.038946    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k" podUID="b47aba03-a343-47f3-ab12-25aa7ac25189" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.37:8080/readyz\": dial tcp 10.134.0.37:8080: connect: connection refused"
Oct 30 03:16:14.079107 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:14.079060    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k" podStartSLOduration=1.0790464339999999 podStartE2EDuration="1.079046434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:16:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:16:14.07795068 +0000 UTC m=+2013.920197124" watchObservedRunningTime="2026-10-30 03:16:14.079046434 +0000 UTC m=+2013.921292878"
Oct 30 03:16:14.369018 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:16:14.368943    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:16:15.043296 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.043249    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:15.111361 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.111330    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"]
Oct 30 03:16:15.111557 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.111511    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh" podUID="30fab99c-f0ea-4441-9d51-4b647aa4fdda" containerName="ta-container" containerID="cri-o://e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6" gracePeriod=30
Oct 30 03:16:15.353797 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.353771    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:15.392923 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.392897    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/30fab99c-f0ea-4441-9d51-4b647aa4fdda-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/30fab99c-f0ea-4441-9d51-4b647aa4fdda-data-science-collector-ta-server-cert\") pod \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\" (UID: \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\") "
Oct 30 03:16:15.393254 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.392941    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/30fab99c-f0ea-4441-9d51-4b647aa4fdda-ta-internal\" (UniqueName: \"kubernetes.io/configmap/30fab99c-f0ea-4441-9d51-4b647aa4fdda-ta-internal\") pod \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\" (UID: \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\") "
Oct 30 03:16:15.393254 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.392993    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30fab99c-f0ea-4441-9d51-4b647aa4fdda-kube-api-access-z87gn\" (UniqueName: \"kubernetes.io/projected/30fab99c-f0ea-4441-9d51-4b647aa4fdda-kube-api-access-z87gn\") pod \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\" (UID: \"30fab99c-f0ea-4441-9d51-4b647aa4fdda\") "
Oct 30 03:16:15.393426 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.393365    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30fab99c-f0ea-4441-9d51-4b647aa4fdda-ta-internal" pod "30fab99c-f0ea-4441-9d51-4b647aa4fdda" (UID: "30fab99c-f0ea-4441-9d51-4b647aa4fdda"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:16:15.395431 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.395360    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30fab99c-f0ea-4441-9d51-4b647aa4fdda-kube-api-access-z87gn" pod "30fab99c-f0ea-4441-9d51-4b647aa4fdda" (UID: "30fab99c-f0ea-4441-9d51-4b647aa4fdda"). InnerVolumeSpecName "kube-api-access-z87gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:16:15.397094 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.397066    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30fab99c-f0ea-4441-9d51-4b647aa4fdda-data-science-collector-ta-server-cert" pod "30fab99c-f0ea-4441-9d51-4b647aa4fdda" (UID: "30fab99c-f0ea-4441-9d51-4b647aa4fdda"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:16:15.494200 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.494162    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z87gn\" (UniqueName: \"kubernetes.io/projected/30fab99c-f0ea-4441-9d51-4b647aa4fdda-kube-api-access-z87gn\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:15.494200 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.494194    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/30fab99c-f0ea-4441-9d51-4b647aa4fdda-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:15.494200 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:15.494205    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/30fab99c-f0ea-4441-9d51-4b647aa4fdda-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:16.047751 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:16.047718    5981 generic.go:356] "Generic (PLEG): container finished" podID="30fab99c-f0ea-4441-9d51-4b647aa4fdda" containerID="e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6" exitCode=0
Oct 30 03:16:16.047935 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:16.047764    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"
Oct 30 03:16:16.047935 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:16.047807    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh" event={"ID":"30fab99c-f0ea-4441-9d51-4b647aa4fdda","Type":"ContainerDied","Data":"e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6"}
Oct 30 03:16:16.047935 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:16.047846    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh" event={"ID":"30fab99c-f0ea-4441-9d51-4b647aa4fdda","Type":"ContainerDied","Data":"9d079b2174fc2b32bf4ca5191918f3af1460bc26a00b98a20ce86b1bb4fb7bd2"}
Oct 30 03:16:16.047935 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:16.047863    5981 scope.go:122] "RemoveContainer" containerID="e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6"
Oct 30 03:16:16.056719 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:16.056704    5981 scope.go:122] "RemoveContainer" containerID="e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6"
Oct 30 03:16:16.056970 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:16:16.056953    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6\": container with ID starting with e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6 not found: ID does not exist" containerID="e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6"
Oct 30 03:16:16.057014 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:16.056978    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6"} err="failed to get container status \"e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6\": rpc error: code = NotFound desc = could not find container \"e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6\": container with ID starting with e580042b1f788a01053c62ec8f20b8883b0828cf1610f1f11bc3c15b0cfc7ce6 not found: ID does not exist"
Oct 30 03:16:16.099017 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:16.098994    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"]
Oct 30 03:16:16.111880 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:16.111860    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6f6b7ddd5d-2rkzh"]
Oct 30 03:16:16.274745 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:16.274709    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="30fab99c-f0ea-4441-9d51-4b647aa4fdda" path="/var/lib/kubelet/pods/30fab99c-f0ea-4441-9d51-4b647aa4fdda/volumes"
Oct 30 03:16:22.106467 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.106434    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"]
Oct 30 03:16:22.106852 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.106768    5981 cpu_manager.go:414] "containerMap: removing container" podUID="30fab99c-f0ea-4441-9d51-4b647aa4fdda" containerName="ta-container"
Oct 30 03:16:22.106852 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.106780    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30fab99c-f0ea-4441-9d51-4b647aa4fdda" containerName="ta-container"
Oct 30 03:16:22.106852 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.106846    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="30fab99c-f0ea-4441-9d51-4b647aa4fdda" containerName="ta-container"
Oct 30 03:16:22.111466 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.111447    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:22.127531 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.127503    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"]
Oct 30 03:16:22.153217 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.153187    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7b2760ba-be50-4d13-84a3-6df965762880-ta-internal\") pod \"data-science-collector-targetallocator-68cbc545d4-vdb7n\" (UID: \"7b2760ba-be50-4d13-84a3-6df965762880\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:22.153362 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.153226    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7b2760ba-be50-4d13-84a3-6df965762880-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-68cbc545d4-vdb7n\" (UID: \"7b2760ba-be50-4d13-84a3-6df965762880\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:22.153409 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.153356    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtxql\" (UniqueName: \"kubernetes.io/projected/7b2760ba-be50-4d13-84a3-6df965762880-kube-api-access-rtxql\") pod \"data-science-collector-targetallocator-68cbc545d4-vdb7n\" (UID: \"7b2760ba-be50-4d13-84a3-6df965762880\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:22.254619 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.254587    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7b2760ba-be50-4d13-84a3-6df965762880-ta-internal\") pod \"data-science-collector-targetallocator-68cbc545d4-vdb7n\" (UID: \"7b2760ba-be50-4d13-84a3-6df965762880\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:22.254619 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.254620    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7b2760ba-be50-4d13-84a3-6df965762880-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-68cbc545d4-vdb7n\" (UID: \"7b2760ba-be50-4d13-84a3-6df965762880\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:22.254788 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.254670    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtxql\" (UniqueName: \"kubernetes.io/projected/7b2760ba-be50-4d13-84a3-6df965762880-kube-api-access-rtxql\") pod \"data-science-collector-targetallocator-68cbc545d4-vdb7n\" (UID: \"7b2760ba-be50-4d13-84a3-6df965762880\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:22.255205 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.255183    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7b2760ba-be50-4d13-84a3-6df965762880-ta-internal\") pod \"data-science-collector-targetallocator-68cbc545d4-vdb7n\" (UID: \"7b2760ba-be50-4d13-84a3-6df965762880\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:22.257243 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.257222    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7b2760ba-be50-4d13-84a3-6df965762880-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-68cbc545d4-vdb7n\" (UID: \"7b2760ba-be50-4d13-84a3-6df965762880\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:22.275677 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.275646    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtxql\" (UniqueName: \"kubernetes.io/projected/7b2760ba-be50-4d13-84a3-6df965762880-kube-api-access-rtxql\") pod \"data-science-collector-targetallocator-68cbc545d4-vdb7n\" (UID: \"7b2760ba-be50-4d13-84a3-6df965762880\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:22.422572 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.422545    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:22.713895 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.713871    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"]
Oct 30 03:16:22.716132 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:16:22.716100    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b2760ba_be50_4d13_84a3_6df965762880.slice/crio-d5ab10fe80db43f05f7a4b4f5db5b76cde8b9eba27e5609e129a7cf0e92e1faf WatchSource:0}: Error finding container d5ab10fe80db43f05f7a4b4f5db5b76cde8b9eba27e5609e129a7cf0e92e1faf: Status 404 returned error can't find the container with id d5ab10fe80db43f05f7a4b4f5db5b76cde8b9eba27e5609e129a7cf0e92e1faf
Oct 30 03:16:22.718453 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.718420    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:16:22.718528 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:22.718489    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:16:23.079762 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:23.079673    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n" event={"ID":"7b2760ba-be50-4d13-84a3-6df965762880","Type":"ContainerStarted","Data":"85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04"}
Oct 30 03:16:23.079762 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:23.079725    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n" event={"ID":"7b2760ba-be50-4d13-84a3-6df965762880","Type":"ContainerStarted","Data":"d5ab10fe80db43f05f7a4b4f5db5b76cde8b9eba27e5609e129a7cf0e92e1faf"}
Oct 30 03:16:23.079940 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:23.079830    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:23.081055 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:23.081028    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n" podUID="7b2760ba-be50-4d13-84a3-6df965762880" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.38:8080/readyz\": dial tcp 10.134.0.38:8080: connect: connection refused"
Oct 30 03:16:23.119690 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:23.119645    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n" podStartSLOduration=1.119634763 podStartE2EDuration="1.119634763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:16:23.119108307 +0000 UTC m=+2022.961354752" watchObservedRunningTime="2026-10-30 03:16:23.119634763 +0000 UTC m=+2022.961881205"
Oct 30 03:16:24.085213 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.085188    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:24.152939 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.152901    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"]
Oct 30 03:16:24.153698 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.153115    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k" podUID="b47aba03-a343-47f3-ab12-25aa7ac25189" containerName="ta-container" containerID="cri-o://bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705" gracePeriod=30
Oct 30 03:16:24.396517 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.396490    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:24.477007 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.476974    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b47aba03-a343-47f3-ab12-25aa7ac25189-ta-internal\" (UniqueName: \"kubernetes.io/configmap/b47aba03-a343-47f3-ab12-25aa7ac25189-ta-internal\") pod \"b47aba03-a343-47f3-ab12-25aa7ac25189\" (UID: \"b47aba03-a343-47f3-ab12-25aa7ac25189\") "
Oct 30 03:16:24.477157 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.477013    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b47aba03-a343-47f3-ab12-25aa7ac25189-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b47aba03-a343-47f3-ab12-25aa7ac25189-data-science-collector-ta-server-cert\") pod \"b47aba03-a343-47f3-ab12-25aa7ac25189\" (UID: \"b47aba03-a343-47f3-ab12-25aa7ac25189\") "
Oct 30 03:16:24.477157 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.477038    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b47aba03-a343-47f3-ab12-25aa7ac25189-kube-api-access-kcbm7\" (UniqueName: \"kubernetes.io/projected/b47aba03-a343-47f3-ab12-25aa7ac25189-kube-api-access-kcbm7\") pod \"b47aba03-a343-47f3-ab12-25aa7ac25189\" (UID: \"b47aba03-a343-47f3-ab12-25aa7ac25189\") "
Oct 30 03:16:24.477351 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.477326    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b47aba03-a343-47f3-ab12-25aa7ac25189-ta-internal" pod "b47aba03-a343-47f3-ab12-25aa7ac25189" (UID: "b47aba03-a343-47f3-ab12-25aa7ac25189"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:16:24.479262 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.479238    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b47aba03-a343-47f3-ab12-25aa7ac25189-kube-api-access-kcbm7" pod "b47aba03-a343-47f3-ab12-25aa7ac25189" (UID: "b47aba03-a343-47f3-ab12-25aa7ac25189"). InnerVolumeSpecName "kube-api-access-kcbm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:16:24.479262 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.479245    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b47aba03-a343-47f3-ab12-25aa7ac25189-data-science-collector-ta-server-cert" pod "b47aba03-a343-47f3-ab12-25aa7ac25189" (UID: "b47aba03-a343-47f3-ab12-25aa7ac25189"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:16:24.578495 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.578471    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b47aba03-a343-47f3-ab12-25aa7ac25189-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:24.578495 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.578495    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b47aba03-a343-47f3-ab12-25aa7ac25189-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:24.578665 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:24.578506    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcbm7\" (UniqueName: \"kubernetes.io/projected/b47aba03-a343-47f3-ab12-25aa7ac25189-kube-api-access-kcbm7\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:25.089113 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:25.089075    5981 generic.go:356] "Generic (PLEG): container finished" podID="b47aba03-a343-47f3-ab12-25aa7ac25189" containerID="bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705" exitCode=0
Oct 30 03:16:25.089113 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:25.089117    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"
Oct 30 03:16:25.089408 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:25.089109    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k" event={"ID":"b47aba03-a343-47f3-ab12-25aa7ac25189","Type":"ContainerDied","Data":"bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705"}
Oct 30 03:16:25.089408 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:25.089235    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k" event={"ID":"b47aba03-a343-47f3-ab12-25aa7ac25189","Type":"ContainerDied","Data":"784e29d55e2b051dda205929356c274f7252d48d7a37ad7540c4aa07ad3429b7"}
Oct 30 03:16:25.089408 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:25.089256    5981 scope.go:122] "RemoveContainer" containerID="bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705"
Oct 30 03:16:25.099371 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:25.099355    5981 scope.go:122] "RemoveContainer" containerID="bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705"
Oct 30 03:16:25.099632 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:16:25.099612    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705\": container with ID starting with bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705 not found: ID does not exist" containerID="bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705"
Oct 30 03:16:25.099684 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:25.099642    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705"} err="failed to get container status \"bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705\": rpc error: code = NotFound desc = could not find container \"bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705\": container with ID starting with bd5a083f0984e1d08f25b3a0feb0c419aa604b33f83df73f2c26960de7210705 not found: ID does not exist"
Oct 30 03:16:25.144588 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:25.144557    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"]
Oct 30 03:16:25.149025 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:25.148999    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c4994b75f-fmh7k"]
Oct 30 03:16:26.274446 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:26.274406    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b47aba03-a343-47f3-ab12-25aa7ac25189" path="/var/lib/kubelet/pods/b47aba03-a343-47f3-ab12-25aa7ac25189/volumes"
Oct 30 03:16:30.964607 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:30.964577    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"]
Oct 30 03:16:30.965023 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:30.964942    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b47aba03-a343-47f3-ab12-25aa7ac25189" containerName="ta-container"
Oct 30 03:16:30.965023 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:30.964952    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b47aba03-a343-47f3-ab12-25aa7ac25189" containerName="ta-container"
Oct 30 03:16:30.965023 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:30.965006    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b47aba03-a343-47f3-ab12-25aa7ac25189" containerName="ta-container"
Oct 30 03:16:30.969263 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:30.969246    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:31.001858 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.001824    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"]
Oct 30 03:16:31.039114 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.039085    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-ta-internal\") pod \"data-science-collector-targetallocator-6f68c9948f-s2zv6\" (UID: \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:31.039252 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.039125    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6f68c9948f-s2zv6\" (UID: \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:31.039252 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.039207    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slz8k\" (UniqueName: \"kubernetes.io/projected/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-kube-api-access-slz8k\") pod \"data-science-collector-targetallocator-6f68c9948f-s2zv6\" (UID: \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:31.140550 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.140519    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slz8k\" (UniqueName: \"kubernetes.io/projected/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-kube-api-access-slz8k\") pod \"data-science-collector-targetallocator-6f68c9948f-s2zv6\" (UID: \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:31.140714 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.140583    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-ta-internal\") pod \"data-science-collector-targetallocator-6f68c9948f-s2zv6\" (UID: \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:31.140714 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.140613    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6f68c9948f-s2zv6\" (UID: \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:31.141213 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.141186    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-ta-internal\") pod \"data-science-collector-targetallocator-6f68c9948f-s2zv6\" (UID: \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:31.143294 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.143268    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6f68c9948f-s2zv6\" (UID: \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:31.160448 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.160420    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slz8k\" (UniqueName: \"kubernetes.io/projected/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-kube-api-access-slz8k\") pod \"data-science-collector-targetallocator-6f68c9948f-s2zv6\" (UID: \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:31.281040 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.280955    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:31.572984 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.572960    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"]
Oct 30 03:16:31.575181 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:16:31.575148    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ab1ad64_5ad4_4215_abd8_9b180cbe9f35.slice/crio-7528ec20fae3ac0b8c9e54be76cad6bbcf61cc23e3c99971840e8bda088aaf95 WatchSource:0}: Error finding container 7528ec20fae3ac0b8c9e54be76cad6bbcf61cc23e3c99971840e8bda088aaf95: Status 404 returned error can't find the container with id 7528ec20fae3ac0b8c9e54be76cad6bbcf61cc23e3c99971840e8bda088aaf95
Oct 30 03:16:31.577373 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.577334    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:16:31.577462 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:31.577389    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:16:32.120562 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.120527    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6" event={"ID":"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35","Type":"ContainerStarted","Data":"4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807"}
Oct 30 03:16:32.120562 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.120568    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6" event={"ID":"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35","Type":"ContainerStarted","Data":"7528ec20fae3ac0b8c9e54be76cad6bbcf61cc23e3c99971840e8bda088aaf95"}
Oct 30 03:16:32.121062 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.120746    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:32.122670 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.122646    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:32.164798 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.164751    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6" podStartSLOduration=2.164737315 podStartE2EDuration="2.164737315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:16:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:16:32.16402333 +0000 UTC m=+2032.006269775" watchObservedRunningTime="2026-10-30 03:16:32.164737315 +0000 UTC m=+2032.006983759"
Oct 30 03:16:32.242470 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.242440    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"]
Oct 30 03:16:32.242630 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.242611    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n" podUID="7b2760ba-be50-4d13-84a3-6df965762880" containerName="ta-container" containerID="cri-o://85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04" gracePeriod=30
Oct 30 03:16:32.497646 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.497618    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:32.552594 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.552561    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b2760ba-be50-4d13-84a3-6df965762880-kube-api-access-rtxql\" (UniqueName: \"kubernetes.io/projected/7b2760ba-be50-4d13-84a3-6df965762880-kube-api-access-rtxql\") pod \"7b2760ba-be50-4d13-84a3-6df965762880\" (UID: \"7b2760ba-be50-4d13-84a3-6df965762880\") "
Oct 30 03:16:32.552734 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.552644    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b2760ba-be50-4d13-84a3-6df965762880-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7b2760ba-be50-4d13-84a3-6df965762880-data-science-collector-ta-server-cert\") pod \"7b2760ba-be50-4d13-84a3-6df965762880\" (UID: \"7b2760ba-be50-4d13-84a3-6df965762880\") "
Oct 30 03:16:32.552817 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.552739    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b2760ba-be50-4d13-84a3-6df965762880-ta-internal\" (UniqueName: \"kubernetes.io/configmap/7b2760ba-be50-4d13-84a3-6df965762880-ta-internal\") pod \"7b2760ba-be50-4d13-84a3-6df965762880\" (UID: \"7b2760ba-be50-4d13-84a3-6df965762880\") "
Oct 30 03:16:32.553082 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.553059    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b2760ba-be50-4d13-84a3-6df965762880-ta-internal" pod "7b2760ba-be50-4d13-84a3-6df965762880" (UID: "7b2760ba-be50-4d13-84a3-6df965762880"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:16:32.554753 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.554730    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b2760ba-be50-4d13-84a3-6df965762880-kube-api-access-rtxql" pod "7b2760ba-be50-4d13-84a3-6df965762880" (UID: "7b2760ba-be50-4d13-84a3-6df965762880"). InnerVolumeSpecName "kube-api-access-rtxql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:16:32.554865 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.554845    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b2760ba-be50-4d13-84a3-6df965762880-data-science-collector-ta-server-cert" pod "7b2760ba-be50-4d13-84a3-6df965762880" (UID: "7b2760ba-be50-4d13-84a3-6df965762880"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:16:32.654199 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.654174    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/7b2760ba-be50-4d13-84a3-6df965762880-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:32.654199 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.654197    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtxql\" (UniqueName: \"kubernetes.io/projected/7b2760ba-be50-4d13-84a3-6df965762880-kube-api-access-rtxql\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:32.654334 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:32.654208    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/7b2760ba-be50-4d13-84a3-6df965762880-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:33.126266 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:33.126230    5981 generic.go:356] "Generic (PLEG): container finished" podID="7b2760ba-be50-4d13-84a3-6df965762880" containerID="85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04" exitCode=0
Oct 30 03:16:33.126694 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:33.126276    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"
Oct 30 03:16:33.126694 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:33.126320    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n" event={"ID":"7b2760ba-be50-4d13-84a3-6df965762880","Type":"ContainerDied","Data":"85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04"}
Oct 30 03:16:33.126694 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:33.126367    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n" event={"ID":"7b2760ba-be50-4d13-84a3-6df965762880","Type":"ContainerDied","Data":"d5ab10fe80db43f05f7a4b4f5db5b76cde8b9eba27e5609e129a7cf0e92e1faf"}
Oct 30 03:16:33.126694 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:33.126390    5981 scope.go:122] "RemoveContainer" containerID="85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04"
Oct 30 03:16:33.135162 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:33.135146    5981 scope.go:122] "RemoveContainer" containerID="85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04"
Oct 30 03:16:33.135436 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:16:33.135419    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04\": container with ID starting with 85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04 not found: ID does not exist" containerID="85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04"
Oct 30 03:16:33.135497 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:33.135444    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04"} err="failed to get container status \"85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04\": rpc error: code = NotFound desc = could not find container \"85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04\": container with ID starting with 85753de2992d98ce2967b9fca224c565d333db3ced20eab149637eee9e1f0d04 not found: ID does not exist"
Oct 30 03:16:33.177712 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:33.177686    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"]
Oct 30 03:16:33.190520 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:33.190486    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-68cbc545d4-vdb7n"]
Oct 30 03:16:34.274388 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:34.274353    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b2760ba-be50-4d13-84a3-6df965762880" path="/var/lib/kubelet/pods/7b2760ba-be50-4d13-84a3-6df965762880/volumes"
Oct 30 03:16:38.873919 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:38.873886    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 03:16:38.874425 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:38.874234    5981 cpu_manager.go:414] "containerMap: removing container" podUID="7b2760ba-be50-4d13-84a3-6df965762880" containerName="ta-container"
Oct 30 03:16:38.874425 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:38.874244    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b2760ba-be50-4d13-84a3-6df965762880" containerName="ta-container"
Oct 30 03:16:38.874425 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:38.874318    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b2760ba-be50-4d13-84a3-6df965762880" containerName="ta-container"
Oct 30 03:16:38.878797 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:38.878774    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:38.909442 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:38.909415    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 03:16:38.909442 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:38.909426    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 03:16:38.909673 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:38.909445    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 03:16:38.909673 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:38.909563    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 03:16:38.909673 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:38.909634    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 03:16:38.909808 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:38.909743    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-rzsdv\""
Oct 30 03:16:38.923462 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:38.923437    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 03:16:39.009642 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.009595    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-otlp-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.009833 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.009738    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.009833 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.009776    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd464\" (UniqueName: \"kubernetes.io/projected/329c399b-8278-4db7-bbab-02ae6e814e6d-kube-api-access-cd464\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.009935 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.009851    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-monitoring-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.009976 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.009937    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/329c399b-8278-4db7-bbab-02ae6e814e6d-otc-internal\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.009976 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.009955    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.057306 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.057259    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"]
Oct 30 03:16:39.060630 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.060613    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:39.085275 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.085250    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"]
Oct 30 03:16:39.111121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.111091    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/329c399b-8278-4db7-bbab-02ae6e814e6d-otc-internal\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.111121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.111124    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.111474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.111145    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-otlp-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.111474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.111203    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.111474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.111220    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd464\" (UniqueName: \"kubernetes.io/projected/329c399b-8278-4db7-bbab-02ae6e814e6d-kube-api-access-cd464\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.111474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.111246    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-monitoring-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.111811 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.111790    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/329c399b-8278-4db7-bbab-02ae6e814e6d-otc-internal\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.113871 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.113847    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.113995 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.113886    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-otlp-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.114242 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.114225    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-monitoring-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.114344 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.114327    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.131193 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.131124    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd464\" (UniqueName: \"kubernetes.io/projected/329c399b-8278-4db7-bbab-02ae6e814e6d-kube-api-access-cd464\") pod \"data-science-collector-collector-2\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.191753 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.191711    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:16:39.212519 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.212486    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b859764a-5551-41ed-9218-99f99ee51e82-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-54959bdf86-fkwzd\" (UID: \"b859764a-5551-41ed-9218-99f99ee51e82\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:39.212642 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.212536    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b859764a-5551-41ed-9218-99f99ee51e82-ta-internal\") pod \"data-science-collector-targetallocator-54959bdf86-fkwzd\" (UID: \"b859764a-5551-41ed-9218-99f99ee51e82\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:39.212642 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.212565    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btw2l\" (UniqueName: \"kubernetes.io/projected/b859764a-5551-41ed-9218-99f99ee51e82-kube-api-access-btw2l\") pod \"data-science-collector-targetallocator-54959bdf86-fkwzd\" (UID: \"b859764a-5551-41ed-9218-99f99ee51e82\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:39.313991 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.313947    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btw2l\" (UniqueName: \"kubernetes.io/projected/b859764a-5551-41ed-9218-99f99ee51e82-kube-api-access-btw2l\") pod \"data-science-collector-targetallocator-54959bdf86-fkwzd\" (UID: \"b859764a-5551-41ed-9218-99f99ee51e82\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:39.314200 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.314057    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b859764a-5551-41ed-9218-99f99ee51e82-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-54959bdf86-fkwzd\" (UID: \"b859764a-5551-41ed-9218-99f99ee51e82\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:39.314200 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.314088    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b859764a-5551-41ed-9218-99f99ee51e82-ta-internal\") pod \"data-science-collector-targetallocator-54959bdf86-fkwzd\" (UID: \"b859764a-5551-41ed-9218-99f99ee51e82\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:39.314888 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.314828    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b859764a-5551-41ed-9218-99f99ee51e82-ta-internal\") pod \"data-science-collector-targetallocator-54959bdf86-fkwzd\" (UID: \"b859764a-5551-41ed-9218-99f99ee51e82\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:39.316766 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.316746    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b859764a-5551-41ed-9218-99f99ee51e82-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-54959bdf86-fkwzd\" (UID: \"b859764a-5551-41ed-9218-99f99ee51e82\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:39.333898 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.333867    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btw2l\" (UniqueName: \"kubernetes.io/projected/b859764a-5551-41ed-9218-99f99ee51e82-kube-api-access-btw2l\") pod \"data-science-collector-targetallocator-54959bdf86-fkwzd\" (UID: \"b859764a-5551-41ed-9218-99f99ee51e82\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:39.371608 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.371565    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:39.497858 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.497830    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 03:16:39.499934 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:16:39.499903    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329c399b_8278_4db7_bbab_02ae6e814e6d.slice/crio-f491c45122f4eb77e3f4b99bedc95376aaef1e6a889e68d947c8cd5d21fa863f WatchSource:0}: Error finding container f491c45122f4eb77e3f4b99bedc95376aaef1e6a889e68d947c8cd5d21fa863f: Status 404 returned error can't find the container with id f491c45122f4eb77e3f4b99bedc95376aaef1e6a889e68d947c8cd5d21fa863f
Oct 30 03:16:39.665970 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.665926    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"]
Oct 30 03:16:39.669990 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:16:39.669962    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb859764a_5551_41ed_9218_99f99ee51e82.slice/crio-42fc2f07c56c73aca3bbeee1a75e8b3f536d55de953948972194d04bda30958c WatchSource:0}: Error finding container 42fc2f07c56c73aca3bbeee1a75e8b3f536d55de953948972194d04bda30958c: Status 404 returned error can't find the container with id 42fc2f07c56c73aca3bbeee1a75e8b3f536d55de953948972194d04bda30958c
Oct 30 03:16:39.672262 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.672225    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:16:39.672408 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:39.672315    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:16:40.157355 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.157317    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-2" event={"ID":"329c399b-8278-4db7-bbab-02ae6e814e6d","Type":"ContainerStarted","Data":"f491c45122f4eb77e3f4b99bedc95376aaef1e6a889e68d947c8cd5d21fa863f"}
Oct 30 03:16:40.158858 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.158828    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd" event={"ID":"b859764a-5551-41ed-9218-99f99ee51e82","Type":"ContainerStarted","Data":"d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3"}
Oct 30 03:16:40.159016 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.158863    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd" event={"ID":"b859764a-5551-41ed-9218-99f99ee51e82","Type":"ContainerStarted","Data":"42fc2f07c56c73aca3bbeee1a75e8b3f536d55de953948972194d04bda30958c"}
Oct 30 03:16:40.159076 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.159016    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:40.160871 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.160840    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:16:40.199968 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.199911    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd" podStartSLOduration=1.1998970899999999 podStartE2EDuration="1.19989709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:16:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:16:40.199479094 +0000 UTC m=+2040.041725540" watchObservedRunningTime="2026-10-30 03:16:40.19989709 +0000 UTC m=+2040.042143534"
Oct 30 03:16:40.268383 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.268061    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"]
Oct 30 03:16:40.271380 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.268258    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6" podUID="5ab1ad64-5ad4-4215-abd8-9b180cbe9f35" containerName="ta-container" containerID="cri-o://4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807" gracePeriod=30
Oct 30 03:16:40.285870 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:16:40.285831    5981 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ab1ad64_5ad4_4215_abd8_9b180cbe9f35.slice/crio-4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 03:16:40.539888 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.539858    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:40.626099 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.626064    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-ta-internal\") pod \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\" (UID: \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\") "
Oct 30 03:16:40.626303 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.626126    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-kube-api-access-slz8k\" (UniqueName: \"kubernetes.io/projected/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-kube-api-access-slz8k\") pod \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\" (UID: \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\") "
Oct 30 03:16:40.626303 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.626250    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-data-science-collector-ta-server-cert\") pod \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\" (UID: \"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35\") "
Oct 30 03:16:40.626511 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.626483    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-ta-internal" pod "5ab1ad64-5ad4-4215-abd8-9b180cbe9f35" (UID: "5ab1ad64-5ad4-4215-abd8-9b180cbe9f35"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:16:40.628555 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.628529    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-kube-api-access-slz8k" pod "5ab1ad64-5ad4-4215-abd8-9b180cbe9f35" (UID: "5ab1ad64-5ad4-4215-abd8-9b180cbe9f35"). InnerVolumeSpecName "kube-api-access-slz8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:16:40.629373 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.629348    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-data-science-collector-ta-server-cert" pod "5ab1ad64-5ad4-4215-abd8-9b180cbe9f35" (UID: "5ab1ad64-5ad4-4215-abd8-9b180cbe9f35"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:16:40.727249 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.727162    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:40.727249 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.727201    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slz8k\" (UniqueName: \"kubernetes.io/projected/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-kube-api-access-slz8k\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:40.727249 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:40.727217    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:16:41.165658 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:41.165621    5981 generic.go:356] "Generic (PLEG): container finished" podID="5ab1ad64-5ad4-4215-abd8-9b180cbe9f35" containerID="4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807" exitCode=0
Oct 30 03:16:41.166052 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:41.165680    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"
Oct 30 03:16:41.166052 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:41.165708    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6" event={"ID":"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35","Type":"ContainerDied","Data":"4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807"}
Oct 30 03:16:41.166052 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:41.165760    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6" event={"ID":"5ab1ad64-5ad4-4215-abd8-9b180cbe9f35","Type":"ContainerDied","Data":"7528ec20fae3ac0b8c9e54be76cad6bbcf61cc23e3c99971840e8bda088aaf95"}
Oct 30 03:16:41.166052 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:41.165796    5981 scope.go:122] "RemoveContainer" containerID="4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807"
Oct 30 03:16:41.176671 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:41.176654    5981 scope.go:122] "RemoveContainer" containerID="4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807"
Oct 30 03:16:41.176996 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:16:41.176972    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807\": container with ID starting with 4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807 not found: ID does not exist" containerID="4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807"
Oct 30 03:16:41.177069 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:41.177006    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807"} err="failed to get container status \"4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807\": rpc error: code = NotFound desc = could not find container \"4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807\": container with ID starting with 4d667accf9d329f8755b499bbd50deebca08aec00f94af4c2f34de4e4100c807 not found: ID does not exist"
Oct 30 03:16:41.217327 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:41.217297    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"]
Oct 30 03:16:41.230316 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:41.230269    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6f68c9948f-s2zv6"]
Oct 30 03:16:42.275705 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:42.275669    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ab1ad64-5ad4-4215-abd8-9b180cbe9f35" path="/var/lib/kubelet/pods/5ab1ad64-5ad4-4215-abd8-9b180cbe9f35/volumes"
Oct 30 03:16:43.365276 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:43.365239    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:16:43.365700 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:43.365335    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:16:44.184602 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:44.184565    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-2" event={"ID":"329c399b-8278-4db7-bbab-02ae6e814e6d","Type":"ContainerStarted","Data":"cc34ff4b95e0e751ca2dfe0bef6610fdaa7dc36490784f6f42db464f4474b484"}
Oct 30 03:16:44.226631 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:16:44.226577    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-2" podStartSLOduration=2.363997146 podStartE2EDuration="6.226564132s" totalImagesPullingTime="3.862566986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:16:44.225491727 +0000 UTC m=+2044.067738174" watchObservedRunningTime="2026-10-30 03:16:44.226564132 +0000 UTC m=+2044.068810576"
Oct 30 03:16:44.369102 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:16:44.369064    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:17:14.369464 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:17:14.369420    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:17:44.368674 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:17:44.368636    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:18:14.368548 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:18:14.368515    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:18:44.368725 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:18:44.368689    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:19:14.368712 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:19:14.368632    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:19:44.368271 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:19:44.368235    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:20:14.368618 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:20:14.368582    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:20:44.369015 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:20:44.368975    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:21:14.368504 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:21:14.368464    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:21:44.369058 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:21:44.369020    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:22:14.369692 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:22:14.369615    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:22:44.369462 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:22:44.369424    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:23:14.369383 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:23:14.369340    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:23:44.368723 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:23:44.368675    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:24:14.368541 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:24:14.368483    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:24:44.368666 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:24:44.368625    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:25:14.369848 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:25:14.369763    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:25:44.368912 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:25:44.368874    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:26:14.369847 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:26:14.369808    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:26:44.370552 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:26:44.370514    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:26:46.489777 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.489744    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 03:26:46.490240 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.489930    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-2" podUID="329c399b-8278-4db7-bbab-02ae6e814e6d" containerName="otc-container" containerID="cri-o://cc34ff4b95e0e751ca2dfe0bef6610fdaa7dc36490784f6f42db464f4474b484" gracePeriod=30
Oct 30 03:26:46.760879 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.760796    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"]
Oct 30 03:26:46.761223 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.761208    5981 cpu_manager.go:414] "containerMap: removing container" podUID="5ab1ad64-5ad4-4215-abd8-9b180cbe9f35" containerName="ta-container"
Oct 30 03:26:46.761277 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.761226    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ab1ad64-5ad4-4215-abd8-9b180cbe9f35" containerName="ta-container"
Oct 30 03:26:46.761337 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.761301    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ab1ad64-5ad4-4215-abd8-9b180cbe9f35" containerName="ta-container"
Oct 30 03:26:46.764360 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.764339    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:46.785048 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.785020    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"]
Oct 30 03:26:46.795933 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.795908    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/80037ab2-7c08-474a-8c54-75a3fa6725cd-ta-internal\") pod \"data-science-collector-targetallocator-6db578df4c-s6rtt\" (UID: \"80037ab2-7c08-474a-8c54-75a3fa6725cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:46.796056 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.795944    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t2kd\" (UniqueName: \"kubernetes.io/projected/80037ab2-7c08-474a-8c54-75a3fa6725cd-kube-api-access-8t2kd\") pod \"data-science-collector-targetallocator-6db578df4c-s6rtt\" (UID: \"80037ab2-7c08-474a-8c54-75a3fa6725cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:46.796056 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.795980    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/80037ab2-7c08-474a-8c54-75a3fa6725cd-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6db578df4c-s6rtt\" (UID: \"80037ab2-7c08-474a-8c54-75a3fa6725cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:46.896829 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.896801    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/80037ab2-7c08-474a-8c54-75a3fa6725cd-ta-internal\") pod \"data-science-collector-targetallocator-6db578df4c-s6rtt\" (UID: \"80037ab2-7c08-474a-8c54-75a3fa6725cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:46.897000 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.896836    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t2kd\" (UniqueName: \"kubernetes.io/projected/80037ab2-7c08-474a-8c54-75a3fa6725cd-kube-api-access-8t2kd\") pod \"data-science-collector-targetallocator-6db578df4c-s6rtt\" (UID: \"80037ab2-7c08-474a-8c54-75a3fa6725cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:46.897000 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.896871    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/80037ab2-7c08-474a-8c54-75a3fa6725cd-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6db578df4c-s6rtt\" (UID: \"80037ab2-7c08-474a-8c54-75a3fa6725cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:46.897452 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.897429    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/80037ab2-7c08-474a-8c54-75a3fa6725cd-ta-internal\") pod \"data-science-collector-targetallocator-6db578df4c-s6rtt\" (UID: \"80037ab2-7c08-474a-8c54-75a3fa6725cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:46.899450 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.899427    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/80037ab2-7c08-474a-8c54-75a3fa6725cd-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6db578df4c-s6rtt\" (UID: \"80037ab2-7c08-474a-8c54-75a3fa6725cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:46.918203 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:46.918176    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t2kd\" (UniqueName: \"kubernetes.io/projected/80037ab2-7c08-474a-8c54-75a3fa6725cd-kube-api-access-8t2kd\") pod \"data-science-collector-targetallocator-6db578df4c-s6rtt\" (UID: \"80037ab2-7c08-474a-8c54-75a3fa6725cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:47.075786 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:47.075710    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:47.379007 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:47.378981    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"]
Oct 30 03:26:47.381161 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:26:47.381125    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80037ab2_7c08_474a_8c54_75a3fa6725cd.slice/crio-0c224d6e96e47f193e04965f932f5138970e6ec56a70a3da8fd5739de65ef4d0 WatchSource:0}: Error finding container 0c224d6e96e47f193e04965f932f5138970e6ec56a70a3da8fd5739de65ef4d0: Status 404 returned error can't find the container with id 0c224d6e96e47f193e04965f932f5138970e6ec56a70a3da8fd5739de65ef4d0
Oct 30 03:26:47.383490 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:47.383452    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:26:47.383583 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:47.383525    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:26:47.770354 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:47.770319    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt" event={"ID":"80037ab2-7c08-474a-8c54-75a3fa6725cd","Type":"ContainerStarted","Data":"1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19"}
Oct 30 03:26:47.770354 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:47.770360    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt" event={"ID":"80037ab2-7c08-474a-8c54-75a3fa6725cd","Type":"ContainerStarted","Data":"0c224d6e96e47f193e04965f932f5138970e6ec56a70a3da8fd5739de65ef4d0"}
Oct 30 03:26:47.770790 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:47.770527    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:47.771825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:47.771800    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt" podUID="80037ab2-7c08-474a-8c54-75a3fa6725cd" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.42:8080/readyz\": dial tcp 10.134.0.42:8080: connect: connection refused"
Oct 30 03:26:47.814725 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:47.814683    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt" podStartSLOduration=1.814669711 podStartE2EDuration="1.814669711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:26:47.812614722 +0000 UTC m=+2647.654861167" watchObservedRunningTime="2026-10-30 03:26:47.814669711 +0000 UTC m=+2647.656916186"
Oct 30 03:26:48.776516 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.776484    5981 generic.go:356] "Generic (PLEG): container finished" podID="329c399b-8278-4db7-bbab-02ae6e814e6d" containerID="cc34ff4b95e0e751ca2dfe0bef6610fdaa7dc36490784f6f42db464f4474b484" exitCode=0
Oct 30 03:26:48.776933 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.776553    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-2" event={"ID":"329c399b-8278-4db7-bbab-02ae6e814e6d","Type":"ContainerDied","Data":"cc34ff4b95e0e751ca2dfe0bef6610fdaa7dc36490784f6f42db464f4474b484"}
Oct 30 03:26:48.777762 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.777741    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:26:48.850167 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.850139    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:26:48.863819 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.863787    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"]
Oct 30 03:26:48.863996 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.863970    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd" podUID="b859764a-5551-41ed-9218-99f99ee51e82" containerName="ta-container" containerID="cri-o://d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3" gracePeriod=30
Oct 30 03:26:48.915941 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.915856    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-data-science-collector-ta-client-cert\") pod \"329c399b-8278-4db7-bbab-02ae6e814e6d\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") "
Oct 30 03:26:48.915941 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.915925    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-otlp-tls-certs\") pod \"329c399b-8278-4db7-bbab-02ae6e814e6d\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") "
Oct 30 03:26:48.916152 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.915960    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/329c399b-8278-4db7-bbab-02ae6e814e6d-kube-api-access-cd464\" (UniqueName: \"kubernetes.io/projected/329c399b-8278-4db7-bbab-02ae6e814e6d-kube-api-access-cd464\") pod \"329c399b-8278-4db7-bbab-02ae6e814e6d\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") "
Oct 30 03:26:48.916667 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.916437    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-tls-certs\") pod \"329c399b-8278-4db7-bbab-02ae6e814e6d\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") "
Oct 30 03:26:48.916667 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.916558    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/329c399b-8278-4db7-bbab-02ae6e814e6d-otc-internal\" (UniqueName: \"kubernetes.io/configmap/329c399b-8278-4db7-bbab-02ae6e814e6d-otc-internal\") pod \"329c399b-8278-4db7-bbab-02ae6e814e6d\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") "
Oct 30 03:26:48.916869 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.916778    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-monitoring-tls-certs\") pod \"329c399b-8278-4db7-bbab-02ae6e814e6d\" (UID: \"329c399b-8278-4db7-bbab-02ae6e814e6d\") "
Oct 30 03:26:48.917721 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.917690    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/329c399b-8278-4db7-bbab-02ae6e814e6d-otc-internal" pod "329c399b-8278-4db7-bbab-02ae6e814e6d" (UID: "329c399b-8278-4db7-bbab-02ae6e814e6d"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:26:48.918656 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.918630    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-otlp-tls-certs" pod "329c399b-8278-4db7-bbab-02ae6e814e6d" (UID: "329c399b-8278-4db7-bbab-02ae6e814e6d"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:26:48.918752 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.918653    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-data-science-collector-ta-client-cert" pod "329c399b-8278-4db7-bbab-02ae6e814e6d" (UID: "329c399b-8278-4db7-bbab-02ae6e814e6d"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:26:48.919201 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.919173    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-tls-certs" pod "329c399b-8278-4db7-bbab-02ae6e814e6d" (UID: "329c399b-8278-4db7-bbab-02ae6e814e6d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:26:48.919597 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.919568    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-monitoring-tls-certs" pod "329c399b-8278-4db7-bbab-02ae6e814e6d" (UID: "329c399b-8278-4db7-bbab-02ae6e814e6d"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:26:48.920456 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:48.920436    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/329c399b-8278-4db7-bbab-02ae6e814e6d-kube-api-access-cd464" pod "329c399b-8278-4db7-bbab-02ae6e814e6d" (UID: "329c399b-8278-4db7-bbab-02ae6e814e6d"). InnerVolumeSpecName "kube-api-access-cd464". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:26:49.018201 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.018164    5981 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/329c399b-8278-4db7-bbab-02ae6e814e6d-otc-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:26:49.018374 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.018208    5981 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-monitoring-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:26:49.018374 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.018226    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-data-science-collector-ta-client-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:26:49.018374 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.018243    5981 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-otlp-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:26:49.018374 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.018259    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd464\" (UniqueName: \"kubernetes.io/projected/329c399b-8278-4db7-bbab-02ae6e814e6d-kube-api-access-cd464\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:26:49.018374 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.018273    5981 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/329c399b-8278-4db7-bbab-02ae6e814e6d-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:26:49.113004 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.112977    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:26:49.219981 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.219891    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b859764a-5551-41ed-9218-99f99ee51e82-ta-internal\" (UniqueName: \"kubernetes.io/configmap/b859764a-5551-41ed-9218-99f99ee51e82-ta-internal\") pod \"b859764a-5551-41ed-9218-99f99ee51e82\" (UID: \"b859764a-5551-41ed-9218-99f99ee51e82\") "
Oct 30 03:26:49.219981 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.219955    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b859764a-5551-41ed-9218-99f99ee51e82-kube-api-access-btw2l\" (UniqueName: \"kubernetes.io/projected/b859764a-5551-41ed-9218-99f99ee51e82-kube-api-access-btw2l\") pod \"b859764a-5551-41ed-9218-99f99ee51e82\" (UID: \"b859764a-5551-41ed-9218-99f99ee51e82\") "
Oct 30 03:26:49.219981 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.219980    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b859764a-5551-41ed-9218-99f99ee51e82-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b859764a-5551-41ed-9218-99f99ee51e82-data-science-collector-ta-server-cert\") pod \"b859764a-5551-41ed-9218-99f99ee51e82\" (UID: \"b859764a-5551-41ed-9218-99f99ee51e82\") "
Oct 30 03:26:49.220273 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.220241    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b859764a-5551-41ed-9218-99f99ee51e82-ta-internal" pod "b859764a-5551-41ed-9218-99f99ee51e82" (UID: "b859764a-5551-41ed-9218-99f99ee51e82"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:26:49.222350 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.222327    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b859764a-5551-41ed-9218-99f99ee51e82-data-science-collector-ta-server-cert" pod "b859764a-5551-41ed-9218-99f99ee51e82" (UID: "b859764a-5551-41ed-9218-99f99ee51e82"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:26:49.222350 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.222343    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b859764a-5551-41ed-9218-99f99ee51e82-kube-api-access-btw2l" pod "b859764a-5551-41ed-9218-99f99ee51e82" (UID: "b859764a-5551-41ed-9218-99f99ee51e82"). InnerVolumeSpecName "kube-api-access-btw2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:26:49.321547 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.321508    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b859764a-5551-41ed-9218-99f99ee51e82-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:26:49.321547 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.321543    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btw2l\" (UniqueName: \"kubernetes.io/projected/b859764a-5551-41ed-9218-99f99ee51e82-kube-api-access-btw2l\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:26:49.321740 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.321558    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b859764a-5551-41ed-9218-99f99ee51e82-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:26:49.782081 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.782056    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 03:26:49.782615 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.782053    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-2" event={"ID":"329c399b-8278-4db7-bbab-02ae6e814e6d","Type":"ContainerDied","Data":"f491c45122f4eb77e3f4b99bedc95376aaef1e6a889e68d947c8cd5d21fa863f"}
Oct 30 03:26:49.782615 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.782216    5981 scope.go:122] "RemoveContainer" containerID="cc34ff4b95e0e751ca2dfe0bef6610fdaa7dc36490784f6f42db464f4474b484"
Oct 30 03:26:49.783558 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.783515    5981 generic.go:356] "Generic (PLEG): container finished" podID="b859764a-5551-41ed-9218-99f99ee51e82" containerID="d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3" exitCode=0
Oct 30 03:26:49.783558 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.783544    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd" event={"ID":"b859764a-5551-41ed-9218-99f99ee51e82","Type":"ContainerDied","Data":"d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3"}
Oct 30 03:26:49.783695 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.783569    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"
Oct 30 03:26:49.783695 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.783586    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd" event={"ID":"b859764a-5551-41ed-9218-99f99ee51e82","Type":"ContainerDied","Data":"42fc2f07c56c73aca3bbeee1a75e8b3f536d55de953948972194d04bda30958c"}
Oct 30 03:26:49.791236 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.791208    5981 scope.go:122] "RemoveContainer" containerID="d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3"
Oct 30 03:26:49.799196 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.799181    5981 scope.go:122] "RemoveContainer" containerID="d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3"
Oct 30 03:26:49.799450 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:26:49.799433    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3\": container with ID starting with d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3 not found: ID does not exist" containerID="d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3"
Oct 30 03:26:49.799515 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.799458    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3"} err="failed to get container status \"d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3\": rpc error: code = NotFound desc = could not find container \"d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3\": container with ID starting with d27961ea721904e95c757728cd19227284589f5b328f09317be9a7f63afcf8e3 not found: ID does not exist"
Oct 30 03:26:49.836924 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.836906    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"]
Oct 30 03:26:49.840177 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.840156    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-54959bdf86-fkwzd"]
Oct 30 03:26:49.883294 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.883259    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 03:26:49.885777 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:49.885755    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 03:26:50.274743 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:50.274713    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="329c399b-8278-4db7-bbab-02ae6e814e6d" path="/var/lib/kubelet/pods/329c399b-8278-4db7-bbab-02ae6e814e6d/volumes"
Oct 30 03:26:50.275112 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:50.275098    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b859764a-5551-41ed-9218-99f99ee51e82" path="/var/lib/kubelet/pods/b859764a-5551-41ed-9218-99f99ee51e82/volumes"
Oct 30 03:26:58.756254 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.756219    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"]
Oct 30 03:26:58.756661 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.756561    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b859764a-5551-41ed-9218-99f99ee51e82" containerName="ta-container"
Oct 30 03:26:58.756661 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.756573    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b859764a-5551-41ed-9218-99f99ee51e82" containerName="ta-container"
Oct 30 03:26:58.756661 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.756590    5981 cpu_manager.go:414] "containerMap: removing container" podUID="329c399b-8278-4db7-bbab-02ae6e814e6d" containerName="otc-container"
Oct 30 03:26:58.756661 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.756595    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="329c399b-8278-4db7-bbab-02ae6e814e6d" containerName="otc-container"
Oct 30 03:26:58.756661 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.756657    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b859764a-5551-41ed-9218-99f99ee51e82" containerName="ta-container"
Oct 30 03:26:58.756817 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.756665    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="329c399b-8278-4db7-bbab-02ae6e814e6d" containerName="otc-container"
Oct 30 03:26:58.761209 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.761186    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:58.792775 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.792746    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"]
Oct 30 03:26:58.796573 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.796548    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1aa0afd7-1185-4dd7-9114-7ad87f99646a-ta-internal\") pod \"data-science-collector-targetallocator-b9c5fcc88-5v7tw\" (UID: \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:58.796701 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.796583    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6q2p\" (UniqueName: \"kubernetes.io/projected/1aa0afd7-1185-4dd7-9114-7ad87f99646a-kube-api-access-w6q2p\") pod \"data-science-collector-targetallocator-b9c5fcc88-5v7tw\" (UID: \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:58.796701 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.796626    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1aa0afd7-1185-4dd7-9114-7ad87f99646a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-b9c5fcc88-5v7tw\" (UID: \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:58.898091 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.898058    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1aa0afd7-1185-4dd7-9114-7ad87f99646a-ta-internal\") pod \"data-science-collector-targetallocator-b9c5fcc88-5v7tw\" (UID: \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:58.898091 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.898098    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6q2p\" (UniqueName: \"kubernetes.io/projected/1aa0afd7-1185-4dd7-9114-7ad87f99646a-kube-api-access-w6q2p\") pod \"data-science-collector-targetallocator-b9c5fcc88-5v7tw\" (UID: \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:58.898405 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.898133    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1aa0afd7-1185-4dd7-9114-7ad87f99646a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-b9c5fcc88-5v7tw\" (UID: \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:58.898840 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.898812    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1aa0afd7-1185-4dd7-9114-7ad87f99646a-ta-internal\") pod \"data-science-collector-targetallocator-b9c5fcc88-5v7tw\" (UID: \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:58.900750 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.900721    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1aa0afd7-1185-4dd7-9114-7ad87f99646a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-b9c5fcc88-5v7tw\" (UID: \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:58.919551 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:58.919522    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6q2p\" (UniqueName: \"kubernetes.io/projected/1aa0afd7-1185-4dd7-9114-7ad87f99646a-kube-api-access-w6q2p\") pod \"data-science-collector-targetallocator-b9c5fcc88-5v7tw\" (UID: \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:59.072922 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:59.072822    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:59.364237 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:59.364211    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"]
Oct 30 03:26:59.366080 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:26:59.366050    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1aa0afd7_1185_4dd7_9114_7ad87f99646a.slice/crio-1f9006f18050ad109798dd02dc8417b96e410bf0256f1088aeb69883afd9d1aa WatchSource:0}: Error finding container 1f9006f18050ad109798dd02dc8417b96e410bf0256f1088aeb69883afd9d1aa: Status 404 returned error can't find the container with id 1f9006f18050ad109798dd02dc8417b96e410bf0256f1088aeb69883afd9d1aa
Oct 30 03:26:59.368738 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:59.368711    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:26:59.368815 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:59.368766    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:26:59.827170 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:59.827135    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw" event={"ID":"1aa0afd7-1185-4dd7-9114-7ad87f99646a","Type":"ContainerStarted","Data":"3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8"}
Oct 30 03:26:59.827170 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:59.827177    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw" event={"ID":"1aa0afd7-1185-4dd7-9114-7ad87f99646a","Type":"ContainerStarted","Data":"1f9006f18050ad109798dd02dc8417b96e410bf0256f1088aeb69883afd9d1aa"}
Oct 30 03:26:59.827632 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:59.827318    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:59.829117 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:59.829094    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:26:59.870468 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:59.870418    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw" podStartSLOduration=1.8704039099999998 podStartE2EDuration="1.87040391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:26:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:26:59.869688587 +0000 UTC m=+2659.711935032" watchObservedRunningTime="2026-10-30 03:26:59.87040391 +0000 UTC m=+2659.712650422"
Oct 30 03:26:59.940235 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:59.940206    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"]
Oct 30 03:26:59.940421 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:26:59.940395    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt" podUID="80037ab2-7c08-474a-8c54-75a3fa6725cd" containerName="ta-container" containerID="cri-o://1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19" gracePeriod=30
Oct 30 03:27:00.190956 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.190931    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:27:00.215476 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.215450    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80037ab2-7c08-474a-8c54-75a3fa6725cd-kube-api-access-8t2kd\" (UniqueName: \"kubernetes.io/projected/80037ab2-7c08-474a-8c54-75a3fa6725cd-kube-api-access-8t2kd\") pod \"80037ab2-7c08-474a-8c54-75a3fa6725cd\" (UID: \"80037ab2-7c08-474a-8c54-75a3fa6725cd\") "
Oct 30 03:27:00.215619 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.215491    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/80037ab2-7c08-474a-8c54-75a3fa6725cd-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/80037ab2-7c08-474a-8c54-75a3fa6725cd-data-science-collector-ta-server-cert\") pod \"80037ab2-7c08-474a-8c54-75a3fa6725cd\" (UID: \"80037ab2-7c08-474a-8c54-75a3fa6725cd\") "
Oct 30 03:27:00.215619 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.215589    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80037ab2-7c08-474a-8c54-75a3fa6725cd-ta-internal\" (UniqueName: \"kubernetes.io/configmap/80037ab2-7c08-474a-8c54-75a3fa6725cd-ta-internal\") pod \"80037ab2-7c08-474a-8c54-75a3fa6725cd\" (UID: \"80037ab2-7c08-474a-8c54-75a3fa6725cd\") "
Oct 30 03:27:00.215950 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.215920    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80037ab2-7c08-474a-8c54-75a3fa6725cd-ta-internal" pod "80037ab2-7c08-474a-8c54-75a3fa6725cd" (UID: "80037ab2-7c08-474a-8c54-75a3fa6725cd"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:27:00.217975 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.217944    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80037ab2-7c08-474a-8c54-75a3fa6725cd-data-science-collector-ta-server-cert" pod "80037ab2-7c08-474a-8c54-75a3fa6725cd" (UID: "80037ab2-7c08-474a-8c54-75a3fa6725cd"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:27:00.218090 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.218007    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80037ab2-7c08-474a-8c54-75a3fa6725cd-kube-api-access-8t2kd" pod "80037ab2-7c08-474a-8c54-75a3fa6725cd" (UID: "80037ab2-7c08-474a-8c54-75a3fa6725cd"). InnerVolumeSpecName "kube-api-access-8t2kd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:27:00.316560 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.316524    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t2kd\" (UniqueName: \"kubernetes.io/projected/80037ab2-7c08-474a-8c54-75a3fa6725cd-kube-api-access-8t2kd\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:27:00.316560 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.316550    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/80037ab2-7c08-474a-8c54-75a3fa6725cd-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:27:00.316560 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.316560    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/80037ab2-7c08-474a-8c54-75a3fa6725cd-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:27:00.833577 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.833543    5981 generic.go:356] "Generic (PLEG): container finished" podID="80037ab2-7c08-474a-8c54-75a3fa6725cd" containerID="1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19" exitCode=0
Oct 30 03:27:00.834036 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.833589    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"
Oct 30 03:27:00.834036 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.833631    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt" event={"ID":"80037ab2-7c08-474a-8c54-75a3fa6725cd","Type":"ContainerDied","Data":"1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19"}
Oct 30 03:27:00.834036 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.833672    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt" event={"ID":"80037ab2-7c08-474a-8c54-75a3fa6725cd","Type":"ContainerDied","Data":"0c224d6e96e47f193e04965f932f5138970e6ec56a70a3da8fd5739de65ef4d0"}
Oct 30 03:27:00.834036 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.833691    5981 scope.go:122] "RemoveContainer" containerID="1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19"
Oct 30 03:27:00.842076 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.842061    5981 scope.go:122] "RemoveContainer" containerID="1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19"
Oct 30 03:27:00.842380 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:27:00.842355    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19\": container with ID starting with 1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19 not found: ID does not exist" containerID="1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19"
Oct 30 03:27:00.842488 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.842385    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19"} err="failed to get container status \"1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19\": rpc error: code = NotFound desc = could not find container \"1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19\": container with ID starting with 1e00ae1f0d9fdfb3e1320091db4c43c7f8a7db0a691a3016f2d1dd52a30bfc19 not found: ID does not exist"
Oct 30 03:27:00.901149 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.901117    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"]
Oct 30 03:27:00.913373 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:00.913344    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6db578df4c-s6rtt"]
Oct 30 03:27:02.275924 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:02.275888    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80037ab2-7c08-474a-8c54-75a3fa6725cd" path="/var/lib/kubelet/pods/80037ab2-7c08-474a-8c54-75a3fa6725cd/volumes"
Oct 30 03:27:05.881252 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:05.881220    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"]
Oct 30 03:27:05.881660 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:05.881617    5981 cpu_manager.go:414] "containerMap: removing container" podUID="80037ab2-7c08-474a-8c54-75a3fa6725cd" containerName="ta-container"
Oct 30 03:27:05.881660 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:05.881630    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80037ab2-7c08-474a-8c54-75a3fa6725cd" containerName="ta-container"
Oct 30 03:27:05.881760 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:05.881692    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="80037ab2-7c08-474a-8c54-75a3fa6725cd" containerName="ta-container"
Oct 30 03:27:05.885662 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:05.885645    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:05.903346 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:05.903315    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"]
Oct 30 03:27:05.966262 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:05.966227    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2q7q\" (UniqueName: \"kubernetes.io/projected/96849bbb-d3ce-487f-875a-637c2f00a6bd-kube-api-access-j2q7q\") pod \"data-science-collector-targetallocator-7485bc46f4-4dvnr\" (UID: \"96849bbb-d3ce-487f-875a-637c2f00a6bd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:05.966262 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:05.966265    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/96849bbb-d3ce-487f-875a-637c2f00a6bd-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7485bc46f4-4dvnr\" (UID: \"96849bbb-d3ce-487f-875a-637c2f00a6bd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:05.966491 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:05.966368    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/96849bbb-d3ce-487f-875a-637c2f00a6bd-ta-internal\") pod \"data-science-collector-targetallocator-7485bc46f4-4dvnr\" (UID: \"96849bbb-d3ce-487f-875a-637c2f00a6bd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:06.067836 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.067801    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2q7q\" (UniqueName: \"kubernetes.io/projected/96849bbb-d3ce-487f-875a-637c2f00a6bd-kube-api-access-j2q7q\") pod \"data-science-collector-targetallocator-7485bc46f4-4dvnr\" (UID: \"96849bbb-d3ce-487f-875a-637c2f00a6bd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:06.068014 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.067844    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/96849bbb-d3ce-487f-875a-637c2f00a6bd-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7485bc46f4-4dvnr\" (UID: \"96849bbb-d3ce-487f-875a-637c2f00a6bd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:06.068014 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.067884    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/96849bbb-d3ce-487f-875a-637c2f00a6bd-ta-internal\") pod \"data-science-collector-targetallocator-7485bc46f4-4dvnr\" (UID: \"96849bbb-d3ce-487f-875a-637c2f00a6bd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:06.068612 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.068586    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/96849bbb-d3ce-487f-875a-637c2f00a6bd-ta-internal\") pod \"data-science-collector-targetallocator-7485bc46f4-4dvnr\" (UID: \"96849bbb-d3ce-487f-875a-637c2f00a6bd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:06.070518 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.070495    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/96849bbb-d3ce-487f-875a-637c2f00a6bd-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7485bc46f4-4dvnr\" (UID: \"96849bbb-d3ce-487f-875a-637c2f00a6bd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:06.087654 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.087636    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2q7q\" (UniqueName: \"kubernetes.io/projected/96849bbb-d3ce-487f-875a-637c2f00a6bd-kube-api-access-j2q7q\") pod \"data-science-collector-targetallocator-7485bc46f4-4dvnr\" (UID: \"96849bbb-d3ce-487f-875a-637c2f00a6bd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:06.197293 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.197260    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:06.491299 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.491252    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"]
Oct 30 03:27:06.493252 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:27:06.493223    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96849bbb_d3ce_487f_875a_637c2f00a6bd.slice/crio-1a107bbf5ddccd7c8b566c4550114e0ce888dc7d686fef12761a39bf96353646 WatchSource:0}: Error finding container 1a107bbf5ddccd7c8b566c4550114e0ce888dc7d686fef12761a39bf96353646: Status 404 returned error can't find the container with id 1a107bbf5ddccd7c8b566c4550114e0ce888dc7d686fef12761a39bf96353646
Oct 30 03:27:06.495373 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.495341    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:27:06.495459 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.495398    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:27:06.860273 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.860185    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr" event={"ID":"96849bbb-d3ce-487f-875a-637c2f00a6bd","Type":"ContainerStarted","Data":"75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd"}
Oct 30 03:27:06.860273 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.860231    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr" event={"ID":"96849bbb-d3ce-487f-875a-637c2f00a6bd","Type":"ContainerStarted","Data":"1a107bbf5ddccd7c8b566c4550114e0ce888dc7d686fef12761a39bf96353646"}
Oct 30 03:27:06.860484 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.860414    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:06.861558 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.861533    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr" podUID="96849bbb-d3ce-487f-875a-637c2f00a6bd" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.44:8080/readyz\": dial tcp 10.134.0.44:8080: connect: connection refused"
Oct 30 03:27:06.901815 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:06.901755    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr" podStartSLOduration=1.901736556 podStartE2EDuration="1.901736556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:27:06.901224448 +0000 UTC m=+2666.743470893" watchObservedRunningTime="2026-10-30 03:27:06.901736556 +0000 UTC m=+2666.743983002"
Oct 30 03:27:07.865470 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:07.865443    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:27:07.933584 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:07.933555    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"]
Oct 30 03:27:07.934014 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:07.933745    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw" podUID="1aa0afd7-1185-4dd7-9114-7ad87f99646a" containerName="ta-container" containerID="cri-o://3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8" gracePeriod=30
Oct 30 03:27:08.177536 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.177511    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:27:08.289075 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.289047    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1aa0afd7-1185-4dd7-9114-7ad87f99646a-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1aa0afd7-1185-4dd7-9114-7ad87f99646a-data-science-collector-ta-server-cert\") pod \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\" (UID: \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\") "
Oct 30 03:27:08.289257 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.289160    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1aa0afd7-1185-4dd7-9114-7ad87f99646a-kube-api-access-w6q2p\" (UniqueName: \"kubernetes.io/projected/1aa0afd7-1185-4dd7-9114-7ad87f99646a-kube-api-access-w6q2p\") pod \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\" (UID: \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\") "
Oct 30 03:27:08.289257 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.289187    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1aa0afd7-1185-4dd7-9114-7ad87f99646a-ta-internal\" (UniqueName: \"kubernetes.io/configmap/1aa0afd7-1185-4dd7-9114-7ad87f99646a-ta-internal\") pod \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\" (UID: \"1aa0afd7-1185-4dd7-9114-7ad87f99646a\") "
Oct 30 03:27:08.289631 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.289600    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aa0afd7-1185-4dd7-9114-7ad87f99646a-ta-internal" pod "1aa0afd7-1185-4dd7-9114-7ad87f99646a" (UID: "1aa0afd7-1185-4dd7-9114-7ad87f99646a"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:27:08.291361 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.291332    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aa0afd7-1185-4dd7-9114-7ad87f99646a-kube-api-access-w6q2p" pod "1aa0afd7-1185-4dd7-9114-7ad87f99646a" (UID: "1aa0afd7-1185-4dd7-9114-7ad87f99646a"). InnerVolumeSpecName "kube-api-access-w6q2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:27:08.291435 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.291387    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aa0afd7-1185-4dd7-9114-7ad87f99646a-data-science-collector-ta-server-cert" pod "1aa0afd7-1185-4dd7-9114-7ad87f99646a" (UID: "1aa0afd7-1185-4dd7-9114-7ad87f99646a"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:27:08.390793 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.390751    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6q2p\" (UniqueName: \"kubernetes.io/projected/1aa0afd7-1185-4dd7-9114-7ad87f99646a-kube-api-access-w6q2p\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:27:08.390793 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.390784    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1aa0afd7-1185-4dd7-9114-7ad87f99646a-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:27:08.390793 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.390793    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1aa0afd7-1185-4dd7-9114-7ad87f99646a-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:27:08.869915 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.869881    5981 generic.go:356] "Generic (PLEG): container finished" podID="1aa0afd7-1185-4dd7-9114-7ad87f99646a" containerID="3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8" exitCode=0
Oct 30 03:27:08.870093 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.869923    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"
Oct 30 03:27:08.870093 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.869963    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw" event={"ID":"1aa0afd7-1185-4dd7-9114-7ad87f99646a","Type":"ContainerDied","Data":"3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8"}
Oct 30 03:27:08.870093 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.870002    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw" event={"ID":"1aa0afd7-1185-4dd7-9114-7ad87f99646a","Type":"ContainerDied","Data":"1f9006f18050ad109798dd02dc8417b96e410bf0256f1088aeb69883afd9d1aa"}
Oct 30 03:27:08.870093 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.870019    5981 scope.go:122] "RemoveContainer" containerID="3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8"
Oct 30 03:27:08.879053 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.879037    5981 scope.go:122] "RemoveContainer" containerID="3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8"
Oct 30 03:27:08.879334 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:27:08.879311    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8\": container with ID starting with 3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8 not found: ID does not exist" containerID="3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8"
Oct 30 03:27:08.879423 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.879340    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8"} err="failed to get container status \"3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8\": rpc error: code = NotFound desc = could not find container \"3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8\": container with ID starting with 3ebc4287acb0227e5fcf3457cf32577d49334908eeaa1548ca2e9c11272692d8 not found: ID does not exist"
Oct 30 03:27:08.922289 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.922263    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"]
Oct 30 03:27:08.935445 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:08.935417    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-5v7tw"]
Oct 30 03:27:10.279710 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:27:10.276470    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1aa0afd7-1185-4dd7-9114-7ad87f99646a" path="/var/lib/kubelet/pods/1aa0afd7-1185-4dd7-9114-7ad87f99646a/volumes"
Oct 30 03:27:14.369083 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:27:14.369041    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:27:44.368705 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:27:44.368667    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:28:14.369843 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:28:14.369804    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:28:39.681261 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.681223    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"]
Oct 30 03:28:39.681739 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.681587    5981 cpu_manager.go:414] "containerMap: removing container" podUID="1aa0afd7-1185-4dd7-9114-7ad87f99646a" containerName="ta-container"
Oct 30 03:28:39.681739 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.681599    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1aa0afd7-1185-4dd7-9114-7ad87f99646a" containerName="ta-container"
Oct 30 03:28:39.681739 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.681668    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="1aa0afd7-1185-4dd7-9114-7ad87f99646a" containerName="ta-container"
Oct 30 03:28:39.684636 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.684619    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:39.717081 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.717050    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"]
Oct 30 03:28:39.839438 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.839394    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1e50245d-b593-4e93-b81d-c06a7bf771ec-ta-internal\") pod \"data-science-collector-targetallocator-694cb6db4f-fdg4m\" (UID: \"1e50245d-b593-4e93-b81d-c06a7bf771ec\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:39.839438 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.839438    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkwpm\" (UniqueName: \"kubernetes.io/projected/1e50245d-b593-4e93-b81d-c06a7bf771ec-kube-api-access-mkwpm\") pod \"data-science-collector-targetallocator-694cb6db4f-fdg4m\" (UID: \"1e50245d-b593-4e93-b81d-c06a7bf771ec\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:39.839656 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.839552    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1e50245d-b593-4e93-b81d-c06a7bf771ec-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-694cb6db4f-fdg4m\" (UID: \"1e50245d-b593-4e93-b81d-c06a7bf771ec\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:39.940564 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.940466    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1e50245d-b593-4e93-b81d-c06a7bf771ec-ta-internal\") pod \"data-science-collector-targetallocator-694cb6db4f-fdg4m\" (UID: \"1e50245d-b593-4e93-b81d-c06a7bf771ec\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:39.940564 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.940507    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkwpm\" (UniqueName: \"kubernetes.io/projected/1e50245d-b593-4e93-b81d-c06a7bf771ec-kube-api-access-mkwpm\") pod \"data-science-collector-targetallocator-694cb6db4f-fdg4m\" (UID: \"1e50245d-b593-4e93-b81d-c06a7bf771ec\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:39.940794 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.940568    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1e50245d-b593-4e93-b81d-c06a7bf771ec-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-694cb6db4f-fdg4m\" (UID: \"1e50245d-b593-4e93-b81d-c06a7bf771ec\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:39.941190 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.941169    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1e50245d-b593-4e93-b81d-c06a7bf771ec-ta-internal\") pod \"data-science-collector-targetallocator-694cb6db4f-fdg4m\" (UID: \"1e50245d-b593-4e93-b81d-c06a7bf771ec\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:39.943195 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.943173    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1e50245d-b593-4e93-b81d-c06a7bf771ec-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-694cb6db4f-fdg4m\" (UID: \"1e50245d-b593-4e93-b81d-c06a7bf771ec\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:39.961673 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.961643    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkwpm\" (UniqueName: \"kubernetes.io/projected/1e50245d-b593-4e93-b81d-c06a7bf771ec-kube-api-access-mkwpm\") pod \"data-science-collector-targetallocator-694cb6db4f-fdg4m\" (UID: \"1e50245d-b593-4e93-b81d-c06a7bf771ec\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:39.996222 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:39.996201    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:40.305917 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:40.305893    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"]
Oct 30 03:28:40.308108 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:28:40.308082    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e50245d_b593_4e93_b81d_c06a7bf771ec.slice/crio-1060ca028970d565b803eca9bdfa026cf2badaf668115a785fae7ced19237aad WatchSource:0}: Error finding container 1060ca028970d565b803eca9bdfa026cf2badaf668115a785fae7ced19237aad: Status 404 returned error can't find the container with id 1060ca028970d565b803eca9bdfa026cf2badaf668115a785fae7ced19237aad
Oct 30 03:28:40.310274 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:40.310234    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:28:40.310367 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:40.310348    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:28:41.260016 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.259985    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m" event={"ID":"1e50245d-b593-4e93-b81d-c06a7bf771ec","Type":"ContainerStarted","Data":"4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c"}
Oct 30 03:28:41.260474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.260026    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m" event={"ID":"1e50245d-b593-4e93-b81d-c06a7bf771ec","Type":"ContainerStarted","Data":"1060ca028970d565b803eca9bdfa026cf2badaf668115a785fae7ced19237aad"}
Oct 30 03:28:41.260474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.260142    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:41.262016 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.261995    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:41.303887 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.303843    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m" podStartSLOduration=2.3038311 podStartE2EDuration="2.3038311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:28:41.303074942 +0000 UTC m=+2761.145321410" watchObservedRunningTime="2026-10-30 03:28:41.3038311 +0000 UTC m=+2761.146077541"
Oct 30 03:28:41.378270 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.378239    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"]
Oct 30 03:28:41.378538 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.378498    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr" podUID="96849bbb-d3ce-487f-875a-637c2f00a6bd" containerName="ta-container" containerID="cri-o://75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd" gracePeriod=30
Oct 30 03:28:41.626772 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.626749    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:28:41.753727 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.753699    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96849bbb-d3ce-487f-875a-637c2f00a6bd-kube-api-access-j2q7q\" (UniqueName: \"kubernetes.io/projected/96849bbb-d3ce-487f-875a-637c2f00a6bd-kube-api-access-j2q7q\") pod \"96849bbb-d3ce-487f-875a-637c2f00a6bd\" (UID: \"96849bbb-d3ce-487f-875a-637c2f00a6bd\") "
Oct 30 03:28:41.753884 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.753842    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96849bbb-d3ce-487f-875a-637c2f00a6bd-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/96849bbb-d3ce-487f-875a-637c2f00a6bd-data-science-collector-ta-server-cert\") pod \"96849bbb-d3ce-487f-875a-637c2f00a6bd\" (UID: \"96849bbb-d3ce-487f-875a-637c2f00a6bd\") "
Oct 30 03:28:41.753884 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.753872    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96849bbb-d3ce-487f-875a-637c2f00a6bd-ta-internal\" (UniqueName: \"kubernetes.io/configmap/96849bbb-d3ce-487f-875a-637c2f00a6bd-ta-internal\") pod \"96849bbb-d3ce-487f-875a-637c2f00a6bd\" (UID: \"96849bbb-d3ce-487f-875a-637c2f00a6bd\") "
Oct 30 03:28:41.754253 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.754229    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96849bbb-d3ce-487f-875a-637c2f00a6bd-ta-internal" pod "96849bbb-d3ce-487f-875a-637c2f00a6bd" (UID: "96849bbb-d3ce-487f-875a-637c2f00a6bd"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:28:41.755911 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.755892    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96849bbb-d3ce-487f-875a-637c2f00a6bd-kube-api-access-j2q7q" pod "96849bbb-d3ce-487f-875a-637c2f00a6bd" (UID: "96849bbb-d3ce-487f-875a-637c2f00a6bd"). InnerVolumeSpecName "kube-api-access-j2q7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:28:41.756033 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.756017    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96849bbb-d3ce-487f-875a-637c2f00a6bd-data-science-collector-ta-server-cert" pod "96849bbb-d3ce-487f-875a-637c2f00a6bd" (UID: "96849bbb-d3ce-487f-875a-637c2f00a6bd"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:28:41.855156 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.855094    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/96849bbb-d3ce-487f-875a-637c2f00a6bd-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:28:41.855156 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.855116    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/96849bbb-d3ce-487f-875a-637c2f00a6bd-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:28:41.855156 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:41.855126    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2q7q\" (UniqueName: \"kubernetes.io/projected/96849bbb-d3ce-487f-875a-637c2f00a6bd-kube-api-access-j2q7q\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:28:42.265106 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:42.265070    5981 generic.go:356] "Generic (PLEG): container finished" podID="96849bbb-d3ce-487f-875a-637c2f00a6bd" containerID="75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd" exitCode=0
Oct 30 03:28:42.265575 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:42.265130    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"
Oct 30 03:28:42.265575 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:42.265151    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr" event={"ID":"96849bbb-d3ce-487f-875a-637c2f00a6bd","Type":"ContainerDied","Data":"75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd"}
Oct 30 03:28:42.265575 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:42.265195    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr" event={"ID":"96849bbb-d3ce-487f-875a-637c2f00a6bd","Type":"ContainerDied","Data":"1a107bbf5ddccd7c8b566c4550114e0ce888dc7d686fef12761a39bf96353646"}
Oct 30 03:28:42.265575 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:42.265212    5981 scope.go:122] "RemoveContainer" containerID="75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd"
Oct 30 03:28:42.274241 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:42.274224    5981 scope.go:122] "RemoveContainer" containerID="75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd"
Oct 30 03:28:42.274565 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:28:42.274543    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd\": container with ID starting with 75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd not found: ID does not exist" containerID="75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd"
Oct 30 03:28:42.274643 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:42.274579    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd"} err="failed to get container status \"75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd\": rpc error: code = NotFound desc = could not find container \"75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd\": container with ID starting with 75bb1db362c3b610c9e537d7c27f95074511f1a2e0ea8cfb5d6efed4c7f250fd not found: ID does not exist"
Oct 30 03:28:42.317905 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:42.317881    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"]
Oct 30 03:28:42.330592 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:42.330571    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7485bc46f4-4dvnr"]
Oct 30 03:28:44.274798 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:44.274764    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96849bbb-d3ce-487f-875a-637c2f00a6bd" path="/var/lib/kubelet/pods/96849bbb-d3ce-487f-875a-637c2f00a6bd/volumes"
Oct 30 03:28:44.368837 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:28:44.368739    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:28:47.785335 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:47.785304    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"]
Oct 30 03:28:47.785737 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:47.785632    5981 cpu_manager.go:414] "containerMap: removing container" podUID="96849bbb-d3ce-487f-875a-637c2f00a6bd" containerName="ta-container"
Oct 30 03:28:47.785737 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:47.785643    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96849bbb-d3ce-487f-875a-637c2f00a6bd" containerName="ta-container"
Oct 30 03:28:47.785737 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:47.785712    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="96849bbb-d3ce-487f-875a-637c2f00a6bd" containerName="ta-container"
Oct 30 03:28:47.788604 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:47.788587    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:47.821748 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:47.821712    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"]
Oct 30 03:28:47.906741 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:47.906708    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3df010c8-8ec3-499c-a77f-50a101f1caaf-ta-internal\") pod \"data-science-collector-targetallocator-b9c5fcc88-l8vff\" (UID: \"3df010c8-8ec3-499c-a77f-50a101f1caaf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:47.906933 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:47.906755    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqglc\" (UniqueName: \"kubernetes.io/projected/3df010c8-8ec3-499c-a77f-50a101f1caaf-kube-api-access-bqglc\") pod \"data-science-collector-targetallocator-b9c5fcc88-l8vff\" (UID: \"3df010c8-8ec3-499c-a77f-50a101f1caaf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:47.906933 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:47.906792    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3df010c8-8ec3-499c-a77f-50a101f1caaf-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-b9c5fcc88-l8vff\" (UID: \"3df010c8-8ec3-499c-a77f-50a101f1caaf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:48.007332 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:48.007301    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3df010c8-8ec3-499c-a77f-50a101f1caaf-ta-internal\") pod \"data-science-collector-targetallocator-b9c5fcc88-l8vff\" (UID: \"3df010c8-8ec3-499c-a77f-50a101f1caaf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:48.007477 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:48.007342    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqglc\" (UniqueName: \"kubernetes.io/projected/3df010c8-8ec3-499c-a77f-50a101f1caaf-kube-api-access-bqglc\") pod \"data-science-collector-targetallocator-b9c5fcc88-l8vff\" (UID: \"3df010c8-8ec3-499c-a77f-50a101f1caaf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:48.007477 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:48.007379    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3df010c8-8ec3-499c-a77f-50a101f1caaf-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-b9c5fcc88-l8vff\" (UID: \"3df010c8-8ec3-499c-a77f-50a101f1caaf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:48.007992 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:48.007965    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3df010c8-8ec3-499c-a77f-50a101f1caaf-ta-internal\") pod \"data-science-collector-targetallocator-b9c5fcc88-l8vff\" (UID: \"3df010c8-8ec3-499c-a77f-50a101f1caaf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:48.009994 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:48.009967    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3df010c8-8ec3-499c-a77f-50a101f1caaf-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-b9c5fcc88-l8vff\" (UID: \"3df010c8-8ec3-499c-a77f-50a101f1caaf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:48.027452 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:48.027429    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqglc\" (UniqueName: \"kubernetes.io/projected/3df010c8-8ec3-499c-a77f-50a101f1caaf-kube-api-access-bqglc\") pod \"data-science-collector-targetallocator-b9c5fcc88-l8vff\" (UID: \"3df010c8-8ec3-499c-a77f-50a101f1caaf\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:48.099981 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:48.099911    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:48.394929 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:48.394894    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"]
Oct 30 03:28:48.396645 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:28:48.396614    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3df010c8_8ec3_499c_a77f_50a101f1caaf.slice/crio-b7ddea8103a01c582a64e102f85b39ef12789da0bbe2ece6a9f7ebeba421fa46 WatchSource:0}: Error finding container b7ddea8103a01c582a64e102f85b39ef12789da0bbe2ece6a9f7ebeba421fa46: Status 404 returned error can't find the container with id b7ddea8103a01c582a64e102f85b39ef12789da0bbe2ece6a9f7ebeba421fa46
Oct 30 03:28:48.401552 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:48.401518    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:28:48.401644 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:48.401580    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:28:49.296330 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.296267    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff" event={"ID":"3df010c8-8ec3-499c-a77f-50a101f1caaf","Type":"ContainerStarted","Data":"b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b"}
Oct 30 03:28:49.296330 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.296337    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff" event={"ID":"3df010c8-8ec3-499c-a77f-50a101f1caaf","Type":"ContainerStarted","Data":"b7ddea8103a01c582a64e102f85b39ef12789da0bbe2ece6a9f7ebeba421fa46"}
Oct 30 03:28:49.296873 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.296466    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:49.298367 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.298347    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:49.349105 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.349042    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff" podStartSLOduration=2.3490245229999998 podStartE2EDuration="2.349024523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:28:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:28:49.34834911 +0000 UTC m=+2769.190595556" watchObservedRunningTime="2026-10-30 03:28:49.349024523 +0000 UTC m=+2769.191270968"
Oct 30 03:28:49.426808 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.426772    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"]
Oct 30 03:28:49.427030 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.426998    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m" podUID="1e50245d-b593-4e93-b81d-c06a7bf771ec" containerName="ta-container" containerID="cri-o://4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c" gracePeriod=30
Oct 30 03:28:49.666311 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.666266    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:49.823447 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.823411    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e50245d-b593-4e93-b81d-c06a7bf771ec-kube-api-access-mkwpm\" (UniqueName: \"kubernetes.io/projected/1e50245d-b593-4e93-b81d-c06a7bf771ec-kube-api-access-mkwpm\") pod \"1e50245d-b593-4e93-b81d-c06a7bf771ec\" (UID: \"1e50245d-b593-4e93-b81d-c06a7bf771ec\") "
Oct 30 03:28:49.823603 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.823490    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1e50245d-b593-4e93-b81d-c06a7bf771ec-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1e50245d-b593-4e93-b81d-c06a7bf771ec-data-science-collector-ta-server-cert\") pod \"1e50245d-b593-4e93-b81d-c06a7bf771ec\" (UID: \"1e50245d-b593-4e93-b81d-c06a7bf771ec\") "
Oct 30 03:28:49.823603 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.823531    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e50245d-b593-4e93-b81d-c06a7bf771ec-ta-internal\" (UniqueName: \"kubernetes.io/configmap/1e50245d-b593-4e93-b81d-c06a7bf771ec-ta-internal\") pod \"1e50245d-b593-4e93-b81d-c06a7bf771ec\" (UID: \"1e50245d-b593-4e93-b81d-c06a7bf771ec\") "
Oct 30 03:28:49.823949 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.823914    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e50245d-b593-4e93-b81d-c06a7bf771ec-ta-internal" pod "1e50245d-b593-4e93-b81d-c06a7bf771ec" (UID: "1e50245d-b593-4e93-b81d-c06a7bf771ec"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:28:49.825629 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.825609    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e50245d-b593-4e93-b81d-c06a7bf771ec-data-science-collector-ta-server-cert" pod "1e50245d-b593-4e93-b81d-c06a7bf771ec" (UID: "1e50245d-b593-4e93-b81d-c06a7bf771ec"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:28:49.825757 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.825737    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e50245d-b593-4e93-b81d-c06a7bf771ec-kube-api-access-mkwpm" pod "1e50245d-b593-4e93-b81d-c06a7bf771ec" (UID: "1e50245d-b593-4e93-b81d-c06a7bf771ec"). InnerVolumeSpecName "kube-api-access-mkwpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:28:49.924479 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.924444    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1e50245d-b593-4e93-b81d-c06a7bf771ec-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:28:49.924479 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.924471    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkwpm\" (UniqueName: \"kubernetes.io/projected/1e50245d-b593-4e93-b81d-c06a7bf771ec-kube-api-access-mkwpm\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:28:49.924479 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:49.924485    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1e50245d-b593-4e93-b81d-c06a7bf771ec-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:28:50.301269 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:50.301240    5981 generic.go:356] "Generic (PLEG): container finished" podID="1e50245d-b593-4e93-b81d-c06a7bf771ec" containerID="4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c" exitCode=0
Oct 30 03:28:50.301662 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:50.301311    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"
Oct 30 03:28:50.301662 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:50.301312    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m" event={"ID":"1e50245d-b593-4e93-b81d-c06a7bf771ec","Type":"ContainerDied","Data":"4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c"}
Oct 30 03:28:50.301662 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:50.301409    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m" event={"ID":"1e50245d-b593-4e93-b81d-c06a7bf771ec","Type":"ContainerDied","Data":"1060ca028970d565b803eca9bdfa026cf2badaf668115a785fae7ced19237aad"}
Oct 30 03:28:50.301662 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:50.301426    5981 scope.go:122] "RemoveContainer" containerID="4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c"
Oct 30 03:28:50.309591 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:50.309568    5981 scope.go:122] "RemoveContainer" containerID="4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c"
Oct 30 03:28:50.309846 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:28:50.309828    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c\": container with ID starting with 4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c not found: ID does not exist" containerID="4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c"
Oct 30 03:28:50.309905 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:50.309860    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c"} err="failed to get container status \"4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c\": rpc error: code = NotFound desc = could not find container \"4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c\": container with ID starting with 4e4b2a39364e7b2e5820a7b94a409b0338247b27de7bfac24ae9ca3f0b53139c not found: ID does not exist"
Oct 30 03:28:50.353235 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:50.353209    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"]
Oct 30 03:28:50.359499 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:50.359478    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-694cb6db4f-fdg4m"]
Oct 30 03:28:52.274682 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:52.274646    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e50245d-b593-4e93-b81d-c06a7bf771ec" path="/var/lib/kubelet/pods/1e50245d-b593-4e93-b81d-c06a7bf771ec/volumes"
Oct 30 03:28:53.710746 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.710717    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"]
Oct 30 03:28:53.711157 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.711059    5981 cpu_manager.go:414] "containerMap: removing container" podUID="1e50245d-b593-4e93-b81d-c06a7bf771ec" containerName="ta-container"
Oct 30 03:28:53.711157 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.711071    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e50245d-b593-4e93-b81d-c06a7bf771ec" containerName="ta-container"
Oct 30 03:28:53.711233 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.711158    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e50245d-b593-4e93-b81d-c06a7bf771ec" containerName="ta-container"
Oct 30 03:28:53.715412 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.715395    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:53.730842 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.730822    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"]
Oct 30 03:28:53.861177 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.861146    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v44mg\" (UniqueName: \"kubernetes.io/projected/a2be361b-1be9-488e-b9a9-c4947fade83e-kube-api-access-v44mg\") pod \"data-science-collector-targetallocator-b654b758f-htbhd\" (UID: \"a2be361b-1be9-488e-b9a9-c4947fade83e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:53.861379 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.861190    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a2be361b-1be9-488e-b9a9-c4947fade83e-ta-internal\") pod \"data-science-collector-targetallocator-b654b758f-htbhd\" (UID: \"a2be361b-1be9-488e-b9a9-c4947fade83e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:53.861379 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.861209    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a2be361b-1be9-488e-b9a9-c4947fade83e-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-b654b758f-htbhd\" (UID: \"a2be361b-1be9-488e-b9a9-c4947fade83e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:53.962438 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.962353    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v44mg\" (UniqueName: \"kubernetes.io/projected/a2be361b-1be9-488e-b9a9-c4947fade83e-kube-api-access-v44mg\") pod \"data-science-collector-targetallocator-b654b758f-htbhd\" (UID: \"a2be361b-1be9-488e-b9a9-c4947fade83e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:53.962438 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.962397    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a2be361b-1be9-488e-b9a9-c4947fade83e-ta-internal\") pod \"data-science-collector-targetallocator-b654b758f-htbhd\" (UID: \"a2be361b-1be9-488e-b9a9-c4947fade83e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:53.962438 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.962417    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a2be361b-1be9-488e-b9a9-c4947fade83e-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-b654b758f-htbhd\" (UID: \"a2be361b-1be9-488e-b9a9-c4947fade83e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:53.963171 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.963147    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a2be361b-1be9-488e-b9a9-c4947fade83e-ta-internal\") pod \"data-science-collector-targetallocator-b654b758f-htbhd\" (UID: \"a2be361b-1be9-488e-b9a9-c4947fade83e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:53.965061 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.965034    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a2be361b-1be9-488e-b9a9-c4947fade83e-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-b654b758f-htbhd\" (UID: \"a2be361b-1be9-488e-b9a9-c4947fade83e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:53.982120 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:53.982096    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v44mg\" (UniqueName: \"kubernetes.io/projected/a2be361b-1be9-488e-b9a9-c4947fade83e-kube-api-access-v44mg\") pod \"data-science-collector-targetallocator-b654b758f-htbhd\" (UID: \"a2be361b-1be9-488e-b9a9-c4947fade83e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:54.026991 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:54.026967    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:54.318717 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:54.318675    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"]
Oct 30 03:28:54.320452 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:28:54.320427    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2be361b_1be9_488e_b9a9_c4947fade83e.slice/crio-c6c875a7841b9ffa031fff8fa18c56609736f9672ecc459adad1da260b3cddf1 WatchSource:0}: Error finding container c6c875a7841b9ffa031fff8fa18c56609736f9672ecc459adad1da260b3cddf1: Status 404 returned error can't find the container with id c6c875a7841b9ffa031fff8fa18c56609736f9672ecc459adad1da260b3cddf1
Oct 30 03:28:54.322486 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:54.322452    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:28:54.322588 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:54.322518    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:28:55.329030 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.328987    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd" event={"ID":"a2be361b-1be9-488e-b9a9-c4947fade83e","Type":"ContainerStarted","Data":"493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad"}
Oct 30 03:28:55.329578 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.329042    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:55.329578 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.329060    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd" event={"ID":"a2be361b-1be9-488e-b9a9-c4947fade83e","Type":"ContainerStarted","Data":"c6c875a7841b9ffa031fff8fa18c56609736f9672ecc459adad1da260b3cddf1"}
Oct 30 03:28:55.330929 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.330897    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:28:55.371230 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.371183    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd" podStartSLOduration=2.371167313 podStartE2EDuration="2.371167313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:28:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:28:55.370265162 +0000 UTC m=+2775.212511606" watchObservedRunningTime="2026-10-30 03:28:55.371167313 +0000 UTC m=+2775.213413769"
Oct 30 03:28:55.442006 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.441977    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"]
Oct 30 03:28:55.442191 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.442169    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff" podUID="3df010c8-8ec3-499c-a77f-50a101f1caaf" containerName="ta-container" containerID="cri-o://b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b" gracePeriod=30
Oct 30 03:28:55.685578 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.685554    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:55.779931 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.779903    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3df010c8-8ec3-499c-a77f-50a101f1caaf-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3df010c8-8ec3-499c-a77f-50a101f1caaf-data-science-collector-ta-server-cert\") pod \"3df010c8-8ec3-499c-a77f-50a101f1caaf\" (UID: \"3df010c8-8ec3-499c-a77f-50a101f1caaf\") "
Oct 30 03:28:55.779931 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.779944    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3df010c8-8ec3-499c-a77f-50a101f1caaf-ta-internal\" (UniqueName: \"kubernetes.io/configmap/3df010c8-8ec3-499c-a77f-50a101f1caaf-ta-internal\") pod \"3df010c8-8ec3-499c-a77f-50a101f1caaf\" (UID: \"3df010c8-8ec3-499c-a77f-50a101f1caaf\") "
Oct 30 03:28:55.780349 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.780325    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3df010c8-8ec3-499c-a77f-50a101f1caaf-ta-internal" pod "3df010c8-8ec3-499c-a77f-50a101f1caaf" (UID: "3df010c8-8ec3-499c-a77f-50a101f1caaf"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:28:55.782156 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.782129    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3df010c8-8ec3-499c-a77f-50a101f1caaf-data-science-collector-ta-server-cert" pod "3df010c8-8ec3-499c-a77f-50a101f1caaf" (UID: "3df010c8-8ec3-499c-a77f-50a101f1caaf"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:28:55.880503 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.880426    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3df010c8-8ec3-499c-a77f-50a101f1caaf-kube-api-access-bqglc\" (UniqueName: \"kubernetes.io/projected/3df010c8-8ec3-499c-a77f-50a101f1caaf-kube-api-access-bqglc\") pod \"3df010c8-8ec3-499c-a77f-50a101f1caaf\" (UID: \"3df010c8-8ec3-499c-a77f-50a101f1caaf\") "
Oct 30 03:28:55.880633 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.880608    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3df010c8-8ec3-499c-a77f-50a101f1caaf-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:28:55.880633 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.880620    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3df010c8-8ec3-499c-a77f-50a101f1caaf-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:28:55.882626 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.882601    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3df010c8-8ec3-499c-a77f-50a101f1caaf-kube-api-access-bqglc" pod "3df010c8-8ec3-499c-a77f-50a101f1caaf" (UID: "3df010c8-8ec3-499c-a77f-50a101f1caaf"). InnerVolumeSpecName "kube-api-access-bqglc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:28:55.981884 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:55.981856    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqglc\" (UniqueName: \"kubernetes.io/projected/3df010c8-8ec3-499c-a77f-50a101f1caaf-kube-api-access-bqglc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:28:56.334654 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:56.334617    5981 generic.go:356] "Generic (PLEG): container finished" podID="3df010c8-8ec3-499c-a77f-50a101f1caaf" containerID="b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b" exitCode=0
Oct 30 03:28:56.335086 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:56.334660    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"
Oct 30 03:28:56.335086 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:56.334706    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff" event={"ID":"3df010c8-8ec3-499c-a77f-50a101f1caaf","Type":"ContainerDied","Data":"b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b"}
Oct 30 03:28:56.335086 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:56.334757    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff" event={"ID":"3df010c8-8ec3-499c-a77f-50a101f1caaf","Type":"ContainerDied","Data":"b7ddea8103a01c582a64e102f85b39ef12789da0bbe2ece6a9f7ebeba421fa46"}
Oct 30 03:28:56.335086 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:56.334782    5981 scope.go:122] "RemoveContainer" containerID="b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b"
Oct 30 03:28:56.342994 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:56.342971    5981 scope.go:122] "RemoveContainer" containerID="b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b"
Oct 30 03:28:56.343271 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:28:56.343253    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b\": container with ID starting with b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b not found: ID does not exist" containerID="b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b"
Oct 30 03:28:56.343339 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:56.343304    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b"} err="failed to get container status \"b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b\": rpc error: code = NotFound desc = could not find container \"b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b\": container with ID starting with b393a6e119e536598e57c8dbc5be41ee4e3b3b7f6b7c9de530ba59a0de3cc51b not found: ID does not exist"
Oct 30 03:28:56.385754 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:56.385728    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"]
Oct 30 03:28:56.398483 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:56.398459    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b9c5fcc88-l8vff"]
Oct 30 03:28:58.274882 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:28:58.274849    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3df010c8-8ec3-499c-a77f-50a101f1caaf" path="/var/lib/kubelet/pods/3df010c8-8ec3-499c-a77f-50a101f1caaf/volumes"
Oct 30 03:29:06.364656 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.364627    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"]
Oct 30 03:29:06.365125 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.365108    5981 cpu_manager.go:414] "containerMap: removing container" podUID="3df010c8-8ec3-499c-a77f-50a101f1caaf" containerName="ta-container"
Oct 30 03:29:06.365193 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.365127    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3df010c8-8ec3-499c-a77f-50a101f1caaf" containerName="ta-container"
Oct 30 03:29:06.365262 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.365246    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="3df010c8-8ec3-499c-a77f-50a101f1caaf" containerName="ta-container"
Oct 30 03:29:06.369414 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.369393    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:06.386382 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.386357    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"]
Oct 30 03:29:06.468076 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.468043    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxz7b\" (UniqueName: \"kubernetes.io/projected/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-kube-api-access-bxz7b\") pod \"data-science-collector-targetallocator-7c79bbbc47-kfj47\" (UID: \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:06.468243 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.468095    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-ta-internal\") pod \"data-science-collector-targetallocator-7c79bbbc47-kfj47\" (UID: \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:06.468243 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.468203    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7c79bbbc47-kfj47\" (UID: \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:06.541028 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.540992    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"]
Oct 30 03:29:06.541267 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:29:06.541242    5981 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[data-science-collector-ta-server-cert kube-api-access-bxz7b ta-internal], unattached volumes=[], failed to process volumes=[]: context canceled" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47" podUID="5593d69a-5695-4a85-99b5-d2bf2fdbbe52"
Oct 30 03:29:06.569464 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.569434    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxz7b\" (UniqueName: \"kubernetes.io/projected/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-kube-api-access-bxz7b\") pod \"data-science-collector-targetallocator-7c79bbbc47-kfj47\" (UID: \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:06.569566 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.569522    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-ta-internal\") pod \"data-science-collector-targetallocator-7c79bbbc47-kfj47\" (UID: \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:06.569632 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.569577    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7c79bbbc47-kfj47\" (UID: \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:06.570312 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.570258    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-ta-internal\") pod \"data-science-collector-targetallocator-7c79bbbc47-kfj47\" (UID: \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:06.572356 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.572331    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7c79bbbc47-kfj47\" (UID: \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:06.584080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.584053    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"]
Oct 30 03:29:06.587461 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.587438    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:06.594118 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.594093    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxz7b\" (UniqueName: \"kubernetes.io/projected/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-kube-api-access-bxz7b\") pod \"data-science-collector-targetallocator-7c79bbbc47-kfj47\" (UID: \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:06.606377 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.606354    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"]
Oct 30 03:29:06.670698 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.670663    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9nj8\" (UniqueName: \"kubernetes.io/projected/90a55576-5ce2-4ae1-a54a-8ebac17d776f-kube-api-access-l9nj8\") pod \"data-science-collector-targetallocator-5bb59d5f4b-zfr8z\" (UID: \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:06.670863 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.670772    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/90a55576-5ce2-4ae1-a54a-8ebac17d776f-ta-internal\") pod \"data-science-collector-targetallocator-5bb59d5f4b-zfr8z\" (UID: \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:06.670863 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.670813    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/90a55576-5ce2-4ae1-a54a-8ebac17d776f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bb59d5f4b-zfr8z\" (UID: \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:06.771431 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.771392    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9nj8\" (UniqueName: \"kubernetes.io/projected/90a55576-5ce2-4ae1-a54a-8ebac17d776f-kube-api-access-l9nj8\") pod \"data-science-collector-targetallocator-5bb59d5f4b-zfr8z\" (UID: \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:06.771581 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.771443    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/90a55576-5ce2-4ae1-a54a-8ebac17d776f-ta-internal\") pod \"data-science-collector-targetallocator-5bb59d5f4b-zfr8z\" (UID: \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:06.771581 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.771466    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/90a55576-5ce2-4ae1-a54a-8ebac17d776f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bb59d5f4b-zfr8z\" (UID: \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:06.772094 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.772073    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/90a55576-5ce2-4ae1-a54a-8ebac17d776f-ta-internal\") pod \"data-science-collector-targetallocator-5bb59d5f4b-zfr8z\" (UID: \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:06.774050 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.774016    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/90a55576-5ce2-4ae1-a54a-8ebac17d776f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bb59d5f4b-zfr8z\" (UID: \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:06.791753 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.791724    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9nj8\" (UniqueName: \"kubernetes.io/projected/90a55576-5ce2-4ae1-a54a-8ebac17d776f-kube-api-access-l9nj8\") pod \"data-science-collector-targetallocator-5bb59d5f4b-zfr8z\" (UID: \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:06.907097 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:06.907060    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:07.197142 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.197108    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"]
Oct 30 03:29:07.199235 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:29:07.199208    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90a55576_5ce2_4ae1_a54a_8ebac17d776f.slice/crio-4dfd8818f4c5f7a7dc8acd57e0786f115dc697ec5c9ac450745a119bcc9843f8 WatchSource:0}: Error finding container 4dfd8818f4c5f7a7dc8acd57e0786f115dc697ec5c9ac450745a119bcc9843f8: Status 404 returned error can't find the container with id 4dfd8818f4c5f7a7dc8acd57e0786f115dc697ec5c9ac450745a119bcc9843f8
Oct 30 03:29:07.201338 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.201273    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:29:07.201419 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.201366    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:29:07.384983 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.384934    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z" event={"ID":"90a55576-5ce2-4ae1-a54a-8ebac17d776f","Type":"ContainerStarted","Data":"6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad"}
Oct 30 03:29:07.385427 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.384994    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:07.385427 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.385019    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:07.385427 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.385054    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z" event={"ID":"90a55576-5ce2-4ae1-a54a-8ebac17d776f","Type":"ContainerStarted","Data":"4dfd8818f4c5f7a7dc8acd57e0786f115dc697ec5c9ac450745a119bcc9843f8"}
Oct 30 03:29:07.386139 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.386114    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z" podUID="90a55576-5ce2-4ae1-a54a-8ebac17d776f" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.49:8080/readyz\": dial tcp 10.134.0.49:8080: connect: connection refused"
Oct 30 03:29:07.391768 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.391745    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:07.425998 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.425950    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z" podStartSLOduration=1.425937319 podStartE2EDuration="1.425937319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:29:07.424457575 +0000 UTC m=+2787.266704020" watchObservedRunningTime="2026-10-30 03:29:07.425937319 +0000 UTC m=+2787.268183758"
Oct 30 03:29:07.477155 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.477074    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-ta-internal\" (UniqueName: \"kubernetes.io/configmap/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-ta-internal\") pod \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\" (UID: \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\") "
Oct 30 03:29:07.477155 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.477143    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-kube-api-access-bxz7b\" (UniqueName: \"kubernetes.io/projected/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-kube-api-access-bxz7b\") pod \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\" (UID: \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\") "
Oct 30 03:29:07.477373 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.477196    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-data-science-collector-ta-server-cert\") pod \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\" (UID: \"5593d69a-5695-4a85-99b5-d2bf2fdbbe52\") "
Oct 30 03:29:07.477501 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.477474    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-ta-internal" pod "5593d69a-5695-4a85-99b5-d2bf2fdbbe52" (UID: "5593d69a-5695-4a85-99b5-d2bf2fdbbe52"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:29:07.479541 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.479515    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-kube-api-access-bxz7b" pod "5593d69a-5695-4a85-99b5-d2bf2fdbbe52" (UID: "5593d69a-5695-4a85-99b5-d2bf2fdbbe52"). InnerVolumeSpecName "kube-api-access-bxz7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:29:07.479541 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.479537    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-data-science-collector-ta-server-cert" pod "5593d69a-5695-4a85-99b5-d2bf2fdbbe52" (UID: "5593d69a-5695-4a85-99b5-d2bf2fdbbe52"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:29:07.578765 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.578720    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:29:07.578765 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.578756    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxz7b\" (UniqueName: \"kubernetes.io/projected/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-kube-api-access-bxz7b\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:29:07.578765 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:07.578769    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5593d69a-5695-4a85-99b5-d2bf2fdbbe52-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:29:08.388872 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.388839    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"
Oct 30 03:29:08.390173 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.390148    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:29:08.473542 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.473510    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"]
Oct 30 03:29:08.473738 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.473722    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd" podUID="a2be361b-1be9-488e-b9a9-c4947fade83e" containerName="ta-container" containerID="cri-o://493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad" gracePeriod=30
Oct 30 03:29:08.516312 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.516257    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"]
Oct 30 03:29:08.520257 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.520232    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c79bbbc47-kfj47"]
Oct 30 03:29:08.716172 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.716147    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:29:08.790898 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.790869    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a2be361b-1be9-488e-b9a9-c4947fade83e-kube-api-access-v44mg\" (UniqueName: \"kubernetes.io/projected/a2be361b-1be9-488e-b9a9-c4947fade83e-kube-api-access-v44mg\") pod \"a2be361b-1be9-488e-b9a9-c4947fade83e\" (UID: \"a2be361b-1be9-488e-b9a9-c4947fade83e\") "
Oct 30 03:29:08.791071 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.790937    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a2be361b-1be9-488e-b9a9-c4947fade83e-ta-internal\" (UniqueName: \"kubernetes.io/configmap/a2be361b-1be9-488e-b9a9-c4947fade83e-ta-internal\") pod \"a2be361b-1be9-488e-b9a9-c4947fade83e\" (UID: \"a2be361b-1be9-488e-b9a9-c4947fade83e\") "
Oct 30 03:29:08.791071 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.790986    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a2be361b-1be9-488e-b9a9-c4947fade83e-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a2be361b-1be9-488e-b9a9-c4947fade83e-data-science-collector-ta-server-cert\") pod \"a2be361b-1be9-488e-b9a9-c4947fade83e\" (UID: \"a2be361b-1be9-488e-b9a9-c4947fade83e\") "
Oct 30 03:29:08.791361 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.791338    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2be361b-1be9-488e-b9a9-c4947fade83e-ta-internal" pod "a2be361b-1be9-488e-b9a9-c4947fade83e" (UID: "a2be361b-1be9-488e-b9a9-c4947fade83e"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:29:08.793069 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.793046    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2be361b-1be9-488e-b9a9-c4947fade83e-data-science-collector-ta-server-cert" pod "a2be361b-1be9-488e-b9a9-c4947fade83e" (UID: "a2be361b-1be9-488e-b9a9-c4947fade83e"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:29:08.793157 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.793127    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2be361b-1be9-488e-b9a9-c4947fade83e-kube-api-access-v44mg" pod "a2be361b-1be9-488e-b9a9-c4947fade83e" (UID: "a2be361b-1be9-488e-b9a9-c4947fade83e"). InnerVolumeSpecName "kube-api-access-v44mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:29:08.892624 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.892551    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v44mg\" (UniqueName: \"kubernetes.io/projected/a2be361b-1be9-488e-b9a9-c4947fade83e-kube-api-access-v44mg\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:29:08.892624 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.892577    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a2be361b-1be9-488e-b9a9-c4947fade83e-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:29:08.892624 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:08.892587    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a2be361b-1be9-488e-b9a9-c4947fade83e-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:29:09.395137 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:09.395088    5981 generic.go:356] "Generic (PLEG): container finished" podID="a2be361b-1be9-488e-b9a9-c4947fade83e" containerID="493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad" exitCode=0
Oct 30 03:29:09.395137 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:09.395137    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"
Oct 30 03:29:09.395714 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:09.395171    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd" event={"ID":"a2be361b-1be9-488e-b9a9-c4947fade83e","Type":"ContainerDied","Data":"493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad"}
Oct 30 03:29:09.395714 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:09.395217    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd" event={"ID":"a2be361b-1be9-488e-b9a9-c4947fade83e","Type":"ContainerDied","Data":"c6c875a7841b9ffa031fff8fa18c56609736f9672ecc459adad1da260b3cddf1"}
Oct 30 03:29:09.395714 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:09.395234    5981 scope.go:122] "RemoveContainer" containerID="493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad"
Oct 30 03:29:09.404413 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:09.404399    5981 scope.go:122] "RemoveContainer" containerID="493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad"
Oct 30 03:29:09.404675 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:29:09.404660    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad\": container with ID starting with 493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad not found: ID does not exist" containerID="493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad"
Oct 30 03:29:09.404718 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:09.404685    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad"} err="failed to get container status \"493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad\": rpc error: code = NotFound desc = could not find container \"493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad\": container with ID starting with 493a8e2e16556122da81e35a175a3034753994fda7d89d43bb278800cf1398ad not found: ID does not exist"
Oct 30 03:29:09.448440 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:09.448410    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"]
Oct 30 03:29:09.459830 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:09.459796    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-b654b758f-htbhd"]
Oct 30 03:29:10.274390 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:10.274360    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5593d69a-5695-4a85-99b5-d2bf2fdbbe52" path="/var/lib/kubelet/pods/5593d69a-5695-4a85-99b5-d2bf2fdbbe52/volumes"
Oct 30 03:29:10.274637 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:29:10.274625    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a2be361b-1be9-488e-b9a9-c4947fade83e" path="/var/lib/kubelet/pods/a2be361b-1be9-488e-b9a9-c4947fade83e/volumes"
Oct 30 03:29:14.369098 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:29:14.369060    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:29:44.368220 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:29:44.368181    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:30:14.369896 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:30:14.369861    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:30:44.368731 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:30:44.368697    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:31:14.368717 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:31:14.368633    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:31:28.381450 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.376566    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"]
Oct 30 03:31:28.381450 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.377317    5981 cpu_manager.go:414] "containerMap: removing container" podUID="a2be361b-1be9-488e-b9a9-c4947fade83e" containerName="ta-container"
Oct 30 03:31:28.381450 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.377337    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a2be361b-1be9-488e-b9a9-c4947fade83e" containerName="ta-container"
Oct 30 03:31:28.381450 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.377544    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="a2be361b-1be9-488e-b9a9-c4947fade83e" containerName="ta-container"
Oct 30 03:31:28.382104 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.381743    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:28.397177 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.397151    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"]
Oct 30 03:31:28.518739 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.518700    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9h9p\" (UniqueName: \"kubernetes.io/projected/2e42b8ab-1955-42eb-be96-6c7cf03023d4-kube-api-access-t9h9p\") pod \"data-science-collector-targetallocator-5fdc5b75b4-qrt5g\" (UID: \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:28.518910 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.518747    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2e42b8ab-1955-42eb-be96-6c7cf03023d4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5fdc5b75b4-qrt5g\" (UID: \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:28.518910 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.518831    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2e42b8ab-1955-42eb-be96-6c7cf03023d4-ta-internal\") pod \"data-science-collector-targetallocator-5fdc5b75b4-qrt5g\" (UID: \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:28.536838 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.536799    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"]
Oct 30 03:31:28.537062 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:31:28.537040    5981 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[data-science-collector-ta-server-cert kube-api-access-t9h9p ta-internal], unattached volumes=[], failed to process volumes=[]: context canceled" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g" podUID="2e42b8ab-1955-42eb-be96-6c7cf03023d4"
Oct 30 03:31:28.590256 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.590223    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"]
Oct 30 03:31:28.593481 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.593459    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:28.614377 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.614354    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"]
Oct 30 03:31:28.620792 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.620762    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9h9p\" (UniqueName: \"kubernetes.io/projected/2e42b8ab-1955-42eb-be96-6c7cf03023d4-kube-api-access-t9h9p\") pod \"data-science-collector-targetallocator-5fdc5b75b4-qrt5g\" (UID: \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:28.620920 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.620827    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2e42b8ab-1955-42eb-be96-6c7cf03023d4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5fdc5b75b4-qrt5g\" (UID: \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:28.620920 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.620873    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2e42b8ab-1955-42eb-be96-6c7cf03023d4-ta-internal\") pod \"data-science-collector-targetallocator-5fdc5b75b4-qrt5g\" (UID: \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:28.621687 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.621662    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2e42b8ab-1955-42eb-be96-6c7cf03023d4-ta-internal\") pod \"data-science-collector-targetallocator-5fdc5b75b4-qrt5g\" (UID: \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:28.623591 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.623564    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2e42b8ab-1955-42eb-be96-6c7cf03023d4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5fdc5b75b4-qrt5g\" (UID: \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:28.641883 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.641831    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9h9p\" (UniqueName: \"kubernetes.io/projected/2e42b8ab-1955-42eb-be96-6c7cf03023d4-kube-api-access-t9h9p\") pod \"data-science-collector-targetallocator-5fdc5b75b4-qrt5g\" (UID: \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:28.721743 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.721710    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-ta-internal\") pod \"data-science-collector-targetallocator-65488b45b8-q5ntl\" (UID: \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:28.721860 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.721843    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhwbt\" (UniqueName: \"kubernetes.io/projected/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-kube-api-access-vhwbt\") pod \"data-science-collector-targetallocator-65488b45b8-q5ntl\" (UID: \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:28.721915 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.721892    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-65488b45b8-q5ntl\" (UID: \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:28.823181 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.823147    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-65488b45b8-q5ntl\" (UID: \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:28.823357 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.823198    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-ta-internal\") pod \"data-science-collector-targetallocator-65488b45b8-q5ntl\" (UID: \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:28.823357 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.823253    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhwbt\" (UniqueName: \"kubernetes.io/projected/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-kube-api-access-vhwbt\") pod \"data-science-collector-targetallocator-65488b45b8-q5ntl\" (UID: \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:28.823925 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.823902    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-ta-internal\") pod \"data-science-collector-targetallocator-65488b45b8-q5ntl\" (UID: \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:28.825836 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.825817    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-65488b45b8-q5ntl\" (UID: \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:28.843881 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.843853    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhwbt\" (UniqueName: \"kubernetes.io/projected/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-kube-api-access-vhwbt\") pod \"data-science-collector-targetallocator-65488b45b8-q5ntl\" (UID: \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:28.904882 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.904851    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:28.986435 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.986410    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:28.993768 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:28.993746    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:29.125678 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.125636    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e42b8ab-1955-42eb-be96-6c7cf03023d4-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2e42b8ab-1955-42eb-be96-6c7cf03023d4-data-science-collector-ta-server-cert\") pod \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\" (UID: \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\") "
Oct 30 03:31:29.125880 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.125727    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e42b8ab-1955-42eb-be96-6c7cf03023d4-ta-internal\" (UniqueName: \"kubernetes.io/configmap/2e42b8ab-1955-42eb-be96-6c7cf03023d4-ta-internal\") pod \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\" (UID: \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\") "
Oct 30 03:31:29.125880 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.125783    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e42b8ab-1955-42eb-be96-6c7cf03023d4-kube-api-access-t9h9p\" (UniqueName: \"kubernetes.io/projected/2e42b8ab-1955-42eb-be96-6c7cf03023d4-kube-api-access-t9h9p\") pod \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\" (UID: \"2e42b8ab-1955-42eb-be96-6c7cf03023d4\") "
Oct 30 03:31:29.126103 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.126077    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e42b8ab-1955-42eb-be96-6c7cf03023d4-ta-internal" pod "2e42b8ab-1955-42eb-be96-6c7cf03023d4" (UID: "2e42b8ab-1955-42eb-be96-6c7cf03023d4"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:31:29.128045 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.128019    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e42b8ab-1955-42eb-be96-6c7cf03023d4-data-science-collector-ta-server-cert" pod "2e42b8ab-1955-42eb-be96-6c7cf03023d4" (UID: "2e42b8ab-1955-42eb-be96-6c7cf03023d4"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:31:29.128045 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.128041    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e42b8ab-1955-42eb-be96-6c7cf03023d4-kube-api-access-t9h9p" pod "2e42b8ab-1955-42eb-be96-6c7cf03023d4" (UID: "2e42b8ab-1955-42eb-be96-6c7cf03023d4"). InnerVolumeSpecName "kube-api-access-t9h9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:31:29.197494 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.197466    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"]
Oct 30 03:31:29.199960 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:31:29.199926    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd60bd95_a9a1_42ec_b6a0_0020c027ecd4.slice/crio-4d5a144f7df33c849012c56d52c5e7f5405ef61e16602cb411d0c511a68af49c WatchSource:0}: Error finding container 4d5a144f7df33c849012c56d52c5e7f5405ef61e16602cb411d0c511a68af49c: Status 404 returned error can't find the container with id 4d5a144f7df33c849012c56d52c5e7f5405ef61e16602cb411d0c511a68af49c
Oct 30 03:31:29.202059 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.202026    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:31:29.202139 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.202082    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:31:29.226779 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.226756    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9h9p\" (UniqueName: \"kubernetes.io/projected/2e42b8ab-1955-42eb-be96-6c7cf03023d4-kube-api-access-t9h9p\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:29.226859 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.226781    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2e42b8ab-1955-42eb-be96-6c7cf03023d4-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:29.226859 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.226792    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2e42b8ab-1955-42eb-be96-6c7cf03023d4-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:29.992673 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.992629    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl" event={"ID":"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4","Type":"ContainerStarted","Data":"933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809"}
Oct 30 03:31:29.992673 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.992672    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl" event={"ID":"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4","Type":"ContainerStarted","Data":"4d5a144f7df33c849012c56d52c5e7f5405ef61e16602cb411d0c511a68af49c"}
Oct 30 03:31:29.993176 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.992696    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:29.993176 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.992785    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"
Oct 30 03:31:29.994250 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:29.994229    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:30.032476 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.032423    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl" podStartSLOduration=2.032410117 podStartE2EDuration="2.032410117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:31:30.032258606 +0000 UTC m=+2929.874505034" watchObservedRunningTime="2026-10-30 03:31:30.032410117 +0000 UTC m=+2929.874656561"
Oct 30 03:31:30.092009 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.091983    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"]
Oct 30 03:31:30.095851 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.095820    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5fdc5b75b4-qrt5g"]
Oct 30 03:31:30.162225 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.162196    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"]
Oct 30 03:31:30.162446 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.162421    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z" podUID="90a55576-5ce2-4ae1-a54a-8ebac17d776f" containerName="ta-container" containerID="cri-o://6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad" gracePeriod=30
Oct 30 03:31:30.274549 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.274484    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e42b8ab-1955-42eb-be96-6c7cf03023d4" path="/var/lib/kubelet/pods/2e42b8ab-1955-42eb-be96-6c7cf03023d4/volumes"
Oct 30 03:31:30.410336 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.410311    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:31:30.536785 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.536711    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90a55576-5ce2-4ae1-a54a-8ebac17d776f-kube-api-access-l9nj8\" (UniqueName: \"kubernetes.io/projected/90a55576-5ce2-4ae1-a54a-8ebac17d776f-kube-api-access-l9nj8\") pod \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\" (UID: \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\") "
Oct 30 03:31:30.536785 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.536780    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/90a55576-5ce2-4ae1-a54a-8ebac17d776f-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/90a55576-5ce2-4ae1-a54a-8ebac17d776f-data-science-collector-ta-server-cert\") pod \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\" (UID: \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\") "
Oct 30 03:31:30.537001 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.536872    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/90a55576-5ce2-4ae1-a54a-8ebac17d776f-ta-internal\" (UniqueName: \"kubernetes.io/configmap/90a55576-5ce2-4ae1-a54a-8ebac17d776f-ta-internal\") pod \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\" (UID: \"90a55576-5ce2-4ae1-a54a-8ebac17d776f\") "
Oct 30 03:31:30.537254 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.537230    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90a55576-5ce2-4ae1-a54a-8ebac17d776f-ta-internal" pod "90a55576-5ce2-4ae1-a54a-8ebac17d776f" (UID: "90a55576-5ce2-4ae1-a54a-8ebac17d776f"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:31:30.539022 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.539002    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a55576-5ce2-4ae1-a54a-8ebac17d776f-kube-api-access-l9nj8" pod "90a55576-5ce2-4ae1-a54a-8ebac17d776f" (UID: "90a55576-5ce2-4ae1-a54a-8ebac17d776f"). InnerVolumeSpecName "kube-api-access-l9nj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:31:30.539092 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.539036    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90a55576-5ce2-4ae1-a54a-8ebac17d776f-data-science-collector-ta-server-cert" pod "90a55576-5ce2-4ae1-a54a-8ebac17d776f" (UID: "90a55576-5ce2-4ae1-a54a-8ebac17d776f"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:31:30.638233 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.638203    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9nj8\" (UniqueName: \"kubernetes.io/projected/90a55576-5ce2-4ae1-a54a-8ebac17d776f-kube-api-access-l9nj8\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:30.638233 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.638232    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/90a55576-5ce2-4ae1-a54a-8ebac17d776f-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:30.638403 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.638243    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/90a55576-5ce2-4ae1-a54a-8ebac17d776f-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:30.997734 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.997697    5981 generic.go:356] "Generic (PLEG): container finished" podID="90a55576-5ce2-4ae1-a54a-8ebac17d776f" containerID="6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad" exitCode=0
Oct 30 03:31:30.998223 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.997744    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"
Oct 30 03:31:30.998223 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.997777    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z" event={"ID":"90a55576-5ce2-4ae1-a54a-8ebac17d776f","Type":"ContainerDied","Data":"6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad"}
Oct 30 03:31:30.998223 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.997816    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z" event={"ID":"90a55576-5ce2-4ae1-a54a-8ebac17d776f","Type":"ContainerDied","Data":"4dfd8818f4c5f7a7dc8acd57e0786f115dc697ec5c9ac450745a119bcc9843f8"}
Oct 30 03:31:30.998223 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:30.997833    5981 scope.go:122] "RemoveContainer" containerID="6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad"
Oct 30 03:31:31.009084 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:31.009065    5981 scope.go:122] "RemoveContainer" containerID="6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad"
Oct 30 03:31:31.009385 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:31:31.009367    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad\": container with ID starting with 6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad not found: ID does not exist" containerID="6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad"
Oct 30 03:31:31.009445 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:31.009394    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad"} err="failed to get container status \"6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad\": rpc error: code = NotFound desc = could not find container \"6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad\": container with ID starting with 6e23c03d4e6980986b0258814c0f8480f3901ea25087bda043266c036fa017ad not found: ID does not exist"
Oct 30 03:31:31.054981 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:31.054957    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"]
Oct 30 03:31:31.067952 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:31.067929    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bb59d5f4b-zfr8z"]
Oct 30 03:31:32.274861 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:32.274829    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="90a55576-5ce2-4ae1-a54a-8ebac17d776f" path="/var/lib/kubelet/pods/90a55576-5ce2-4ae1-a54a-8ebac17d776f/volumes"
Oct 30 03:31:34.337087 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.337051    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"]
Oct 30 03:31:34.337608 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.337542    5981 cpu_manager.go:414] "containerMap: removing container" podUID="90a55576-5ce2-4ae1-a54a-8ebac17d776f" containerName="ta-container"
Oct 30 03:31:34.337608 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.337560    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90a55576-5ce2-4ae1-a54a-8ebac17d776f" containerName="ta-container"
Oct 30 03:31:34.337721 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.337683    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="90a55576-5ce2-4ae1-a54a-8ebac17d776f" containerName="ta-container"
Oct 30 03:31:34.342131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.342110    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:34.375128 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.375102    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"]
Oct 30 03:31:34.470724 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.470688    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4d5b54d9-a182-42df-a74e-5713282f6062-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-85bc6fb7cc-dbcmk\" (UID: \"4d5b54d9-a182-42df-a74e-5713282f6062\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:34.470908 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.470740    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9ssn\" (UniqueName: \"kubernetes.io/projected/4d5b54d9-a182-42df-a74e-5713282f6062-kube-api-access-j9ssn\") pod \"data-science-collector-targetallocator-85bc6fb7cc-dbcmk\" (UID: \"4d5b54d9-a182-42df-a74e-5713282f6062\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:34.470908 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.470858    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4d5b54d9-a182-42df-a74e-5713282f6062-ta-internal\") pod \"data-science-collector-targetallocator-85bc6fb7cc-dbcmk\" (UID: \"4d5b54d9-a182-42df-a74e-5713282f6062\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:34.572009 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.571968    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4d5b54d9-a182-42df-a74e-5713282f6062-ta-internal\") pod \"data-science-collector-targetallocator-85bc6fb7cc-dbcmk\" (UID: \"4d5b54d9-a182-42df-a74e-5713282f6062\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:34.572172 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.572054    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4d5b54d9-a182-42df-a74e-5713282f6062-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-85bc6fb7cc-dbcmk\" (UID: \"4d5b54d9-a182-42df-a74e-5713282f6062\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:34.572172 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.572105    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ssn\" (UniqueName: \"kubernetes.io/projected/4d5b54d9-a182-42df-a74e-5713282f6062-kube-api-access-j9ssn\") pod \"data-science-collector-targetallocator-85bc6fb7cc-dbcmk\" (UID: \"4d5b54d9-a182-42df-a74e-5713282f6062\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:34.572758 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.572737    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4d5b54d9-a182-42df-a74e-5713282f6062-ta-internal\") pod \"data-science-collector-targetallocator-85bc6fb7cc-dbcmk\" (UID: \"4d5b54d9-a182-42df-a74e-5713282f6062\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:34.574665 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.574644    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4d5b54d9-a182-42df-a74e-5713282f6062-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-85bc6fb7cc-dbcmk\" (UID: \"4d5b54d9-a182-42df-a74e-5713282f6062\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:34.592041 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.591981    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9ssn\" (UniqueName: \"kubernetes.io/projected/4d5b54d9-a182-42df-a74e-5713282f6062-kube-api-access-j9ssn\") pod \"data-science-collector-targetallocator-85bc6fb7cc-dbcmk\" (UID: \"4d5b54d9-a182-42df-a74e-5713282f6062\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:34.653377 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.653343    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:34.951398 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.951365    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"]
Oct 30 03:31:34.954659 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:31:34.954628    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d5b54d9_a182_42df_a74e_5713282f6062.slice/crio-58fb123462063b057da123933c86677dff25653e2db245dfc1766148b765f27a WatchSource:0}: Error finding container 58fb123462063b057da123933c86677dff25653e2db245dfc1766148b765f27a: Status 404 returned error can't find the container with id 58fb123462063b057da123933c86677dff25653e2db245dfc1766148b765f27a
Oct 30 03:31:34.956988 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.956941    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:31:34.957079 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:34.957021    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:31:35.016890 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:35.016864    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk" event={"ID":"4d5b54d9-a182-42df-a74e-5713282f6062","Type":"ContainerStarted","Data":"b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19"}
Oct 30 03:31:35.017005 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:35.016902    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk" event={"ID":"4d5b54d9-a182-42df-a74e-5713282f6062","Type":"ContainerStarted","Data":"58fb123462063b057da123933c86677dff25653e2db245dfc1766148b765f27a"}
Oct 30 03:31:36.021213 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.021178    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:36.023205 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.023180    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:36.062591 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.062545    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk" podStartSLOduration=2.062532467 podStartE2EDuration="2.062532467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:31:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:31:36.06080884 +0000 UTC m=+2935.903055285" watchObservedRunningTime="2026-10-30 03:31:36.062532467 +0000 UTC m=+2935.904778911"
Oct 30 03:31:36.129232 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.129194    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"]
Oct 30 03:31:36.129427 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.129379    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl" podUID="cd60bd95-a9a1-42ec-b6a0-0020c027ecd4" containerName="ta-container" containerID="cri-o://933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809" gracePeriod=30
Oct 30 03:31:36.370838 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.370812    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:36.489579 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.489546    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-ta-internal\" (UniqueName: \"kubernetes.io/configmap/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-ta-internal\") pod \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\" (UID: \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\") "
Oct 30 03:31:36.489761 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.489590    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-kube-api-access-vhwbt\" (UniqueName: \"kubernetes.io/projected/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-kube-api-access-vhwbt\") pod \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\" (UID: \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\") "
Oct 30 03:31:36.489761 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.489626    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-data-science-collector-ta-server-cert\") pod \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\" (UID: \"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4\") "
Oct 30 03:31:36.489985 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.489958    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-ta-internal" pod "cd60bd95-a9a1-42ec-b6a0-0020c027ecd4" (UID: "cd60bd95-a9a1-42ec-b6a0-0020c027ecd4"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:31:36.491873 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.491850    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-data-science-collector-ta-server-cert" pod "cd60bd95-a9a1-42ec-b6a0-0020c027ecd4" (UID: "cd60bd95-a9a1-42ec-b6a0-0020c027ecd4"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:31:36.491988 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.491923    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-kube-api-access-vhwbt" pod "cd60bd95-a9a1-42ec-b6a0-0020c027ecd4" (UID: "cd60bd95-a9a1-42ec-b6a0-0020c027ecd4"). InnerVolumeSpecName "kube-api-access-vhwbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:31:36.590528 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.590469    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:36.590528 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.590492    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:36.590528 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:36.590501    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhwbt\" (UniqueName: \"kubernetes.io/projected/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4-kube-api-access-vhwbt\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:37.026625 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:37.026590    5981 generic.go:356] "Generic (PLEG): container finished" podID="cd60bd95-a9a1-42ec-b6a0-0020c027ecd4" containerID="933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809" exitCode=0
Oct 30 03:31:37.027131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:37.026638    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"
Oct 30 03:31:37.027131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:37.026684    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl" event={"ID":"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4","Type":"ContainerDied","Data":"933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809"}
Oct 30 03:31:37.027131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:37.026725    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl" event={"ID":"cd60bd95-a9a1-42ec-b6a0-0020c027ecd4","Type":"ContainerDied","Data":"4d5a144f7df33c849012c56d52c5e7f5405ef61e16602cb411d0c511a68af49c"}
Oct 30 03:31:37.027131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:37.026744    5981 scope.go:122] "RemoveContainer" containerID="933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809"
Oct 30 03:31:37.035591 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:37.035575    5981 scope.go:122] "RemoveContainer" containerID="933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809"
Oct 30 03:31:37.035857 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:31:37.035837    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809\": container with ID starting with 933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809 not found: ID does not exist" containerID="933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809"
Oct 30 03:31:37.035928 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:37.035866    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809"} err="failed to get container status \"933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809\": rpc error: code = NotFound desc = could not find container \"933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809\": container with ID starting with 933ba1cc9b2cba837c3d70b6c74576608d66b6fd19b73ff81186c16868536809 not found: ID does not exist"
Oct 30 03:31:37.081916 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:37.081888    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"]
Oct 30 03:31:37.094872 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:37.094844    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-65488b45b8-q5ntl"]
Oct 30 03:31:38.274266 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:38.274222    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd60bd95-a9a1-42ec-b6a0-0020c027ecd4" path="/var/lib/kubelet/pods/cd60bd95-a9a1-42ec-b6a0-0020c027ecd4/volumes"
Oct 30 03:31:44.369571 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:31:44.369507    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:31:47.675796 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.675760    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"]
Oct 30 03:31:47.676176 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.676103    5981 cpu_manager.go:414] "containerMap: removing container" podUID="cd60bd95-a9a1-42ec-b6a0-0020c027ecd4" containerName="ta-container"
Oct 30 03:31:47.676176 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.676114    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd60bd95-a9a1-42ec-b6a0-0020c027ecd4" containerName="ta-container"
Oct 30 03:31:47.676176 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.676173    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd60bd95-a9a1-42ec-b6a0-0020c027ecd4" containerName="ta-container"
Oct 30 03:31:47.680597 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.680576    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:47.695515 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.695489    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"]
Oct 30 03:31:47.788059 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.788026    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a0692eb0-8347-4524-8ac9-0c3320cab047-ta-internal\") pod \"data-science-collector-targetallocator-dc5ff85b8-v8ttp\" (UID: \"a0692eb0-8347-4524-8ac9-0c3320cab047\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:47.788220 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.788069    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a0692eb0-8347-4524-8ac9-0c3320cab047-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-dc5ff85b8-v8ttp\" (UID: \"a0692eb0-8347-4524-8ac9-0c3320cab047\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:47.788310 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.788244    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fb7l\" (UniqueName: \"kubernetes.io/projected/a0692eb0-8347-4524-8ac9-0c3320cab047-kube-api-access-2fb7l\") pod \"data-science-collector-targetallocator-dc5ff85b8-v8ttp\" (UID: \"a0692eb0-8347-4524-8ac9-0c3320cab047\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:47.889712 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.889676    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a0692eb0-8347-4524-8ac9-0c3320cab047-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-dc5ff85b8-v8ttp\" (UID: \"a0692eb0-8347-4524-8ac9-0c3320cab047\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:47.889851 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.889737    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fb7l\" (UniqueName: \"kubernetes.io/projected/a0692eb0-8347-4524-8ac9-0c3320cab047-kube-api-access-2fb7l\") pod \"data-science-collector-targetallocator-dc5ff85b8-v8ttp\" (UID: \"a0692eb0-8347-4524-8ac9-0c3320cab047\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:47.889851 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.889786    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a0692eb0-8347-4524-8ac9-0c3320cab047-ta-internal\") pod \"data-science-collector-targetallocator-dc5ff85b8-v8ttp\" (UID: \"a0692eb0-8347-4524-8ac9-0c3320cab047\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:47.890418 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.890397    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a0692eb0-8347-4524-8ac9-0c3320cab047-ta-internal\") pod \"data-science-collector-targetallocator-dc5ff85b8-v8ttp\" (UID: \"a0692eb0-8347-4524-8ac9-0c3320cab047\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:47.892264 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.892242    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a0692eb0-8347-4524-8ac9-0c3320cab047-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-dc5ff85b8-v8ttp\" (UID: \"a0692eb0-8347-4524-8ac9-0c3320cab047\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:47.910841 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.910819    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fb7l\" (UniqueName: \"kubernetes.io/projected/a0692eb0-8347-4524-8ac9-0c3320cab047-kube-api-access-2fb7l\") pod \"data-science-collector-targetallocator-dc5ff85b8-v8ttp\" (UID: \"a0692eb0-8347-4524-8ac9-0c3320cab047\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:47.991765 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:47.991679    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:48.282487 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:48.282412    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"]
Oct 30 03:31:48.284614 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:31:48.284588    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0692eb0_8347_4524_8ac9_0c3320cab047.slice/crio-6d004f738fcff293f46836d25108f35b9fd7f091da00d6571943fb4f9099e1a8 WatchSource:0}: Error finding container 6d004f738fcff293f46836d25108f35b9fd7f091da00d6571943fb4f9099e1a8: Status 404 returned error can't find the container with id 6d004f738fcff293f46836d25108f35b9fd7f091da00d6571943fb4f9099e1a8
Oct 30 03:31:48.286494 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:48.286462    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:31:48.286594 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:48.286520    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:31:49.077689 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.077646    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp" event={"ID":"a0692eb0-8347-4524-8ac9-0c3320cab047","Type":"ContainerStarted","Data":"13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4"}
Oct 30 03:31:49.077689 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.077688    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp" event={"ID":"a0692eb0-8347-4524-8ac9-0c3320cab047","Type":"ContainerStarted","Data":"6d004f738fcff293f46836d25108f35b9fd7f091da00d6571943fb4f9099e1a8"}
Oct 30 03:31:49.078119 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.077707    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:49.079483 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.079460    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:49.121155 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.121111    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp" podStartSLOduration=2.12109863 podStartE2EDuration="2.12109863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:31:49.120409502 +0000 UTC m=+2948.962655948" watchObservedRunningTime="2026-10-30 03:31:49.12109863 +0000 UTC m=+2948.963345073"
Oct 30 03:31:49.200258 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.200222    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"]
Oct 30 03:31:49.200523 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.200500    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk" podUID="4d5b54d9-a182-42df-a74e-5713282f6062" containerName="ta-container" containerID="cri-o://b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19" gracePeriod=30
Oct 30 03:31:49.439051 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.439023    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:49.503667 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.503632    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d5b54d9-a182-42df-a74e-5713282f6062-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4d5b54d9-a182-42df-a74e-5713282f6062-data-science-collector-ta-server-cert\") pod \"4d5b54d9-a182-42df-a74e-5713282f6062\" (UID: \"4d5b54d9-a182-42df-a74e-5713282f6062\") "
Oct 30 03:31:49.503823 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.503680    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d5b54d9-a182-42df-a74e-5713282f6062-ta-internal\" (UniqueName: \"kubernetes.io/configmap/4d5b54d9-a182-42df-a74e-5713282f6062-ta-internal\") pod \"4d5b54d9-a182-42df-a74e-5713282f6062\" (UID: \"4d5b54d9-a182-42df-a74e-5713282f6062\") "
Oct 30 03:31:49.503823 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.503812    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d5b54d9-a182-42df-a74e-5713282f6062-kube-api-access-j9ssn\" (UniqueName: \"kubernetes.io/projected/4d5b54d9-a182-42df-a74e-5713282f6062-kube-api-access-j9ssn\") pod \"4d5b54d9-a182-42df-a74e-5713282f6062\" (UID: \"4d5b54d9-a182-42df-a74e-5713282f6062\") "
Oct 30 03:31:49.504050 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.504029    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d5b54d9-a182-42df-a74e-5713282f6062-ta-internal" pod "4d5b54d9-a182-42df-a74e-5713282f6062" (UID: "4d5b54d9-a182-42df-a74e-5713282f6062"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:31:49.505982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.505951    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d5b54d9-a182-42df-a74e-5713282f6062-kube-api-access-j9ssn" pod "4d5b54d9-a182-42df-a74e-5713282f6062" (UID: "4d5b54d9-a182-42df-a74e-5713282f6062"). InnerVolumeSpecName "kube-api-access-j9ssn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:31:49.506082 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.505999    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d5b54d9-a182-42df-a74e-5713282f6062-data-science-collector-ta-server-cert" pod "4d5b54d9-a182-42df-a74e-5713282f6062" (UID: "4d5b54d9-a182-42df-a74e-5713282f6062"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:31:49.605058 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.605027    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4d5b54d9-a182-42df-a74e-5713282f6062-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:49.605058 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.605051    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4d5b54d9-a182-42df-a74e-5713282f6062-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:49.605058 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:49.605061    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9ssn\" (UniqueName: \"kubernetes.io/projected/4d5b54d9-a182-42df-a74e-5713282f6062-kube-api-access-j9ssn\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:50.083496 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:50.083456    5981 generic.go:356] "Generic (PLEG): container finished" podID="4d5b54d9-a182-42df-a74e-5713282f6062" containerID="b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19" exitCode=0
Oct 30 03:31:50.083975 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:50.083502    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"
Oct 30 03:31:50.083975 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:50.083537    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk" event={"ID":"4d5b54d9-a182-42df-a74e-5713282f6062","Type":"ContainerDied","Data":"b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19"}
Oct 30 03:31:50.083975 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:50.083573    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk" event={"ID":"4d5b54d9-a182-42df-a74e-5713282f6062","Type":"ContainerDied","Data":"58fb123462063b057da123933c86677dff25653e2db245dfc1766148b765f27a"}
Oct 30 03:31:50.083975 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:50.083590    5981 scope.go:122] "RemoveContainer" containerID="b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19"
Oct 30 03:31:50.098263 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:50.098227    5981 scope.go:122] "RemoveContainer" containerID="b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19"
Oct 30 03:31:50.098600 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:31:50.098580    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19\": container with ID starting with b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19 not found: ID does not exist" containerID="b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19"
Oct 30 03:31:50.098668 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:50.098608    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19"} err="failed to get container status \"b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19\": rpc error: code = NotFound desc = could not find container \"b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19\": container with ID starting with b24bf8a70ab8f1d39c7d3d544ec94dc19c7fc704293f870c3b897c4638eb2d19 not found: ID does not exist"
Oct 30 03:31:50.133964 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:50.133935    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"]
Oct 30 03:31:50.147080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:50.147058    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85bc6fb7cc-dbcmk"]
Oct 30 03:31:50.274585 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:50.274556    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d5b54d9-a182-42df-a74e-5713282f6062" path="/var/lib/kubelet/pods/4d5b54d9-a182-42df-a74e-5713282f6062/volumes"
Oct 30 03:31:54.741366 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.741312    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"]
Oct 30 03:31:54.741868 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.741801    5981 cpu_manager.go:414] "containerMap: removing container" podUID="4d5b54d9-a182-42df-a74e-5713282f6062" containerName="ta-container"
Oct 30 03:31:54.741868 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.741822    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d5b54d9-a182-42df-a74e-5713282f6062" containerName="ta-container"
Oct 30 03:31:54.741980 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.741948    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d5b54d9-a182-42df-a74e-5713282f6062" containerName="ta-container"
Oct 30 03:31:54.746456 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.746433    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:54.775858 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.775829    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"]
Oct 30 03:31:54.845747 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.845705    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/aab3455c-a9cf-4d43-9998-f061595a2456-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-d794647f5-fdjfb\" (UID: \"aab3455c-a9cf-4d43-9998-f061595a2456\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:54.845909 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.845753    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phdtm\" (UniqueName: \"kubernetes.io/projected/aab3455c-a9cf-4d43-9998-f061595a2456-kube-api-access-phdtm\") pod \"data-science-collector-targetallocator-d794647f5-fdjfb\" (UID: \"aab3455c-a9cf-4d43-9998-f061595a2456\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:54.845987 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.845904    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/aab3455c-a9cf-4d43-9998-f061595a2456-ta-internal\") pod \"data-science-collector-targetallocator-d794647f5-fdjfb\" (UID: \"aab3455c-a9cf-4d43-9998-f061595a2456\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:54.947086 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.947051    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/aab3455c-a9cf-4d43-9998-f061595a2456-ta-internal\") pod \"data-science-collector-targetallocator-d794647f5-fdjfb\" (UID: \"aab3455c-a9cf-4d43-9998-f061595a2456\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:54.947234 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.947149    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/aab3455c-a9cf-4d43-9998-f061595a2456-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-d794647f5-fdjfb\" (UID: \"aab3455c-a9cf-4d43-9998-f061595a2456\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:54.947234 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.947183    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phdtm\" (UniqueName: \"kubernetes.io/projected/aab3455c-a9cf-4d43-9998-f061595a2456-kube-api-access-phdtm\") pod \"data-science-collector-targetallocator-d794647f5-fdjfb\" (UID: \"aab3455c-a9cf-4d43-9998-f061595a2456\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:54.947797 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.947769    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/aab3455c-a9cf-4d43-9998-f061595a2456-ta-internal\") pod \"data-science-collector-targetallocator-d794647f5-fdjfb\" (UID: \"aab3455c-a9cf-4d43-9998-f061595a2456\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:54.949672 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.949652    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/aab3455c-a9cf-4d43-9998-f061595a2456-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-d794647f5-fdjfb\" (UID: \"aab3455c-a9cf-4d43-9998-f061595a2456\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:54.968113 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:54.968078    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phdtm\" (UniqueName: \"kubernetes.io/projected/aab3455c-a9cf-4d43-9998-f061595a2456-kube-api-access-phdtm\") pod \"data-science-collector-targetallocator-d794647f5-fdjfb\" (UID: \"aab3455c-a9cf-4d43-9998-f061595a2456\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:55.057991 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:55.057897    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:55.377788 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:55.377758    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"]
Oct 30 03:31:55.379031 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:31:55.378998    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaab3455c_a9cf_4d43_9998_f061595a2456.slice/crio-54ab7979e2c5a535e091dd9ee6f04b89ef03a7ab996af166ec8275282a0fadd2 WatchSource:0}: Error finding container 54ab7979e2c5a535e091dd9ee6f04b89ef03a7ab996af166ec8275282a0fadd2: Status 404 returned error can't find the container with id 54ab7979e2c5a535e091dd9ee6f04b89ef03a7ab996af166ec8275282a0fadd2
Oct 30 03:31:55.381149 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:55.381121    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:31:55.381235 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:55.381175    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:31:56.114377 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.114342    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb" event={"ID":"aab3455c-a9cf-4d43-9998-f061595a2456","Type":"ContainerStarted","Data":"c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833"}
Oct 30 03:31:56.114769 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.114387    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb" event={"ID":"aab3455c-a9cf-4d43-9998-f061595a2456","Type":"ContainerStarted","Data":"54ab7979e2c5a535e091dd9ee6f04b89ef03a7ab996af166ec8275282a0fadd2"}
Oct 30 03:31:56.114769 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.114544    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:56.116319 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.116277    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:31:56.155200 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.155140    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb" podStartSLOduration=2.15512644 podStartE2EDuration="2.15512644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:31:56.154278762 +0000 UTC m=+2955.996525208" watchObservedRunningTime="2026-10-30 03:31:56.15512644 +0000 UTC m=+2955.997372889"
Oct 30 03:31:56.226185 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.226154    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"]
Oct 30 03:31:56.226379 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.226341    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp" podUID="a0692eb0-8347-4524-8ac9-0c3320cab047" containerName="ta-container" containerID="cri-o://13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4" gracePeriod=30
Oct 30 03:31:56.467341 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.467313    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:56.560247 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.560217    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a0692eb0-8347-4524-8ac9-0c3320cab047-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a0692eb0-8347-4524-8ac9-0c3320cab047-data-science-collector-ta-server-cert\") pod \"a0692eb0-8347-4524-8ac9-0c3320cab047\" (UID: \"a0692eb0-8347-4524-8ac9-0c3320cab047\") "
Oct 30 03:31:56.560425 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.560306    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0692eb0-8347-4524-8ac9-0c3320cab047-kube-api-access-2fb7l\" (UniqueName: \"kubernetes.io/projected/a0692eb0-8347-4524-8ac9-0c3320cab047-kube-api-access-2fb7l\") pod \"a0692eb0-8347-4524-8ac9-0c3320cab047\" (UID: \"a0692eb0-8347-4524-8ac9-0c3320cab047\") "
Oct 30 03:31:56.560425 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.560405    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0692eb0-8347-4524-8ac9-0c3320cab047-ta-internal\" (UniqueName: \"kubernetes.io/configmap/a0692eb0-8347-4524-8ac9-0c3320cab047-ta-internal\") pod \"a0692eb0-8347-4524-8ac9-0c3320cab047\" (UID: \"a0692eb0-8347-4524-8ac9-0c3320cab047\") "
Oct 30 03:31:56.560780 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.560753    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0692eb0-8347-4524-8ac9-0c3320cab047-ta-internal" pod "a0692eb0-8347-4524-8ac9-0c3320cab047" (UID: "a0692eb0-8347-4524-8ac9-0c3320cab047"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:31:56.562448 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.562430    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0692eb0-8347-4524-8ac9-0c3320cab047-data-science-collector-ta-server-cert" pod "a0692eb0-8347-4524-8ac9-0c3320cab047" (UID: "a0692eb0-8347-4524-8ac9-0c3320cab047"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:31:56.562533 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.562512    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0692eb0-8347-4524-8ac9-0c3320cab047-kube-api-access-2fb7l" pod "a0692eb0-8347-4524-8ac9-0c3320cab047" (UID: "a0692eb0-8347-4524-8ac9-0c3320cab047"). InnerVolumeSpecName "kube-api-access-2fb7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:31:56.661145 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.661114    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a0692eb0-8347-4524-8ac9-0c3320cab047-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:56.661145 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.661145    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a0692eb0-8347-4524-8ac9-0c3320cab047-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:56.661358 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:56.661157    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fb7l\" (UniqueName: \"kubernetes.io/projected/a0692eb0-8347-4524-8ac9-0c3320cab047-kube-api-access-2fb7l\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:31:57.121058 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:57.120973    5981 generic.go:356] "Generic (PLEG): container finished" podID="a0692eb0-8347-4524-8ac9-0c3320cab047" containerID="13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4" exitCode=0
Oct 30 03:31:57.121058 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:57.121030    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"
Oct 30 03:31:57.121542 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:57.121059    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp" event={"ID":"a0692eb0-8347-4524-8ac9-0c3320cab047","Type":"ContainerDied","Data":"13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4"}
Oct 30 03:31:57.121542 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:57.121106    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp" event={"ID":"a0692eb0-8347-4524-8ac9-0c3320cab047","Type":"ContainerDied","Data":"6d004f738fcff293f46836d25108f35b9fd7f091da00d6571943fb4f9099e1a8"}
Oct 30 03:31:57.121542 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:57.121122    5981 scope.go:122] "RemoveContainer" containerID="13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4"
Oct 30 03:31:57.130450 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:57.130436    5981 scope.go:122] "RemoveContainer" containerID="13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4"
Oct 30 03:31:57.130729 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:31:57.130710    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4\": container with ID starting with 13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4 not found: ID does not exist" containerID="13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4"
Oct 30 03:31:57.130783 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:57.130739    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4"} err="failed to get container status \"13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4\": rpc error: code = NotFound desc = could not find container \"13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4\": container with ID starting with 13f3cf71281311064ce320151afae68e762d88b86bca567e163b559a98d097e4 not found: ID does not exist"
Oct 30 03:31:57.172898 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:57.172869    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"]
Oct 30 03:31:57.186035 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:57.186012    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-v8ttp"]
Oct 30 03:31:58.274886 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:31:58.274853    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0692eb0-8347-4524-8ac9-0c3320cab047" path="/var/lib/kubelet/pods/a0692eb0-8347-4524-8ac9-0c3320cab047/volumes"
Oct 30 03:32:14.369117 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:32:14.369075    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:32:44.368165 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:32:44.368128    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:33:06.747325 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:06.747271    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 03:33:06.747915 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:06.747786    5981 cpu_manager.go:414] "containerMap: removing container" podUID="a0692eb0-8347-4524-8ac9-0c3320cab047" containerName="ta-container"
Oct 30 03:33:06.747915 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:06.747807    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0692eb0-8347-4524-8ac9-0c3320cab047" containerName="ta-container"
Oct 30 03:33:06.747915 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:06.747895    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0692eb0-8347-4524-8ac9-0c3320cab047" containerName="ta-container"
Oct 30 03:33:06.752373 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:06.752350    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 03:33:06.764518 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:06.764496    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 03:33:06.768136 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:06.768113    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"tests-monitoring-otlp-identity\"/\"openshift-service-ca.crt\""
Oct 30 03:33:06.776743 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:06.776723    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"tests-monitoring-otlp-identity\"/\"default-dockercfg-kfpgr\""
Oct 30 03:33:06.871008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:06.870975    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca9e53c2-2666-4ec8-97b4-2ca57a96822d-service-ca\") pod \"otlp-identity-spoof-probe\" (UID: \"ca9e53c2-2666-4ec8-97b4-2ca57a96822d\") " pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 03:33:06.972232 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:06.972196    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca9e53c2-2666-4ec8-97b4-2ca57a96822d-service-ca\") pod \"otlp-identity-spoof-probe\" (UID: \"ca9e53c2-2666-4ec8-97b4-2ca57a96822d\") " pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 03:33:06.972850 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:06.972831    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca9e53c2-2666-4ec8-97b4-2ca57a96822d-service-ca\") pod \"otlp-identity-spoof-probe\" (UID: \"ca9e53c2-2666-4ec8-97b4-2ca57a96822d\") " pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 03:33:07.064465 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:07.064383    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 03:33:07.353588 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:07.353562    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 03:33:07.356123 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:33:07.356094    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca9e53c2_2666_4ec8_97b4_2ca57a96822d.slice/crio-75c6a510947d16dba06d1263b704734f8159180ca5b4e2be7c71e1d46ecb02af WatchSource:0}: Error finding container 75c6a510947d16dba06d1263b704734f8159180ca5b4e2be7c71e1d46ecb02af: Status 404 returned error can't find the container with id 75c6a510947d16dba06d1263b704734f8159180ca5b4e2be7c71e1d46ecb02af
Oct 30 03:33:07.409868 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:07.409840    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" event={"ID":"ca9e53c2-2666-4ec8-97b4-2ca57a96822d","Type":"ContainerStarted","Data":"75c6a510947d16dba06d1263b704734f8159180ca5b4e2be7c71e1d46ecb02af"}
Oct 30 03:33:08.415426 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:08.415387    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" event={"ID":"ca9e53c2-2666-4ec8-97b4-2ca57a96822d","Type":"ContainerStarted","Data":"e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b"}
Oct 30 03:33:08.454425 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:33:08.454375    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" podStartSLOduration=2.454360979 podStartE2EDuration="2.454360979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:33:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:33:08.453271971 +0000 UTC m=+3028.295518416" watchObservedRunningTime="2026-10-30 03:33:08.454360979 +0000 UTC m=+3028.296607461"
Oct 30 03:33:14.369354 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:33:14.369308    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:33:44.370204 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:33:44.370097    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:34:14.368689 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:34:14.368597    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:34:44.370305 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:34:44.370253    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:35:14.369151 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:35:14.369109    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:35:22.397408 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:22.397325    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 03:35:22.397912 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:22.397508    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" podUID="ca9e53c2-2666-4ec8-97b4-2ca57a96822d" containerName="otlp-spoof-probe" containerID="cri-o://e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b" gracePeriod=30
Oct 30 03:35:44.369591 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:35:44.369546    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:35:52.548021 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:52.547992    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 03:35:52.597094 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:52.597062    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca9e53c2-2666-4ec8-97b4-2ca57a96822d-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca9e53c2-2666-4ec8-97b4-2ca57a96822d-service-ca\") pod \"ca9e53c2-2666-4ec8-97b4-2ca57a96822d\" (UID: \"ca9e53c2-2666-4ec8-97b4-2ca57a96822d\") "
Oct 30 03:35:52.597409 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:52.597390    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca9e53c2-2666-4ec8-97b4-2ca57a96822d-service-ca" pod "ca9e53c2-2666-4ec8-97b4-2ca57a96822d" (UID: "ca9e53c2-2666-4ec8-97b4-2ca57a96822d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:35:52.698589 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:52.698494    5981 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca9e53c2-2666-4ec8-97b4-2ca57a96822d-service-ca\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:35:53.097102 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:53.097022    5981 generic.go:356] "Generic (PLEG): container finished" podID="ca9e53c2-2666-4ec8-97b4-2ca57a96822d" containerID="e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b" exitCode=137
Oct 30 03:35:53.097102 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:53.097072    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 03:35:53.097102 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:53.097085    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" event={"ID":"ca9e53c2-2666-4ec8-97b4-2ca57a96822d","Type":"ContainerDied","Data":"e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b"}
Oct 30 03:35:53.097368 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:53.097117    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" event={"ID":"ca9e53c2-2666-4ec8-97b4-2ca57a96822d","Type":"ContainerDied","Data":"75c6a510947d16dba06d1263b704734f8159180ca5b4e2be7c71e1d46ecb02af"}
Oct 30 03:35:53.097368 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:53.097133    5981 scope.go:122] "RemoveContainer" containerID="e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b"
Oct 30 03:35:53.108265 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:53.108249    5981 scope.go:122] "RemoveContainer" containerID="e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b"
Oct 30 03:35:53.108596 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:35:53.108579    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b\": container with ID starting with e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b not found: ID does not exist" containerID="e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b"
Oct 30 03:35:53.108664 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:53.108606    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b"} err="failed to get container status \"e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b\": rpc error: code = NotFound desc = could not find container \"e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b\": container with ID starting with e94ef211d4274f30a5173d3bd9625dd6d0c69bf2aef9ed0c5da35957e3bf563b not found: ID does not exist"
Oct 30 03:35:53.149104 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:53.149077    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 03:35:53.156769 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:53.156745    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 03:35:54.274540 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:54.274511    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca9e53c2-2666-4ec8-97b4-2ca57a96822d" path="/var/lib/kubelet/pods/ca9e53c2-2666-4ec8-97b4-2ca57a96822d/volumes"
Oct 30 03:35:57.067989 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.067954    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"]
Oct 30 03:35:57.068444 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.068426    5981 cpu_manager.go:414] "containerMap: removing container" podUID="ca9e53c2-2666-4ec8-97b4-2ca57a96822d" containerName="otlp-spoof-probe"
Oct 30 03:35:57.068491 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.068447    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca9e53c2-2666-4ec8-97b4-2ca57a96822d" containerName="otlp-spoof-probe"
Oct 30 03:35:57.068525 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.068516    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca9e53c2-2666-4ec8-97b4-2ca57a96822d" containerName="otlp-spoof-probe"
Oct 30 03:35:57.072573 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.072558    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:57.107112 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.107087    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"]
Oct 30 03:35:57.137677 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.137645    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znthf\" (UniqueName: \"kubernetes.io/projected/784ce5f4-7610-4f4f-986e-51a1c0fc507c-kube-api-access-znthf\") pod \"data-science-collector-targetallocator-7c9b4ff486-jmx2p\" (UID: \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:57.137828 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.137760    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/784ce5f4-7610-4f4f-986e-51a1c0fc507c-ta-internal\") pod \"data-science-collector-targetallocator-7c9b4ff486-jmx2p\" (UID: \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:57.137873 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.137828    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/784ce5f4-7610-4f4f-986e-51a1c0fc507c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7c9b4ff486-jmx2p\" (UID: \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:57.238389 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.238357    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znthf\" (UniqueName: \"kubernetes.io/projected/784ce5f4-7610-4f4f-986e-51a1c0fc507c-kube-api-access-znthf\") pod \"data-science-collector-targetallocator-7c9b4ff486-jmx2p\" (UID: \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:57.238554 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.238420    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/784ce5f4-7610-4f4f-986e-51a1c0fc507c-ta-internal\") pod \"data-science-collector-targetallocator-7c9b4ff486-jmx2p\" (UID: \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:57.238554 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.238459    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/784ce5f4-7610-4f4f-986e-51a1c0fc507c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7c9b4ff486-jmx2p\" (UID: \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:57.239104 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.239078    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/784ce5f4-7610-4f4f-986e-51a1c0fc507c-ta-internal\") pod \"data-science-collector-targetallocator-7c9b4ff486-jmx2p\" (UID: \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:57.241136 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.241105    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/784ce5f4-7610-4f4f-986e-51a1c0fc507c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7c9b4ff486-jmx2p\" (UID: \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:57.258569 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.258545    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znthf\" (UniqueName: \"kubernetes.io/projected/784ce5f4-7610-4f4f-986e-51a1c0fc507c-kube-api-access-znthf\") pod \"data-science-collector-targetallocator-7c9b4ff486-jmx2p\" (UID: \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:57.383472 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.383393    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:57.675522 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.675448    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"]
Oct 30 03:35:57.678872 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:35:57.678827    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod784ce5f4_7610_4f4f_986e_51a1c0fc507c.slice/crio-d6391365c391ecdbbc37f66332a2e258e39111a40155e353aa549fef001b2de6 WatchSource:0}: Error finding container d6391365c391ecdbbc37f66332a2e258e39111a40155e353aa549fef001b2de6: Status 404 returned error can't find the container with id d6391365c391ecdbbc37f66332a2e258e39111a40155e353aa549fef001b2de6
Oct 30 03:35:57.681702 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.681661    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:35:57.681805 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:57.681741    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:35:58.122349 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.122249    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p" event={"ID":"784ce5f4-7610-4f4f-986e-51a1c0fc507c","Type":"ContainerStarted","Data":"8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b"}
Oct 30 03:35:58.122349 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.122308    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p" event={"ID":"784ce5f4-7610-4f4f-986e-51a1c0fc507c","Type":"ContainerStarted","Data":"d6391365c391ecdbbc37f66332a2e258e39111a40155e353aa549fef001b2de6"}
Oct 30 03:35:58.122810 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.122532    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:58.124026 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.124005    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:35:58.168688 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.168635    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p" podStartSLOduration=1.168593689 podStartE2EDuration="1.168593689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:35:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:35:58.168355713 +0000 UTC m=+3198.010602179" watchObservedRunningTime="2026-10-30 03:35:58.168593689 +0000 UTC m=+3198.010840133"
Oct 30 03:35:58.245664 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.245633    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"]
Oct 30 03:35:58.245917 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.245879    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb" podUID="aab3455c-a9cf-4d43-9998-f061595a2456" containerName="ta-container" containerID="cri-o://c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833" gracePeriod=30
Oct 30 03:35:58.490532 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.490505    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:35:58.552030 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.552000    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aab3455c-a9cf-4d43-9998-f061595a2456-kube-api-access-phdtm\" (UniqueName: \"kubernetes.io/projected/aab3455c-a9cf-4d43-9998-f061595a2456-kube-api-access-phdtm\") pod \"aab3455c-a9cf-4d43-9998-f061595a2456\" (UID: \"aab3455c-a9cf-4d43-9998-f061595a2456\") "
Oct 30 03:35:58.552030 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.552037    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aab3455c-a9cf-4d43-9998-f061595a2456-ta-internal\" (UniqueName: \"kubernetes.io/configmap/aab3455c-a9cf-4d43-9998-f061595a2456-ta-internal\") pod \"aab3455c-a9cf-4d43-9998-f061595a2456\" (UID: \"aab3455c-a9cf-4d43-9998-f061595a2456\") "
Oct 30 03:35:58.552307 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.552077    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aab3455c-a9cf-4d43-9998-f061595a2456-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/aab3455c-a9cf-4d43-9998-f061595a2456-data-science-collector-ta-server-cert\") pod \"aab3455c-a9cf-4d43-9998-f061595a2456\" (UID: \"aab3455c-a9cf-4d43-9998-f061595a2456\") "
Oct 30 03:35:58.552424 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.552403    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aab3455c-a9cf-4d43-9998-f061595a2456-ta-internal" pod "aab3455c-a9cf-4d43-9998-f061595a2456" (UID: "aab3455c-a9cf-4d43-9998-f061595a2456"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:35:58.554419 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.554388    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aab3455c-a9cf-4d43-9998-f061595a2456-kube-api-access-phdtm" pod "aab3455c-a9cf-4d43-9998-f061595a2456" (UID: "aab3455c-a9cf-4d43-9998-f061595a2456"). InnerVolumeSpecName "kube-api-access-phdtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:35:58.554548 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.554485    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aab3455c-a9cf-4d43-9998-f061595a2456-data-science-collector-ta-server-cert" pod "aab3455c-a9cf-4d43-9998-f061595a2456" (UID: "aab3455c-a9cf-4d43-9998-f061595a2456"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:35:58.653439 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.653404    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/aab3455c-a9cf-4d43-9998-f061595a2456-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:35:58.653439 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.653434    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phdtm\" (UniqueName: \"kubernetes.io/projected/aab3455c-a9cf-4d43-9998-f061595a2456-kube-api-access-phdtm\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:35:58.653439 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:58.653444    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/aab3455c-a9cf-4d43-9998-f061595a2456-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:35:59.127388 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:59.127350    5981 generic.go:356] "Generic (PLEG): container finished" podID="aab3455c-a9cf-4d43-9998-f061595a2456" containerID="c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833" exitCode=0
Oct 30 03:35:59.127388 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:59.127386    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"
Oct 30 03:35:59.127895 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:59.127426    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb" event={"ID":"aab3455c-a9cf-4d43-9998-f061595a2456","Type":"ContainerDied","Data":"c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833"}
Oct 30 03:35:59.127895 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:59.127464    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb" event={"ID":"aab3455c-a9cf-4d43-9998-f061595a2456","Type":"ContainerDied","Data":"54ab7979e2c5a535e091dd9ee6f04b89ef03a7ab996af166ec8275282a0fadd2"}
Oct 30 03:35:59.127895 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:59.127480    5981 scope.go:122] "RemoveContainer" containerID="c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833"
Oct 30 03:35:59.136177 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:59.136161    5981 scope.go:122] "RemoveContainer" containerID="c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833"
Oct 30 03:35:59.136465 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:35:59.136445    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833\": container with ID starting with c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833 not found: ID does not exist" containerID="c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833"
Oct 30 03:35:59.136522 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:59.136474    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833"} err="failed to get container status \"c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833\": rpc error: code = NotFound desc = could not find container \"c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833\": container with ID starting with c9ee1f8d80e809265b3d027d29161a420ace9da55bd58c6e3c656e9d8a57d833 not found: ID does not exist"
Oct 30 03:35:59.180862 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:59.180835    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"]
Oct 30 03:35:59.190506 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:35:59.190485    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d794647f5-fdjfb"]
Oct 30 03:36:00.274224 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:00.274188    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aab3455c-a9cf-4d43-9998-f061595a2456" path="/var/lib/kubelet/pods/aab3455c-a9cf-4d43-9998-f061595a2456/volumes"
Oct 30 03:36:05.238686 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.238656    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"]
Oct 30 03:36:05.239089 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.239031    5981 cpu_manager.go:414] "containerMap: removing container" podUID="aab3455c-a9cf-4d43-9998-f061595a2456" containerName="ta-container"
Oct 30 03:36:05.239089 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.239045    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aab3455c-a9cf-4d43-9998-f061595a2456" containerName="ta-container"
Oct 30 03:36:05.239162 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.239123    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="aab3455c-a9cf-4d43-9998-f061595a2456" containerName="ta-container"
Oct 30 03:36:05.242539 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.242522    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:05.273410 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.273381    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"]
Oct 30 03:36:05.311928 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.311895    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b0e9c986-6381-418b-8db2-7660bcd11af6-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-797f4bd8cc-spncl\" (UID: \"b0e9c986-6381-418b-8db2-7660bcd11af6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:05.312084 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.311941    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7g9c\" (UniqueName: \"kubernetes.io/projected/b0e9c986-6381-418b-8db2-7660bcd11af6-kube-api-access-l7g9c\") pod \"data-science-collector-targetallocator-797f4bd8cc-spncl\" (UID: \"b0e9c986-6381-418b-8db2-7660bcd11af6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:05.312084 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.312018    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b0e9c986-6381-418b-8db2-7660bcd11af6-ta-internal\") pod \"data-science-collector-targetallocator-797f4bd8cc-spncl\" (UID: \"b0e9c986-6381-418b-8db2-7660bcd11af6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:05.412978 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.412942    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b0e9c986-6381-418b-8db2-7660bcd11af6-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-797f4bd8cc-spncl\" (UID: \"b0e9c986-6381-418b-8db2-7660bcd11af6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:05.413158 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.413003    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7g9c\" (UniqueName: \"kubernetes.io/projected/b0e9c986-6381-418b-8db2-7660bcd11af6-kube-api-access-l7g9c\") pod \"data-science-collector-targetallocator-797f4bd8cc-spncl\" (UID: \"b0e9c986-6381-418b-8db2-7660bcd11af6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:05.413158 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.413035    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b0e9c986-6381-418b-8db2-7660bcd11af6-ta-internal\") pod \"data-science-collector-targetallocator-797f4bd8cc-spncl\" (UID: \"b0e9c986-6381-418b-8db2-7660bcd11af6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:05.413730 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.413701    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b0e9c986-6381-418b-8db2-7660bcd11af6-ta-internal\") pod \"data-science-collector-targetallocator-797f4bd8cc-spncl\" (UID: \"b0e9c986-6381-418b-8db2-7660bcd11af6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:05.415612 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.415578    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b0e9c986-6381-418b-8db2-7660bcd11af6-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-797f4bd8cc-spncl\" (UID: \"b0e9c986-6381-418b-8db2-7660bcd11af6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:05.434009 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.433981    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7g9c\" (UniqueName: \"kubernetes.io/projected/b0e9c986-6381-418b-8db2-7660bcd11af6-kube-api-access-l7g9c\") pod \"data-science-collector-targetallocator-797f4bd8cc-spncl\" (UID: \"b0e9c986-6381-418b-8db2-7660bcd11af6\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:05.553276 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.553190    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:05.845305 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.845260    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"]
Oct 30 03:36:05.847378 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:36:05.847348    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0e9c986_6381_418b_8db2_7660bcd11af6.slice/crio-d51a4297365a596ead943014337c173f3eb16b37547659430451ff8d3e1cd44c WatchSource:0}: Error finding container d51a4297365a596ead943014337c173f3eb16b37547659430451ff8d3e1cd44c: Status 404 returned error can't find the container with id d51a4297365a596ead943014337c173f3eb16b37547659430451ff8d3e1cd44c
Oct 30 03:36:05.849580 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.849553    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:36:05.849638 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:05.849605    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:36:06.157305 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:06.157252    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl" event={"ID":"b0e9c986-6381-418b-8db2-7660bcd11af6","Type":"ContainerStarted","Data":"4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe"}
Oct 30 03:36:06.157479 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:06.157318    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl" event={"ID":"b0e9c986-6381-418b-8db2-7660bcd11af6","Type":"ContainerStarted","Data":"d51a4297365a596ead943014337c173f3eb16b37547659430451ff8d3e1cd44c"}
Oct 30 03:36:06.157523 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:06.157493    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:06.158493 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:06.158470    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl" podUID="b0e9c986-6381-418b-8db2-7660bcd11af6" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.57:8080/readyz\": dial tcp 10.134.0.57:8080: connect: connection refused"
Oct 30 03:36:06.197233 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:06.197186    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl" podStartSLOduration=1.197173363 podStartE2EDuration="1.197173363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:36:06.196999865 +0000 UTC m=+3206.039246328" watchObservedRunningTime="2026-10-30 03:36:06.197173363 +0000 UTC m=+3206.039419808"
Oct 30 03:36:07.162866 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.162835    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:07.236605 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.236575    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"]
Oct 30 03:36:07.236761 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.236728    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p" podUID="784ce5f4-7610-4f4f-986e-51a1c0fc507c" containerName="ta-container" containerID="cri-o://8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b" gracePeriod=30
Oct 30 03:36:07.477577 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.477545    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:36:07.534009 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.533982    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/784ce5f4-7610-4f4f-986e-51a1c0fc507c-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/784ce5f4-7610-4f4f-986e-51a1c0fc507c-data-science-collector-ta-server-cert\") pod \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\" (UID: \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\") "
Oct 30 03:36:07.534148 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.534090    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/784ce5f4-7610-4f4f-986e-51a1c0fc507c-kube-api-access-znthf\" (UniqueName: \"kubernetes.io/projected/784ce5f4-7610-4f4f-986e-51a1c0fc507c-kube-api-access-znthf\") pod \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\" (UID: \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\") "
Oct 30 03:36:07.534148 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.534140    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/784ce5f4-7610-4f4f-986e-51a1c0fc507c-ta-internal\" (UniqueName: \"kubernetes.io/configmap/784ce5f4-7610-4f4f-986e-51a1c0fc507c-ta-internal\") pod \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\" (UID: \"784ce5f4-7610-4f4f-986e-51a1c0fc507c\") "
Oct 30 03:36:07.534604 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.534575    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/784ce5f4-7610-4f4f-986e-51a1c0fc507c-ta-internal" pod "784ce5f4-7610-4f4f-986e-51a1c0fc507c" (UID: "784ce5f4-7610-4f4f-986e-51a1c0fc507c"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:36:07.536265 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.536242    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/784ce5f4-7610-4f4f-986e-51a1c0fc507c-data-science-collector-ta-server-cert" pod "784ce5f4-7610-4f4f-986e-51a1c0fc507c" (UID: "784ce5f4-7610-4f4f-986e-51a1c0fc507c"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:36:07.536378 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.536269    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/784ce5f4-7610-4f4f-986e-51a1c0fc507c-kube-api-access-znthf" pod "784ce5f4-7610-4f4f-986e-51a1c0fc507c" (UID: "784ce5f4-7610-4f4f-986e-51a1c0fc507c"). InnerVolumeSpecName "kube-api-access-znthf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:36:07.635784 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.635752    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znthf\" (UniqueName: \"kubernetes.io/projected/784ce5f4-7610-4f4f-986e-51a1c0fc507c-kube-api-access-znthf\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:07.635784 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.635777    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/784ce5f4-7610-4f4f-986e-51a1c0fc507c-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:07.635784 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:07.635787    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/784ce5f4-7610-4f4f-986e-51a1c0fc507c-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:08.166318 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:08.166263    5981 generic.go:356] "Generic (PLEG): container finished" podID="784ce5f4-7610-4f4f-986e-51a1c0fc507c" containerID="8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b" exitCode=0
Oct 30 03:36:08.166783 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:08.166335    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p" event={"ID":"784ce5f4-7610-4f4f-986e-51a1c0fc507c","Type":"ContainerDied","Data":"8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b"}
Oct 30 03:36:08.166783 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:08.166364    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p" event={"ID":"784ce5f4-7610-4f4f-986e-51a1c0fc507c","Type":"ContainerDied","Data":"d6391365c391ecdbbc37f66332a2e258e39111a40155e353aa549fef001b2de6"}
Oct 30 03:36:08.166783 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:08.166380    5981 scope.go:122] "RemoveContainer" containerID="8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b"
Oct 30 03:36:08.166783 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:08.166336    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"
Oct 30 03:36:08.176018 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:08.175997    5981 scope.go:122] "RemoveContainer" containerID="8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b"
Oct 30 03:36:08.176306 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:36:08.176267    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b\": container with ID starting with 8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b not found: ID does not exist" containerID="8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b"
Oct 30 03:36:08.176400 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:08.176319    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b"} err="failed to get container status \"8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b\": rpc error: code = NotFound desc = could not find container \"8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b\": container with ID starting with 8741ebefcc965fcd819b1286c2d31080851fd97d2328fb4076ab1c5fe30bb86b not found: ID does not exist"
Oct 30 03:36:08.217505 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:08.217479    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"]
Oct 30 03:36:08.230332 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:08.230306    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c9b4ff486-jmx2p"]
Oct 30 03:36:08.274837 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:08.274808    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="784ce5f4-7610-4f4f-986e-51a1c0fc507c" path="/var/lib/kubelet/pods/784ce5f4-7610-4f4f-986e-51a1c0fc507c/volumes"
Oct 30 03:36:10.948589 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:10.948556    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"]
Oct 30 03:36:10.948998 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:10.948922    5981 cpu_manager.go:414] "containerMap: removing container" podUID="784ce5f4-7610-4f4f-986e-51a1c0fc507c" containerName="ta-container"
Oct 30 03:36:10.948998 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:10.948935    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="784ce5f4-7610-4f4f-986e-51a1c0fc507c" containerName="ta-container"
Oct 30 03:36:10.949095 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:10.949017    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="784ce5f4-7610-4f4f-986e-51a1c0fc507c" containerName="ta-container"
Oct 30 03:36:10.951923 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:10.951905    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:10.978064 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:10.978027    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"]
Oct 30 03:36:11.063300 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.063256    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fe1d63a5-0f92-468d-8d48-abaef3486c69-ta-internal\") pod \"data-science-collector-targetallocator-dc5ff85b8-tdwlg\" (UID: \"fe1d63a5-0f92-468d-8d48-abaef3486c69\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:11.063484 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.063364    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvlwl\" (UniqueName: \"kubernetes.io/projected/fe1d63a5-0f92-468d-8d48-abaef3486c69-kube-api-access-xvlwl\") pod \"data-science-collector-targetallocator-dc5ff85b8-tdwlg\" (UID: \"fe1d63a5-0f92-468d-8d48-abaef3486c69\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:11.063484 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.063394    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fe1d63a5-0f92-468d-8d48-abaef3486c69-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-dc5ff85b8-tdwlg\" (UID: \"fe1d63a5-0f92-468d-8d48-abaef3486c69\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:11.164077 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.164026    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvlwl\" (UniqueName: \"kubernetes.io/projected/fe1d63a5-0f92-468d-8d48-abaef3486c69-kube-api-access-xvlwl\") pod \"data-science-collector-targetallocator-dc5ff85b8-tdwlg\" (UID: \"fe1d63a5-0f92-468d-8d48-abaef3486c69\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:11.164257 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.164093    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fe1d63a5-0f92-468d-8d48-abaef3486c69-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-dc5ff85b8-tdwlg\" (UID: \"fe1d63a5-0f92-468d-8d48-abaef3486c69\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:11.164257 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.164180    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fe1d63a5-0f92-468d-8d48-abaef3486c69-ta-internal\") pod \"data-science-collector-targetallocator-dc5ff85b8-tdwlg\" (UID: \"fe1d63a5-0f92-468d-8d48-abaef3486c69\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:11.165002 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.164960    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fe1d63a5-0f92-468d-8d48-abaef3486c69-ta-internal\") pod \"data-science-collector-targetallocator-dc5ff85b8-tdwlg\" (UID: \"fe1d63a5-0f92-468d-8d48-abaef3486c69\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:11.166886 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.166854    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fe1d63a5-0f92-468d-8d48-abaef3486c69-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-dc5ff85b8-tdwlg\" (UID: \"fe1d63a5-0f92-468d-8d48-abaef3486c69\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:11.185093 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.185062    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvlwl\" (UniqueName: \"kubernetes.io/projected/fe1d63a5-0f92-468d-8d48-abaef3486c69-kube-api-access-xvlwl\") pod \"data-science-collector-targetallocator-dc5ff85b8-tdwlg\" (UID: \"fe1d63a5-0f92-468d-8d48-abaef3486c69\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:11.263214 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.263105    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:11.557916 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.557883    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"]
Oct 30 03:36:11.560820 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:36:11.560792    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe1d63a5_0f92_468d_8d48_abaef3486c69.slice/crio-57e89055fd0e67963539c648aadd3df8e189265aea7bcb127aff1cf38713c423 WatchSource:0}: Error finding container 57e89055fd0e67963539c648aadd3df8e189265aea7bcb127aff1cf38713c423: Status 404 returned error can't find the container with id 57e89055fd0e67963539c648aadd3df8e189265aea7bcb127aff1cf38713c423
Oct 30 03:36:11.563394 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.563358    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:36:11.563503 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:11.563431    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:36:12.185744 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.185705    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg" event={"ID":"fe1d63a5-0f92-468d-8d48-abaef3486c69","Type":"ContainerStarted","Data":"00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b"}
Oct 30 03:36:12.185744 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.185749    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg" event={"ID":"fe1d63a5-0f92-468d-8d48-abaef3486c69","Type":"ContainerStarted","Data":"57e89055fd0e67963539c648aadd3df8e189265aea7bcb127aff1cf38713c423"}
Oct 30 03:36:12.186174 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.185860    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:12.187687 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.187665    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:12.227157 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.227095    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg" podStartSLOduration=2.227080164 podStartE2EDuration="2.227080164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:36:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:36:12.225859659 +0000 UTC m=+3212.068106125" watchObservedRunningTime="2026-10-30 03:36:12.227080164 +0000 UTC m=+3212.069326608"
Oct 30 03:36:12.297058 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.297029    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"]
Oct 30 03:36:12.297254 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.297224    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl" podUID="b0e9c986-6381-418b-8db2-7660bcd11af6" containerName="ta-container" containerID="cri-o://4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe" gracePeriod=30
Oct 30 03:36:12.546163 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.546132    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:12.679792 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.679749    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b0e9c986-6381-418b-8db2-7660bcd11af6-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b0e9c986-6381-418b-8db2-7660bcd11af6-data-science-collector-ta-server-cert\") pod \"b0e9c986-6381-418b-8db2-7660bcd11af6\" (UID: \"b0e9c986-6381-418b-8db2-7660bcd11af6\") "
Oct 30 03:36:12.679989 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.679837    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b0e9c986-6381-418b-8db2-7660bcd11af6-ta-internal\" (UniqueName: \"kubernetes.io/configmap/b0e9c986-6381-418b-8db2-7660bcd11af6-ta-internal\") pod \"b0e9c986-6381-418b-8db2-7660bcd11af6\" (UID: \"b0e9c986-6381-418b-8db2-7660bcd11af6\") "
Oct 30 03:36:12.679989 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.679886    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0e9c986-6381-418b-8db2-7660bcd11af6-kube-api-access-l7g9c\" (UniqueName: \"kubernetes.io/projected/b0e9c986-6381-418b-8db2-7660bcd11af6-kube-api-access-l7g9c\") pod \"b0e9c986-6381-418b-8db2-7660bcd11af6\" (UID: \"b0e9c986-6381-418b-8db2-7660bcd11af6\") "
Oct 30 03:36:12.680273 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.680252    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0e9c986-6381-418b-8db2-7660bcd11af6-ta-internal" pod "b0e9c986-6381-418b-8db2-7660bcd11af6" (UID: "b0e9c986-6381-418b-8db2-7660bcd11af6"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:36:12.682213 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.682178    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e9c986-6381-418b-8db2-7660bcd11af6-kube-api-access-l7g9c" pod "b0e9c986-6381-418b-8db2-7660bcd11af6" (UID: "b0e9c986-6381-418b-8db2-7660bcd11af6"). InnerVolumeSpecName "kube-api-access-l7g9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:36:12.682387 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.682230    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0e9c986-6381-418b-8db2-7660bcd11af6-data-science-collector-ta-server-cert" pod "b0e9c986-6381-418b-8db2-7660bcd11af6" (UID: "b0e9c986-6381-418b-8db2-7660bcd11af6"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:36:12.781262 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.781154    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b0e9c986-6381-418b-8db2-7660bcd11af6-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:12.781262 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.781200    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7g9c\" (UniqueName: \"kubernetes.io/projected/b0e9c986-6381-418b-8db2-7660bcd11af6-kube-api-access-l7g9c\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:12.781262 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:12.781212    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b0e9c986-6381-418b-8db2-7660bcd11af6-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:13.191642 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:13.191611    5981 generic.go:356] "Generic (PLEG): container finished" podID="b0e9c986-6381-418b-8db2-7660bcd11af6" containerID="4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe" exitCode=0
Oct 30 03:36:13.192109 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:13.191658    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"
Oct 30 03:36:13.192109 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:13.191694    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl" event={"ID":"b0e9c986-6381-418b-8db2-7660bcd11af6","Type":"ContainerDied","Data":"4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe"}
Oct 30 03:36:13.192109 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:13.191739    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl" event={"ID":"b0e9c986-6381-418b-8db2-7660bcd11af6","Type":"ContainerDied","Data":"d51a4297365a596ead943014337c173f3eb16b37547659430451ff8d3e1cd44c"}
Oct 30 03:36:13.192109 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:13.191761    5981 scope.go:122] "RemoveContainer" containerID="4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe"
Oct 30 03:36:13.201094 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:13.201074    5981 scope.go:122] "RemoveContainer" containerID="4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe"
Oct 30 03:36:13.201409 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:36:13.201387    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe\": container with ID starting with 4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe not found: ID does not exist" containerID="4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe"
Oct 30 03:36:13.201472 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:13.201420    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe"} err="failed to get container status \"4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe\": rpc error: code = NotFound desc = could not find container \"4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe\": container with ID starting with 4d41603b6d04e3574d3f9d3a5ae1ec9314177298c1cb726a7b985c123bed1dfe not found: ID does not exist"
Oct 30 03:36:13.243688 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:13.243653    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"]
Oct 30 03:36:13.256828 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:13.256799    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-797f4bd8cc-spncl"]
Oct 30 03:36:14.275120 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:14.275087    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b0e9c986-6381-418b-8db2-7660bcd11af6" path="/var/lib/kubelet/pods/b0e9c986-6381-418b-8db2-7660bcd11af6/volumes"
Oct 30 03:36:14.369383 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:36:14.369348    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:36:18.794647 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:18.794614    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"]
Oct 30 03:36:18.795041 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:18.794950    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b0e9c986-6381-418b-8db2-7660bcd11af6" containerName="ta-container"
Oct 30 03:36:18.795041 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:18.794961    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0e9c986-6381-418b-8db2-7660bcd11af6" containerName="ta-container"
Oct 30 03:36:18.795041 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:18.795029    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0e9c986-6381-418b-8db2-7660bcd11af6" containerName="ta-container"
Oct 30 03:36:18.799185 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:18.799165    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:18.829302 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:18.829254    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"]
Oct 30 03:36:18.942428 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:18.942387    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/764d7c01-2a17-47a3-a746-8f5d101b3dc4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bdcd8d6c-wqw5k\" (UID: \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:18.942611 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:18.942531    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtn7x\" (UniqueName: \"kubernetes.io/projected/764d7c01-2a17-47a3-a746-8f5d101b3dc4-kube-api-access-jtn7x\") pod \"data-science-collector-targetallocator-5bdcd8d6c-wqw5k\" (UID: \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:18.942611 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:18.942582    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/764d7c01-2a17-47a3-a746-8f5d101b3dc4-ta-internal\") pod \"data-science-collector-targetallocator-5bdcd8d6c-wqw5k\" (UID: \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:19.043685 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:19.043646    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtn7x\" (UniqueName: \"kubernetes.io/projected/764d7c01-2a17-47a3-a746-8f5d101b3dc4-kube-api-access-jtn7x\") pod \"data-science-collector-targetallocator-5bdcd8d6c-wqw5k\" (UID: \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:19.043834 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:19.043696    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/764d7c01-2a17-47a3-a746-8f5d101b3dc4-ta-internal\") pod \"data-science-collector-targetallocator-5bdcd8d6c-wqw5k\" (UID: \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:19.043834 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:19.043736    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/764d7c01-2a17-47a3-a746-8f5d101b3dc4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bdcd8d6c-wqw5k\" (UID: \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:19.044508 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:19.044489    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/764d7c01-2a17-47a3-a746-8f5d101b3dc4-ta-internal\") pod \"data-science-collector-targetallocator-5bdcd8d6c-wqw5k\" (UID: \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:19.046439 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:19.046383    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/764d7c01-2a17-47a3-a746-8f5d101b3dc4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bdcd8d6c-wqw5k\" (UID: \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:19.064171 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:19.064140    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtn7x\" (UniqueName: \"kubernetes.io/projected/764d7c01-2a17-47a3-a746-8f5d101b3dc4-kube-api-access-jtn7x\") pod \"data-science-collector-targetallocator-5bdcd8d6c-wqw5k\" (UID: \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:19.110225 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:19.110183    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:19.401640 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:19.401615    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"]
Oct 30 03:36:19.403139 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:36:19.403112    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod764d7c01_2a17_47a3_a746_8f5d101b3dc4.slice/crio-c35bd10cc7811c99e45c2b4f69c89eff4d3e2273e550f0b2692a2d5d7366d827 WatchSource:0}: Error finding container c35bd10cc7811c99e45c2b4f69c89eff4d3e2273e550f0b2692a2d5d7366d827: Status 404 returned error can't find the container with id c35bd10cc7811c99e45c2b4f69c89eff4d3e2273e550f0b2692a2d5d7366d827
Oct 30 03:36:19.405317 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:19.405269    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:36:19.405389 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:19.405345    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:36:20.223225 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.223188    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k" event={"ID":"764d7c01-2a17-47a3-a746-8f5d101b3dc4","Type":"ContainerStarted","Data":"d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4"}
Oct 30 03:36:20.223647 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.223238    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k" event={"ID":"764d7c01-2a17-47a3-a746-8f5d101b3dc4","Type":"ContainerStarted","Data":"c35bd10cc7811c99e45c2b4f69c89eff4d3e2273e550f0b2692a2d5d7366d827"}
Oct 30 03:36:20.223647 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.223256    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:20.224910 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.224883    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:20.264936 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.264884    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k" podStartSLOduration=2.2648696 podStartE2EDuration="2.2648696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:36:20.264076071 +0000 UTC m=+3220.106322498" watchObservedRunningTime="2026-10-30 03:36:20.2648696 +0000 UTC m=+3220.107116044"
Oct 30 03:36:20.336416 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.336386    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"]
Oct 30 03:36:20.336592 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.336571    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg" podUID="fe1d63a5-0f92-468d-8d48-abaef3486c69" containerName="ta-container" containerID="cri-o://00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b" gracePeriod=30
Oct 30 03:36:20.585354 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.585329    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:20.757241 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.757151    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe1d63a5-0f92-468d-8d48-abaef3486c69-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fe1d63a5-0f92-468d-8d48-abaef3486c69-data-science-collector-ta-server-cert\") pod \"fe1d63a5-0f92-468d-8d48-abaef3486c69\" (UID: \"fe1d63a5-0f92-468d-8d48-abaef3486c69\") "
Oct 30 03:36:20.757424 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.757251    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fe1d63a5-0f92-468d-8d48-abaef3486c69-kube-api-access-xvlwl\" (UniqueName: \"kubernetes.io/projected/fe1d63a5-0f92-468d-8d48-abaef3486c69-kube-api-access-xvlwl\") pod \"fe1d63a5-0f92-468d-8d48-abaef3486c69\" (UID: \"fe1d63a5-0f92-468d-8d48-abaef3486c69\") "
Oct 30 03:36:20.757424 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.757322    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe1d63a5-0f92-468d-8d48-abaef3486c69-ta-internal\" (UniqueName: \"kubernetes.io/configmap/fe1d63a5-0f92-468d-8d48-abaef3486c69-ta-internal\") pod \"fe1d63a5-0f92-468d-8d48-abaef3486c69\" (UID: \"fe1d63a5-0f92-468d-8d48-abaef3486c69\") "
Oct 30 03:36:20.757702 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.757676    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe1d63a5-0f92-468d-8d48-abaef3486c69-ta-internal" pod "fe1d63a5-0f92-468d-8d48-abaef3486c69" (UID: "fe1d63a5-0f92-468d-8d48-abaef3486c69"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:36:20.759569 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.759542    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe1d63a5-0f92-468d-8d48-abaef3486c69-kube-api-access-xvlwl" pod "fe1d63a5-0f92-468d-8d48-abaef3486c69" (UID: "fe1d63a5-0f92-468d-8d48-abaef3486c69"). InnerVolumeSpecName "kube-api-access-xvlwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:36:20.759569 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.759553    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe1d63a5-0f92-468d-8d48-abaef3486c69-data-science-collector-ta-server-cert" pod "fe1d63a5-0f92-468d-8d48-abaef3486c69" (UID: "fe1d63a5-0f92-468d-8d48-abaef3486c69"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:36:20.858429 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.858394    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fe1d63a5-0f92-468d-8d48-abaef3486c69-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:20.858429 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.858423    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvlwl\" (UniqueName: \"kubernetes.io/projected/fe1d63a5-0f92-468d-8d48-abaef3486c69-kube-api-access-xvlwl\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:20.858429 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:20.858435    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fe1d63a5-0f92-468d-8d48-abaef3486c69-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:21.234458 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:21.234427    5981 generic.go:356] "Generic (PLEG): container finished" podID="fe1d63a5-0f92-468d-8d48-abaef3486c69" containerID="00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b" exitCode=0
Oct 30 03:36:21.234941 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:21.234487    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"
Oct 30 03:36:21.234941 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:21.234519    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg" event={"ID":"fe1d63a5-0f92-468d-8d48-abaef3486c69","Type":"ContainerDied","Data":"00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b"}
Oct 30 03:36:21.234941 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:21.234565    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg" event={"ID":"fe1d63a5-0f92-468d-8d48-abaef3486c69","Type":"ContainerDied","Data":"57e89055fd0e67963539c648aadd3df8e189265aea7bcb127aff1cf38713c423"}
Oct 30 03:36:21.234941 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:21.234588    5981 scope.go:122] "RemoveContainer" containerID="00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b"
Oct 30 03:36:21.244101 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:21.244084    5981 scope.go:122] "RemoveContainer" containerID="00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b"
Oct 30 03:36:21.244404 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:36:21.244385    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b\": container with ID starting with 00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b not found: ID does not exist" containerID="00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b"
Oct 30 03:36:21.244458 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:21.244413    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b"} err="failed to get container status \"00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b\": rpc error: code = NotFound desc = could not find container \"00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b\": container with ID starting with 00d575ef1b07c95bc886619b6a917d1ab2e315a5e91665ccd30f3b4e8a6fac2b not found: ID does not exist"
Oct 30 03:36:21.286161 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:21.286138    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"]
Oct 30 03:36:21.299023 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:21.299001    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-dc5ff85b8-tdwlg"]
Oct 30 03:36:22.015292 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.015245    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 03:36:22.015638 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.015625    5981 cpu_manager.go:414] "containerMap: removing container" podUID="fe1d63a5-0f92-468d-8d48-abaef3486c69" containerName="ta-container"
Oct 30 03:36:22.015682 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.015639    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe1d63a5-0f92-468d-8d48-abaef3486c69" containerName="ta-container"
Oct 30 03:36:22.015722 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.015713    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe1d63a5-0f92-468d-8d48-abaef3486c69" containerName="ta-container"
Oct 30 03:36:22.019924 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.019903    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 03:36:22.034579 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.034553    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 03:36:22.035250 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.035229    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"odh-observability-metrics-ca\""
Oct 30 03:36:22.170153 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.170117    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rvhs\" (UniqueName: \"kubernetes.io/projected/47055809-3a6f-4fea-99d0-0a81b1605a32-kube-api-access-6rvhs\") pod \"operator-metrics-auth-probe\" (UID: \"47055809-3a6f-4fea-99d0-0a81b1605a32\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 03:36:22.170343 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.170183    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-ca\" (UniqueName: \"kubernetes.io/configmap/47055809-3a6f-4fea-99d0-0a81b1605a32-metrics-ca\") pod \"operator-metrics-auth-probe\" (UID: \"47055809-3a6f-4fea-99d0-0a81b1605a32\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 03:36:22.271203 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.271108    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-ca\" (UniqueName: \"kubernetes.io/configmap/47055809-3a6f-4fea-99d0-0a81b1605a32-metrics-ca\") pod \"operator-metrics-auth-probe\" (UID: \"47055809-3a6f-4fea-99d0-0a81b1605a32\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 03:36:22.271612 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.271211    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rvhs\" (UniqueName: \"kubernetes.io/projected/47055809-3a6f-4fea-99d0-0a81b1605a32-kube-api-access-6rvhs\") pod \"operator-metrics-auth-probe\" (UID: \"47055809-3a6f-4fea-99d0-0a81b1605a32\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 03:36:22.271960 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.271940    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-ca\" (UniqueName: \"kubernetes.io/configmap/47055809-3a6f-4fea-99d0-0a81b1605a32-metrics-ca\") pod \"operator-metrics-auth-probe\" (UID: \"47055809-3a6f-4fea-99d0-0a81b1605a32\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 03:36:22.274352 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.274331    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fe1d63a5-0f92-468d-8d48-abaef3486c69" path="/var/lib/kubelet/pods/fe1d63a5-0f92-468d-8d48-abaef3486c69/volumes"
Oct 30 03:36:22.300316 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.300265    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rvhs\" (UniqueName: \"kubernetes.io/projected/47055809-3a6f-4fea-99d0-0a81b1605a32-kube-api-access-6rvhs\") pod \"operator-metrics-auth-probe\" (UID: \"47055809-3a6f-4fea-99d0-0a81b1605a32\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 03:36:22.331081 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.331045    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 03:36:22.637899 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:22.637872    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 03:36:22.639822 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:36:22.639792    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47055809_3a6f_4fea_99d0_0a81b1605a32.slice/crio-f7b3b4b5e8f2dc7a2cd99761ae7956ed85dab7a747437441649d5801ff58876b WatchSource:0}: Error finding container f7b3b4b5e8f2dc7a2cd99761ae7956ed85dab7a747437441649d5801ff58876b: Status 404 returned error can't find the container with id f7b3b4b5e8f2dc7a2cd99761ae7956ed85dab7a747437441649d5801ff58876b
Oct 30 03:36:23.246210 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:23.246174    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/operator-metrics-auth-probe" event={"ID":"47055809-3a6f-4fea-99d0-0a81b1605a32","Type":"ContainerStarted","Data":"8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77"}
Oct 30 03:36:23.246506 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:23.246216    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/operator-metrics-auth-probe" event={"ID":"47055809-3a6f-4fea-99d0-0a81b1605a32","Type":"ContainerStarted","Data":"f7b3b4b5e8f2dc7a2cd99761ae7956ed85dab7a747437441649d5801ff58876b"}
Oct 30 03:36:23.285245 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:23.285195    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/operator-metrics-auth-probe" podStartSLOduration=2.2851823749999998 podStartE2EDuration="2.285182375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:36:23.284636339 +0000 UTC m=+3223.126882784" watchObservedRunningTime="2026-10-30 03:36:23.285182375 +0000 UTC m=+3223.127428816"
Oct 30 03:36:27.895680 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:27.895643    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 03:36:27.896230 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:27.895824    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/operator-metrics-auth-probe" podUID="47055809-3a6f-4fea-99d0-0a81b1605a32" containerName="curl" containerID="cri-o://8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77" gracePeriod=30
Oct 30 03:36:36.460474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:36.460439    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e331674ddc2e45"]
Oct 30 03:36:36.464253 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:36.464228    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e331674ddc2e45"
Oct 30 03:36:36.475008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:36.474980    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e331674ddc2e45"
Oct 30 03:36:36.477044 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:36.477022    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e331674ddc2e45"]
Oct 30 03:36:36.769256 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:36.769221    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e331674ddc2e45"]
Oct 30 03:36:36.771372 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:36:36.771340    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8a389cb_b5a1_4d64_be4a_4d8c3951cc22.slice/crio-f279766f8d9492285d9dc20b962aff3b179e1ca1a313cdc0df483018b9914dd8 WatchSource:0}: Error finding container f279766f8d9492285d9dc20b962aff3b179e1ca1a313cdc0df483018b9914dd8: Status 404 returned error can't find the container with id f279766f8d9492285d9dc20b962aff3b179e1ca1a313cdc0df483018b9914dd8
Oct 30 03:36:36.773482 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:36.773462    5981 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 03:36:37.307240 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:37.307204    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e331674ddc2e45" event={"ID":"c8a389cb-b5a1-4d64-be4a-4d8c3951cc22","Type":"ContainerStarted","Data":"f279766f8d9492285d9dc20b962aff3b179e1ca1a313cdc0df483018b9914dd8"}
Oct 30 03:36:40.321271 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:40.321238    5981 generic.go:356] "Generic (PLEG): container finished" podID="c8a389cb-b5a1-4d64-be4a-4d8c3951cc22" containerID="dce58e42c213c4be25814e701c7878593fbcd1be9006d5d123a86d3271622e79" exitCode=0
Oct 30 03:36:40.321691 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:40.321364    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e331674ddc2e45" event={"ID":"c8a389cb-b5a1-4d64-be4a-4d8c3951cc22","Type":"ContainerDied","Data":"dce58e42c213c4be25814e701c7878593fbcd1be9006d5d123a86d3271622e79"}
Oct 30 03:36:41.458956 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:41.458917    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e331674ddc2e45"
Oct 30 03:36:42.329766 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:42.329742    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e331674ddc2e45"
Oct 30 03:36:42.329932 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:42.329781    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e331674ddc2e45" event={"ID":"c8a389cb-b5a1-4d64-be4a-4d8c3951cc22","Type":"ContainerDied","Data":"f279766f8d9492285d9dc20b962aff3b179e1ca1a313cdc0df483018b9914dd8"}
Oct 30 03:36:42.329932 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:42.329825    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f279766f8d9492285d9dc20b962aff3b179e1ca1a313cdc0df483018b9914dd8"
Oct 30 03:36:44.370923 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:36:44.370883    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:36:54.876098 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:54.876012    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8"]
Oct 30 03:36:54.876551 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:54.876363    5981 cpu_manager.go:414] "containerMap: removing container" podUID="c8a389cb-b5a1-4d64-be4a-4d8c3951cc22" containerName="curl"
Oct 30 03:36:54.876551 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:54.876374    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8a389cb-b5a1-4d64-be4a-4d8c3951cc22" containerName="curl"
Oct 30 03:36:54.876551 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:54.876462    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8a389cb-b5a1-4d64-be4a-4d8c3951cc22" containerName="curl"
Oct 30 03:36:54.879604 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:54.879586    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8"
Oct 30 03:36:54.890067 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:54.890049    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8"
Oct 30 03:36:54.895579 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:54.895551    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8"]
Oct 30 03:36:55.184861 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:55.184835    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8"]
Oct 30 03:36:55.389168 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:55.389135    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8" event={"ID":"bc5ca459-9245-454f-840c-b85a40bde164","Type":"ContainerStarted","Data":"4569d7606b16baef12866754a21293923c70d17435a215b7cbd351ecfdef9508"}
Oct 30 03:36:55.389382 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:55.389178    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8" event={"ID":"bc5ca459-9245-454f-840c-b85a40bde164","Type":"ContainerStarted","Data":"2f8699d6b77493f8b2a6b12d869e25eb6e1cbe041d8728a9c12eee03b670518e"}
Oct 30 03:36:55.427404 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:55.427355    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8" podStartSLOduration=1.427341065 podStartE2EDuration="1.427341065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:36:55.427311498 +0000 UTC m=+3255.269557944" watchObservedRunningTime="2026-10-30 03:36:55.427341065 +0000 UTC m=+3255.269587509"
Oct 30 03:36:57.222948 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.222905    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"]
Oct 30 03:36:57.226114 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.226096    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:57.243796 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.243767    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"]
Oct 30 03:36:57.276086 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.276054    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6b95f49c9f-cm4pz\" (UID: \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:57.276221 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.276102    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqd2n\" (UniqueName: \"kubernetes.io/projected/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-kube-api-access-xqd2n\") pod \"data-science-collector-targetallocator-6b95f49c9f-cm4pz\" (UID: \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:57.276259 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.276231    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-ta-internal\") pod \"data-science-collector-targetallocator-6b95f49c9f-cm4pz\" (UID: \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:57.376630 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.376591    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-ta-internal\") pod \"data-science-collector-targetallocator-6b95f49c9f-cm4pz\" (UID: \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:57.376772 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.376642    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6b95f49c9f-cm4pz\" (UID: \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:57.376772 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.376670    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqd2n\" (UniqueName: \"kubernetes.io/projected/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-kube-api-access-xqd2n\") pod \"data-science-collector-targetallocator-6b95f49c9f-cm4pz\" (UID: \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:57.377230 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.377202    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-ta-internal\") pod \"data-science-collector-targetallocator-6b95f49c9f-cm4pz\" (UID: \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:57.379256 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.379234    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6b95f49c9f-cm4pz\" (UID: \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:57.396951 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.396928    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqd2n\" (UniqueName: \"kubernetes.io/projected/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-kube-api-access-xqd2n\") pod \"data-science-collector-targetallocator-6b95f49c9f-cm4pz\" (UID: \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:57.537972 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.537881    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:57.830165 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.830140    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"]
Oct 30 03:36:57.834158 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.834121    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:36:57.834301 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:57.834190    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:36:57.931094 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:36:57.931056    5981 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47055809_3a6f_4fea_99d0_0a81b1605a32.slice/crio-8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47055809_3a6f_4fea_99d0_0a81b1605a32.slice/crio-conmon-8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 03:36:58.028782 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.028756    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 03:36:58.082605 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.082523    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47055809-3a6f-4fea-99d0-0a81b1605a32-kube-api-access-6rvhs\" (UniqueName: \"kubernetes.io/projected/47055809-3a6f-4fea-99d0-0a81b1605a32-kube-api-access-6rvhs\") pod \"47055809-3a6f-4fea-99d0-0a81b1605a32\" (UID: \"47055809-3a6f-4fea-99d0-0a81b1605a32\") "
Oct 30 03:36:58.082605 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.082585    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/47055809-3a6f-4fea-99d0-0a81b1605a32-metrics-ca\" (UniqueName: \"kubernetes.io/configmap/47055809-3a6f-4fea-99d0-0a81b1605a32-metrics-ca\") pod \"47055809-3a6f-4fea-99d0-0a81b1605a32\" (UID: \"47055809-3a6f-4fea-99d0-0a81b1605a32\") "
Oct 30 03:36:58.082927 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.082899    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47055809-3a6f-4fea-99d0-0a81b1605a32-metrics-ca" pod "47055809-3a6f-4fea-99d0-0a81b1605a32" (UID: "47055809-3a6f-4fea-99d0-0a81b1605a32"). InnerVolumeSpecName "metrics-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:36:58.084984 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.084952    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47055809-3a6f-4fea-99d0-0a81b1605a32-kube-api-access-6rvhs" pod "47055809-3a6f-4fea-99d0-0a81b1605a32" (UID: "47055809-3a6f-4fea-99d0-0a81b1605a32"). InnerVolumeSpecName "kube-api-access-6rvhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:36:58.183216 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.183180    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rvhs\" (UniqueName: \"kubernetes.io/projected/47055809-3a6f-4fea-99d0-0a81b1605a32-kube-api-access-6rvhs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:58.183216 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.183210    5981 reconciler_common.go:299] "Volume detached for volume \"metrics-ca\" (UniqueName: \"kubernetes.io/configmap/47055809-3a6f-4fea-99d0-0a81b1605a32-metrics-ca\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:58.407244 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.407206    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz" event={"ID":"931ab5cf-8e1e-456e-ab4c-ca2807cd1129","Type":"ContainerStarted","Data":"569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b"}
Oct 30 03:36:58.407730 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.407251    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz" event={"ID":"931ab5cf-8e1e-456e-ab4c-ca2807cd1129","Type":"ContainerStarted","Data":"a361c1a129ecee739cb5014efd6a0f1e5eed4ffb6316955bfaba7fb920d8879c"}
Oct 30 03:36:58.407730 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.407397    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:58.408687 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.408661    5981 generic.go:356] "Generic (PLEG): container finished" podID="47055809-3a6f-4fea-99d0-0a81b1605a32" containerID="8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77" exitCode=137
Oct 30 03:36:58.408819 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.408694    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 03:36:58.408819 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.408749    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/operator-metrics-auth-probe" event={"ID":"47055809-3a6f-4fea-99d0-0a81b1605a32","Type":"ContainerDied","Data":"8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77"}
Oct 30 03:36:58.408819 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.408795    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/operator-metrics-auth-probe" event={"ID":"47055809-3a6f-4fea-99d0-0a81b1605a32","Type":"ContainerDied","Data":"f7b3b4b5e8f2dc7a2cd99761ae7956ed85dab7a747437441649d5801ff58876b"}
Oct 30 03:36:58.408819 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.408817    5981 scope.go:122] "RemoveContainer" containerID="8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77"
Oct 30 03:36:58.409714 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.409677    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:36:58.417342 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.417326    5981 scope.go:122] "RemoveContainer" containerID="8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77"
Oct 30 03:36:58.417587 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:36:58.417568    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77\": container with ID starting with 8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77 not found: ID does not exist" containerID="8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77"
Oct 30 03:36:58.417639 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.417597    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77"} err="failed to get container status \"8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77\": rpc error: code = NotFound desc = could not find container \"8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77\": container with ID starting with 8e76c881c45a360f84096b6b2bd07ae88e1fc55e922fe3f760428a4add1b6b77 not found: ID does not exist"
Oct 30 03:36:58.449178 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.449135    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz" podStartSLOduration=1.449121862 podStartE2EDuration="1.449121862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:36:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:36:58.448446762 +0000 UTC m=+3258.290693217" watchObservedRunningTime="2026-10-30 03:36:58.449121862 +0000 UTC m=+3258.291368299"
Oct 30 03:36:58.484458 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.484425    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 03:36:58.488306 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.488267    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 03:36:58.564736 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.564702    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"]
Oct 30 03:36:58.564946 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.564918    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k" podUID="764d7c01-2a17-47a3-a746-8f5d101b3dc4" containerName="ta-container" containerID="cri-o://d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4" gracePeriod=30
Oct 30 03:36:58.810572 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.810544    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:58.890631 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.890598    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/764d7c01-2a17-47a3-a746-8f5d101b3dc4-kube-api-access-jtn7x\" (UniqueName: \"kubernetes.io/projected/764d7c01-2a17-47a3-a746-8f5d101b3dc4-kube-api-access-jtn7x\") pod \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\" (UID: \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\") "
Oct 30 03:36:58.890815 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.890644    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/764d7c01-2a17-47a3-a746-8f5d101b3dc4-ta-internal\" (UniqueName: \"kubernetes.io/configmap/764d7c01-2a17-47a3-a746-8f5d101b3dc4-ta-internal\") pod \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\" (UID: \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\") "
Oct 30 03:36:58.890815 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.890712    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/764d7c01-2a17-47a3-a746-8f5d101b3dc4-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/764d7c01-2a17-47a3-a746-8f5d101b3dc4-data-science-collector-ta-server-cert\") pod \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\" (UID: \"764d7c01-2a17-47a3-a746-8f5d101b3dc4\") "
Oct 30 03:36:58.891098 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.891072    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/764d7c01-2a17-47a3-a746-8f5d101b3dc4-ta-internal" pod "764d7c01-2a17-47a3-a746-8f5d101b3dc4" (UID: "764d7c01-2a17-47a3-a746-8f5d101b3dc4"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:36:58.892888 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.892864    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/764d7c01-2a17-47a3-a746-8f5d101b3dc4-kube-api-access-jtn7x" pod "764d7c01-2a17-47a3-a746-8f5d101b3dc4" (UID: "764d7c01-2a17-47a3-a746-8f5d101b3dc4"). InnerVolumeSpecName "kube-api-access-jtn7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:36:58.892888 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.892870    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/764d7c01-2a17-47a3-a746-8f5d101b3dc4-data-science-collector-ta-server-cert" pod "764d7c01-2a17-47a3-a746-8f5d101b3dc4" (UID: "764d7c01-2a17-47a3-a746-8f5d101b3dc4"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:36:58.991677 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.991593    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtn7x\" (UniqueName: \"kubernetes.io/projected/764d7c01-2a17-47a3-a746-8f5d101b3dc4-kube-api-access-jtn7x\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:58.991677 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.991623    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/764d7c01-2a17-47a3-a746-8f5d101b3dc4-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:58.991677 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:58.991633    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/764d7c01-2a17-47a3-a746-8f5d101b3dc4-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:36:59.415142 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:59.415111    5981 generic.go:356] "Generic (PLEG): container finished" podID="764d7c01-2a17-47a3-a746-8f5d101b3dc4" containerID="d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4" exitCode=0
Oct 30 03:36:59.415600 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:59.415156    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"
Oct 30 03:36:59.415600 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:59.415210    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k" event={"ID":"764d7c01-2a17-47a3-a746-8f5d101b3dc4","Type":"ContainerDied","Data":"d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4"}
Oct 30 03:36:59.415600 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:59.415247    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k" event={"ID":"764d7c01-2a17-47a3-a746-8f5d101b3dc4","Type":"ContainerDied","Data":"c35bd10cc7811c99e45c2b4f69c89eff4d3e2273e550f0b2692a2d5d7366d827"}
Oct 30 03:36:59.415600 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:59.415264    5981 scope.go:122] "RemoveContainer" containerID="d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4"
Oct 30 03:36:59.424423 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:59.424407    5981 scope.go:122] "RemoveContainer" containerID="d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4"
Oct 30 03:36:59.424711 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:36:59.424693    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4\": container with ID starting with d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4 not found: ID does not exist" containerID="d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4"
Oct 30 03:36:59.424756 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:59.424719    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4"} err="failed to get container status \"d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4\": rpc error: code = NotFound desc = could not find container \"d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4\": container with ID starting with d5b653e0d70897e4d82b746d80c8bd195166adcf23b36747561a1d95154ed7e4 not found: ID does not exist"
Oct 30 03:36:59.467743 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:59.467715    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"]
Oct 30 03:36:59.481170 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:36:59.481138    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-wqw5k"]
Oct 30 03:37:00.275525 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:00.275490    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="47055809-3a6f-4fea-99d0-0a81b1605a32" path="/var/lib/kubelet/pods/47055809-3a6f-4fea-99d0-0a81b1605a32/volumes"
Oct 30 03:37:00.275881 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:00.275868    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="764d7c01-2a17-47a3-a746-8f5d101b3dc4" path="/var/lib/kubelet/pods/764d7c01-2a17-47a3-a746-8f5d101b3dc4/volumes"
Oct 30 03:37:03.434983 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:03.434950    5981 generic.go:356] "Generic (PLEG): container finished" podID="bc5ca459-9245-454f-840c-b85a40bde164" containerID="4569d7606b16baef12866754a21293923c70d17435a215b7cbd351ecfdef9508" exitCode=0
Oct 30 03:37:03.435403 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:03.435019    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8" event={"ID":"bc5ca459-9245-454f-840c-b85a40bde164","Type":"ContainerDied","Data":"4569d7606b16baef12866754a21293923c70d17435a215b7cbd351ecfdef9508"}
Oct 30 03:37:04.573661 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:04.573631    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8"
Oct 30 03:37:05.064545 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.064510    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d"]
Oct 30 03:37:05.064939 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.064921    5981 cpu_manager.go:414] "containerMap: removing container" podUID="bc5ca459-9245-454f-840c-b85a40bde164" containerName="curl"
Oct 30 03:37:05.065031 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.064943    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc5ca459-9245-454f-840c-b85a40bde164" containerName="curl"
Oct 30 03:37:05.065031 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.064967    5981 cpu_manager.go:414] "containerMap: removing container" podUID="764d7c01-2a17-47a3-a746-8f5d101b3dc4" containerName="ta-container"
Oct 30 03:37:05.065031 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.064974    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="764d7c01-2a17-47a3-a746-8f5d101b3dc4" containerName="ta-container"
Oct 30 03:37:05.065031 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.065014    5981 cpu_manager.go:414] "containerMap: removing container" podUID="47055809-3a6f-4fea-99d0-0a81b1605a32" containerName="curl"
Oct 30 03:37:05.065031 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.065022    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="47055809-3a6f-4fea-99d0-0a81b1605a32" containerName="curl"
Oct 30 03:37:05.065310 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.065111    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="47055809-3a6f-4fea-99d0-0a81b1605a32" containerName="curl"
Oct 30 03:37:05.065310 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.065128    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc5ca459-9245-454f-840c-b85a40bde164" containerName="curl"
Oct 30 03:37:05.065310 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.065138    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="764d7c01-2a17-47a3-a746-8f5d101b3dc4" containerName="ta-container"
Oct 30 03:37:05.068069 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.068049    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d"
Oct 30 03:37:05.078512 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.078492    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d"
Oct 30 03:37:05.083869 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.083849    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d"]
Oct 30 03:37:05.369180 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.369155    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d"]
Oct 30 03:37:05.370983 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:37:05.370954    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd09fc264_9524_440e_b9b0_893ebc3c7e2b.slice/crio-6bf06f52d99c07efdf2efecd72dd41dabd813fb22220672e50b17bb3e2a43169 WatchSource:0}: Error finding container 6bf06f52d99c07efdf2efecd72dd41dabd813fb22220672e50b17bb3e2a43169: Status 404 returned error can't find the container with id 6bf06f52d99c07efdf2efecd72dd41dabd813fb22220672e50b17bb3e2a43169
Oct 30 03:37:05.444697 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.444675    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8"
Oct 30 03:37:05.444697 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.444675    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8" event={"ID":"bc5ca459-9245-454f-840c-b85a40bde164","Type":"ContainerDied","Data":"2f8699d6b77493f8b2a6b12d869e25eb6e1cbe041d8728a9c12eee03b670518e"}
Oct 30 03:37:05.444893 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.444722    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f8699d6b77493f8b2a6b12d869e25eb6e1cbe041d8728a9c12eee03b670518e"
Oct 30 03:37:05.446491 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.446468    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d" event={"ID":"d09fc264-9524-440e-b9b0-893ebc3c7e2b","Type":"ContainerStarted","Data":"8d3fe338036f8e97a9c8f68c540e8402021542313b7c7464b12fda7ad2d35ffa"}
Oct 30 03:37:05.446616 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.446498    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d" event={"ID":"d09fc264-9524-440e-b9b0-893ebc3c7e2b","Type":"ContainerStarted","Data":"6bf06f52d99c07efdf2efecd72dd41dabd813fb22220672e50b17bb3e2a43169"}
Oct 30 03:37:05.485713 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:05.485660    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d" podStartSLOduration=0.485645509 podStartE2EDuration="485.645509ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:37:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:37:05.484674215 +0000 UTC m=+3265.326920672" watchObservedRunningTime="2026-10-30 03:37:05.485645509 +0000 UTC m=+3265.327891955"
Oct 30 03:37:13.482024 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:13.481990    5981 generic.go:356] "Generic (PLEG): container finished" podID="d09fc264-9524-440e-b9b0-893ebc3c7e2b" containerID="8d3fe338036f8e97a9c8f68c540e8402021542313b7c7464b12fda7ad2d35ffa" exitCode=0
Oct 30 03:37:13.482433 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:13.482065    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d" event={"ID":"d09fc264-9524-440e-b9b0-893ebc3c7e2b","Type":"ContainerDied","Data":"8d3fe338036f8e97a9c8f68c540e8402021542313b7c7464b12fda7ad2d35ffa"}
Oct 30 03:37:14.368175 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:37:14.368140    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:37:14.617879 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:14.617849    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d"
Oct 30 03:37:15.259224 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:15.259195    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c"]
Oct 30 03:37:15.259552 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:15.259539    5981 cpu_manager.go:414] "containerMap: removing container" podUID="d09fc264-9524-440e-b9b0-893ebc3c7e2b" containerName="curl"
Oct 30 03:37:15.259597 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:15.259554    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d09fc264-9524-440e-b9b0-893ebc3c7e2b" containerName="curl"
Oct 30 03:37:15.259643 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:15.259634    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="d09fc264-9524-440e-b9b0-893ebc3c7e2b" containerName="curl"
Oct 30 03:37:15.262848 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:15.262831    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c"
Oct 30 03:37:15.274704 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:15.274680    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c"
Oct 30 03:37:15.278215 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:15.278189    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c"]
Oct 30 03:37:15.491781 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:15.491747    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d" event={"ID":"d09fc264-9524-440e-b9b0-893ebc3c7e2b","Type":"ContainerDied","Data":"6bf06f52d99c07efdf2efecd72dd41dabd813fb22220672e50b17bb3e2a43169"}
Oct 30 03:37:15.491781 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:15.491766    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d"
Oct 30 03:37:15.491781 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:15.491783    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bf06f52d99c07efdf2efecd72dd41dabd813fb22220672e50b17bb3e2a43169"
Oct 30 03:37:15.565005 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:15.564981    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c"]
Oct 30 03:37:15.567669 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:37:15.567643    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dd43b84_d19c_49b7_b9c8_97f484e95457.slice/crio-7c1a6077c0f083937cc84ba4e53250db0033056d0951d749e82822f716c7d902 WatchSource:0}: Error finding container 7c1a6077c0f083937cc84ba4e53250db0033056d0951d749e82822f716c7d902: Status 404 returned error can't find the container with id 7c1a6077c0f083937cc84ba4e53250db0033056d0951d749e82822f716c7d902
Oct 30 03:37:16.504368 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:16.504317    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c" event={"ID":"9dd43b84-d19c-49b7-b9c8-97f484e95457","Type":"ContainerStarted","Data":"80cc3f64ba828a56aa376c29ee8d1ac09bd01ec2d7a17a17f37c01a0dd397bb3"}
Oct 30 03:37:16.504368 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:16.504381    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c" event={"ID":"9dd43b84-d19c-49b7-b9c8-97f484e95457","Type":"ContainerStarted","Data":"7c1a6077c0f083937cc84ba4e53250db0033056d0951d749e82822f716c7d902"}
Oct 30 03:37:16.543646 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:16.543601    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c" podStartSLOduration=1.543587388 podStartE2EDuration="1.543587388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:37:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:37:16.542419931 +0000 UTC m=+3276.384666377" watchObservedRunningTime="2026-10-30 03:37:16.543587388 +0000 UTC m=+3276.385833833"
Oct 30 03:37:23.536969 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:23.536885    5981 generic.go:356] "Generic (PLEG): container finished" podID="9dd43b84-d19c-49b7-b9c8-97f484e95457" containerID="80cc3f64ba828a56aa376c29ee8d1ac09bd01ec2d7a17a17f37c01a0dd397bb3" exitCode=0
Oct 30 03:37:23.537360 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:23.536959    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c" event={"ID":"9dd43b84-d19c-49b7-b9c8-97f484e95457","Type":"ContainerDied","Data":"80cc3f64ba828a56aa376c29ee8d1ac09bd01ec2d7a17a17f37c01a0dd397bb3"}
Oct 30 03:37:24.672578 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:24.672551    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c"
Oct 30 03:37:25.442698 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:25.442666    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e"]
Oct 30 03:37:25.443026 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:25.443012    5981 cpu_manager.go:414] "containerMap: removing container" podUID="9dd43b84-d19c-49b7-b9c8-97f484e95457" containerName="curl"
Oct 30 03:37:25.443075 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:25.443027    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9dd43b84-d19c-49b7-b9c8-97f484e95457" containerName="curl"
Oct 30 03:37:25.443112 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:25.443108    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="9dd43b84-d19c-49b7-b9c8-97f484e95457" containerName="curl"
Oct 30 03:37:25.446175 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:25.446160    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e"
Oct 30 03:37:25.457116 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:25.457094    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e"
Oct 30 03:37:25.462482 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:25.460006    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e"]
Oct 30 03:37:25.546771 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:25.546748    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c"
Oct 30 03:37:25.546922 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:25.546776    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c" event={"ID":"9dd43b84-d19c-49b7-b9c8-97f484e95457","Type":"ContainerDied","Data":"7c1a6077c0f083937cc84ba4e53250db0033056d0951d749e82822f716c7d902"}
Oct 30 03:37:25.546922 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:25.546811    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c1a6077c0f083937cc84ba4e53250db0033056d0951d749e82822f716c7d902"
Oct 30 03:37:25.754709 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:25.754681    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e"]
Oct 30 03:37:25.756732 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:37:25.756702    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c010546_e902_4f8c_b234_f9bffda8164a.slice/crio-ea9f631d23bf171be510031a8082ba89614604ab573b74c29c7a88ff39f180fd WatchSource:0}: Error finding container ea9f631d23bf171be510031a8082ba89614604ab573b74c29c7a88ff39f180fd: Status 404 returned error can't find the container with id ea9f631d23bf171be510031a8082ba89614604ab573b74c29c7a88ff39f180fd
Oct 30 03:37:26.552664 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:26.552625    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e" event={"ID":"1c010546-e902-4f8c-b234-f9bffda8164a","Type":"ContainerStarted","Data":"3d3bf18a2f205d9d00f099dc2f6ce3c28572b7f35ee87e890cff6a5551df3943"}
Oct 30 03:37:26.552864 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:26.552672    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e" event={"ID":"1c010546-e902-4f8c-b234-f9bffda8164a","Type":"ContainerStarted","Data":"ea9f631d23bf171be510031a8082ba89614604ab573b74c29c7a88ff39f180fd"}
Oct 30 03:37:26.595575 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:26.595532    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e" podStartSLOduration=1.595520059 podStartE2EDuration="1.595520059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:37:26.594918156 +0000 UTC m=+3286.437164600" watchObservedRunningTime="2026-10-30 03:37:26.595520059 +0000 UTC m=+3286.437766503"
Oct 30 03:37:33.584501 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:33.584461    5981 generic.go:356] "Generic (PLEG): container finished" podID="1c010546-e902-4f8c-b234-f9bffda8164a" containerID="3d3bf18a2f205d9d00f099dc2f6ce3c28572b7f35ee87e890cff6a5551df3943" exitCode=0
Oct 30 03:37:33.584909 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:33.584531    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e" event={"ID":"1c010546-e902-4f8c-b234-f9bffda8164a","Type":"ContainerDied","Data":"3d3bf18a2f205d9d00f099dc2f6ce3c28572b7f35ee87e890cff6a5551df3943"}
Oct 30 03:37:34.731579 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:34.731555    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e"
Oct 30 03:37:35.594694 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:35.594660    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e" event={"ID":"1c010546-e902-4f8c-b234-f9bffda8164a","Type":"ContainerDied","Data":"ea9f631d23bf171be510031a8082ba89614604ab573b74c29c7a88ff39f180fd"}
Oct 30 03:37:35.594694 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:35.594688    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e"
Oct 30 03:37:35.594694 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:35.594698    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea9f631d23bf171be510031a8082ba89614604ab573b74c29c7a88ff39f180fd"
Oct 30 03:37:35.630102 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:35.630071    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035"]
Oct 30 03:37:35.630421 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:35.630409    5981 cpu_manager.go:414] "containerMap: removing container" podUID="1c010546-e902-4f8c-b234-f9bffda8164a" containerName="curl"
Oct 30 03:37:35.630473 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:35.630422    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1c010546-e902-4f8c-b234-f9bffda8164a" containerName="curl"
Oct 30 03:37:35.630508 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:35.630501    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="1c010546-e902-4f8c-b234-f9bffda8164a" containerName="curl"
Oct 30 03:37:35.633438 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:35.633422    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035"
Oct 30 03:37:35.643748 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:35.643729    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035"
Oct 30 03:37:35.649057 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:35.648969    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035"]
Oct 30 03:37:35.938581 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:35.938555    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035"]
Oct 30 03:37:35.940845 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:37:35.940807    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6388b416_81dc_4c87_a9f1_ea564f1a2668.slice/crio-5c9e8b4935a9945eed76a59bfb3382b44ab4e53afa590d0d9f8c02fd81876195 WatchSource:0}: Error finding container 5c9e8b4935a9945eed76a59bfb3382b44ab4e53afa590d0d9f8c02fd81876195: Status 404 returned error can't find the container with id 5c9e8b4935a9945eed76a59bfb3382b44ab4e53afa590d0d9f8c02fd81876195
Oct 30 03:37:36.600234 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:36.600199    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035" event={"ID":"6388b416-81dc-4c87-a9f1-ea564f1a2668","Type":"ContainerStarted","Data":"4e4cc11aa512eaec8af999b7c90ae64d30a7baf45b76c85335dd27db072209ab"}
Oct 30 03:37:36.600432 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:36.600240    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035" event={"ID":"6388b416-81dc-4c87-a9f1-ea564f1a2668","Type":"ContainerStarted","Data":"5c9e8b4935a9945eed76a59bfb3382b44ab4e53afa590d0d9f8c02fd81876195"}
Oct 30 03:37:36.638982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:36.638919    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035" podStartSLOduration=1.638905624 podStartE2EDuration="1.638905624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:37:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:37:36.637999344 +0000 UTC m=+3296.480245789" watchObservedRunningTime="2026-10-30 03:37:36.638905624 +0000 UTC m=+3296.481152068"
Oct 30 03:37:43.635810 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:43.635778    5981 generic.go:356] "Generic (PLEG): container finished" podID="6388b416-81dc-4c87-a9f1-ea564f1a2668" containerID="4e4cc11aa512eaec8af999b7c90ae64d30a7baf45b76c85335dd27db072209ab" exitCode=0
Oct 30 03:37:43.636159 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:43.635852    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035" event={"ID":"6388b416-81dc-4c87-a9f1-ea564f1a2668","Type":"ContainerDied","Data":"4e4cc11aa512eaec8af999b7c90ae64d30a7baf45b76c85335dd27db072209ab"}
Oct 30 03:37:44.368275 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:37:44.368239    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:37:44.767861 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:44.767837    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035"
Oct 30 03:37:45.645625 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:45.645595    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035"
Oct 30 03:37:45.645775 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:45.645636    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035" event={"ID":"6388b416-81dc-4c87-a9f1-ea564f1a2668","Type":"ContainerDied","Data":"5c9e8b4935a9945eed76a59bfb3382b44ab4e53afa590d0d9f8c02fd81876195"}
Oct 30 03:37:45.645775 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:45.645672    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c9e8b4935a9945eed76a59bfb3382b44ab4e53afa590d0d9f8c02fd81876195"
Oct 30 03:37:45.820262 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:45.820231    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9"]
Oct 30 03:37:45.820637 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:45.820580    5981 cpu_manager.go:414] "containerMap: removing container" podUID="6388b416-81dc-4c87-a9f1-ea564f1a2668" containerName="curl"
Oct 30 03:37:45.820637 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:45.820591    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6388b416-81dc-4c87-a9f1-ea564f1a2668" containerName="curl"
Oct 30 03:37:45.820706 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:45.820656    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="6388b416-81dc-4c87-a9f1-ea564f1a2668" containerName="curl"
Oct 30 03:37:45.823435 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:45.823419    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9"
Oct 30 03:37:45.833644 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:45.833626    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9"
Oct 30 03:37:45.839460 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:45.839437    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9"]
Oct 30 03:37:46.125276 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:46.125252    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9"]
Oct 30 03:37:46.127651 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:37:46.127622    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5686de13_7fc2_49c3_8a0e_a888281f00d3.slice/crio-d97c8ee3d2881cbc59ebab6f4f97c5606693c127076ba2bb5693ccf0966ee94d WatchSource:0}: Error finding container d97c8ee3d2881cbc59ebab6f4f97c5606693c127076ba2bb5693ccf0966ee94d: Status 404 returned error can't find the container with id d97c8ee3d2881cbc59ebab6f4f97c5606693c127076ba2bb5693ccf0966ee94d
Oct 30 03:37:46.651504 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:46.651468    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9" event={"ID":"5686de13-7fc2-49c3-8a0e-a888281f00d3","Type":"ContainerStarted","Data":"1936b4c98072a6b9355365a70d7d0fef7319eebf02c139bff1cb4d52da4bd4d2"}
Oct 30 03:37:46.651718 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:46.651512    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9" event={"ID":"5686de13-7fc2-49c3-8a0e-a888281f00d3","Type":"ContainerStarted","Data":"d97c8ee3d2881cbc59ebab6f4f97c5606693c127076ba2bb5693ccf0966ee94d"}
Oct 30 03:37:54.686073 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:54.686037    5981 generic.go:356] "Generic (PLEG): container finished" podID="5686de13-7fc2-49c3-8a0e-a888281f00d3" containerID="1936b4c98072a6b9355365a70d7d0fef7319eebf02c139bff1cb4d52da4bd4d2" exitCode=0
Oct 30 03:37:54.686480 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:54.686106    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9" event={"ID":"5686de13-7fc2-49c3-8a0e-a888281f00d3","Type":"ContainerDied","Data":"1936b4c98072a6b9355365a70d7d0fef7319eebf02c139bff1cb4d52da4bd4d2"}
Oct 30 03:37:55.817536 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:55.817508    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9"
Oct 30 03:37:55.996555 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:55.996476    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9"]
Oct 30 03:37:55.996841 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:55.996829    5981 cpu_manager.go:414] "containerMap: removing container" podUID="5686de13-7fc2-49c3-8a0e-a888281f00d3" containerName="curl"
Oct 30 03:37:55.996884 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:55.996843    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5686de13-7fc2-49c3-8a0e-a888281f00d3" containerName="curl"
Oct 30 03:37:55.996928 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:55.996918    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="5686de13-7fc2-49c3-8a0e-a888281f00d3" containerName="curl"
Oct 30 03:37:55.999881 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:55.999865    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9"
Oct 30 03:37:56.010547 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:56.010525    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9"
Oct 30 03:37:56.016350 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:56.016330    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9"]
Oct 30 03:37:56.301725 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:56.301703    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9"]
Oct 30 03:37:56.303759 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:37:56.303727    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod768a5a5c_993c_420f_a808_dafa76c4674e.slice/crio-68a1ef12f4106d8676cf35827424f3a5242184ad53d1cc2d2b02633929e30a66 WatchSource:0}: Error finding container 68a1ef12f4106d8676cf35827424f3a5242184ad53d1cc2d2b02633929e30a66: Status 404 returned error can't find the container with id 68a1ef12f4106d8676cf35827424f3a5242184ad53d1cc2d2b02633929e30a66
Oct 30 03:37:56.696660 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:56.696629    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9"
Oct 30 03:37:56.696660 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:56.696639    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9" event={"ID":"5686de13-7fc2-49c3-8a0e-a888281f00d3","Type":"ContainerDied","Data":"d97c8ee3d2881cbc59ebab6f4f97c5606693c127076ba2bb5693ccf0966ee94d"}
Oct 30 03:37:56.696886 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:56.696676    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d97c8ee3d2881cbc59ebab6f4f97c5606693c127076ba2bb5693ccf0966ee94d"
Oct 30 03:37:56.698232 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:56.698200    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9" event={"ID":"768a5a5c-993c-420f-a808-dafa76c4674e","Type":"ContainerStarted","Data":"792a9c3c09c24b6dbb406a5ab0d96310f11a96a8694ad6a0a966abdfa9b84ea2"}
Oct 30 03:37:56.698400 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:56.698245    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9" event={"ID":"768a5a5c-993c-420f-a808-dafa76c4674e","Type":"ContainerStarted","Data":"68a1ef12f4106d8676cf35827424f3a5242184ad53d1cc2d2b02633929e30a66"}
Oct 30 03:37:56.739119 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:37:56.739075    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9" podStartSLOduration=1.7390633659999999 podStartE2EDuration="1.739063366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:37:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:37:56.738042921 +0000 UTC m=+3316.580289366" watchObservedRunningTime="2026-10-30 03:37:56.739063366 +0000 UTC m=+3316.581309810"
Oct 30 03:38:04.734661 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:04.734628    5981 generic.go:356] "Generic (PLEG): container finished" podID="768a5a5c-993c-420f-a808-dafa76c4674e" containerID="792a9c3c09c24b6dbb406a5ab0d96310f11a96a8694ad6a0a966abdfa9b84ea2" exitCode=0
Oct 30 03:38:04.735148 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:04.734670    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9" event={"ID":"768a5a5c-993c-420f-a808-dafa76c4674e","Type":"ContainerDied","Data":"792a9c3c09c24b6dbb406a5ab0d96310f11a96a8694ad6a0a966abdfa9b84ea2"}
Oct 30 03:38:05.881098 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:05.881066    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9"
Oct 30 03:38:06.170418 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.170387    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a"]
Oct 30 03:38:06.170817 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.170799    5981 cpu_manager.go:414] "containerMap: removing container" podUID="768a5a5c-993c-420f-a808-dafa76c4674e" containerName="curl"
Oct 30 03:38:06.170925 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.170819    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="768a5a5c-993c-420f-a808-dafa76c4674e" containerName="curl"
Oct 30 03:38:06.170991 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.170937    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="768a5a5c-993c-420f-a808-dafa76c4674e" containerName="curl"
Oct 30 03:38:06.173874 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.173854    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a"
Oct 30 03:38:06.184293 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.184261    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a"
Oct 30 03:38:06.189144 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.189118    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a"]
Oct 30 03:38:06.474334 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.474304    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a"]
Oct 30 03:38:06.476525 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:38:06.476493    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98eafec7_7b85_4906_91a5_e16af7daa6ac.slice/crio-b407a64cebc2582d4db04b3cf305e5d08ec958966c90411cde4cb04dd0194847 WatchSource:0}: Error finding container b407a64cebc2582d4db04b3cf305e5d08ec958966c90411cde4cb04dd0194847: Status 404 returned error can't find the container with id b407a64cebc2582d4db04b3cf305e5d08ec958966c90411cde4cb04dd0194847
Oct 30 03:38:06.745163 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.745077    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9" event={"ID":"768a5a5c-993c-420f-a808-dafa76c4674e","Type":"ContainerDied","Data":"68a1ef12f4106d8676cf35827424f3a5242184ad53d1cc2d2b02633929e30a66"}
Oct 30 03:38:06.745163 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.745095    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9"
Oct 30 03:38:06.745163 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.745118    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68a1ef12f4106d8676cf35827424f3a5242184ad53d1cc2d2b02633929e30a66"
Oct 30 03:38:06.746713 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.746678    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a" event={"ID":"98eafec7-7b85-4906-91a5-e16af7daa6ac","Type":"ContainerStarted","Data":"3616b382bc388932616628e00b572c095fdfa065817870ba71c63930e0476dc2"}
Oct 30 03:38:06.746841 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.746716    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a" event={"ID":"98eafec7-7b85-4906-91a5-e16af7daa6ac","Type":"ContainerStarted","Data":"b407a64cebc2582d4db04b3cf305e5d08ec958966c90411cde4cb04dd0194847"}
Oct 30 03:38:06.784995 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:06.784952    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a" podStartSLOduration=0.784938703 podStartE2EDuration="784.938703ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:38:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:38:06.784912692 +0000 UTC m=+3326.627159138" watchObservedRunningTime="2026-10-30 03:38:06.784938703 +0000 UTC m=+3326.627185147"
Oct 30 03:38:14.368701 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:38:14.368619    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:38:14.784179 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:14.784143    5981 generic.go:356] "Generic (PLEG): container finished" podID="98eafec7-7b85-4906-91a5-e16af7daa6ac" containerID="3616b382bc388932616628e00b572c095fdfa065817870ba71c63930e0476dc2" exitCode=0
Oct 30 03:38:14.784179 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:14.784180    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a" event={"ID":"98eafec7-7b85-4906-91a5-e16af7daa6ac","Type":"ContainerDied","Data":"3616b382bc388932616628e00b572c095fdfa065817870ba71c63930e0476dc2"}
Oct 30 03:38:15.916144 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:15.916120    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a"
Oct 30 03:38:16.344261 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.344233    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05"]
Oct 30 03:38:16.344612 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.344599    5981 cpu_manager.go:414] "containerMap: removing container" podUID="98eafec7-7b85-4906-91a5-e16af7daa6ac" containerName="curl"
Oct 30 03:38:16.344658 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.344613    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98eafec7-7b85-4906-91a5-e16af7daa6ac" containerName="curl"
Oct 30 03:38:16.344692 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.344664    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="98eafec7-7b85-4906-91a5-e16af7daa6ac" containerName="curl"
Oct 30 03:38:16.347513 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.347495    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05"
Oct 30 03:38:16.358583 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.358562    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05"
Oct 30 03:38:16.365437 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.365410    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05"]
Oct 30 03:38:16.654839 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.654816    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05"]
Oct 30 03:38:16.656969 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:38:16.656933    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f3d29c1_3744_4ca4_84d1_2bf8138e9b45.slice/crio-20184dd446cb4c4ca5674822073e1de043fcf106d4900b6d857cdcd735f9d252 WatchSource:0}: Error finding container 20184dd446cb4c4ca5674822073e1de043fcf106d4900b6d857cdcd735f9d252: Status 404 returned error can't find the container with id 20184dd446cb4c4ca5674822073e1de043fcf106d4900b6d857cdcd735f9d252
Oct 30 03:38:16.794560 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.794536    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a"
Oct 30 03:38:16.794708 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.794532    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a" event={"ID":"98eafec7-7b85-4906-91a5-e16af7daa6ac","Type":"ContainerDied","Data":"b407a64cebc2582d4db04b3cf305e5d08ec958966c90411cde4cb04dd0194847"}
Oct 30 03:38:16.794708 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.794659    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b407a64cebc2582d4db04b3cf305e5d08ec958966c90411cde4cb04dd0194847"
Oct 30 03:38:16.796113 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.796090    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05" event={"ID":"7f3d29c1-3744-4ca4-84d1-2bf8138e9b45","Type":"ContainerStarted","Data":"bfdc518de7c069b2f48c307a4aea95dbab9fa9dc98477275bcac5fa8dbadafb1"}
Oct 30 03:38:16.796446 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.796129    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05" event={"ID":"7f3d29c1-3744-4ca4-84d1-2bf8138e9b45","Type":"ContainerStarted","Data":"20184dd446cb4c4ca5674822073e1de043fcf106d4900b6d857cdcd735f9d252"}
Oct 30 03:38:16.834799 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:16.834745    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05" podStartSLOduration=0.834733519 podStartE2EDuration="834.733519ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:38:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:38:16.834663847 +0000 UTC m=+3336.676910272" watchObservedRunningTime="2026-10-30 03:38:16.834733519 +0000 UTC m=+3336.676979961"
Oct 30 03:38:24.832427 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:24.832390    5981 generic.go:356] "Generic (PLEG): container finished" podID="7f3d29c1-3744-4ca4-84d1-2bf8138e9b45" containerID="bfdc518de7c069b2f48c307a4aea95dbab9fa9dc98477275bcac5fa8dbadafb1" exitCode=0
Oct 30 03:38:24.832852 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:24.832467    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05" event={"ID":"7f3d29c1-3744-4ca4-84d1-2bf8138e9b45","Type":"ContainerDied","Data":"bfdc518de7c069b2f48c307a4aea95dbab9fa9dc98477275bcac5fa8dbadafb1"}
Oct 30 03:38:25.959737 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:25.959707    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05"
Oct 30 03:38:26.520986 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:26.520950    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922"]
Oct 30 03:38:26.521347 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:26.521334    5981 cpu_manager.go:414] "containerMap: removing container" podUID="7f3d29c1-3744-4ca4-84d1-2bf8138e9b45" containerName="curl"
Oct 30 03:38:26.521400 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:26.521349    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f3d29c1-3744-4ca4-84d1-2bf8138e9b45" containerName="curl"
Oct 30 03:38:26.521435 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:26.521415    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f3d29c1-3744-4ca4-84d1-2bf8138e9b45" containerName="curl"
Oct 30 03:38:26.524453 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:26.524429    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922"
Oct 30 03:38:26.535091 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:26.535045    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922"
Oct 30 03:38:26.542094 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:26.542072    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922"]
Oct 30 03:38:26.828875 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:26.828849    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922"]
Oct 30 03:38:26.831016 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:38:26.830986    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e305464_a66e_417b_b4e9_247788c8abc4.slice/crio-618b56dcca0a5d3a7cdfdba7ce53bcd595fd3fddc600b4d9f72bf5206e286ba7 WatchSource:0}: Error finding container 618b56dcca0a5d3a7cdfdba7ce53bcd595fd3fddc600b4d9f72bf5206e286ba7: Status 404 returned error can't find the container with id 618b56dcca0a5d3a7cdfdba7ce53bcd595fd3fddc600b4d9f72bf5206e286ba7
Oct 30 03:38:26.843522 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:26.843492    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922" event={"ID":"3e305464-a66e-417b-b4e9-247788c8abc4","Type":"ContainerStarted","Data":"618b56dcca0a5d3a7cdfdba7ce53bcd595fd3fddc600b4d9f72bf5206e286ba7"}
Oct 30 03:38:26.844854 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:26.844827    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05" event={"ID":"7f3d29c1-3744-4ca4-84d1-2bf8138e9b45","Type":"ContainerDied","Data":"20184dd446cb4c4ca5674822073e1de043fcf106d4900b6d857cdcd735f9d252"}
Oct 30 03:38:26.844939 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:26.844869    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20184dd446cb4c4ca5674822073e1de043fcf106d4900b6d857cdcd735f9d252"
Oct 30 03:38:26.844939 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:26.844902    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05"
Oct 30 03:38:27.851571 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:27.851531    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922" event={"ID":"3e305464-a66e-417b-b4e9-247788c8abc4","Type":"ContainerStarted","Data":"e93f9763a78f26f12c4a7d7d20b111401661611bb4f4b14cfe12bf721cca32b0"}
Oct 30 03:38:27.890483 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:27.890433    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922" podStartSLOduration=1.890420073 podStartE2EDuration="1.890420073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:38:27.889377904 +0000 UTC m=+3347.731624349" watchObservedRunningTime="2026-10-30 03:38:27.890420073 +0000 UTC m=+3347.732666517"
Oct 30 03:38:34.884751 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:34.884660    5981 generic.go:356] "Generic (PLEG): container finished" podID="3e305464-a66e-417b-b4e9-247788c8abc4" containerID="e93f9763a78f26f12c4a7d7d20b111401661611bb4f4b14cfe12bf721cca32b0" exitCode=0
Oct 30 03:38:34.885184 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:34.884741    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922" event={"ID":"3e305464-a66e-417b-b4e9-247788c8abc4","Type":"ContainerDied","Data":"e93f9763a78f26f12c4a7d7d20b111401661611bb4f4b14cfe12bf721cca32b0"}
Oct 30 03:38:36.020862 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:36.020838    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922"
Oct 30 03:38:36.706200 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:36.706164    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4"]
Oct 30 03:38:36.706526 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:36.706512    5981 cpu_manager.go:414] "containerMap: removing container" podUID="3e305464-a66e-417b-b4e9-247788c8abc4" containerName="curl"
Oct 30 03:38:36.706570 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:36.706527    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e305464-a66e-417b-b4e9-247788c8abc4" containerName="curl"
Oct 30 03:38:36.706620 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:36.706611    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e305464-a66e-417b-b4e9-247788c8abc4" containerName="curl"
Oct 30 03:38:36.709598 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:36.709582    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4"
Oct 30 03:38:36.720345 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:36.720325    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4"
Oct 30 03:38:36.726726 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:36.726702    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4"]
Oct 30 03:38:36.894974 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:36.894940    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922"
Oct 30 03:38:36.895148 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:36.894984    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922" event={"ID":"3e305464-a66e-417b-b4e9-247788c8abc4","Type":"ContainerDied","Data":"618b56dcca0a5d3a7cdfdba7ce53bcd595fd3fddc600b4d9f72bf5206e286ba7"}
Oct 30 03:38:36.895148 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:36.895021    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="618b56dcca0a5d3a7cdfdba7ce53bcd595fd3fddc600b4d9f72bf5206e286ba7"
Oct 30 03:38:37.016534 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:37.016501    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4"]
Oct 30 03:38:37.019210 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:38:37.019182    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfe32651_f503_4877_a573_e6de78408a9b.slice/crio-d9d176efb62c6ad07f05aff6862dfbad3f997df3d20e33afedf4b9808009b847 WatchSource:0}: Error finding container d9d176efb62c6ad07f05aff6862dfbad3f997df3d20e33afedf4b9808009b847: Status 404 returned error can't find the container with id d9d176efb62c6ad07f05aff6862dfbad3f997df3d20e33afedf4b9808009b847
Oct 30 03:38:37.900640 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:37.900602    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4" event={"ID":"bfe32651-f503-4877-a573-e6de78408a9b","Type":"ContainerStarted","Data":"62037db9c7d64ef6cc481965de29ce2a749e6839ce43b1875716ec166bf54dac"}
Oct 30 03:38:37.901095 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:37.900649    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4" event={"ID":"bfe32651-f503-4877-a573-e6de78408a9b","Type":"ContainerStarted","Data":"d9d176efb62c6ad07f05aff6862dfbad3f997df3d20e33afedf4b9808009b847"}
Oct 30 03:38:37.940320 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:37.940252    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4" podStartSLOduration=1.9402391049999999 podStartE2EDuration="1.940239105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:38:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:38:37.939026282 +0000 UTC m=+3357.781272727" watchObservedRunningTime="2026-10-30 03:38:37.940239105 +0000 UTC m=+3357.782485550"
Oct 30 03:38:44.369502 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:38:44.369463    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:38:44.933478 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:44.933446    5981 generic.go:356] "Generic (PLEG): container finished" podID="bfe32651-f503-4877-a573-e6de78408a9b" containerID="62037db9c7d64ef6cc481965de29ce2a749e6839ce43b1875716ec166bf54dac" exitCode=0
Oct 30 03:38:44.933684 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:44.933514    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4" event={"ID":"bfe32651-f503-4877-a573-e6de78408a9b","Type":"ContainerDied","Data":"62037db9c7d64ef6cc481965de29ce2a749e6839ce43b1875716ec166bf54dac"}
Oct 30 03:38:46.070861 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:46.070840    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4"
Oct 30 03:38:46.909502 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:46.909459    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-workload-allowed-18e33185ac3c2e5c"]
Oct 30 03:38:46.909824 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:46.909812    5981 cpu_manager.go:414] "containerMap: removing container" podUID="bfe32651-f503-4877-a573-e6de78408a9b" containerName="curl"
Oct 30 03:38:46.909866 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:46.909825    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bfe32651-f503-4877-a573-e6de78408a9b" containerName="curl"
Oct 30 03:38:46.909915 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:46.909905    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="bfe32651-f503-4877-a573-e6de78408a9b" containerName="curl"
Oct 30 03:38:46.912951 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:46.912932    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-workload-allowed-18e33185ac3c2e5c"
Oct 30 03:38:46.928561 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:46.928534    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-workload-allowed-18e33185ac3c2e5c"]
Oct 30 03:38:46.940381 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:46.940360    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e3316b94494c02\"/\"default-dockercfg-ls4gh\""
Oct 30 03:38:46.943768 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:46.943738    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-workload-allowed-18e33185ac3c2e5c"
Oct 30 03:38:46.944428 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:46.944409    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4"
Oct 30 03:38:46.944533 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:46.944440    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4" event={"ID":"bfe32651-f503-4877-a573-e6de78408a9b","Type":"ContainerDied","Data":"d9d176efb62c6ad07f05aff6862dfbad3f997df3d20e33afedf4b9808009b847"}
Oct 30 03:38:46.944533 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:46.944470    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9d176efb62c6ad07f05aff6862dfbad3f997df3d20e33afedf4b9808009b847"
Oct 30 03:38:47.236403 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:47.236377    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-workload-allowed-18e33185ac3c2e5c"]
Oct 30 03:38:47.239001 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:38:47.238963    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f8f6fde_6973_4b2c_a8e4_2d2b98bb4a1c.slice/crio-843ed72929930081fb1d921b6505d5369a085b62d8e0eeb3bc5d8a8857c2eec8 WatchSource:0}: Error finding container 843ed72929930081fb1d921b6505d5369a085b62d8e0eeb3bc5d8a8857c2eec8: Status 404 returned error can't find the container with id 843ed72929930081fb1d921b6505d5369a085b62d8e0eeb3bc5d8a8857c2eec8
Oct 30 03:38:47.950186 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:47.950144    5981 generic.go:356] "Generic (PLEG): container finished" podID="7f8f6fde-6973-4b2c-a8e4-2d2b98bb4a1c" containerID="b910a5a6e724b2af08da9e3b06f873754e132dbdcdf13d57dc682702924c190d" exitCode=0
Oct 30 03:38:47.950381 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:47.950236    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-workload-allowed-18e33185ac3c2e5c" event={"ID":"7f8f6fde-6973-4b2c-a8e4-2d2b98bb4a1c","Type":"ContainerDied","Data":"b910a5a6e724b2af08da9e3b06f873754e132dbdcdf13d57dc682702924c190d"}
Oct 30 03:38:47.950381 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:47.950273    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-workload-allowed-18e33185ac3c2e5c" event={"ID":"7f8f6fde-6973-4b2c-a8e4-2d2b98bb4a1c","Type":"ContainerStarted","Data":"843ed72929930081fb1d921b6505d5369a085b62d8e0eeb3bc5d8a8857c2eec8"}
Oct 30 03:38:49.091096 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:49.091068    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-workload-allowed-18e33185ac3c2e5c"
Oct 30 03:38:49.962497 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:49.962472    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-workload-allowed-18e33185ac3c2e5c"
Oct 30 03:38:49.962646 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:49.962473    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-workload-allowed-18e33185ac3c2e5c" event={"ID":"7f8f6fde-6973-4b2c-a8e4-2d2b98bb4a1c","Type":"ContainerDied","Data":"843ed72929930081fb1d921b6505d5369a085b62d8e0eeb3bc5d8a8857c2eec8"}
Oct 30 03:38:49.962646 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:49.962594    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="843ed72929930081fb1d921b6505d5369a085b62d8e0eeb3bc5d8a8857c2eec8"
Oct 30 03:38:51.049884 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:51.049855    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-prefill-allowed-18e33186a2f98508"]
Oct 30 03:38:51.050253 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:51.050205    5981 cpu_manager.go:414] "containerMap: removing container" podUID="7f8f6fde-6973-4b2c-a8e4-2d2b98bb4a1c" containerName="curl"
Oct 30 03:38:51.050253 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:51.050215    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f8f6fde-6973-4b2c-a8e4-2d2b98bb4a1c" containerName="curl"
Oct 30 03:38:51.050361 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:51.050316    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f8f6fde-6973-4b2c-a8e4-2d2b98bb4a1c" containerName="curl"
Oct 30 03:38:51.053161 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:51.053142    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-prefill-allowed-18e33186a2f98508"
Oct 30 03:38:51.069018 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:51.068990    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-prefill-allowed-18e33186a2f98508"]
Oct 30 03:38:51.080952 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:51.080932    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e3316b94494c02\"/\"default-dockercfg-ls4gh\""
Oct 30 03:38:51.085050 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:51.085030    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-prefill-allowed-18e33186a2f98508"
Oct 30 03:38:51.375875 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:51.375851    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-prefill-allowed-18e33186a2f98508"]
Oct 30 03:38:51.377820 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:38:51.377794    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6566294f_9f35_4545_979c_59bf586c6aeb.slice/crio-ae7ef878846f9ded8884fc4d68eb41fcaeea183e55f40533951eba20434d8a42 WatchSource:0}: Error finding container ae7ef878846f9ded8884fc4d68eb41fcaeea183e55f40533951eba20434d8a42: Status 404 returned error can't find the container with id ae7ef878846f9ded8884fc4d68eb41fcaeea183e55f40533951eba20434d8a42
Oct 30 03:38:51.974652 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:51.974617    5981 generic.go:356] "Generic (PLEG): container finished" podID="6566294f-9f35-4545-979c-59bf586c6aeb" containerID="c4b7976a91b4b85f3809c7cf5ca6c848723324dde0b69384e7e0e6477b4801f4" exitCode=0
Oct 30 03:38:51.974837 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:51.974699    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-prefill-allowed-18e33186a2f98508" event={"ID":"6566294f-9f35-4545-979c-59bf586c6aeb","Type":"ContainerDied","Data":"c4b7976a91b4b85f3809c7cf5ca6c848723324dde0b69384e7e0e6477b4801f4"}
Oct 30 03:38:51.974837 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:51.974738    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-prefill-allowed-18e33186a2f98508" event={"ID":"6566294f-9f35-4545-979c-59bf586c6aeb","Type":"ContainerStarted","Data":"ae7ef878846f9ded8884fc4d68eb41fcaeea183e55f40533951eba20434d8a42"}
Oct 30 03:38:53.110589 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:53.110564    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-prefill-allowed-18e33186a2f98508"
Oct 30 03:38:53.984896 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:53.984866    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-prefill-allowed-18e33186a2f98508"
Oct 30 03:38:53.984896 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:53.984877    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-prefill-allowed-18e33186a2f98508" event={"ID":"6566294f-9f35-4545-979c-59bf586c6aeb","Type":"ContainerDied","Data":"ae7ef878846f9ded8884fc4d68eb41fcaeea183e55f40533951eba20434d8a42"}
Oct 30 03:38:53.985118 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:53.984909    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae7ef878846f9ded8884fc4d68eb41fcaeea183e55f40533951eba20434d8a42"
Oct 30 03:38:55.186108 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:55.186073    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-worker-allowed-18e3318799a1208d"]
Oct 30 03:38:55.186561 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:55.186430    5981 cpu_manager.go:414] "containerMap: removing container" podUID="6566294f-9f35-4545-979c-59bf586c6aeb" containerName="curl"
Oct 30 03:38:55.186561 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:55.186441    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6566294f-9f35-4545-979c-59bf586c6aeb" containerName="curl"
Oct 30 03:38:55.186561 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:55.186501    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="6566294f-9f35-4545-979c-59bf586c6aeb" containerName="curl"
Oct 30 03:38:55.189363 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:55.189347    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-allowed-18e3318799a1208d"
Oct 30 03:38:55.205135 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:55.205116    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e3316b94494c02\"/\"default-dockercfg-ls4gh\""
Oct 30 03:38:55.210495 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:55.210476    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-allowed-18e3318799a1208d"
Oct 30 03:38:55.219132 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:55.219112    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-worker-allowed-18e3318799a1208d"]
Oct 30 03:38:55.501060 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:55.501037    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-worker-allowed-18e3318799a1208d"]
Oct 30 03:38:55.503158 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:38:55.503129    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb66bf025_1ec4_4a5a_b401_3b563a600e85.slice/crio-4bf1af34d8da62850d150091d28cc88e8613664f94b9238a8daea09d4fa09ff9 WatchSource:0}: Error finding container 4bf1af34d8da62850d150091d28cc88e8613664f94b9238a8daea09d4fa09ff9: Status 404 returned error can't find the container with id 4bf1af34d8da62850d150091d28cc88e8613664f94b9238a8daea09d4fa09ff9
Oct 30 03:38:55.995944 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:55.995908    5981 generic.go:356] "Generic (PLEG): container finished" podID="b66bf025-1ec4-4a5a-b401-3b563a600e85" containerID="36bb27b79304efd52723b46c27fb950cb831905f902d7b4634d1e933c09c72ff" exitCode=0
Oct 30 03:38:55.996152 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:55.995974    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-allowed-18e3318799a1208d" event={"ID":"b66bf025-1ec4-4a5a-b401-3b563a600e85","Type":"ContainerDied","Data":"36bb27b79304efd52723b46c27fb950cb831905f902d7b4634d1e933c09c72ff"}
Oct 30 03:38:55.996152 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:55.996002    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-allowed-18e3318799a1208d" event={"ID":"b66bf025-1ec4-4a5a-b401-3b563a600e85","Type":"ContainerStarted","Data":"4bf1af34d8da62850d150091d28cc88e8613664f94b9238a8daea09d4fa09ff9"}
Oct 30 03:38:57.136659 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:57.136624    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-allowed-18e3318799a1208d"
Oct 30 03:38:57.310638 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:57.310561    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-leader-allowed-18e33188181d9327"]
Oct 30 03:38:57.310950 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:57.310935    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b66bf025-1ec4-4a5a-b401-3b563a600e85" containerName="curl"
Oct 30 03:38:57.311005 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:57.310953    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b66bf025-1ec4-4a5a-b401-3b563a600e85" containerName="curl"
Oct 30 03:38:57.311066 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:57.311056    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b66bf025-1ec4-4a5a-b401-3b563a600e85" containerName="curl"
Oct 30 03:38:57.314043 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:57.314027    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-allowed-18e33188181d9327"
Oct 30 03:38:57.325089 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:57.325062    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-allowed-18e33188181d9327"
Oct 30 03:38:57.330296 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:57.330253    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-leader-allowed-18e33188181d9327"]
Oct 30 03:38:57.618570 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:57.618527    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-leader-allowed-18e33188181d9327"]
Oct 30 03:38:57.620723 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:38:57.620690    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddeff4e28_9f77_4d82_85be_b36897eaf313.slice/crio-df9a97f7360d4cffdb652ec4a999d89c5121c11945fdbeb3bcd7a142d8711cce WatchSource:0}: Error finding container df9a97f7360d4cffdb652ec4a999d89c5121c11945fdbeb3bcd7a142d8711cce: Status 404 returned error can't find the container with id df9a97f7360d4cffdb652ec4a999d89c5121c11945fdbeb3bcd7a142d8711cce
Oct 30 03:38:58.007436 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:58.007408    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-allowed-18e3318799a1208d"
Oct 30 03:38:58.007436 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:58.007426    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-allowed-18e3318799a1208d" event={"ID":"b66bf025-1ec4-4a5a-b401-3b563a600e85","Type":"ContainerDied","Data":"4bf1af34d8da62850d150091d28cc88e8613664f94b9238a8daea09d4fa09ff9"}
Oct 30 03:38:58.007669 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:58.007459    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bf1af34d8da62850d150091d28cc88e8613664f94b9238a8daea09d4fa09ff9"
Oct 30 03:38:58.009000 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:58.008978    5981 generic.go:356] "Generic (PLEG): container finished" podID="deff4e28-9f77-4d82-85be-b36897eaf313" containerID="b33f831057409d1485b5eb2f165acf708448c11f313d92e1bd63ec57724ded4a" exitCode=0
Oct 30 03:38:58.009111 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:58.009052    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-allowed-18e33188181d9327" event={"ID":"deff4e28-9f77-4d82-85be-b36897eaf313","Type":"ContainerDied","Data":"b33f831057409d1485b5eb2f165acf708448c11f313d92e1bd63ec57724ded4a"}
Oct 30 03:38:58.009111 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:58.009075    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-allowed-18e33188181d9327" event={"ID":"deff4e28-9f77-4d82-85be-b36897eaf313","Type":"ContainerStarted","Data":"df9a97f7360d4cffdb652ec4a999d89c5121c11945fdbeb3bcd7a142d8711cce"}
Oct 30 03:38:59.145447 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:59.145424    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-allowed-18e33188181d9327"
Oct 30 03:38:59.414400 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:59.414366    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-worker-prefill-allowed-18e33188967bc372"]
Oct 30 03:38:59.414712 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:59.414699    5981 cpu_manager.go:414] "containerMap: removing container" podUID="deff4e28-9f77-4d82-85be-b36897eaf313" containerName="curl"
Oct 30 03:38:59.414757 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:59.414713    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="deff4e28-9f77-4d82-85be-b36897eaf313" containerName="curl"
Oct 30 03:38:59.414801 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:59.414792    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="deff4e28-9f77-4d82-85be-b36897eaf313" containerName="curl"
Oct 30 03:38:59.417744 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:59.417728    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-prefill-allowed-18e33188967bc372"
Oct 30 03:38:59.428657 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:59.428626    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-prefill-allowed-18e33188967bc372"
Oct 30 03:38:59.434050 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:59.434024    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-worker-prefill-allowed-18e33188967bc372"]
Oct 30 03:38:59.720393 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:38:59.720368    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-worker-prefill-allowed-18e33188967bc372"]
Oct 30 03:38:59.722390 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:38:59.722355    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb9725c9_b8a0_4188_a902_9ef6c85177af.slice/crio-f9640cd131a39000e74320b133cf8a047dafee802f4ce4f9a88e0f5d7c352e39 WatchSource:0}: Error finding container f9640cd131a39000e74320b133cf8a047dafee802f4ce4f9a88e0f5d7c352e39: Status 404 returned error can't find the container with id f9640cd131a39000e74320b133cf8a047dafee802f4ce4f9a88e0f5d7c352e39
Oct 30 03:39:00.020060 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:00.019968    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-allowed-18e33188181d9327"
Oct 30 03:39:00.020060 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:00.019969    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-allowed-18e33188181d9327" event={"ID":"deff4e28-9f77-4d82-85be-b36897eaf313","Type":"ContainerDied","Data":"df9a97f7360d4cffdb652ec4a999d89c5121c11945fdbeb3bcd7a142d8711cce"}
Oct 30 03:39:00.020308 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:00.020091    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df9a97f7360d4cffdb652ec4a999d89c5121c11945fdbeb3bcd7a142d8711cce"
Oct 30 03:39:00.021658 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:00.021631    5981 generic.go:356] "Generic (PLEG): container finished" podID="db9725c9-b8a0-4188-a902-9ef6c85177af" containerID="876d7c444a3917979f7ea812c0f85ee2420826b7d89d8f277834004bd6837a98" exitCode=0
Oct 30 03:39:00.021812 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:00.021705    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-prefill-allowed-18e33188967bc372" event={"ID":"db9725c9-b8a0-4188-a902-9ef6c85177af","Type":"ContainerDied","Data":"876d7c444a3917979f7ea812c0f85ee2420826b7d89d8f277834004bd6837a98"}
Oct 30 03:39:00.021812 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:00.021737    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-prefill-allowed-18e33188967bc372" event={"ID":"db9725c9-b8a0-4188-a902-9ef6c85177af","Type":"ContainerStarted","Data":"f9640cd131a39000e74320b133cf8a047dafee802f4ce4f9a88e0f5d7c352e39"}
Oct 30 03:39:01.158748 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:01.158725    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-prefill-allowed-18e33188967bc372"
Oct 30 03:39:01.536986 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:01.536953    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-leader-prefill-allowed-18e3318914058d23"]
Oct 30 03:39:01.537348 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:01.537334    5981 cpu_manager.go:414] "containerMap: removing container" podUID="db9725c9-b8a0-4188-a902-9ef6c85177af" containerName="curl"
Oct 30 03:39:01.537399 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:01.537349    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db9725c9-b8a0-4188-a902-9ef6c85177af" containerName="curl"
Oct 30 03:39:01.537433 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:01.537418    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="db9725c9-b8a0-4188-a902-9ef6c85177af" containerName="curl"
Oct 30 03:39:01.540452 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:01.540434    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-prefill-allowed-18e3318914058d23"
Oct 30 03:39:01.551156 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:01.551136    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-prefill-allowed-18e3318914058d23"
Oct 30 03:39:01.556255 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:01.556227    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-leader-prefill-allowed-18e3318914058d23"]
Oct 30 03:39:01.843674 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:01.843649    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-leader-prefill-allowed-18e3318914058d23"]
Oct 30 03:39:01.845654 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:39:01.845619    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode81e98f1_9bbd_444d_9879_d576d057a33e.slice/crio-fb9cdfc4fbad2e3a34bc7dc10cec533f5e2443a4a3a2a0fc513b4aa6cb4b95a3 WatchSource:0}: Error finding container fb9cdfc4fbad2e3a34bc7dc10cec533f5e2443a4a3a2a0fc513b4aa6cb4b95a3: Status 404 returned error can't find the container with id fb9cdfc4fbad2e3a34bc7dc10cec533f5e2443a4a3a2a0fc513b4aa6cb4b95a3
Oct 30 03:39:02.032089 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:02.032054    5981 generic.go:356] "Generic (PLEG): container finished" podID="e81e98f1-9bbd-444d-9879-d576d057a33e" containerID="c3f5484dd2662485a03378f1f94fbec0d68f061f5bc1a8c9f819a0b0053c6037" exitCode=0
Oct 30 03:39:02.032300 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:02.032131    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-prefill-allowed-18e3318914058d23" event={"ID":"e81e98f1-9bbd-444d-9879-d576d057a33e","Type":"ContainerDied","Data":"c3f5484dd2662485a03378f1f94fbec0d68f061f5bc1a8c9f819a0b0053c6037"}
Oct 30 03:39:02.032300 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:02.032172    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-prefill-allowed-18e3318914058d23" event={"ID":"e81e98f1-9bbd-444d-9879-d576d057a33e","Type":"ContainerStarted","Data":"fb9cdfc4fbad2e3a34bc7dc10cec533f5e2443a4a3a2a0fc513b4aa6cb4b95a3"}
Oct 30 03:39:02.033464 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:02.033433    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-prefill-allowed-18e33188967bc372" event={"ID":"db9725c9-b8a0-4188-a902-9ef6c85177af","Type":"ContainerDied","Data":"f9640cd131a39000e74320b133cf8a047dafee802f4ce4f9a88e0f5d7c352e39"}
Oct 30 03:39:02.033464 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:02.033463    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9640cd131a39000e74320b133cf8a047dafee802f4ce4f9a88e0f5d7c352e39"
Oct 30 03:39:02.033616 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:02.033437    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-worker-prefill-allowed-18e33188967bc372"
Oct 30 03:39:03.169210 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:03.169183    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-prefill-allowed-18e3318914058d23"
Oct 30 03:39:03.641444 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:03.641412    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009"]
Oct 30 03:39:03.641746 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:03.641734    5981 cpu_manager.go:414] "containerMap: removing container" podUID="e81e98f1-9bbd-444d-9879-d576d057a33e" containerName="curl"
Oct 30 03:39:03.641799 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:03.641746    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e81e98f1-9bbd-444d-9879-d576d057a33e" containerName="curl"
Oct 30 03:39:03.641833 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:03.641817    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="e81e98f1-9bbd-444d-9879-d576d057a33e" containerName="curl"
Oct 30 03:39:03.644610 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:03.644594    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009"
Oct 30 03:39:03.655143 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:03.655120    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009"
Oct 30 03:39:03.660419 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:03.660398    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009"]
Oct 30 03:39:03.960468 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:03.960445    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009"]
Oct 30 03:39:03.961930 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:39:03.961905    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b330291_dabe_422c_826b_88baf270c0af.slice/crio-a84c2454e929014a0ad16370b4eb16997c8ba56516ac3fe565cf2ea37a4f645b WatchSource:0}: Error finding container a84c2454e929014a0ad16370b4eb16997c8ba56516ac3fe565cf2ea37a4f645b: Status 404 returned error can't find the container with id a84c2454e929014a0ad16370b4eb16997c8ba56516ac3fe565cf2ea37a4f645b
Oct 30 03:39:04.045811 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:04.045790    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-prefill-allowed-18e3318914058d23"
Oct 30 03:39:04.045951 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:04.045789    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-leader-prefill-allowed-18e3318914058d23" event={"ID":"e81e98f1-9bbd-444d-9879-d576d057a33e","Type":"ContainerDied","Data":"fb9cdfc4fbad2e3a34bc7dc10cec533f5e2443a4a3a2a0fc513b4aa6cb4b95a3"}
Oct 30 03:39:04.045951 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:04.045910    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb9cdfc4fbad2e3a34bc7dc10cec533f5e2443a4a3a2a0fc513b4aa6cb4b95a3"
Oct 30 03:39:04.047579 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:04.047556    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009" event={"ID":"2b330291-dabe-422c-826b-88baf270c0af","Type":"ContainerStarted","Data":"8bd968851c2581124372c64848e7b490ca35b0ef090767acbbb9da52678f5e66"}
Oct 30 03:39:04.047700 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:04.047587    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009" event={"ID":"2b330291-dabe-422c-826b-88baf270c0af","Type":"ContainerStarted","Data":"a84c2454e929014a0ad16370b4eb16997c8ba56516ac3fe565cf2ea37a4f645b"}
Oct 30 03:39:04.086732 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:04.086691    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009" podStartSLOduration=1.086677617 podStartE2EDuration="1.086677617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:39:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:39:04.085742668 +0000 UTC m=+3383.927989152" watchObservedRunningTime="2026-10-30 03:39:04.086677617 +0000 UTC m=+3383.928924058"
Oct 30 03:39:05.054009 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:05.053970    5981 generic.go:356] "Generic (PLEG): container finished" podID="2b330291-dabe-422c-826b-88baf270c0af" containerID="8bd968851c2581124372c64848e7b490ca35b0ef090767acbbb9da52678f5e66" exitCode=0
Oct 30 03:39:05.054402 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:05.054057    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009" event={"ID":"2b330291-dabe-422c-826b-88baf270c0af","Type":"ContainerDied","Data":"8bd968851c2581124372c64848e7b490ca35b0ef090767acbbb9da52678f5e66"}
Oct 30 03:39:06.194134 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:06.194105    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009"
Oct 30 03:39:07.064572 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:07.064531    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009" event={"ID":"2b330291-dabe-422c-826b-88baf270c0af","Type":"ContainerDied","Data":"a84c2454e929014a0ad16370b4eb16997c8ba56516ac3fe565cf2ea37a4f645b"}
Oct 30 03:39:07.064572 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:07.064548    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009"
Oct 30 03:39:07.064572 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:07.064568    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a84c2454e929014a0ad16370b4eb16997c8ba56516ac3fe565cf2ea37a4f645b"
Oct 30 03:39:07.766529 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:07.766502    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1"]
Oct 30 03:39:07.766911 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:07.766843    5981 cpu_manager.go:414] "containerMap: removing container" podUID="2b330291-dabe-422c-826b-88baf270c0af" containerName="curl"
Oct 30 03:39:07.766911 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:07.766855    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b330291-dabe-422c-826b-88baf270c0af" containerName="curl"
Oct 30 03:39:07.766989 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:07.766938    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b330291-dabe-422c-826b-88baf270c0af" containerName="curl"
Oct 30 03:39:07.770042 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:07.770025    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1"
Oct 30 03:39:07.785825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:07.785800    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1"]
Oct 30 03:39:07.797798 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:07.797750    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e3316b94494c02\"/\"default-dockercfg-ls4gh\""
Oct 30 03:39:07.801396 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:07.801378    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1"
Oct 30 03:39:08.090743 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:08.090719    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1"]
Oct 30 03:39:08.092712 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:39:08.092683    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42d3df2b_9f0d_4fb1_b95b_5a413fa14206.slice/crio-e63400281f82a1cd46c0ac6ae78facf542f695a3373f3178e9ae330caa07a532 WatchSource:0}: Error finding container e63400281f82a1cd46c0ac6ae78facf542f695a3373f3178e9ae330caa07a532: Status 404 returned error can't find the container with id e63400281f82a1cd46c0ac6ae78facf542f695a3373f3178e9ae330caa07a532
Oct 30 03:39:09.076573 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:09.076534    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1" event={"ID":"42d3df2b-9f0d-4fb1-b95b-5a413fa14206","Type":"ContainerStarted","Data":"d8707a2bb83e0362ccd264d9adc8b459d1faeb218b058a9dcc2f89e8f3e520e1"}
Oct 30 03:39:09.076573 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:09.076578    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1" event={"ID":"42d3df2b-9f0d-4fb1-b95b-5a413fa14206","Type":"ContainerStarted","Data":"e63400281f82a1cd46c0ac6ae78facf542f695a3373f3178e9ae330caa07a532"}
Oct 30 03:39:09.114872 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:09.114828    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1" podStartSLOduration=2.114768981 podStartE2EDuration="2.114768981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:39:09.114149205 +0000 UTC m=+3388.956395642" watchObservedRunningTime="2026-10-30 03:39:09.114768981 +0000 UTC m=+3388.957015478"
Oct 30 03:39:14.368689 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:39:14.368653    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:39:16.112460 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:16.112369    5981 generic.go:356] "Generic (PLEG): container finished" podID="42d3df2b-9f0d-4fb1-b95b-5a413fa14206" containerID="d8707a2bb83e0362ccd264d9adc8b459d1faeb218b058a9dcc2f89e8f3e520e1" exitCode=0
Oct 30 03:39:16.112920 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:16.112449    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1" event={"ID":"42d3df2b-9f0d-4fb1-b95b-5a413fa14206","Type":"ContainerDied","Data":"d8707a2bb83e0362ccd264d9adc8b459d1faeb218b058a9dcc2f89e8f3e520e1"}
Oct 30 03:39:17.250984 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:17.250949    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1"
Oct 30 03:39:17.943674 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:17.943638    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737"]
Oct 30 03:39:17.944063 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:17.944045    5981 cpu_manager.go:414] "containerMap: removing container" podUID="42d3df2b-9f0d-4fb1-b95b-5a413fa14206" containerName="curl"
Oct 30 03:39:17.944161 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:17.944067    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42d3df2b-9f0d-4fb1-b95b-5a413fa14206" containerName="curl"
Oct 30 03:39:17.944215 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:17.944194    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="42d3df2b-9f0d-4fb1-b95b-5a413fa14206" containerName="curl"
Oct 30 03:39:17.947155 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:17.947132    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737"
Oct 30 03:39:17.958234 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:17.958212    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737"
Oct 30 03:39:17.963618 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:17.963588    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737"]
Oct 30 03:39:18.123749 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:18.123705    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1" event={"ID":"42d3df2b-9f0d-4fb1-b95b-5a413fa14206","Type":"ContainerDied","Data":"e63400281f82a1cd46c0ac6ae78facf542f695a3373f3178e9ae330caa07a532"}
Oct 30 03:39:18.123924 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:18.123763    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e63400281f82a1cd46c0ac6ae78facf542f695a3373f3178e9ae330caa07a532"
Oct 30 03:39:18.123924 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:18.123724    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1"
Oct 30 03:39:18.253382 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:18.253350    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737"]
Oct 30 03:39:18.254903 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:39:18.254862    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09717851_e009_4d57_ad23_3ee8010f781f.slice/crio-4ea505025adc95ae0dbf99040e3ea9800f7e0b30035e8df1a8bce16f41d9679d WatchSource:0}: Error finding container 4ea505025adc95ae0dbf99040e3ea9800f7e0b30035e8df1a8bce16f41d9679d: Status 404 returned error can't find the container with id 4ea505025adc95ae0dbf99040e3ea9800f7e0b30035e8df1a8bce16f41d9679d
Oct 30 03:39:19.130583 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:19.130541    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737" event={"ID":"09717851-e009-4d57-ad23-3ee8010f781f","Type":"ContainerStarted","Data":"d2db6e5694448a853cc24d38a40f93a730c07dcbdf34d082f786605c55b68b51"}
Oct 30 03:39:19.130758 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:19.130593    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737" event={"ID":"09717851-e009-4d57-ad23-3ee8010f781f","Type":"ContainerStarted","Data":"4ea505025adc95ae0dbf99040e3ea9800f7e0b30035e8df1a8bce16f41d9679d"}
Oct 30 03:39:19.169524 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:19.169417    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737" podStartSLOduration=2.169398958 podStartE2EDuration="2.169398958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:39:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:39:19.169221297 +0000 UTC m=+3399.011467746" watchObservedRunningTime="2026-10-30 03:39:19.169398958 +0000 UTC m=+3399.011645407"
Oct 30 03:39:26.166762 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:26.166722    5981 generic.go:356] "Generic (PLEG): container finished" podID="09717851-e009-4d57-ad23-3ee8010f781f" containerID="d2db6e5694448a853cc24d38a40f93a730c07dcbdf34d082f786605c55b68b51" exitCode=0
Oct 30 03:39:26.167168 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:26.166793    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737" event={"ID":"09717851-e009-4d57-ad23-3ee8010f781f","Type":"ContainerDied","Data":"d2db6e5694448a853cc24d38a40f93a730c07dcbdf34d082f786605c55b68b51"}
Oct 30 03:39:27.298905 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:27.298881    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737"
Oct 30 03:39:28.127279 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:28.127243    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015"]
Oct 30 03:39:28.127621 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:28.127608    5981 cpu_manager.go:414] "containerMap: removing container" podUID="09717851-e009-4d57-ad23-3ee8010f781f" containerName="curl"
Oct 30 03:39:28.127665 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:28.127622    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09717851-e009-4d57-ad23-3ee8010f781f" containerName="curl"
Oct 30 03:39:28.127696 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:28.127685    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="09717851-e009-4d57-ad23-3ee8010f781f" containerName="curl"
Oct 30 03:39:28.130672 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:28.130656    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015"
Oct 30 03:39:28.141229 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:28.141209    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015"
Oct 30 03:39:28.146442 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:28.146421    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015"]
Oct 30 03:39:28.178910 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:28.178887    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737"
Oct 30 03:39:28.179061 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:28.178920    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737" event={"ID":"09717851-e009-4d57-ad23-3ee8010f781f","Type":"ContainerDied","Data":"4ea505025adc95ae0dbf99040e3ea9800f7e0b30035e8df1a8bce16f41d9679d"}
Oct 30 03:39:28.179061 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:28.178955    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ea505025adc95ae0dbf99040e3ea9800f7e0b30035e8df1a8bce16f41d9679d"
Oct 30 03:39:28.435854 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:28.435831    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015"]
Oct 30 03:39:28.437679 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:39:28.437645    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee9bac34_c078_4a29_abb5_f060c5d99267.slice/crio-8f475d32f1ac845445f854910f160ea85a93561f37d2235b240e49ee5ef47098 WatchSource:0}: Error finding container 8f475d32f1ac845445f854910f160ea85a93561f37d2235b240e49ee5ef47098: Status 404 returned error can't find the container with id 8f475d32f1ac845445f854910f160ea85a93561f37d2235b240e49ee5ef47098
Oct 30 03:39:29.184990 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:29.184947    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015" event={"ID":"ee9bac34-c078-4a29-abb5-f060c5d99267","Type":"ContainerStarted","Data":"1f5e48bd2c9f8f75ee1d3dc1da8e13b14f8d4d5f951b98466c4257bc6a0dd658"}
Oct 30 03:39:29.184990 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:29.184992    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015" event={"ID":"ee9bac34-c078-4a29-abb5-f060c5d99267","Type":"ContainerStarted","Data":"8f475d32f1ac845445f854910f160ea85a93561f37d2235b240e49ee5ef47098"}
Oct 30 03:39:29.224722 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:29.224669    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015" podStartSLOduration=1.224657378 podStartE2EDuration="1.224657378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:39:29.223074468 +0000 UTC m=+3409.065320937" watchObservedRunningTime="2026-10-30 03:39:29.224657378 +0000 UTC m=+3409.066903820"
Oct 30 03:39:36.220792 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:36.220760    5981 generic.go:356] "Generic (PLEG): container finished" podID="ee9bac34-c078-4a29-abb5-f060c5d99267" containerID="1f5e48bd2c9f8f75ee1d3dc1da8e13b14f8d4d5f951b98466c4257bc6a0dd658" exitCode=0
Oct 30 03:39:36.221162 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:36.220831    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015" event={"ID":"ee9bac34-c078-4a29-abb5-f060c5d99267","Type":"ContainerDied","Data":"1f5e48bd2c9f8f75ee1d3dc1da8e13b14f8d4d5f951b98466c4257bc6a0dd658"}
Oct 30 03:39:37.360241 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:37.360217    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015"
Oct 30 03:39:38.232440 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:38.232398    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015" event={"ID":"ee9bac34-c078-4a29-abb5-f060c5d99267","Type":"ContainerDied","Data":"8f475d32f1ac845445f854910f160ea85a93561f37d2235b240e49ee5ef47098"}
Oct 30 03:39:38.232440 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:38.232439    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015"
Oct 30 03:39:38.232653 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:38.232444    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f475d32f1ac845445f854910f160ea85a93561f37d2235b240e49ee5ef47098"
Oct 30 03:39:38.298049 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:38.298017    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182"]
Oct 30 03:39:38.298384 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:38.298371    5981 cpu_manager.go:414] "containerMap: removing container" podUID="ee9bac34-c078-4a29-abb5-f060c5d99267" containerName="curl"
Oct 30 03:39:38.298439 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:38.298385    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee9bac34-c078-4a29-abb5-f060c5d99267" containerName="curl"
Oct 30 03:39:38.298474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:38.298455    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee9bac34-c078-4a29-abb5-f060c5d99267" containerName="curl"
Oct 30 03:39:38.301570 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:38.301552    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182"
Oct 30 03:39:38.317696 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:38.317662    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182"]
Oct 30 03:39:38.318152 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:38.318132    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e3316b94494c02\"/\"default-dockercfg-ls4gh\""
Oct 30 03:39:38.323252 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:38.323227    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182"
Oct 30 03:39:38.622331 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:38.622304    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182"]
Oct 30 03:39:38.624089 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:39:38.624062    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb756df61_c8ff_40f8_ae6b_a61a6ad81a4e.slice/crio-bfd12ed362452d440c1cc7ccb86bcc081371ae3efc51618f8f68ae405128c541 WatchSource:0}: Error finding container bfd12ed362452d440c1cc7ccb86bcc081371ae3efc51618f8f68ae405128c541: Status 404 returned error can't find the container with id bfd12ed362452d440c1cc7ccb86bcc081371ae3efc51618f8f68ae405128c541
Oct 30 03:39:39.239130 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:39.239084    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182" event={"ID":"b756df61-c8ff-40f8-ae6b-a61a6ad81a4e","Type":"ContainerStarted","Data":"d4d7423af1c6a5d7eed4ced574ba13829aa605a1a1e28c19766ba86d60d5f7af"}
Oct 30 03:39:39.239342 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:39.239136    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182" event={"ID":"b756df61-c8ff-40f8-ae6b-a61a6ad81a4e","Type":"ContainerStarted","Data":"bfd12ed362452d440c1cc7ccb86bcc081371ae3efc51618f8f68ae405128c541"}
Oct 30 03:39:39.279011 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:39.278942    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182" podStartSLOduration=1.278927062 podStartE2EDuration="1.278927062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:39:39.278122684 +0000 UTC m=+3419.120369129" watchObservedRunningTime="2026-10-30 03:39:39.278927062 +0000 UTC m=+3419.121173506"
Oct 30 03:39:44.369444 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:39:44.369404    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:39:46.272908 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:46.272883    5981 generic.go:356] "Generic (PLEG): container finished" podID="b756df61-c8ff-40f8-ae6b-a61a6ad81a4e" containerID="d4d7423af1c6a5d7eed4ced574ba13829aa605a1a1e28c19766ba86d60d5f7af" exitCode=0
Oct 30 03:39:46.275052 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:46.275027    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182" event={"ID":"b756df61-c8ff-40f8-ae6b-a61a6ad81a4e","Type":"ContainerDied","Data":"d4d7423af1c6a5d7eed4ced574ba13829aa605a1a1e28c19766ba86d60d5f7af"}
Oct 30 03:39:47.418830 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:47.418806    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182"
Oct 30 03:39:48.290530 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:48.290492    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182" event={"ID":"b756df61-c8ff-40f8-ae6b-a61a6ad81a4e","Type":"ContainerDied","Data":"bfd12ed362452d440c1cc7ccb86bcc081371ae3efc51618f8f68ae405128c541"}
Oct 30 03:39:48.290658 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:48.290539    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182"
Oct 30 03:39:48.290658 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:48.290542    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfd12ed362452d440c1cc7ccb86bcc081371ae3efc51618f8f68ae405128c541"
Oct 30 03:39:48.483103 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:48.483069    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e33194027534ca"]
Oct 30 03:39:48.483518 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:48.483449    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b756df61-c8ff-40f8-ae6b-a61a6ad81a4e" containerName="curl"
Oct 30 03:39:48.483518 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:48.483460    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b756df61-c8ff-40f8-ae6b-a61a6ad81a4e" containerName="curl"
Oct 30 03:39:48.483617 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:48.483526    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b756df61-c8ff-40f8-ae6b-a61a6ad81a4e" containerName="curl"
Oct 30 03:39:48.486511 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:48.486494    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e33194027534ca"
Oct 30 03:39:48.497254 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:48.497235    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e33194027534ca"
Oct 30 03:39:48.502575 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:48.502552    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e33194027534ca"]
Oct 30 03:39:48.793048 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:48.793020    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e33194027534ca"]
Oct 30 03:39:48.794329 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:39:48.794301    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0e3f416_96d2_4aa4_9f10_7d9a6006dcef.slice/crio-d9e0341ace2af4784f7a227406e2df6182655793104c90fb2c8dca344f832ad4 WatchSource:0}: Error finding container d9e0341ace2af4784f7a227406e2df6182655793104c90fb2c8dca344f832ad4: Status 404 returned error can't find the container with id d9e0341ace2af4784f7a227406e2df6182655793104c90fb2c8dca344f832ad4
Oct 30 03:39:49.297720 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:49.297682    5981 generic.go:356] "Generic (PLEG): container finished" podID="a0e3f416-96d2-4aa4-9f10-7d9a6006dcef" containerID="87e60e3a1ea853b4bcae9a76a5fc600554d0c7074fa1f7cb3cabf4695a9d24aa" exitCode=0
Oct 30 03:39:49.297720 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:49.297724    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e33194027534ca" event={"ID":"a0e3f416-96d2-4aa4-9f10-7d9a6006dcef","Type":"ContainerDied","Data":"87e60e3a1ea853b4bcae9a76a5fc600554d0c7074fa1f7cb3cabf4695a9d24aa"}
Oct 30 03:39:49.297980 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:49.297752    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e33194027534ca" event={"ID":"a0e3f416-96d2-4aa4-9f10-7d9a6006dcef","Type":"ContainerStarted","Data":"d9e0341ace2af4784f7a227406e2df6182655793104c90fb2c8dca344f832ad4"}
Oct 30 03:39:50.434324 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:50.434301    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e33194027534ca"
Oct 30 03:39:50.590333 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:50.590243    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6"]
Oct 30 03:39:50.590634 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:50.590621    5981 cpu_manager.go:414] "containerMap: removing container" podUID="a0e3f416-96d2-4aa4-9f10-7d9a6006dcef" containerName="curl"
Oct 30 03:39:50.590675 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:50.590635    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0e3f416-96d2-4aa4-9f10-7d9a6006dcef" containerName="curl"
Oct 30 03:39:50.590709 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:50.590696    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0e3f416-96d2-4aa4-9f10-7d9a6006dcef" containerName="curl"
Oct 30 03:39:50.593621 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:50.593605    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6"
Oct 30 03:39:50.604505 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:50.604485    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6"
Oct 30 03:39:50.609208 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:50.609186    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6"]
Oct 30 03:39:50.897046 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:50.897025    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6"]
Oct 30 03:39:50.898624 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:39:50.898593    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda580b653_8006_4afa_a4b9_82a67374ab3f.slice/crio-bf74332fa163002519ea4f342900e5b971f4a361c86cd9a0ea33875f27220a73 WatchSource:0}: Error finding container bf74332fa163002519ea4f342900e5b971f4a361c86cd9a0ea33875f27220a73: Status 404 returned error can't find the container with id bf74332fa163002519ea4f342900e5b971f4a361c86cd9a0ea33875f27220a73
Oct 30 03:39:51.308172 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:51.308143    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e33194027534ca"
Oct 30 03:39:51.308381 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:51.308185    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e33194027534ca" event={"ID":"a0e3f416-96d2-4aa4-9f10-7d9a6006dcef","Type":"ContainerDied","Data":"d9e0341ace2af4784f7a227406e2df6182655793104c90fb2c8dca344f832ad4"}
Oct 30 03:39:51.308381 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:51.308228    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9e0341ace2af4784f7a227406e2df6182655793104c90fb2c8dca344f832ad4"
Oct 30 03:39:51.309777 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:51.309752    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6" event={"ID":"a580b653-8006-4afa-a4b9-82a67374ab3f","Type":"ContainerStarted","Data":"68f604e99b4400658bf55f6f42406d93b4c56712f53f6629a323cdf2ed0a569f"}
Oct 30 03:39:51.309882 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:51.309787    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6" event={"ID":"a580b653-8006-4afa-a4b9-82a67374ab3f","Type":"ContainerStarted","Data":"bf74332fa163002519ea4f342900e5b971f4a361c86cd9a0ea33875f27220a73"}
Oct 30 03:39:51.358909 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:51.358870    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6" podStartSLOduration=1.358858937 podStartE2EDuration="1.358858937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:39:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:39:51.35847251 +0000 UTC m=+3431.200718937" watchObservedRunningTime="2026-10-30 03:39:51.358858937 +0000 UTC m=+3431.201105410"
Oct 30 03:39:56.335902 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:56.335808    5981 generic.go:356] "Generic (PLEG): container finished" podID="a580b653-8006-4afa-a4b9-82a67374ab3f" containerID="68f604e99b4400658bf55f6f42406d93b4c56712f53f6629a323cdf2ed0a569f" exitCode=0
Oct 30 03:39:56.335902 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:56.335884    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6" event={"ID":"a580b653-8006-4afa-a4b9-82a67374ab3f","Type":"ContainerDied","Data":"68f604e99b4400658bf55f6f42406d93b4c56712f53f6629a323cdf2ed0a569f"}
Oct 30 03:39:57.469354 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:57.469330    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6"
Oct 30 03:39:58.345541 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.345511    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6"
Oct 30 03:39:58.345704 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.345541    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6" event={"ID":"a580b653-8006-4afa-a4b9-82a67374ab3f","Type":"ContainerDied","Data":"bf74332fa163002519ea4f342900e5b971f4a361c86cd9a0ea33875f27220a73"}
Oct 30 03:39:58.345704 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.345581    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf74332fa163002519ea4f342900e5b971f4a361c86cd9a0ea33875f27220a73"
Oct 30 03:39:58.766259 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.766226    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d"]
Oct 30 03:39:58.766825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.766631    5981 cpu_manager.go:414] "containerMap: removing container" podUID="a580b653-8006-4afa-a4b9-82a67374ab3f" containerName="curl"
Oct 30 03:39:58.766825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.766648    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a580b653-8006-4afa-a4b9-82a67374ab3f" containerName="curl"
Oct 30 03:39:58.766825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.766769    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="a580b653-8006-4afa-a4b9-82a67374ab3f" containerName="curl"
Oct 30 03:39:58.769858 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.769838    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d"
Oct 30 03:39:58.785488 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.785467    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d"]
Oct 30 03:39:58.796928 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.796907    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 03:39:58.880533 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.880508    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-certificate\" (UniqueName: \"kubernetes.io/secret/3158a14c-274c-4d22-93bd-91ffaa8db4a4-client-certificate\") pod \"targetallocator-mtls-allowed-18e3319668099b9d\" (UID: \"3158a14c-274c-4d22-93bd-91ffaa8db4a4\") " pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d"
Oct 30 03:39:58.981786 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.981756    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-certificate\" (UniqueName: \"kubernetes.io/secret/3158a14c-274c-4d22-93bd-91ffaa8db4a4-client-certificate\") pod \"targetallocator-mtls-allowed-18e3319668099b9d\" (UID: \"3158a14c-274c-4d22-93bd-91ffaa8db4a4\") " pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d"
Oct 30 03:39:58.984458 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:58.984438    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-certificate\" (UniqueName: \"kubernetes.io/secret/3158a14c-274c-4d22-93bd-91ffaa8db4a4-client-certificate\") pod \"targetallocator-mtls-allowed-18e3319668099b9d\" (UID: \"3158a14c-274c-4d22-93bd-91ffaa8db4a4\") " pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d"
Oct 30 03:39:59.081455 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:59.081382    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d"
Oct 30 03:39:59.382055 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:39:59.382027    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d"]
Oct 30 03:39:59.384041 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:39:59.384011    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3158a14c_274c_4d22_93bd_91ffaa8db4a4.slice/crio-d3691ddb239c9c0f8931d1a5ef08397057aaa9f5618ada47308e4ea45e7fcd72 WatchSource:0}: Error finding container d3691ddb239c9c0f8931d1a5ef08397057aaa9f5618ada47308e4ea45e7fcd72: Status 404 returned error can't find the container with id d3691ddb239c9c0f8931d1a5ef08397057aaa9f5618ada47308e4ea45e7fcd72
Oct 30 03:40:00.356236 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:00.356152    5981 generic.go:356] "Generic (PLEG): container finished" podID="3158a14c-274c-4d22-93bd-91ffaa8db4a4" containerID="04ea73e5f65890b7cb583675300d2cfa6d5cc50a0cd0ac7293a851beab2c310b" exitCode=0
Oct 30 03:40:00.356627 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:00.356245    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d" event={"ID":"3158a14c-274c-4d22-93bd-91ffaa8db4a4","Type":"ContainerDied","Data":"04ea73e5f65890b7cb583675300d2cfa6d5cc50a0cd0ac7293a851beab2c310b"}
Oct 30 03:40:00.356627 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:00.356297    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d" event={"ID":"3158a14c-274c-4d22-93bd-91ffaa8db4a4","Type":"ContainerStarted","Data":"d3691ddb239c9c0f8931d1a5ef08397057aaa9f5618ada47308e4ea45e7fcd72"}
Oct 30 03:40:01.492736 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:01.492706    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d"
Oct 30 03:40:01.602808 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:01.602773    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3158a14c-274c-4d22-93bd-91ffaa8db4a4-client-certificate\" (UniqueName: \"kubernetes.io/secret/3158a14c-274c-4d22-93bd-91ffaa8db4a4-client-certificate\") pod \"3158a14c-274c-4d22-93bd-91ffaa8db4a4\" (UID: \"3158a14c-274c-4d22-93bd-91ffaa8db4a4\") "
Oct 30 03:40:01.605011 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:01.604981    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3158a14c-274c-4d22-93bd-91ffaa8db4a4-client-certificate" pod "3158a14c-274c-4d22-93bd-91ffaa8db4a4" (UID: "3158a14c-274c-4d22-93bd-91ffaa8db4a4"). InnerVolumeSpecName "client-certificate". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:40:01.704387 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:01.704356    5981 reconciler_common.go:299] "Volume detached for volume \"client-certificate\" (UniqueName: \"kubernetes.io/secret/3158a14c-274c-4d22-93bd-91ffaa8db4a4-client-certificate\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:02.370723 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:02.370696    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d"
Oct 30 03:40:02.370875 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:02.370740    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d" event={"ID":"3158a14c-274c-4d22-93bd-91ffaa8db4a4","Type":"ContainerDied","Data":"d3691ddb239c9c0f8931d1a5ef08397057aaa9f5618ada47308e4ea45e7fcd72"}
Oct 30 03:40:02.370875 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:02.370779    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3691ddb239c9c0f8931d1a5ef08397057aaa9f5618ada47308e4ea45e7fcd72"
Oct 30 03:40:02.887214 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:02.887183    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2"]
Oct 30 03:40:02.887626 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:02.887562    5981 cpu_manager.go:414] "containerMap: removing container" podUID="3158a14c-274c-4d22-93bd-91ffaa8db4a4" containerName="curl"
Oct 30 03:40:02.887626 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:02.887575    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3158a14c-274c-4d22-93bd-91ffaa8db4a4" containerName="curl"
Oct 30 03:40:02.887690 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:02.887652    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="3158a14c-274c-4d22-93bd-91ffaa8db4a4" containerName="curl"
Oct 30 03:40:02.890709 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:02.890692    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2"
Oct 30 03:40:02.901527 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:02.901507    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2"
Oct 30 03:40:02.906323 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:02.906301    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2"]
Oct 30 03:40:03.195076 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:03.195047    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2"]
Oct 30 03:40:03.196969 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:40:03.196935    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41eb01b9_2d20_41e1_b382_27f44592660f.slice/crio-62a3c1c3bfc340355d3b8c131700943946078c6f53ae88df18cc20f6b2ad3e88 WatchSource:0}: Error finding container 62a3c1c3bfc340355d3b8c131700943946078c6f53ae88df18cc20f6b2ad3e88: Status 404 returned error can't find the container with id 62a3c1c3bfc340355d3b8c131700943946078c6f53ae88df18cc20f6b2ad3e88
Oct 30 03:40:03.377699 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:03.377662    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2" event={"ID":"41eb01b9-2d20-41e1-b382-27f44592660f","Type":"ContainerStarted","Data":"8317b574b5cef167e87c552fdc35485b18550b0735ae717743fb676bf5eaacef"}
Oct 30 03:40:03.377870 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:03.377708    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2" event={"ID":"41eb01b9-2d20-41e1-b382-27f44592660f","Type":"ContainerStarted","Data":"62a3c1c3bfc340355d3b8c131700943946078c6f53ae88df18cc20f6b2ad3e88"}
Oct 30 03:40:03.416762 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:03.416709    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2" podStartSLOduration=1.416694804 podStartE2EDuration="1.416694804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:40:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:40:03.415772638 +0000 UTC m=+3443.258019083" watchObservedRunningTime="2026-10-30 03:40:03.416694804 +0000 UTC m=+3443.258941249"
Oct 30 03:40:08.406320 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:08.406267    5981 generic.go:356] "Generic (PLEG): container finished" podID="41eb01b9-2d20-41e1-b382-27f44592660f" containerID="8317b574b5cef167e87c552fdc35485b18550b0735ae717743fb676bf5eaacef" exitCode=0
Oct 30 03:40:08.406719 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:08.406341    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2" event={"ID":"41eb01b9-2d20-41e1-b382-27f44592660f","Type":"ContainerDied","Data":"8317b574b5cef167e87c552fdc35485b18550b0735ae717743fb676bf5eaacef"}
Oct 30 03:40:09.538023 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:09.537995    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2"
Oct 30 03:40:10.417129 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:10.417089    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2" event={"ID":"41eb01b9-2d20-41e1-b382-27f44592660f","Type":"ContainerDied","Data":"62a3c1c3bfc340355d3b8c131700943946078c6f53ae88df18cc20f6b2ad3e88"}
Oct 30 03:40:10.417129 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:10.417136    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62a3c1c3bfc340355d3b8c131700943946078c6f53ae88df18cc20f6b2ad3e88"
Oct 30 03:40:10.417348 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:10.417110    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2"
Oct 30 03:40:10.986616 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:10.986583    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2"]
Oct 30 03:40:10.992632 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:10.992604    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e331975dc4cee2"]
Oct 30 03:40:11.016100 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.016068    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d"]
Oct 30 03:40:11.026176 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.026152    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e3319668099b9d"]
Oct 30 03:40:11.047022 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.046995    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6"]
Oct 30 03:40:11.049520 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.049498    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e3319480e781f6"]
Oct 30 03:40:11.073087 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.073055    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e33194027534ca"]
Oct 30 03:40:11.077200 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.077177    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e33194027534ca"]
Oct 30 03:40:11.097446 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.097418    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182"]
Oct 30 03:40:11.104216 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.104191    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-wrong-role-denied-18e33191a429e182"]
Oct 30 03:40:11.125599 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.125573    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015"]
Oct 30 03:40:11.128948 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.128926    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-role-only-denied-18e3318f4544c015"]
Oct 30 03:40:11.148460 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.148435    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737"]
Oct 30 03:40:11.152054 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.152035    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-part-only-denied-18e3318ce6a61737"]
Oct 30 03:40:11.174232 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.174207    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1"]
Oct 30 03:40:11.178783 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.178763    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-unlabeled-denied-18e3318a884382a1"]
Oct 30 03:40:11.199643 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.199619    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009"]
Oct 30 03:40:11.206324 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.206299    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-scheduler-allowed-18e3318992854009"]
Oct 30 03:40:11.222111 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.222080    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-leader-prefill-allowed-18e3318914058d23"]
Oct 30 03:40:11.225603 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.225582    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-leader-prefill-allowed-18e3318914058d23"]
Oct 30 03:40:11.245660 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.245597    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-worker-prefill-allowed-18e33188967bc372"]
Oct 30 03:40:11.249275 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.249254    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-worker-prefill-allowed-18e33188967bc372"]
Oct 30 03:40:11.268809 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.268786    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-leader-allowed-18e33188181d9327"]
Oct 30 03:40:11.276343 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.276321    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-leader-allowed-18e33188181d9327"]
Oct 30 03:40:11.297000 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.296978    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-worker-allowed-18e3318799a1208d"]
Oct 30 03:40:11.300677 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.300658    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-worker-allowed-18e3318799a1208d"]
Oct 30 03:40:11.320918 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.320897    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-prefill-allowed-18e33186a2f98508"]
Oct 30 03:40:11.326629 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.326604    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-prefill-allowed-18e33186a2f98508"]
Oct 30 03:40:11.346784 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.346759    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-workload-allowed-18e33185ac3c2e5c"]
Oct 30 03:40:11.350514 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.350496    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e3316b94494c02/collector-otlp-workload-allowed-18e33185ac3c2e5c"]
Oct 30 03:40:11.370873 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.370850    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4"]
Oct 30 03:40:11.375060 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.375042    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e331834c3598a4"]
Oct 30 03:40:11.396347 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.396325    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922"]
Oct 30 03:40:11.400093 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.400074    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e33180edb9f922"]
Oct 30 03:40:11.420805 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.420785    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05"]
Oct 30 03:40:11.424301 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.424263    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e3317e8f555c05"]
Oct 30 03:40:11.444531 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.444508    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a"]
Oct 30 03:40:11.448440 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.448421    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e3317c30d2bf2a"]
Oct 30 03:40:11.469223 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.469203    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9"]
Oct 30 03:40:11.472549 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.472531    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e33179d27496a9"]
Oct 30 03:40:11.493515 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.493497    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9"]
Oct 30 03:40:11.499189 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.499138    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e3317772e387e9"]
Oct 30 03:40:11.519190 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.519166    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035"]
Oct 30 03:40:11.521393 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.521374    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e3317513c5d035"]
Oct 30 03:40:11.541383 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.541362    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e"]
Oct 30 03:40:11.544993 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.544975    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e33172b48a400e"]
Oct 30 03:40:11.564765 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.564741    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c"]
Oct 30 03:40:11.570943 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.570923    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e33170553ecc5c"]
Oct 30 03:40:11.590728 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.590704    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d"]
Oct 30 03:40:11.594274 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.594257    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e3316df5df629d"]
Oct 30 03:40:11.614318 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.614277    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8"]
Oct 30 03:40:11.618495 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.618475    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e3316b966b36d8"]
Oct 30 03:40:11.680904 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.680878    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e331674ddc2e45"]
Oct 30 03:40:11.686414 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:11.686391    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e331674ddc2e45"]
Oct 30 03:40:12.274357 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.274322    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09717851-e009-4d57-ad23-3ee8010f781f" path="/var/lib/kubelet/pods/09717851-e009-4d57-ad23-3ee8010f781f/volumes"
Oct 30 03:40:12.274748 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.274585    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1c010546-e902-4f8c-b234-f9bffda8164a" path="/var/lib/kubelet/pods/1c010546-e902-4f8c-b234-f9bffda8164a/volumes"
Oct 30 03:40:12.274788 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.274773    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b330291-dabe-422c-826b-88baf270c0af" path="/var/lib/kubelet/pods/2b330291-dabe-422c-826b-88baf270c0af/volumes"
Oct 30 03:40:12.275029 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.275015    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3158a14c-274c-4d22-93bd-91ffaa8db4a4" path="/var/lib/kubelet/pods/3158a14c-274c-4d22-93bd-91ffaa8db4a4/volumes"
Oct 30 03:40:12.275256 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.275245    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e305464-a66e-417b-b4e9-247788c8abc4" path="/var/lib/kubelet/pods/3e305464-a66e-417b-b4e9-247788c8abc4/volumes"
Oct 30 03:40:12.275819 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.275804    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="41eb01b9-2d20-41e1-b382-27f44592660f" path="/var/lib/kubelet/pods/41eb01b9-2d20-41e1-b382-27f44592660f/volumes"
Oct 30 03:40:12.276019 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.276008    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="42d3df2b-9f0d-4fb1-b95b-5a413fa14206" path="/var/lib/kubelet/pods/42d3df2b-9f0d-4fb1-b95b-5a413fa14206/volumes"
Oct 30 03:40:12.276207 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.276197    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5686de13-7fc2-49c3-8a0e-a888281f00d3" path="/var/lib/kubelet/pods/5686de13-7fc2-49c3-8a0e-a888281f00d3/volumes"
Oct 30 03:40:12.276424 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.276412    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6388b416-81dc-4c87-a9f1-ea564f1a2668" path="/var/lib/kubelet/pods/6388b416-81dc-4c87-a9f1-ea564f1a2668/volumes"
Oct 30 03:40:12.276611 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.276601    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6566294f-9f35-4545-979c-59bf586c6aeb" path="/var/lib/kubelet/pods/6566294f-9f35-4545-979c-59bf586c6aeb/volumes"
Oct 30 03:40:12.277109 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.277097    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="768a5a5c-993c-420f-a808-dafa76c4674e" path="/var/lib/kubelet/pods/768a5a5c-993c-420f-a808-dafa76c4674e/volumes"
Oct 30 03:40:12.277333 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.277309    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f3d29c1-3744-4ca4-84d1-2bf8138e9b45" path="/var/lib/kubelet/pods/7f3d29c1-3744-4ca4-84d1-2bf8138e9b45/volumes"
Oct 30 03:40:12.277526 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.277515    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f8f6fde-6973-4b2c-a8e4-2d2b98bb4a1c" path="/var/lib/kubelet/pods/7f8f6fde-6973-4b2c-a8e4-2d2b98bb4a1c/volumes"
Oct 30 03:40:12.277711 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.277701    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="98eafec7-7b85-4906-91a5-e16af7daa6ac" path="/var/lib/kubelet/pods/98eafec7-7b85-4906-91a5-e16af7daa6ac/volumes"
Oct 30 03:40:12.277893 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.277883    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9dd43b84-d19c-49b7-b9c8-97f484e95457" path="/var/lib/kubelet/pods/9dd43b84-d19c-49b7-b9c8-97f484e95457/volumes"
Oct 30 03:40:12.278411 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.278397    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0e3f416-96d2-4aa4-9f10-7d9a6006dcef" path="/var/lib/kubelet/pods/a0e3f416-96d2-4aa4-9f10-7d9a6006dcef/volumes"
Oct 30 03:40:12.278596 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.278585    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a580b653-8006-4afa-a4b9-82a67374ab3f" path="/var/lib/kubelet/pods/a580b653-8006-4afa-a4b9-82a67374ab3f/volumes"
Oct 30 03:40:12.278779 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.278768    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b66bf025-1ec4-4a5a-b401-3b563a600e85" path="/var/lib/kubelet/pods/b66bf025-1ec4-4a5a-b401-3b563a600e85/volumes"
Oct 30 03:40:12.278956 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.278946    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b756df61-c8ff-40f8-ae6b-a61a6ad81a4e" path="/var/lib/kubelet/pods/b756df61-c8ff-40f8-ae6b-a61a6ad81a4e/volumes"
Oct 30 03:40:12.279342 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.279322    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc5ca459-9245-454f-840c-b85a40bde164" path="/var/lib/kubelet/pods/bc5ca459-9245-454f-840c-b85a40bde164/volumes"
Oct 30 03:40:12.279599 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.279586    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bfe32651-f503-4877-a573-e6de78408a9b" path="/var/lib/kubelet/pods/bfe32651-f503-4877-a573-e6de78408a9b/volumes"
Oct 30 03:40:12.279785 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.279774    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8a389cb-b5a1-4d64-be4a-4d8c3951cc22" path="/var/lib/kubelet/pods/c8a389cb-b5a1-4d64-be4a-4d8c3951cc22/volumes"
Oct 30 03:40:12.279970 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.279959    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d09fc264-9524-440e-b9b0-893ebc3c7e2b" path="/var/lib/kubelet/pods/d09fc264-9524-440e-b9b0-893ebc3c7e2b/volumes"
Oct 30 03:40:12.280148 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.280138    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db9725c9-b8a0-4188-a902-9ef6c85177af" path="/var/lib/kubelet/pods/db9725c9-b8a0-4188-a902-9ef6c85177af/volumes"
Oct 30 03:40:12.280436 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.280418    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="deff4e28-9f77-4d82-85be-b36897eaf313" path="/var/lib/kubelet/pods/deff4e28-9f77-4d82-85be-b36897eaf313/volumes"
Oct 30 03:40:12.280715 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.280701    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e81e98f1-9bbd-444d-9879-d576d057a33e" path="/var/lib/kubelet/pods/e81e98f1-9bbd-444d-9879-d576d057a33e/volumes"
Oct 30 03:40:12.280902 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.280891    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee9bac34-c078-4a29-abb5-f060c5d99267" path="/var/lib/kubelet/pods/ee9bac34-c078-4a29-abb5-f060c5d99267/volumes"
Oct 30 03:40:12.763680 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.763643    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0"]
Oct 30 03:40:12.764039 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.764026    5981 cpu_manager.go:414] "containerMap: removing container" podUID="41eb01b9-2d20-41e1-b382-27f44592660f" containerName="curl"
Oct 30 03:40:12.764084 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.764041    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="41eb01b9-2d20-41e1-b382-27f44592660f" containerName="curl"
Oct 30 03:40:12.764121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.764107    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="41eb01b9-2d20-41e1-b382-27f44592660f" containerName="curl"
Oct 30 03:40:12.768533 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.768514    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0"
Oct 30 03:40:12.783846 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.783816    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0"]
Oct 30 03:40:12.795969 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.795938    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-namespace-auth-18e331996f0006f0\"/\"default-dockercfg-qkbgc\""
Oct 30 03:40:12.799989 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:12.799961    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0"
Oct 30 03:40:13.093978 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:13.093950    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0"]
Oct 30 03:40:13.096822 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:40:13.096779    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58e89bc0_275f_4ef5_acdd_5cae44feb6db.slice/crio-4c2417e9c5de7c0a4724d0d579f3baea953ab680b908ac4ad51e61aad4dace81 WatchSource:0}: Error finding container 4c2417e9c5de7c0a4724d0d579f3baea953ab680b908ac4ad51e61aad4dace81: Status 404 returned error can't find the container with id 4c2417e9c5de7c0a4724d0d579f3baea953ab680b908ac4ad51e61aad4dace81
Oct 30 03:40:13.436297 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:13.436247    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0" event={"ID":"58e89bc0-275f-4ef5-acdd-5cae44feb6db","Type":"ContainerStarted","Data":"2eaa0b285db403e646a2c9b5982fc7f3947a7c6c2b6f6de193b5d810b7413416"}
Oct 30 03:40:13.436709 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:13.436307    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0" event={"ID":"58e89bc0-275f-4ef5-acdd-5cae44feb6db","Type":"ContainerStarted","Data":"4c2417e9c5de7c0a4724d0d579f3baea953ab680b908ac4ad51e61aad4dace81"}
Oct 30 03:40:13.476150 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:13.476103    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0" podStartSLOduration=1.4760891649999999 podStartE2EDuration="1.476089165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:40:13.475032835 +0000 UTC m=+3453.317279280" watchObservedRunningTime="2026-10-30 03:40:13.476089165 +0000 UTC m=+3453.318335610"
Oct 30 03:40:14.105196 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.105164    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"]
Oct 30 03:40:14.108496 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.108479    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:14.128177 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.128142    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"]
Oct 30 03:40:14.216399 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.216361    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbkb8\" (UniqueName: \"kubernetes.io/projected/90bc3f06-75a6-4465-93b3-fca9b2fa9213-kube-api-access-vbkb8\") pod \"data-science-collector-targetallocator-6d5f545f5-gx6nt\" (UID: \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:14.216576 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.216412    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/90bc3f06-75a6-4465-93b3-fca9b2fa9213-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6d5f545f5-gx6nt\" (UID: \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:14.216576 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.216541    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/90bc3f06-75a6-4465-93b3-fca9b2fa9213-ta-internal\") pod \"data-science-collector-targetallocator-6d5f545f5-gx6nt\" (UID: \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:14.317223 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.317184    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/90bc3f06-75a6-4465-93b3-fca9b2fa9213-ta-internal\") pod \"data-science-collector-targetallocator-6d5f545f5-gx6nt\" (UID: \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:14.317425 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.317232    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbkb8\" (UniqueName: \"kubernetes.io/projected/90bc3f06-75a6-4465-93b3-fca9b2fa9213-kube-api-access-vbkb8\") pod \"data-science-collector-targetallocator-6d5f545f5-gx6nt\" (UID: \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:14.317425 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.317264    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/90bc3f06-75a6-4465-93b3-fca9b2fa9213-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6d5f545f5-gx6nt\" (UID: \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:14.317875 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.317844    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/90bc3f06-75a6-4465-93b3-fca9b2fa9213-ta-internal\") pod \"data-science-collector-targetallocator-6d5f545f5-gx6nt\" (UID: \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:14.320066 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.320039    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/90bc3f06-75a6-4465-93b3-fca9b2fa9213-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6d5f545f5-gx6nt\" (UID: \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:14.337785 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.337758    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbkb8\" (UniqueName: \"kubernetes.io/projected/90bc3f06-75a6-4465-93b3-fca9b2fa9213-kube-api-access-vbkb8\") pod \"data-science-collector-targetallocator-6d5f545f5-gx6nt\" (UID: \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:14.368517 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:40:14.368427    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:40:14.420299 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.420248    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:14.720929 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.720895    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"]
Oct 30 03:40:14.723993 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:40:14.723960    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90bc3f06_75a6_4465_93b3_fca9b2fa9213.slice/crio-9bd90fb0c6aa22aebacae6c20c14a6889f0ae9e21e8af7cabaa403beedf9b20b WatchSource:0}: Error finding container 9bd90fb0c6aa22aebacae6c20c14a6889f0ae9e21e8af7cabaa403beedf9b20b: Status 404 returned error can't find the container with id 9bd90fb0c6aa22aebacae6c20c14a6889f0ae9e21e8af7cabaa403beedf9b20b
Oct 30 03:40:14.726260 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.726229    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:40:14.726358 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:14.726303    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:40:15.449946 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.449912    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt" event={"ID":"90bc3f06-75a6-4465-93b3-fca9b2fa9213","Type":"ContainerStarted","Data":"77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a"}
Oct 30 03:40:15.449946 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.449954    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt" event={"ID":"90bc3f06-75a6-4465-93b3-fca9b2fa9213","Type":"ContainerStarted","Data":"9bd90fb0c6aa22aebacae6c20c14a6889f0ae9e21e8af7cabaa403beedf9b20b"}
Oct 30 03:40:15.450173 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.450035    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:15.452023 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.451995    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:15.492779 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.492729    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt" podStartSLOduration=1.4927153739999999 podStartE2EDuration="1.492715374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:40:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:40:15.491458156 +0000 UTC m=+3455.333704601" watchObservedRunningTime="2026-10-30 03:40:15.492715374 +0000 UTC m=+3455.334961818"
Oct 30 03:40:15.557985 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.557955    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"]
Oct 30 03:40:15.558159 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.558137    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz" podUID="931ab5cf-8e1e-456e-ab4c-ca2807cd1129" containerName="ta-container" containerID="cri-o://569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b" gracePeriod=30
Oct 30 03:40:15.801896 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.801871    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:40:15.931871 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.931832    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-kube-api-access-xqd2n\" (UniqueName: \"kubernetes.io/projected/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-kube-api-access-xqd2n\") pod \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\" (UID: \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\") "
Oct 30 03:40:15.932035 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.931926    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-data-science-collector-ta-server-cert\") pod \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\" (UID: \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\") "
Oct 30 03:40:15.932035 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.931981    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-ta-internal\" (UniqueName: \"kubernetes.io/configmap/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-ta-internal\") pod \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\" (UID: \"931ab5cf-8e1e-456e-ab4c-ca2807cd1129\") "
Oct 30 03:40:15.932429 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.932405    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-ta-internal" pod "931ab5cf-8e1e-456e-ab4c-ca2807cd1129" (UID: "931ab5cf-8e1e-456e-ab4c-ca2807cd1129"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:40:15.934128 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.934103    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-kube-api-access-xqd2n" pod "931ab5cf-8e1e-456e-ab4c-ca2807cd1129" (UID: "931ab5cf-8e1e-456e-ab4c-ca2807cd1129"). InnerVolumeSpecName "kube-api-access-xqd2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:40:15.934209 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:15.934161    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-data-science-collector-ta-server-cert" pod "931ab5cf-8e1e-456e-ab4c-ca2807cd1129" (UID: "931ab5cf-8e1e-456e-ab4c-ca2807cd1129"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:40:16.033340 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:16.033247    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:16.033340 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:16.033273    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqd2n\" (UniqueName: \"kubernetes.io/projected/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-kube-api-access-xqd2n\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:16.033340 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:16.033300    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/931ab5cf-8e1e-456e-ab4c-ca2807cd1129-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:16.458045 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:16.458014    5981 generic.go:356] "Generic (PLEG): container finished" podID="931ab5cf-8e1e-456e-ab4c-ca2807cd1129" containerID="569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b" exitCode=0
Oct 30 03:40:16.458225 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:16.458059    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"
Oct 30 03:40:16.458225 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:16.458097    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz" event={"ID":"931ab5cf-8e1e-456e-ab4c-ca2807cd1129","Type":"ContainerDied","Data":"569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b"}
Oct 30 03:40:16.458225 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:16.458156    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz" event={"ID":"931ab5cf-8e1e-456e-ab4c-ca2807cd1129","Type":"ContainerDied","Data":"a361c1a129ecee739cb5014efd6a0f1e5eed4ffb6316955bfaba7fb920d8879c"}
Oct 30 03:40:16.458225 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:16.458188    5981 scope.go:122] "RemoveContainer" containerID="569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b"
Oct 30 03:40:16.467752 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:16.467732    5981 scope.go:122] "RemoveContainer" containerID="569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b"
Oct 30 03:40:16.468014 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:40:16.467997    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b\": container with ID starting with 569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b not found: ID does not exist" containerID="569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b"
Oct 30 03:40:16.468080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:16.468020    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b"} err="failed to get container status \"569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b\": rpc error: code = NotFound desc = could not find container \"569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b\": container with ID starting with 569451eee51febecb6f063ff79bd94a3db015a85a58e2ab1deaa2063fc52687b not found: ID does not exist"
Oct 30 03:40:16.511228 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:16.511194    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"]
Oct 30 03:40:16.524257 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:16.524226    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b95f49c9f-cm4pz"]
Oct 30 03:40:18.274374 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:18.274341    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="931ab5cf-8e1e-456e-ab4c-ca2807cd1129" path="/var/lib/kubelet/pods/931ab5cf-8e1e-456e-ab4c-ca2807cd1129/volumes"
Oct 30 03:40:21.488809 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:21.488777    5981 generic.go:356] "Generic (PLEG): container finished" podID="58e89bc0-275f-4ef5-acdd-5cae44feb6db" containerID="2eaa0b285db403e646a2c9b5982fc7f3947a7c6c2b6f6de193b5d810b7413416" exitCode=0
Oct 30 03:40:21.489202 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:21.488853    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0" event={"ID":"58e89bc0-275f-4ef5-acdd-5cae44feb6db","Type":"ContainerDied","Data":"2eaa0b285db403e646a2c9b5982fc7f3947a7c6c2b6f6de193b5d810b7413416"}
Oct 30 03:40:22.616725 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:22.616702    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0"
Oct 30 03:40:23.122853 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.122815    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc"]
Oct 30 03:40:23.123160 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.123148    5981 cpu_manager.go:414] "containerMap: removing container" podUID="931ab5cf-8e1e-456e-ab4c-ca2807cd1129" containerName="ta-container"
Oct 30 03:40:23.123211 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.123162    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="931ab5cf-8e1e-456e-ab4c-ca2807cd1129" containerName="ta-container"
Oct 30 03:40:23.123211 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.123178    5981 cpu_manager.go:414] "containerMap: removing container" podUID="58e89bc0-275f-4ef5-acdd-5cae44feb6db" containerName="curl"
Oct 30 03:40:23.123211 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.123182    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58e89bc0-275f-4ef5-acdd-5cae44feb6db" containerName="curl"
Oct 30 03:40:23.123329 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.123260    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="931ab5cf-8e1e-456e-ab4c-ca2807cd1129" containerName="ta-container"
Oct 30 03:40:23.123329 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.123268    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="58e89bc0-275f-4ef5-acdd-5cae44feb6db" containerName="curl"
Oct 30 03:40:23.125959 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.125941    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc"
Oct 30 03:40:23.136335 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.136313    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc"
Oct 30 03:40:23.142374 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.142353    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc"]
Oct 30 03:40:23.427097 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.427068    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc"]
Oct 30 03:40:23.500649 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.500624    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0"
Oct 30 03:40:23.500782 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.500658    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0" event={"ID":"58e89bc0-275f-4ef5-acdd-5cae44feb6db","Type":"ContainerDied","Data":"4c2417e9c5de7c0a4724d0d579f3baea953ab680b908ac4ad51e61aad4dace81"}
Oct 30 03:40:23.500782 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.500698    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c2417e9c5de7c0a4724d0d579f3baea953ab680b908ac4ad51e61aad4dace81"
Oct 30 03:40:23.502461 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.502438    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc" event={"ID":"81528bca-1213-472d-8c7b-a9f2c9128d45","Type":"ContainerStarted","Data":"bb889af1a3df1b47a3e100146e50f1b66faa91a5edba0475270eb9b58c60da98"}
Oct 30 03:40:23.502571 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.502472    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc" event={"ID":"81528bca-1213-472d-8c7b-a9f2c9128d45","Type":"ContainerStarted","Data":"cd0026f3e7dada4668e4c1ae87737edff43b86b2e6ec757a1b4c303203e5e182"}
Oct 30 03:40:23.540905 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:23.540861    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc" podStartSLOduration=0.54084628 podStartE2EDuration="540.84628ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:40:23.539997838 +0000 UTC m=+3463.382244283" watchObservedRunningTime="2026-10-30 03:40:23.54084628 +0000 UTC m=+3463.383092727"
Oct 30 03:40:24.508722 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:24.508687    5981 generic.go:356] "Generic (PLEG): container finished" podID="81528bca-1213-472d-8c7b-a9f2c9128d45" containerID="bb889af1a3df1b47a3e100146e50f1b66faa91a5edba0475270eb9b58c60da98" exitCode=0
Oct 30 03:40:24.509116 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:24.508770    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc" event={"ID":"81528bca-1213-472d-8c7b-a9f2c9128d45","Type":"ContainerDied","Data":"bb889af1a3df1b47a3e100146e50f1b66faa91a5edba0475270eb9b58c60da98"}
Oct 30 03:40:25.641770 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:25.641744    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc"
Oct 30 03:40:26.519830 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:26.519794    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc" event={"ID":"81528bca-1213-472d-8c7b-a9f2c9128d45","Type":"ContainerDied","Data":"cd0026f3e7dada4668e4c1ae87737edff43b86b2e6ec757a1b4c303203e5e182"}
Oct 30 03:40:26.520074 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:26.519841    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd0026f3e7dada4668e4c1ae87737edff43b86b2e6ec757a1b4c303203e5e182"
Oct 30 03:40:26.520074 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:26.519814    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc"
Oct 30 03:40:27.436929 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:27.436890    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6"]
Oct 30 03:40:27.437344 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:27.437265    5981 cpu_manager.go:414] "containerMap: removing container" podUID="81528bca-1213-472d-8c7b-a9f2c9128d45" containerName="curl"
Oct 30 03:40:27.437344 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:27.437276    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81528bca-1213-472d-8c7b-a9f2c9128d45" containerName="curl"
Oct 30 03:40:27.437344 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:27.437344    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="81528bca-1213-472d-8c7b-a9f2c9128d45" containerName="curl"
Oct 30 03:40:27.440204 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:27.440183    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6"
Oct 30 03:40:27.458085 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:27.458057    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6"]
Oct 30 03:40:27.469862 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:27.469830    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-namespace-auth-18e331996f0006f0\"/\"default-dockercfg-qkbgc\""
Oct 30 03:40:27.470889 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:27.470848    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6"
Oct 30 03:40:27.765338 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:27.765313    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6"]
Oct 30 03:40:27.767759 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:40:27.767730    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1f29c82_a40b_4c9a_a362_23820c5e844d.slice/crio-37050cb056b431cfec525564a16fbce3129f185a1410c8657b196859a5ecf1f4 WatchSource:0}: Error finding container 37050cb056b431cfec525564a16fbce3129f185a1410c8657b196859a5ecf1f4: Status 404 returned error can't find the container with id 37050cb056b431cfec525564a16fbce3129f185a1410c8657b196859a5ecf1f4
Oct 30 03:40:28.536464 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:28.536426    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6" event={"ID":"c1f29c82-a40b-4c9a-a362-23820c5e844d","Type":"ContainerStarted","Data":"a30bd5e88cd7fe574fb056ef731dc89bf8ef2c766a10ed9eed3cb82cd3eeeb1e"}
Oct 30 03:40:28.536464 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:28.536465    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6" event={"ID":"c1f29c82-a40b-4c9a-a362-23820c5e844d","Type":"ContainerStarted","Data":"37050cb056b431cfec525564a16fbce3129f185a1410c8657b196859a5ecf1f4"}
Oct 30 03:40:28.578188 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:28.578136    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6" podStartSLOduration=1.5781235200000001 podStartE2EDuration="1.57812352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:40:28.576872272 +0000 UTC m=+3468.419118721" watchObservedRunningTime="2026-10-30 03:40:28.57812352 +0000 UTC m=+3468.420369961"
Oct 30 03:40:35.574093 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:35.574060    5981 generic.go:356] "Generic (PLEG): container finished" podID="c1f29c82-a40b-4c9a-a362-23820c5e844d" containerID="a30bd5e88cd7fe574fb056ef731dc89bf8ef2c766a10ed9eed3cb82cd3eeeb1e" exitCode=0
Oct 30 03:40:35.574556 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:35.574143    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6" event={"ID":"c1f29c82-a40b-4c9a-a362-23820c5e844d","Type":"ContainerDied","Data":"a30bd5e88cd7fe574fb056ef731dc89bf8ef2c766a10ed9eed3cb82cd3eeeb1e"}
Oct 30 03:40:36.713925 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:36.713903    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6"
Oct 30 03:40:37.550004 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:37.549971    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6"]
Oct 30 03:40:37.554813 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:37.554781    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6"]
Oct 30 03:40:37.574795 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:37.574769    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc"]
Oct 30 03:40:37.580797 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:37.580770    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-namespace-auth-18e331996f0006f0/enrolled-inference-allowed-18e3319c13cb67fc"]
Oct 30 03:40:37.585831 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:37.585805    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6"
Oct 30 03:40:37.585952 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:37.585858    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37050cb056b431cfec525564a16fbce3129f185a1410c8657b196859a5ecf1f4"
Oct 30 03:40:37.600593 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:37.600573    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0"]
Oct 30 03:40:37.606773 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:37.606752    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-namespace-auth-18e331996f0006f0/unenrolled-spoof-denied-18e33199a91675b0"]
Oct 30 03:40:37.607511 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:40:37.607487    5981 status_manager.go:1045] "Failed to get status for pod" err="pods \"revoked-inference-denied-18e3319d14db96e6\" is forbidden: User \"system:node:ip-10-0-128-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"collector-namespace-auth-18e331996f0006f0\": no relationship found between node 'ip-10-0-128-202.ec2.internal' and this object" podUID="c1f29c82-a40b-4c9a-a362-23820c5e844d" pod="collector-namespace-auth-18e331996f0006f0/revoked-inference-denied-18e3319d14db96e6"
Oct 30 03:40:38.274762 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:38.274727    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58e89bc0-275f-4ef5-acdd-5cae44feb6db" path="/var/lib/kubelet/pods/58e89bc0-275f-4ef5-acdd-5cae44feb6db/volumes"
Oct 30 03:40:38.275150 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:38.274969    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81528bca-1213-472d-8c7b-a9f2c9128d45" path="/var/lib/kubelet/pods/81528bca-1213-472d-8c7b-a9f2c9128d45/volumes"
Oct 30 03:40:38.275191 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:38.275170    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1f29c82-a40b-4c9a-a362-23820c5e844d" path="/var/lib/kubelet/pods/c1f29c82-a40b-4c9a-a362-23820c5e844d/volumes"
Oct 30 03:40:39.912183 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:39.912147    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"]
Oct 30 03:40:39.912579 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:39.912503    5981 cpu_manager.go:414] "containerMap: removing container" podUID="c1f29c82-a40b-4c9a-a362-23820c5e844d" containerName="curl"
Oct 30 03:40:39.912579 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:39.912514    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1f29c82-a40b-4c9a-a362-23820c5e844d" containerName="curl"
Oct 30 03:40:39.912646 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:39.912597    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1f29c82-a40b-4c9a-a362-23820c5e844d" containerName="curl"
Oct 30 03:40:39.915687 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:39.915666    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:39.936241 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:39.936214    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"]
Oct 30 03:40:40.040469 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.040433    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c042b59a-d728-4ec5-ae3c-45b283202e51-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bdcd8d6c-ngmnb\" (UID: \"c042b59a-d728-4ec5-ae3c-45b283202e51\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:40.040632 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.040499    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c042b59a-d728-4ec5-ae3c-45b283202e51-ta-internal\") pod \"data-science-collector-targetallocator-5bdcd8d6c-ngmnb\" (UID: \"c042b59a-d728-4ec5-ae3c-45b283202e51\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:40.040698 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.040655    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rcgn\" (UniqueName: \"kubernetes.io/projected/c042b59a-d728-4ec5-ae3c-45b283202e51-kube-api-access-9rcgn\") pod \"data-science-collector-targetallocator-5bdcd8d6c-ngmnb\" (UID: \"c042b59a-d728-4ec5-ae3c-45b283202e51\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:40.141860 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.141830    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c042b59a-d728-4ec5-ae3c-45b283202e51-ta-internal\") pod \"data-science-collector-targetallocator-5bdcd8d6c-ngmnb\" (UID: \"c042b59a-d728-4ec5-ae3c-45b283202e51\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:40.142044 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.141888    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rcgn\" (UniqueName: \"kubernetes.io/projected/c042b59a-d728-4ec5-ae3c-45b283202e51-kube-api-access-9rcgn\") pod \"data-science-collector-targetallocator-5bdcd8d6c-ngmnb\" (UID: \"c042b59a-d728-4ec5-ae3c-45b283202e51\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:40.142044 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.141929    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c042b59a-d728-4ec5-ae3c-45b283202e51-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bdcd8d6c-ngmnb\" (UID: \"c042b59a-d728-4ec5-ae3c-45b283202e51\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:40.142570 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.142543    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c042b59a-d728-4ec5-ae3c-45b283202e51-ta-internal\") pod \"data-science-collector-targetallocator-5bdcd8d6c-ngmnb\" (UID: \"c042b59a-d728-4ec5-ae3c-45b283202e51\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:40.144545 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.144526    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c042b59a-d728-4ec5-ae3c-45b283202e51-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bdcd8d6c-ngmnb\" (UID: \"c042b59a-d728-4ec5-ae3c-45b283202e51\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:40.161639 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.161613    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rcgn\" (UniqueName: \"kubernetes.io/projected/c042b59a-d728-4ec5-ae3c-45b283202e51-kube-api-access-9rcgn\") pod \"data-science-collector-targetallocator-5bdcd8d6c-ngmnb\" (UID: \"c042b59a-d728-4ec5-ae3c-45b283202e51\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:40.227102 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.227024    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:40.524507 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.524440    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"]
Oct 30 03:40:40.527636 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:40:40.527605    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc042b59a_d728_4ec5_ae3c_45b283202e51.slice/crio-00b31585bd9c3a96f91429cc76617b338f93525b30c38309d01f893542c2c6be WatchSource:0}: Error finding container 00b31585bd9c3a96f91429cc76617b338f93525b30c38309d01f893542c2c6be: Status 404 returned error can't find the container with id 00b31585bd9c3a96f91429cc76617b338f93525b30c38309d01f893542c2c6be
Oct 30 03:40:40.529859 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.529831    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:40:40.529928 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.529885    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:40:40.602019 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.601989    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb" event={"ID":"c042b59a-d728-4ec5-ae3c-45b283202e51","Type":"ContainerStarted","Data":"6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3"}
Oct 30 03:40:40.602146 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.602029    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb" event={"ID":"c042b59a-d728-4ec5-ae3c-45b283202e51","Type":"ContainerStarted","Data":"00b31585bd9c3a96f91429cc76617b338f93525b30c38309d01f893542c2c6be"}
Oct 30 03:40:40.602203 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.602145    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:40.603919 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:40.603842    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb" podUID="c042b59a-d728-4ec5-ae3c-45b283202e51" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.93:8080/readyz\": dial tcp 10.134.0.93:8080: connect: connection refused"
Oct 30 03:40:41.567168 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:41.567110    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb" podStartSLOduration=2.567091837 podStartE2EDuration="2.567091837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:40:40.648733436 +0000 UTC m=+3480.490979892" watchObservedRunningTime="2026-10-30 03:40:41.567091837 +0000 UTC m=+3481.409338278"
Oct 30 03:40:41.567635 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:41.567613    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"]
Oct 30 03:40:41.567837 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:41.567812    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr" podUID="aa6422cf-86bc-4b8c-8cb3-61ef74158516" containerName="thanos-querier" containerID="cri-o://db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719" gracePeriod=30
Oct 30 03:40:41.610255 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:41.610227    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:41.697606 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:41.697571    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"]
Oct 30 03:40:41.697776 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:41.697754    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt" podUID="90bc3f06-75a6-4465-93b3-fca9b2fa9213" containerName="ta-container" containerID="cri-o://77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a" gracePeriod=30
Oct 30 03:40:41.834946 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:41.834923    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"
Oct 30 03:40:41.944259 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:41.944231    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:41.956796 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:41.956774    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa6422cf-86bc-4b8c-8cb3-61ef74158516-kube-api-access-q78j6\" (UniqueName: \"kubernetes.io/projected/aa6422cf-86bc-4b8c-8cb3-61ef74158516-kube-api-access-q78j6\") pod \"aa6422cf-86bc-4b8c-8cb3-61ef74158516\" (UID: \"aa6422cf-86bc-4b8c-8cb3-61ef74158516\") "
Oct 30 03:40:41.958899 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:41.958873    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6422cf-86bc-4b8c-8cb3-61ef74158516-kube-api-access-q78j6" pod "aa6422cf-86bc-4b8c-8cb3-61ef74158516" (UID: "aa6422cf-86bc-4b8c-8cb3-61ef74158516"). InnerVolumeSpecName "kube-api-access-q78j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:40:42.057970 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.057933    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/90bc3f06-75a6-4465-93b3-fca9b2fa9213-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/90bc3f06-75a6-4465-93b3-fca9b2fa9213-data-science-collector-ta-server-cert\") pod \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\" (UID: \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\") "
Oct 30 03:40:42.058159 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.058012    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90bc3f06-75a6-4465-93b3-fca9b2fa9213-kube-api-access-vbkb8\" (UniqueName: \"kubernetes.io/projected/90bc3f06-75a6-4465-93b3-fca9b2fa9213-kube-api-access-vbkb8\") pod \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\" (UID: \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\") "
Oct 30 03:40:42.058159 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.058121    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/90bc3f06-75a6-4465-93b3-fca9b2fa9213-ta-internal\" (UniqueName: \"kubernetes.io/configmap/90bc3f06-75a6-4465-93b3-fca9b2fa9213-ta-internal\") pod \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\" (UID: \"90bc3f06-75a6-4465-93b3-fca9b2fa9213\") "
Oct 30 03:40:42.058435 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.058408    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q78j6\" (UniqueName: \"kubernetes.io/projected/aa6422cf-86bc-4b8c-8cb3-61ef74158516-kube-api-access-q78j6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:42.058518 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.058504    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90bc3f06-75a6-4465-93b3-fca9b2fa9213-ta-internal" pod "90bc3f06-75a6-4465-93b3-fca9b2fa9213" (UID: "90bc3f06-75a6-4465-93b3-fca9b2fa9213"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:40:42.060347 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.060328    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90bc3f06-75a6-4465-93b3-fca9b2fa9213-data-science-collector-ta-server-cert" pod "90bc3f06-75a6-4465-93b3-fca9b2fa9213" (UID: "90bc3f06-75a6-4465-93b3-fca9b2fa9213"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:40:42.060402 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.060376    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90bc3f06-75a6-4465-93b3-fca9b2fa9213-kube-api-access-vbkb8" pod "90bc3f06-75a6-4465-93b3-fca9b2fa9213" (UID: "90bc3f06-75a6-4465-93b3-fca9b2fa9213"). InnerVolumeSpecName "kube-api-access-vbkb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:40:42.159199 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.159170    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbkb8\" (UniqueName: \"kubernetes.io/projected/90bc3f06-75a6-4465-93b3-fca9b2fa9213-kube-api-access-vbkb8\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:42.159199 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.159197    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/90bc3f06-75a6-4465-93b3-fca9b2fa9213-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:42.159354 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.159206    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/90bc3f06-75a6-4465-93b3-fca9b2fa9213-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:42.559475 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.559395    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"]
Oct 30 03:40:42.597076 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.597039    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:40:42.597841 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.597806    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="14ce6f89-f91e-4216-8fde-ea10050adc4b" containerName="perses" containerID="cri-o://61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa" gracePeriod=30
Oct 30 03:40:42.616133 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.616111    5981 generic.go:356] "Generic (PLEG): container finished" podID="aa6422cf-86bc-4b8c-8cb3-61ef74158516" containerID="db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719" exitCode=0
Oct 30 03:40:42.616234 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.616190    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr" event={"ID":"aa6422cf-86bc-4b8c-8cb3-61ef74158516","Type":"ContainerDied","Data":"db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719"}
Oct 30 03:40:42.616318 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.616224    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"
Oct 30 03:40:42.616318 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.616255    5981 scope.go:122] "RemoveContainer" containerID="db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719"
Oct 30 03:40:42.616318 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.616242    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr" event={"ID":"aa6422cf-86bc-4b8c-8cb3-61ef74158516","Type":"ContainerDied","Data":"5a537448d9c51f24514530f75193f1027009caab2a78f78e198fbff683d360c2"}
Oct 30 03:40:42.617675 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.617656    5981 generic.go:356] "Generic (PLEG): container finished" podID="90bc3f06-75a6-4465-93b3-fca9b2fa9213" containerID="77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a" exitCode=0
Oct 30 03:40:42.617769 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.617710    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"
Oct 30 03:40:42.617769 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.617736    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt" event={"ID":"90bc3f06-75a6-4465-93b3-fca9b2fa9213","Type":"ContainerDied","Data":"77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a"}
Oct 30 03:40:42.617769 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.617767    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt" event={"ID":"90bc3f06-75a6-4465-93b3-fca9b2fa9213","Type":"ContainerDied","Data":"9bd90fb0c6aa22aebacae6c20c14a6889f0ae9e21e8af7cabaa403beedf9b20b"}
Oct 30 03:40:42.662744 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:40:42.662714    5981 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/data-science-collector-targetallocator: configmap "data-science-collector-targetallocator" not found
Oct 30 03:40:42.662869 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:40:42.662806    5981 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c042b59a-d728-4ec5-ae3c-45b283202e51-ta-internal podName:c042b59a-d728-4ec5-ae3c-45b283202e51 nodeName:}" failed. No retries permitted until 2026-10-30 03:40:43.162783711 +0000 UTC m=+3483.005030153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ta-internal" (UniqueName: "kubernetes.io/configmap/c042b59a-d728-4ec5-ae3c-45b283202e51-ta-internal") pod "data-science-collector-targetallocator-5bdcd8d6c-ngmnb" (UID: "c042b59a-d728-4ec5-ae3c-45b283202e51") : configmap "data-science-collector-targetallocator" not found
Oct 30 03:40:42.708339 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.708309    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"]
Oct 30 03:40:42.713685 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.713577    5981 scope.go:122] "RemoveContainer" containerID="db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719"
Oct 30 03:40:42.713971 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:40:42.713949    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719\": container with ID starting with db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719 not found: ID does not exist" containerID="db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719"
Oct 30 03:40:42.714101 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.713978    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719"} err="failed to get container status \"db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719\": rpc error: code = NotFound desc = could not find container \"db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719\": container with ID starting with db0f3c093f4fd6c2fdad05a3fbeb609a0199d6abbee5c28fcf9858bd566cd719 not found: ID does not exist"
Oct 30 03:40:42.714101 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.714003    5981 scope.go:122] "RemoveContainer" containerID="77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a"
Oct 30 03:40:42.715212 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.715192    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d5f545f5-gx6nt"]
Oct 30 03:40:42.722852 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.722823    5981 scope.go:122] "RemoveContainer" containerID="77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a"
Oct 30 03:40:42.723139 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:40:42.723119    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a\": container with ID starting with 77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a not found: ID does not exist" containerID="77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a"
Oct 30 03:40:42.723207 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.723147    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a"} err="failed to get container status \"77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a\": rpc error: code = NotFound desc = could not find container \"77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a\": container with ID starting with 77f1c5422eef88f4e6e576721b51a5fec1969ede1c35b571155e3411ced5bc7a not found: ID does not exist"
Oct 30 03:40:42.761741 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.761709    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"]
Oct 30 03:40:42.766414 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.766384    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-z7msr"]
Oct 30 03:40:42.854938 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.854909    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:42.964694 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.964666    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"14ce6f89-f91e-4216-8fde-ea10050adc4b\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") "
Oct 30 03:40:42.964848 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.964717    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14ce6f89-f91e-4216-8fde-ea10050adc4b-kube-api-access-9n8z5\" (UniqueName: \"kubernetes.io/projected/14ce6f89-f91e-4216-8fde-ea10050adc4b-kube-api-access-9n8z5\") pod \"14ce6f89-f91e-4216-8fde-ea10050adc4b\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") "
Oct 30 03:40:42.964848 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.964747    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14ce6f89-f91e-4216-8fde-ea10050adc4b-config\" (UniqueName: \"kubernetes.io/configmap/14ce6f89-f91e-4216-8fde-ea10050adc4b-config\") pod \"14ce6f89-f91e-4216-8fde-ea10050adc4b\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") "
Oct 30 03:40:42.964848 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.964825    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14ce6f89-f91e-4216-8fde-ea10050adc4b-plugins\" (UniqueName: \"kubernetes.io/empty-dir/14ce6f89-f91e-4216-8fde-ea10050adc4b-plugins\") pod \"14ce6f89-f91e-4216-8fde-ea10050adc4b\" (UID: \"14ce6f89-f91e-4216-8fde-ea10050adc4b\") "
Oct 30 03:40:42.965193 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.965163    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ce6f89-f91e-4216-8fde-ea10050adc4b-config" pod "14ce6f89-f91e-4216-8fde-ea10050adc4b" (UID: "14ce6f89-f91e-4216-8fde-ea10050adc4b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:40:42.967102 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.967074    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ce6f89-f91e-4216-8fde-ea10050adc4b-kube-api-access-9n8z5" pod "14ce6f89-f91e-4216-8fde-ea10050adc4b" (UID: "14ce6f89-f91e-4216-8fde-ea10050adc4b"). InnerVolumeSpecName "kube-api-access-9n8z5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:40:42.967580 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:42.967559    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "14ce6f89-f91e-4216-8fde-ea10050adc4b" (UID: "14ce6f89-f91e-4216-8fde-ea10050adc4b"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 03:40:43.066065 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.066033    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 03:40:43.066065 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.066059    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n8z5\" (UniqueName: \"kubernetes.io/projected/14ce6f89-f91e-4216-8fde-ea10050adc4b-kube-api-access-9n8z5\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:43.066065 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.066071    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14ce6f89-f91e-4216-8fde-ea10050adc4b-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:43.079734 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.079713    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 03:40:43.112545 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.112488    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ce6f89-f91e-4216-8fde-ea10050adc4b-plugins" pod "14ce6f89-f91e-4216-8fde-ea10050adc4b" (UID: "14ce6f89-f91e-4216-8fde-ea10050adc4b"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:40:43.167363 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.167337    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 03:40:43.167363 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.167358    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/14ce6f89-f91e-4216-8fde-ea10050adc4b-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:43.167497 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:40:43.167408    5981 configmap.go:193] Couldn't get configMap redhat-ods-monitoring/data-science-collector-targetallocator: configmap "data-science-collector-targetallocator" not found
Oct 30 03:40:43.167497 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:40:43.167453    5981 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c042b59a-d728-4ec5-ae3c-45b283202e51-ta-internal podName:c042b59a-d728-4ec5-ae3c-45b283202e51 nodeName:}" failed. No retries permitted until 2026-10-30 03:40:44.167441085 +0000 UTC m=+3484.009687521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ta-internal" (UniqueName: "kubernetes.io/configmap/c042b59a-d728-4ec5-ae3c-45b283202e51-ta-internal") pod "data-science-collector-targetallocator-5bdcd8d6c-ngmnb" (UID: "c042b59a-d728-4ec5-ae3c-45b283202e51") : configmap "data-science-collector-targetallocator" not found
Oct 30 03:40:43.625323 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.625263    5981 generic.go:356] "Generic (PLEG): container finished" podID="14ce6f89-f91e-4216-8fde-ea10050adc4b" containerID="61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa" exitCode=0
Oct 30 03:40:43.625323 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.625328    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:43.625889 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.625332    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"14ce6f89-f91e-4216-8fde-ea10050adc4b","Type":"ContainerDied","Data":"61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa"}
Oct 30 03:40:43.625889 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.625389    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"14ce6f89-f91e-4216-8fde-ea10050adc4b","Type":"ContainerDied","Data":"3692166c7f8fb11eb9be506159ecb3ce27f24c98a4b619353e61253355f7bb28"}
Oct 30 03:40:43.625889 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.625411    5981 scope.go:122] "RemoveContainer" containerID="61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa"
Oct 30 03:40:43.628980 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.628950    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb" podUID="c042b59a-d728-4ec5-ae3c-45b283202e51" containerName="ta-container" containerID="cri-o://6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3" gracePeriod=30
Oct 30 03:40:43.638756 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.638730    5981 scope.go:122] "RemoveContainer" containerID="61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa"
Oct 30 03:40:43.639046 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:40:43.639025    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa\": container with ID starting with 61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa not found: ID does not exist" containerID="61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa"
Oct 30 03:40:43.639125 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.639054    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa"} err="failed to get container status \"61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa\": rpc error: code = NotFound desc = could not find container \"61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa\": container with ID starting with 61cfc28c67a6f34964c8a55694a3cfc892c8a33b5792271af316051701349bfa not found: ID does not exist"
Oct 30 03:40:43.677398 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.677371    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:40:43.681058 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.681037    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:40:43.874909 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.874886    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:43.975279 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.975248    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c042b59a-d728-4ec5-ae3c-45b283202e51-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c042b59a-d728-4ec5-ae3c-45b283202e51-data-science-collector-ta-server-cert\") pod \"c042b59a-d728-4ec5-ae3c-45b283202e51\" (UID: \"c042b59a-d728-4ec5-ae3c-45b283202e51\") "
Oct 30 03:40:43.975473 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.975329    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c042b59a-d728-4ec5-ae3c-45b283202e51-ta-internal\" (UniqueName: \"kubernetes.io/configmap/c042b59a-d728-4ec5-ae3c-45b283202e51-ta-internal\") pod \"c042b59a-d728-4ec5-ae3c-45b283202e51\" (UID: \"c042b59a-d728-4ec5-ae3c-45b283202e51\") "
Oct 30 03:40:43.975473 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.975412    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c042b59a-d728-4ec5-ae3c-45b283202e51-kube-api-access-9rcgn\" (UniqueName: \"kubernetes.io/projected/c042b59a-d728-4ec5-ae3c-45b283202e51-kube-api-access-9rcgn\") pod \"c042b59a-d728-4ec5-ae3c-45b283202e51\" (UID: \"c042b59a-d728-4ec5-ae3c-45b283202e51\") "
Oct 30 03:40:43.975681 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.975661    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c042b59a-d728-4ec5-ae3c-45b283202e51-ta-internal" pod "c042b59a-d728-4ec5-ae3c-45b283202e51" (UID: "c042b59a-d728-4ec5-ae3c-45b283202e51"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:40:43.977605 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.977581    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c042b59a-d728-4ec5-ae3c-45b283202e51-data-science-collector-ta-server-cert" pod "c042b59a-d728-4ec5-ae3c-45b283202e51" (UID: "c042b59a-d728-4ec5-ae3c-45b283202e51"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:40:43.977715 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:43.977581    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c042b59a-d728-4ec5-ae3c-45b283202e51-kube-api-access-9rcgn" pod "c042b59a-d728-4ec5-ae3c-45b283202e51" (UID: "c042b59a-d728-4ec5-ae3c-45b283202e51"). InnerVolumeSpecName "kube-api-access-9rcgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:40:44.076157 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.076134    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rcgn\" (UniqueName: \"kubernetes.io/projected/c042b59a-d728-4ec5-ae3c-45b283202e51-kube-api-access-9rcgn\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:44.076157 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.076156    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c042b59a-d728-4ec5-ae3c-45b283202e51-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:44.076326 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.076168    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c042b59a-d728-4ec5-ae3c-45b283202e51-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:40:44.274377 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.274308    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14ce6f89-f91e-4216-8fde-ea10050adc4b" path="/var/lib/kubelet/pods/14ce6f89-f91e-4216-8fde-ea10050adc4b/volumes"
Oct 30 03:40:44.274704 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.274691    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="90bc3f06-75a6-4465-93b3-fca9b2fa9213" path="/var/lib/kubelet/pods/90bc3f06-75a6-4465-93b3-fca9b2fa9213/volumes"
Oct 30 03:40:44.274983 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.274964    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aa6422cf-86bc-4b8c-8cb3-61ef74158516" path="/var/lib/kubelet/pods/aa6422cf-86bc-4b8c-8cb3-61ef74158516/volumes"
Oct 30 03:40:44.368688 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:40:44.368654    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:40:44.634957 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.634873    5981 generic.go:356] "Generic (PLEG): container finished" podID="c042b59a-d728-4ec5-ae3c-45b283202e51" containerID="6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3" exitCode=0
Oct 30 03:40:44.634957 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.634918    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"
Oct 30 03:40:44.635474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.634960    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb" event={"ID":"c042b59a-d728-4ec5-ae3c-45b283202e51","Type":"ContainerDied","Data":"6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3"}
Oct 30 03:40:44.635474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.635015    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb" event={"ID":"c042b59a-d728-4ec5-ae3c-45b283202e51","Type":"ContainerDied","Data":"00b31585bd9c3a96f91429cc76617b338f93525b30c38309d01f893542c2c6be"}
Oct 30 03:40:44.635474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.635034    5981 scope.go:122] "RemoveContainer" containerID="6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3"
Oct 30 03:40:44.643916 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.643898    5981 scope.go:122] "RemoveContainer" containerID="6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3"
Oct 30 03:40:44.644158 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:40:44.644143    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3\": container with ID starting with 6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3 not found: ID does not exist" containerID="6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3"
Oct 30 03:40:44.644219 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.644167    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3"} err="failed to get container status \"6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3\": rpc error: code = NotFound desc = could not find container \"6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3\": container with ID starting with 6bf3e6c184e584a4d2dd7262415960f559a73ef3f51cc01cec2427b2abf446f3 not found: ID does not exist"
Oct 30 03:40:44.689486 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.689460    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"]
Oct 30 03:40:44.702663 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:44.702637    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bdcd8d6c-ngmnb"]
Oct 30 03:40:46.274137 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:46.274101    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c042b59a-d728-4ec5-ae3c-45b283202e51" path="/var/lib/kubelet/pods/c042b59a-d728-4ec5-ae3c-45b283202e51/volumes"
Oct 30 03:40:48.408583 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.408549    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:40:48.408982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.408901    5981 cpu_manager.go:414] "containerMap: removing container" podUID="14ce6f89-f91e-4216-8fde-ea10050adc4b" containerName="perses"
Oct 30 03:40:48.408982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.408913    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14ce6f89-f91e-4216-8fde-ea10050adc4b" containerName="perses"
Oct 30 03:40:48.408982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.408923    5981 cpu_manager.go:414] "containerMap: removing container" podUID="c042b59a-d728-4ec5-ae3c-45b283202e51" containerName="ta-container"
Oct 30 03:40:48.408982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.408929    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c042b59a-d728-4ec5-ae3c-45b283202e51" containerName="ta-container"
Oct 30 03:40:48.408982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.408956    5981 cpu_manager.go:414] "containerMap: removing container" podUID="aa6422cf-86bc-4b8c-8cb3-61ef74158516" containerName="thanos-querier"
Oct 30 03:40:48.408982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.408961    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa6422cf-86bc-4b8c-8cb3-61ef74158516" containerName="thanos-querier"
Oct 30 03:40:48.408982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.408967    5981 cpu_manager.go:414] "containerMap: removing container" podUID="90bc3f06-75a6-4465-93b3-fca9b2fa9213" containerName="ta-container"
Oct 30 03:40:48.408982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.408972    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90bc3f06-75a6-4465-93b3-fca9b2fa9213" containerName="ta-container"
Oct 30 03:40:48.409264 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.409023    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="aa6422cf-86bc-4b8c-8cb3-61ef74158516" containerName="thanos-querier"
Oct 30 03:40:48.409264 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.409031    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="90bc3f06-75a6-4465-93b3-fca9b2fa9213" containerName="ta-container"
Oct 30 03:40:48.409264 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.409039    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="14ce6f89-f91e-4216-8fde-ea10050adc4b" containerName="perses"
Oct 30 03:40:48.409264 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.409045    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="c042b59a-d728-4ec5-ae3c-45b283202e51" containerName="ta-container"
Oct 30 03:40:48.413910 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.413889    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:48.429728 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.429702    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:40:48.465257 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.465216    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 03:40:48.487329 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.487269    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 03:40:48.487501 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.487370    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 03:40:48.487501 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.487380    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 03:40:48.515890 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.515859    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ff6a5e0-6e36-486f-85fc-410cd3a80379-config\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:48.515890 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.515890    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/5ff6a5e0-6e36-486f-85fc-410cd3a80379-plugins\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:48.516091 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.515913    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xhwd\" (UniqueName: \"kubernetes.io/projected/5ff6a5e0-6e36-486f-85fc-410cd3a80379-kube-api-access-7xhwd\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:48.616761 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.616722    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ff6a5e0-6e36-486f-85fc-410cd3a80379-config\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:48.616949 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.616763    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/5ff6a5e0-6e36-486f-85fc-410cd3a80379-plugins\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:48.616949 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.616791    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xhwd\" (UniqueName: \"kubernetes.io/projected/5ff6a5e0-6e36-486f-85fc-410cd3a80379-kube-api-access-7xhwd\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:48.617125 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.617105    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/5ff6a5e0-6e36-486f-85fc-410cd3a80379-plugins\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:48.617469 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.617445    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ff6a5e0-6e36-486f-85fc-410cd3a80379-config\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:48.636528 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:48.636500    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xhwd\" (UniqueName: \"kubernetes.io/projected/5ff6a5e0-6e36-486f-85fc-410cd3a80379-kube-api-access-7xhwd\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:50.736078 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:50.736040    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:50.780029 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:50.779989    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:50.837631 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:50.837595    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:50.837776 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:50.837738    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:50.852829 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:50.852802    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:50.956766 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:50.956725    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:50.988870 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:50.988812    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:51.125847 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:51.125810    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:51.422369 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:51.422335    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:40:51.424989 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:40:51.424954    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ff6a5e0_6e36_486f_85fc_410cd3a80379.slice/crio-c56ea6325db5af091ab82870cc4b4e81aefee2685dbb61c7efa07184df85bed4 WatchSource:0}: Error finding container c56ea6325db5af091ab82870cc4b4e81aefee2685dbb61c7efa07184df85bed4: Status 404 returned error can't find the container with id c56ea6325db5af091ab82870cc4b4e81aefee2685dbb61c7efa07184df85bed4
Oct 30 03:40:51.677350 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:51.677241    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"5ff6a5e0-6e36-486f-85fc-410cd3a80379","Type":"ContainerStarted","Data":"720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5"}
Oct 30 03:40:51.677350 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:51.677309    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:40:51.677350 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:51.677326    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"5ff6a5e0-6e36-486f-85fc-410cd3a80379","Type":"ContainerStarted","Data":"c56ea6325db5af091ab82870cc4b4e81aefee2685dbb61c7efa07184df85bed4"}
Oct 30 03:40:51.720744 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:40:51.720657    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=3.720639976 podStartE2EDuration="3.720639976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:40:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:40:51.720056696 +0000 UTC m=+3491.562303141" watchObservedRunningTime="2026-10-30 03:40:51.720639976 +0000 UTC m=+3491.562886422"
Oct 30 03:41:02.685388 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:02.685354    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:14.368226 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:41:14.368184    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:41:40.033556 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.033520    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:41:40.033992 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.033721    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="5ff6a5e0-6e36-486f-85fc-410cd3a80379" containerName="perses" containerID="cri-o://720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5" gracePeriod=30
Oct 30 03:41:40.310727 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.310700    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:40.367501 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.367471    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ff6a5e0-6e36-486f-85fc-410cd3a80379-plugins\" (UniqueName: \"kubernetes.io/empty-dir/5ff6a5e0-6e36-486f-85fc-410cd3a80379-plugins\") pod \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") "
Oct 30 03:41:40.367674 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.367553    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ff6a5e0-6e36-486f-85fc-410cd3a80379-kube-api-access-7xhwd\" (UniqueName: \"kubernetes.io/projected/5ff6a5e0-6e36-486f-85fc-410cd3a80379-kube-api-access-7xhwd\") pod \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") "
Oct 30 03:41:40.368037 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.368013    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") "
Oct 30 03:41:40.368268 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.368242    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ff6a5e0-6e36-486f-85fc-410cd3a80379-config\" (UniqueName: \"kubernetes.io/configmap/5ff6a5e0-6e36-486f-85fc-410cd3a80379-config\") pod \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\" (UID: \"5ff6a5e0-6e36-486f-85fc-410cd3a80379\") "
Oct 30 03:41:40.368822 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.368799    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ff6a5e0-6e36-486f-85fc-410cd3a80379-config" pod "5ff6a5e0-6e36-486f-85fc-410cd3a80379" (UID: "5ff6a5e0-6e36-486f-85fc-410cd3a80379"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:41:40.370911 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.370882    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ff6a5e0-6e36-486f-85fc-410cd3a80379-kube-api-access-7xhwd" pod "5ff6a5e0-6e36-486f-85fc-410cd3a80379" (UID: "5ff6a5e0-6e36-486f-85fc-410cd3a80379"). InnerVolumeSpecName "kube-api-access-7xhwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:41:40.372120 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.372095    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "5ff6a5e0-6e36-486f-85fc-410cd3a80379" (UID: "5ff6a5e0-6e36-486f-85fc-410cd3a80379"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 03:41:40.469180 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.469150    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ff6a5e0-6e36-486f-85fc-410cd3a80379-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:41:40.469180 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.469178    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xhwd\" (UniqueName: \"kubernetes.io/projected/5ff6a5e0-6e36-486f-85fc-410cd3a80379-kube-api-access-7xhwd\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:41:40.469410 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.469209    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 03:41:40.484151 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.484127    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 03:41:40.527936 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.527901    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ff6a5e0-6e36-486f-85fc-410cd3a80379-plugins" pod "5ff6a5e0-6e36-486f-85fc-410cd3a80379" (UID: "5ff6a5e0-6e36-486f-85fc-410cd3a80379"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:41:40.570485 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.570415    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 03:41:40.570485 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.570441    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/5ff6a5e0-6e36-486f-85fc-410cd3a80379-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:41:40.932828 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.932797    5981 generic.go:356] "Generic (PLEG): container finished" podID="5ff6a5e0-6e36-486f-85fc-410cd3a80379" containerID="720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5" exitCode=0
Oct 30 03:41:40.932993 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.932863    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:40.932993 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.932888    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"5ff6a5e0-6e36-486f-85fc-410cd3a80379","Type":"ContainerDied","Data":"720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5"}
Oct 30 03:41:40.932993 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.932936    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"5ff6a5e0-6e36-486f-85fc-410cd3a80379","Type":"ContainerDied","Data":"c56ea6325db5af091ab82870cc4b4e81aefee2685dbb61c7efa07184df85bed4"}
Oct 30 03:41:40.932993 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.932956    5981 scope.go:122] "RemoveContainer" containerID="720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5"
Oct 30 03:41:40.942160 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.942143    5981 scope.go:122] "RemoveContainer" containerID="720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5"
Oct 30 03:41:40.942496 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:41:40.942477    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5\": container with ID starting with 720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5 not found: ID does not exist" containerID="720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5"
Oct 30 03:41:40.942595 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.942506    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5"} err="failed to get container status \"720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5\": rpc error: code = NotFound desc = could not find container \"720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5\": container with ID starting with 720a3e5e79c084d293204eeb938ede99096b28fe4f88adc52b45d398be1ae1c5 not found: ID does not exist"
Oct 30 03:41:40.997963 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:40.997936    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:41:41.010667 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:41.010647    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:41:42.274990 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:42.274951    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ff6a5e0-6e36-486f-85fc-410cd3a80379" path="/var/lib/kubelet/pods/5ff6a5e0-6e36-486f-85fc-410cd3a80379/volumes"
Oct 30 03:41:44.261066 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.261036    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:41:44.261642 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.261533    5981 cpu_manager.go:414] "containerMap: removing container" podUID="5ff6a5e0-6e36-486f-85fc-410cd3a80379" containerName="perses"
Oct 30 03:41:44.261642 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.261553    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ff6a5e0-6e36-486f-85fc-410cd3a80379" containerName="perses"
Oct 30 03:41:44.261756 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.261669    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ff6a5e0-6e36-486f-85fc-410cd3a80379" containerName="perses"
Oct 30 03:41:44.264368 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.264347    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:44.282744 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.282722    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:41:44.304221 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.304198    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 03:41:44.306248 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.306219    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 03:41:44.306248 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.306226    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 03:41:44.306407 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.306337    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 03:41:44.369166 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:41:44.369132    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:41:44.404686 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.404657    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ffvk\" (UniqueName: \"kubernetes.io/projected/6d920514-4801-4f8e-8cde-73bfaa1f84f6-kube-api-access-6ffvk\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:44.404839 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.404699    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d920514-4801-4f8e-8cde-73bfaa1f84f6-config\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:44.404839 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.404724    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/6d920514-4801-4f8e-8cde-73bfaa1f84f6-plugins\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:44.505541 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.505509    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ffvk\" (UniqueName: \"kubernetes.io/projected/6d920514-4801-4f8e-8cde-73bfaa1f84f6-kube-api-access-6ffvk\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:44.505692 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.505554    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d920514-4801-4f8e-8cde-73bfaa1f84f6-config\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:44.505692 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.505574    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/6d920514-4801-4f8e-8cde-73bfaa1f84f6-plugins\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:44.505915 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.505900    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/6d920514-4801-4f8e-8cde-73bfaa1f84f6-plugins\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:44.506139 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.506120    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d920514-4801-4f8e-8cde-73bfaa1f84f6-config\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:44.534142 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:44.534075    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ffvk\" (UniqueName: \"kubernetes.io/projected/6d920514-4801-4f8e-8cde-73bfaa1f84f6-kube-api-access-6ffvk\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:52.068489 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:52.068446    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:52.099007 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:52.098975    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:52.169406 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:52.169374    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:52.169550 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:52.169512    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:52.184793 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:52.184767    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:52.286514 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:52.286482    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:52.319088 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:52.319023    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:52.375751 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:52.375726    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:52.671988 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:52.671963    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:41:52.674088 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:41:52.674048    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d920514_4801_4f8e_8cde_73bfaa1f84f6.slice/crio-088d602d5994c195e0599c4b131c93c1d2cbf0085f30cdfde9feeef63486d6b3 WatchSource:0}: Error finding container 088d602d5994c195e0599c4b131c93c1d2cbf0085f30cdfde9feeef63486d6b3: Status 404 returned error can't find the container with id 088d602d5994c195e0599c4b131c93c1d2cbf0085f30cdfde9feeef63486d6b3
Oct 30 03:41:52.996711 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:52.996626    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"6d920514-4801-4f8e-8cde-73bfaa1f84f6","Type":"ContainerStarted","Data":"8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48"}
Oct 30 03:41:52.996711 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:52.996669    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"6d920514-4801-4f8e-8cde-73bfaa1f84f6","Type":"ContainerStarted","Data":"088d602d5994c195e0599c4b131c93c1d2cbf0085f30cdfde9feeef63486d6b3"}
Oct 30 03:41:52.996920 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:52.996746    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:53.037000 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:53.036948    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=9.036927931 podStartE2EDuration="9.036927931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:41:53.036464307 +0000 UTC m=+3552.878710761" watchObservedRunningTime="2026-10-30 03:41:53.036927931 +0000 UTC m=+3552.879174377"
Oct 30 03:41:59.529277 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:59.529238    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:41:59.529735 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:59.529484    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="6d920514-4801-4f8e-8cde-73bfaa1f84f6" containerName="perses" containerID="cri-o://8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48" gracePeriod=30
Oct 30 03:41:59.770824 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:59.770800    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:41:59.941751 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:59.941720    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") "
Oct 30 03:41:59.941932 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:59.941758    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d920514-4801-4f8e-8cde-73bfaa1f84f6-kube-api-access-6ffvk\" (UniqueName: \"kubernetes.io/projected/6d920514-4801-4f8e-8cde-73bfaa1f84f6-kube-api-access-6ffvk\") pod \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") "
Oct 30 03:41:59.941932 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:59.941821    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6d920514-4801-4f8e-8cde-73bfaa1f84f6-config\" (UniqueName: \"kubernetes.io/configmap/6d920514-4801-4f8e-8cde-73bfaa1f84f6-config\") pod \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") "
Oct 30 03:41:59.941932 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:59.941848    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d920514-4801-4f8e-8cde-73bfaa1f84f6-plugins\" (UniqueName: \"kubernetes.io/empty-dir/6d920514-4801-4f8e-8cde-73bfaa1f84f6-plugins\") pod \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\" (UID: \"6d920514-4801-4f8e-8cde-73bfaa1f84f6\") "
Oct 30 03:41:59.942298 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:59.942234    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d920514-4801-4f8e-8cde-73bfaa1f84f6-config" pod "6d920514-4801-4f8e-8cde-73bfaa1f84f6" (UID: "6d920514-4801-4f8e-8cde-73bfaa1f84f6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:41:59.944702 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:59.944674    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d920514-4801-4f8e-8cde-73bfaa1f84f6-kube-api-access-6ffvk" pod "6d920514-4801-4f8e-8cde-73bfaa1f84f6" (UID: "6d920514-4801-4f8e-8cde-73bfaa1f84f6"). InnerVolumeSpecName "kube-api-access-6ffvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:41:59.945124 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:41:59.945105    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "6d920514-4801-4f8e-8cde-73bfaa1f84f6" (UID: "6d920514-4801-4f8e-8cde-73bfaa1f84f6"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 03:42:00.035690 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.035648    5981 generic.go:356] "Generic (PLEG): container finished" podID="6d920514-4801-4f8e-8cde-73bfaa1f84f6" containerID="8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48" exitCode=0
Oct 30 03:42:00.035856 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.035691    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:00.035856 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.035726    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"6d920514-4801-4f8e-8cde-73bfaa1f84f6","Type":"ContainerDied","Data":"8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48"}
Oct 30 03:42:00.035856 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.035769    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"6d920514-4801-4f8e-8cde-73bfaa1f84f6","Type":"ContainerDied","Data":"088d602d5994c195e0599c4b131c93c1d2cbf0085f30cdfde9feeef63486d6b3"}
Oct 30 03:42:00.035856 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.035788    5981 scope.go:122] "RemoveContainer" containerID="8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48"
Oct 30 03:42:00.043332 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.043308    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d920514-4801-4f8e-8cde-73bfaa1f84f6-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:42:00.043440 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.043363    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 03:42:00.043440 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.043380    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ffvk\" (UniqueName: \"kubernetes.io/projected/6d920514-4801-4f8e-8cde-73bfaa1f84f6-kube-api-access-6ffvk\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:42:00.045451 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.045431    5981 scope.go:122] "RemoveContainer" containerID="8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48"
Oct 30 03:42:00.045750 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:42:00.045726    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48\": container with ID starting with 8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48 not found: ID does not exist" containerID="8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48"
Oct 30 03:42:00.045843 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.045752    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48"} err="failed to get container status \"8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48\": rpc error: code = NotFound desc = could not find container \"8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48\": container with ID starting with 8c430dcd5c908de893b14397b4ac3b27d9f8cd3cb06947b4fa0730ea0ec58b48 not found: ID does not exist"
Oct 30 03:42:00.055703 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.055683    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 03:42:00.071951 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.071921    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d920514-4801-4f8e-8cde-73bfaa1f84f6-plugins" pod "6d920514-4801-4f8e-8cde-73bfaa1f84f6" (UID: "6d920514-4801-4f8e-8cde-73bfaa1f84f6"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:42:00.144496 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.144473    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 03:42:00.144611 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.144515    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/6d920514-4801-4f8e-8cde-73bfaa1f84f6-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:42:00.374439 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.374408    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:42:00.387216 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:00.387184    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:42:02.274339 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:02.274303    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6d920514-4801-4f8e-8cde-73bfaa1f84f6" path="/var/lib/kubelet/pods/6d920514-4801-4f8e-8cde-73bfaa1f84f6/volumes"
Oct 30 03:42:04.318663 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.318629    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:42:04.319080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.318938    5981 cpu_manager.go:414] "containerMap: removing container" podUID="6d920514-4801-4f8e-8cde-73bfaa1f84f6" containerName="perses"
Oct 30 03:42:04.319080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.318949    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d920514-4801-4f8e-8cde-73bfaa1f84f6" containerName="perses"
Oct 30 03:42:04.319080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.319037    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d920514-4801-4f8e-8cde-73bfaa1f84f6" containerName="perses"
Oct 30 03:42:04.339403 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.339370    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:04.343072 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.343040    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:42:04.399486 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.399446    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 03:42:04.399486 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.399447    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 03:42:04.399735 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.399536    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 03:42:04.399735 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.399561    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 03:42:04.483832 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.483794    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v6pv\" (UniqueName: \"kubernetes.io/projected/9ddac028-c00b-4c59-8721-3597a5ee1652-kube-api-access-6v6pv\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:04.484035 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.483865    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/9ddac028-c00b-4c59-8721-3597a5ee1652-plugins\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:04.484035 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.483927    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ddac028-c00b-4c59-8721-3597a5ee1652-config\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:04.585102 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.585021    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/9ddac028-c00b-4c59-8721-3597a5ee1652-plugins\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:04.585102 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.585091    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ddac028-c00b-4c59-8721-3597a5ee1652-config\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:04.585300 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.585167    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6pv\" (UniqueName: \"kubernetes.io/projected/9ddac028-c00b-4c59-8721-3597a5ee1652-kube-api-access-6v6pv\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:04.585505 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.585484    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/9ddac028-c00b-4c59-8721-3597a5ee1652-plugins\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:04.585878 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.585851    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ddac028-c00b-4c59-8721-3597a5ee1652-config\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:04.606588 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:04.606561    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v6pv\" (UniqueName: \"kubernetes.io/projected/9ddac028-c00b-4c59-8721-3597a5ee1652-kube-api-access-6v6pv\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:14.368049 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:42:14.368008    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:42:16.189619 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:16.189581    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:16.220517 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:16.220484    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:16.290839 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:16.290808    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:16.291004 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:16.290940    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:16.305997 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:16.305973    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:16.405788 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:16.405755    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:16.436296 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:16.436258    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:16.654151 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:16.654113    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:16.949454 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:16.949428    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:42:16.951823 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:42:16.951794    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ddac028_c00b_4c59_8721_3597a5ee1652.slice/crio-1a7d32f61f0515ee906575f9f7503cd38d6214b1e8565f92e56a23b290137eb8 WatchSource:0}: Error finding container 1a7d32f61f0515ee906575f9f7503cd38d6214b1e8565f92e56a23b290137eb8: Status 404 returned error can't find the container with id 1a7d32f61f0515ee906575f9f7503cd38d6214b1e8565f92e56a23b290137eb8
Oct 30 03:42:17.124274 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:17.124238    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"9ddac028-c00b-4c59-8721-3597a5ee1652","Type":"ContainerStarted","Data":"f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece"}
Oct 30 03:42:17.124274 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:17.124305    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"9ddac028-c00b-4c59-8721-3597a5ee1652","Type":"ContainerStarted","Data":"1a7d32f61f0515ee906575f9f7503cd38d6214b1e8565f92e56a23b290137eb8"}
Oct 30 03:42:17.124512 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:17.124357    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:17.166029 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:17.165971    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=13.165958404 podStartE2EDuration="13.165958404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:42:17.165500497 +0000 UTC m=+3577.007746942" watchObservedRunningTime="2026-10-30 03:42:17.165958404 +0000 UTC m=+3577.008204846"
Oct 30 03:42:28.132497 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:28.132463    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:42:40.819336 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:42:40.819302    5981 scope.go:122] "RemoveContainer" containerID="dce58e42c213c4be25814e701c7878593fbcd1be9006d5d123a86d3271622e79"
Oct 30 03:42:44.369129 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:42:44.369093    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:43:02.386638 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.386602    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:43:02.387379 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.386849    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="9ddac028-c00b-4c59-8721-3597a5ee1652" containerName="perses" containerID="cri-o://f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece" gracePeriod=30
Oct 30 03:43:02.644420 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.644357    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:02.694774 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.694745    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ddac028-c00b-4c59-8721-3597a5ee1652-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9ddac028-c00b-4c59-8721-3597a5ee1652-plugins\") pod \"9ddac028-c00b-4c59-8721-3597a5ee1652\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") "
Oct 30 03:43:02.694950 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.694802    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ddac028-c00b-4c59-8721-3597a5ee1652-config\" (UniqueName: \"kubernetes.io/configmap/9ddac028-c00b-4c59-8721-3597a5ee1652-config\") pod \"9ddac028-c00b-4c59-8721-3597a5ee1652\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") "
Oct 30 03:43:02.694950 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.694825    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ddac028-c00b-4c59-8721-3597a5ee1652-kube-api-access-6v6pv\" (UniqueName: \"kubernetes.io/projected/9ddac028-c00b-4c59-8721-3597a5ee1652-kube-api-access-6v6pv\") pod \"9ddac028-c00b-4c59-8721-3597a5ee1652\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") "
Oct 30 03:43:02.695045 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.694950    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"9ddac028-c00b-4c59-8721-3597a5ee1652\" (UID: \"9ddac028-c00b-4c59-8721-3597a5ee1652\") "
Oct 30 03:43:02.695253 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.695211    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ddac028-c00b-4c59-8721-3597a5ee1652-config" pod "9ddac028-c00b-4c59-8721-3597a5ee1652" (UID: "9ddac028-c00b-4c59-8721-3597a5ee1652"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:43:02.697652 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.697627    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ddac028-c00b-4c59-8721-3597a5ee1652-kube-api-access-6v6pv" pod "9ddac028-c00b-4c59-8721-3597a5ee1652" (UID: "9ddac028-c00b-4c59-8721-3597a5ee1652"). InnerVolumeSpecName "kube-api-access-6v6pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:43:02.698330 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.698270    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "9ddac028-c00b-4c59-8721-3597a5ee1652" (UID: "9ddac028-c00b-4c59-8721-3597a5ee1652"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 03:43:02.796090 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.796054    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 03:43:02.796090 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.796090    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ddac028-c00b-4c59-8721-3597a5ee1652-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:43:02.796090 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.796104    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v6pv\" (UniqueName: \"kubernetes.io/projected/9ddac028-c00b-4c59-8721-3597a5ee1652-kube-api-access-6v6pv\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:43:02.815882 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.815846    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 03:43:02.867477 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.867440    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ddac028-c00b-4c59-8721-3597a5ee1652-plugins" pod "9ddac028-c00b-4c59-8721-3597a5ee1652" (UID: "9ddac028-c00b-4c59-8721-3597a5ee1652"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:43:02.897183 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.897145    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/9ddac028-c00b-4c59-8721-3597a5ee1652-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:43:02.897183 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:02.897179    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 03:43:03.362059 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:03.361969    5981 generic.go:356] "Generic (PLEG): container finished" podID="9ddac028-c00b-4c59-8721-3597a5ee1652" containerID="f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece" exitCode=0
Oct 30 03:43:03.362059 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:03.362019    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:03.362311 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:03.362049    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"9ddac028-c00b-4c59-8721-3597a5ee1652","Type":"ContainerDied","Data":"f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece"}
Oct 30 03:43:03.362311 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:03.362097    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"9ddac028-c00b-4c59-8721-3597a5ee1652","Type":"ContainerDied","Data":"1a7d32f61f0515ee906575f9f7503cd38d6214b1e8565f92e56a23b290137eb8"}
Oct 30 03:43:03.362311 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:03.362114    5981 scope.go:122] "RemoveContainer" containerID="f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece"
Oct 30 03:43:03.372333 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:03.372315    5981 scope.go:122] "RemoveContainer" containerID="f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece"
Oct 30 03:43:03.372612 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:43:03.372592    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece\": container with ID starting with f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece not found: ID does not exist" containerID="f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece"
Oct 30 03:43:03.372659 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:03.372622    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece"} err="failed to get container status \"f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece\": rpc error: code = NotFound desc = could not find container \"f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece\": container with ID starting with f750ea644fe4d505f22cdf5732a485bbdd24bd3ce3aaea0db404f88580dbcece not found: ID does not exist"
Oct 30 03:43:03.413383 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:03.413356    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:43:03.426050 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:03.426020    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:43:04.275122 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:04.275089    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ddac028-c00b-4c59-8721-3597a5ee1652" path="/var/lib/kubelet/pods/9ddac028-c00b-4c59-8721-3597a5ee1652/volumes"
Oct 30 03:43:05.935961 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:05.935929    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 03:43:05.936386 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:05.936254    5981 cpu_manager.go:414] "containerMap: removing container" podUID="9ddac028-c00b-4c59-8721-3597a5ee1652" containerName="perses"
Oct 30 03:43:05.936386 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:05.936264    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ddac028-c00b-4c59-8721-3597a5ee1652" containerName="perses"
Oct 30 03:43:05.936386 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:05.936337    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ddac028-c00b-4c59-8721-3597a5ee1652" containerName="perses"
Oct 30 03:43:05.960451 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:05.960422    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 03:43:05.960616 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:05.960516    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:43:05.989097 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:05.989068    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 03:43:05.989097 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:05.989088    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 03:43:05.989271 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:05.989102    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 03:43:06.024686 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:06.024662    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6b58e59-f6a3-4b4d-916f-77428fd790cf-data\") pod \"seaweedfs\" (UID: \"c6b58e59-f6a3-4b4d-916f-77428fd790cf\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:43:06.024834 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:06.024730    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz9d7\" (UniqueName: \"kubernetes.io/projected/c6b58e59-f6a3-4b4d-916f-77428fd790cf-kube-api-access-pz9d7\") pod \"seaweedfs\" (UID: \"c6b58e59-f6a3-4b4d-916f-77428fd790cf\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:43:06.125394 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:06.125362    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6b58e59-f6a3-4b4d-916f-77428fd790cf-data\") pod \"seaweedfs\" (UID: \"c6b58e59-f6a3-4b4d-916f-77428fd790cf\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:43:06.125584 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:06.125451    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz9d7\" (UniqueName: \"kubernetes.io/projected/c6b58e59-f6a3-4b4d-916f-77428fd790cf-kube-api-access-pz9d7\") pod \"seaweedfs\" (UID: \"c6b58e59-f6a3-4b4d-916f-77428fd790cf\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:43:06.125707 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:06.125688    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6b58e59-f6a3-4b4d-916f-77428fd790cf-data\") pod \"seaweedfs\" (UID: \"c6b58e59-f6a3-4b4d-916f-77428fd790cf\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:43:06.145457 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:06.145431    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz9d7\" (UniqueName: \"kubernetes.io/projected/c6b58e59-f6a3-4b4d-916f-77428fd790cf-kube-api-access-pz9d7\") pod \"seaweedfs\" (UID: \"c6b58e59-f6a3-4b4d-916f-77428fd790cf\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:43:06.272717 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:06.272623    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:43:06.569569 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:06.569542    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 03:43:06.571727 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:43:06.571698    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6b58e59_f6a3_4b4d_916f_77428fd790cf.slice/crio-f9222de06b2aa5447d60f1358f99b4922fbb85d3c1ac67f6438aa62809a7f256 WatchSource:0}: Error finding container f9222de06b2aa5447d60f1358f99b4922fbb85d3c1ac67f6438aa62809a7f256: Status 404 returned error can't find the container with id f9222de06b2aa5447d60f1358f99b4922fbb85d3c1ac67f6438aa62809a7f256
Oct 30 03:43:06.573709 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:06.573688    5981 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 03:43:07.386514 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:07.386469    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"c6b58e59-f6a3-4b4d-916f-77428fd790cf","Type":"ContainerStarted","Data":"f9222de06b2aa5447d60f1358f99b4922fbb85d3c1ac67f6438aa62809a7f256"}
Oct 30 03:43:12.415813 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:12.415777    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"c6b58e59-f6a3-4b4d-916f-77428fd790cf","Type":"ContainerStarted","Data":"bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c"}
Oct 30 03:43:12.416215 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:12.415895    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:43:12.456397 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:12.456344    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/seaweedfs" podStartSLOduration=2.579584605 podStartE2EDuration="7.456329984s" totalImagesPullingTime="4.876745379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:43:12.454881675 +0000 UTC m=+3632.297128140" watchObservedRunningTime="2026-10-30 03:43:12.456329984 +0000 UTC m=+3632.298576454"
Oct 30 03:43:14.368486 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:43:14.368447    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:43:23.423073 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:23.423040    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:43:24.192654 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:24.192620    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 03:43:24.195970 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:24.195953    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:43:24.212363 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:24.212331    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 03:43:24.296789 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:24.296758    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jnqt\" (UniqueName: \"kubernetes.io/projected/03317fc1-ec32-4ffd-ab04-6aec7dfca42b-kube-api-access-6jnqt\") pod \"seaweedfs-bucket-creator\" (UID: \"03317fc1-ec32-4ffd-ab04-6aec7dfca42b\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:43:24.397924 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:24.397891    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jnqt\" (UniqueName: \"kubernetes.io/projected/03317fc1-ec32-4ffd-ab04-6aec7dfca42b-kube-api-access-6jnqt\") pod \"seaweedfs-bucket-creator\" (UID: \"03317fc1-ec32-4ffd-ab04-6aec7dfca42b\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:43:24.419481 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:24.419454    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jnqt\" (UniqueName: \"kubernetes.io/projected/03317fc1-ec32-4ffd-ab04-6aec7dfca42b-kube-api-access-6jnqt\") pod \"seaweedfs-bucket-creator\" (UID: \"03317fc1-ec32-4ffd-ab04-6aec7dfca42b\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:43:24.507998 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:24.507924    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:43:24.798725 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:24.798700    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 03:43:24.800624 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:43:24.800598    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03317fc1_ec32_4ffd_ab04_6aec7dfca42b.slice/crio-790043116e71f4c838de84d6f77d649af5fbdff15d5848765e97f26ef0cfa7d4 WatchSource:0}: Error finding container 790043116e71f4c838de84d6f77d649af5fbdff15d5848765e97f26ef0cfa7d4: Status 404 returned error can't find the container with id 790043116e71f4c838de84d6f77d649af5fbdff15d5848765e97f26ef0cfa7d4
Oct 30 03:43:25.486771 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:25.486740    5981 generic.go:356] "Generic (PLEG): container finished" podID="03317fc1-ec32-4ffd-ab04-6aec7dfca42b" containerID="a40350c27587f85c4a30857642ebfc04a33cb0442105f0d3d0548aa1bec2b74a" exitCode=0
Oct 30 03:43:25.486913 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:25.486836    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"03317fc1-ec32-4ffd-ab04-6aec7dfca42b","Type":"ContainerDied","Data":"a40350c27587f85c4a30857642ebfc04a33cb0442105f0d3d0548aa1bec2b74a"}
Oct 30 03:43:25.486913 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:25.486875    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"03317fc1-ec32-4ffd-ab04-6aec7dfca42b","Type":"ContainerStarted","Data":"790043116e71f4c838de84d6f77d649af5fbdff15d5848765e97f26ef0cfa7d4"}
Oct 30 03:43:26.620784 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:26.620753    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:43:26.721547 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:26.721514    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03317fc1-ec32-4ffd-ab04-6aec7dfca42b-kube-api-access-6jnqt\" (UniqueName: \"kubernetes.io/projected/03317fc1-ec32-4ffd-ab04-6aec7dfca42b-kube-api-access-6jnqt\") pod \"03317fc1-ec32-4ffd-ab04-6aec7dfca42b\" (UID: \"03317fc1-ec32-4ffd-ab04-6aec7dfca42b\") "
Oct 30 03:43:26.723691 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:26.723663    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03317fc1-ec32-4ffd-ab04-6aec7dfca42b-kube-api-access-6jnqt" pod "03317fc1-ec32-4ffd-ab04-6aec7dfca42b" (UID: "03317fc1-ec32-4ffd-ab04-6aec7dfca42b"). InnerVolumeSpecName "kube-api-access-6jnqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:43:26.822707 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:26.822641    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jnqt\" (UniqueName: \"kubernetes.io/projected/03317fc1-ec32-4ffd-ab04-6aec7dfca42b-kube-api-access-6jnqt\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:43:27.498062 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:27.498037    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:43:27.498234 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:27.498035    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"03317fc1-ec32-4ffd-ab04-6aec7dfca42b","Type":"ContainerDied","Data":"790043116e71f4c838de84d6f77d649af5fbdff15d5848765e97f26ef0cfa7d4"}
Oct 30 03:43:27.498234 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:27.498159    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="790043116e71f4c838de84d6f77d649af5fbdff15d5848765e97f26ef0cfa7d4"
Oct 30 03:43:30.236172 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.236137    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:43:30.236558 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.236507    5981 cpu_manager.go:414] "containerMap: removing container" podUID="03317fc1-ec32-4ffd-ab04-6aec7dfca42b" containerName="create-bucket"
Oct 30 03:43:30.236558 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.236520    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03317fc1-ec32-4ffd-ab04-6aec7dfca42b" containerName="create-bucket"
Oct 30 03:43:30.236622 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.236600    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="03317fc1-ec32-4ffd-ab04-6aec7dfca42b" containerName="create-bucket"
Oct 30 03:43:30.239597 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.239578    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:30.257794 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.257762    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:43:30.316017 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.315990    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 03:43:30.354560 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.354532    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnkpn\" (UniqueName: \"kubernetes.io/projected/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-kube-api-access-pnkpn\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:30.354727 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.354569    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-config\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:30.354727 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.354613    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-plugins\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:30.455659 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.455621    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnkpn\" (UniqueName: \"kubernetes.io/projected/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-kube-api-access-pnkpn\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:30.455825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.455662    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-config\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:30.455825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.455718    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-plugins\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:30.456150 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.456130    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-plugins\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:30.456420 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.456401    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-config\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:30.480972 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:30.480940    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnkpn\" (UniqueName: \"kubernetes.io/projected/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-kube-api-access-pnkpn\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:34.793389 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:34.793355    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:34.823617 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:34.823582    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:34.893977 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:34.893940    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:34.894131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:34.894072    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:34.908960 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:34.908935    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:35.012101 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:35.012070    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:35.042538 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:35.042511    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:35.351073 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:35.351035    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:35.653000 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:35.652976    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:43:35.655042 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:43:35.655011    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f7558f6_2eb0_4efb_935a_1bfcffd396a9.slice/crio-971d2f1f4f0b44d173c4fdbbae45b133fac617ad20046e66b9eb96eef8e2e0b9 WatchSource:0}: Error finding container 971d2f1f4f0b44d173c4fdbbae45b133fac617ad20046e66b9eb96eef8e2e0b9: Status 404 returned error can't find the container with id 971d2f1f4f0b44d173c4fdbbae45b133fac617ad20046e66b9eb96eef8e2e0b9
Oct 30 03:43:36.554157 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:36.554119    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"4f7558f6-2eb0-4efb-935a-1bfcffd396a9","Type":"ContainerStarted","Data":"631d09378b97233366d7e5f6b357c2e626fd535f9343f7fe87fa8dfc8ec4dbf6"}
Oct 30 03:43:36.554586 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:36.554166    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"4f7558f6-2eb0-4efb-935a-1bfcffd396a9","Type":"ContainerStarted","Data":"971d2f1f4f0b44d173c4fdbbae45b133fac617ad20046e66b9eb96eef8e2e0b9"}
Oct 30 03:43:36.554586 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:36.554250    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:43:36.595623 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:36.595548    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=6.595526636 podStartE2EDuration="6.595526636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:43:36.595222499 +0000 UTC m=+3656.437468964" watchObservedRunningTime="2026-10-30 03:43:36.595526636 +0000 UTC m=+3656.437773136"
Oct 30 03:43:40.849537 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:40.849501    5981 scope.go:122] "RemoveContainer" containerID="4e4cc11aa512eaec8af999b7c90ae64d30a7baf45b76c85335dd27db072209ab"
Oct 30 03:43:40.859494 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:40.859462    5981 scope.go:122] "RemoveContainer" containerID="3d3bf18a2f205d9d00f099dc2f6ce3c28572b7f35ee87e890cff6a5551df3943"
Oct 30 03:43:40.869524 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:40.869499    5981 scope.go:122] "RemoveContainer" containerID="4569d7606b16baef12866754a21293923c70d17435a215b7cbd351ecfdef9508"
Oct 30 03:43:40.879576 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:40.879550    5981 scope.go:122] "RemoveContainer" containerID="80cc3f64ba828a56aa376c29ee8d1ac09bd01ec2d7a17a17f37c01a0dd397bb3"
Oct 30 03:43:40.889187 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:40.889164    5981 scope.go:122] "RemoveContainer" containerID="8d3fe338036f8e97a9c8f68c540e8402021542313b7c7464b12fda7ad2d35ffa"
Oct 30 03:43:44.369355 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:43:44.369316    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:43:47.561406 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:43:47.561366    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:44:14.368172 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:44:14.368133    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:44:40.931903 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:40.931863    5981 scope.go:122] "RemoveContainer" containerID="bfdc518de7c069b2f48c307a4aea95dbab9fa9dc98477275bcac5fa8dbadafb1"
Oct 30 03:44:40.940668 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:40.940648    5981 scope.go:122] "RemoveContainer" containerID="3616b382bc388932616628e00b572c095fdfa065817870ba71c63930e0476dc2"
Oct 30 03:44:40.948878 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:40.948856    5981 scope.go:122] "RemoveContainer" containerID="792a9c3c09c24b6dbb406a5ab0d96310f11a96a8694ad6a0a966abdfa9b84ea2"
Oct 30 03:44:40.956827 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:40.956809    5981 scope.go:122] "RemoveContainer" containerID="e93f9763a78f26f12c4a7d7d20b111401661611bb4f4b14cfe12bf721cca32b0"
Oct 30 03:44:40.966912 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:40.966889    5981 scope.go:122] "RemoveContainer" containerID="1936b4c98072a6b9355365a70d7d0fef7319eebf02c139bff1cb4d52da4bd4d2"
Oct 30 03:44:40.975027 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:40.975003    5981 scope.go:122] "RemoveContainer" containerID="62037db9c7d64ef6cc481965de29ce2a749e6839ce43b1875716ec166bf54dac"
Oct 30 03:44:42.672104 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:42.672071    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:44:42.672733 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:42.672304    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="4f7558f6-2eb0-4efb-935a-1bfcffd396a9" containerName="perses" containerID="cri-o://631d09378b97233366d7e5f6b357c2e626fd535f9343f7fe87fa8dfc8ec4dbf6" gracePeriod=30
Oct 30 03:44:42.902539 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:42.902504    5981 generic.go:356] "Generic (PLEG): container finished" podID="4f7558f6-2eb0-4efb-935a-1bfcffd396a9" containerID="631d09378b97233366d7e5f6b357c2e626fd535f9343f7fe87fa8dfc8ec4dbf6" exitCode=0
Oct 30 03:44:42.902714 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:42.902599    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"4f7558f6-2eb0-4efb-935a-1bfcffd396a9","Type":"ContainerDied","Data":"631d09378b97233366d7e5f6b357c2e626fd535f9343f7fe87fa8dfc8ec4dbf6"}
Oct 30 03:44:42.924961 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:42.924907    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:44:43.059365 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.059336    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") "
Oct 30 03:44:43.059540 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.059419    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-plugins\") pod \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") "
Oct 30 03:44:43.059540 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.059493    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-config\" (UniqueName: \"kubernetes.io/configmap/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-config\") pod \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") "
Oct 30 03:44:43.059660 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.059538    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-kube-api-access-pnkpn\" (UniqueName: \"kubernetes.io/projected/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-kube-api-access-pnkpn\") pod \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\" (UID: \"4f7558f6-2eb0-4efb-935a-1bfcffd396a9\") "
Oct 30 03:44:43.059948 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.059914    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-config" pod "4f7558f6-2eb0-4efb-935a-1bfcffd396a9" (UID: "4f7558f6-2eb0-4efb-935a-1bfcffd396a9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:44:43.063716 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.063677    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "4f7558f6-2eb0-4efb-935a-1bfcffd396a9" (UID: "4f7558f6-2eb0-4efb-935a-1bfcffd396a9"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 03:44:43.067418 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.067391    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-kube-api-access-pnkpn" pod "4f7558f6-2eb0-4efb-935a-1bfcffd396a9" (UID: "4f7558f6-2eb0-4efb-935a-1bfcffd396a9"). InnerVolumeSpecName "kube-api-access-pnkpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:44:43.161429 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.161389    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnkpn\" (UniqueName: \"kubernetes.io/projected/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-kube-api-access-pnkpn\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:44:43.161621 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.161464    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 03:44:43.161621 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.161482    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:44:43.180326 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.180239    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 03:44:43.230802 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.230764    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-plugins" pod "4f7558f6-2eb0-4efb-935a-1bfcffd396a9" (UID: "4f7558f6-2eb0-4efb-935a-1bfcffd396a9"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:44:43.262179 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.262149    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 03:44:43.262179 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.262177    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/4f7558f6-2eb0-4efb-935a-1bfcffd396a9-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:44:43.517848 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.517763    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 03:44:43.525191 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.525159    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 03:44:43.562904 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.562875    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 03:44:43.563092 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.563071    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/seaweedfs" podUID="c6b58e59-f6a3-4b4d-916f-77428fd790cf" containerName="seaweedfs" containerID="cri-o://bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c" gracePeriod=30
Oct 30 03:44:43.908636 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.908598    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"4f7558f6-2eb0-4efb-935a-1bfcffd396a9","Type":"ContainerDied","Data":"971d2f1f4f0b44d173c4fdbbae45b133fac617ad20046e66b9eb96eef8e2e0b9"}
Oct 30 03:44:43.909115 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.908653    5981 scope.go:122] "RemoveContainer" containerID="631d09378b97233366d7e5f6b357c2e626fd535f9343f7fe87fa8dfc8ec4dbf6"
Oct 30 03:44:43.909115 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.908607    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:44:43.962847 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.962818    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:44:43.965657 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:43.965637    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:44:44.274297 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:44.274204    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="03317fc1-ec32-4ffd-ab04-6aec7dfca42b" path="/var/lib/kubelet/pods/03317fc1-ec32-4ffd-ab04-6aec7dfca42b/volumes"
Oct 30 03:44:44.274657 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:44:44.274642    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f7558f6-2eb0-4efb-935a-1bfcffd396a9" path="/var/lib/kubelet/pods/4f7558f6-2eb0-4efb-935a-1bfcffd396a9/volumes"
Oct 30 03:44:44.369557 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:44:44.369522    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:45:08.910355 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:08.910321    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:45:08.975300 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:08.975259    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6b58e59-f6a3-4b4d-916f-77428fd790cf-kube-api-access-pz9d7\" (UniqueName: \"kubernetes.io/projected/c6b58e59-f6a3-4b4d-916f-77428fd790cf-kube-api-access-pz9d7\") pod \"c6b58e59-f6a3-4b4d-916f-77428fd790cf\" (UID: \"c6b58e59-f6a3-4b4d-916f-77428fd790cf\") "
Oct 30 03:45:08.975429 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:08.975351    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6b58e59-f6a3-4b4d-916f-77428fd790cf-data\" (UniqueName: \"kubernetes.io/empty-dir/c6b58e59-f6a3-4b4d-916f-77428fd790cf-data\") pod \"c6b58e59-f6a3-4b4d-916f-77428fd790cf\" (UID: \"c6b58e59-f6a3-4b4d-916f-77428fd790cf\") "
Oct 30 03:45:08.976458 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:08.976434    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6b58e59-f6a3-4b4d-916f-77428fd790cf-data" pod "c6b58e59-f6a3-4b4d-916f-77428fd790cf" (UID: "c6b58e59-f6a3-4b4d-916f-77428fd790cf"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:45:08.977960 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:08.977934    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b58e59-f6a3-4b4d-916f-77428fd790cf-kube-api-access-pz9d7" pod "c6b58e59-f6a3-4b4d-916f-77428fd790cf" (UID: "c6b58e59-f6a3-4b4d-916f-77428fd790cf"). InnerVolumeSpecName "kube-api-access-pz9d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:45:09.032942 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:09.032841    5981 generic.go:356] "Generic (PLEG): container finished" podID="c6b58e59-f6a3-4b4d-916f-77428fd790cf" containerID="bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c" exitCode=0
Oct 30 03:45:09.032942 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:09.032889    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:45:09.032942 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:09.032919    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"c6b58e59-f6a3-4b4d-916f-77428fd790cf","Type":"ContainerDied","Data":"bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c"}
Oct 30 03:45:09.033350 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:09.033013    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"c6b58e59-f6a3-4b4d-916f-77428fd790cf","Type":"ContainerDied","Data":"f9222de06b2aa5447d60f1358f99b4922fbb85d3c1ac67f6438aa62809a7f256"}
Oct 30 03:45:09.033350 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:09.033043    5981 scope.go:122] "RemoveContainer" containerID="bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c"
Oct 30 03:45:09.042553 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:09.042529    5981 scope.go:122] "RemoveContainer" containerID="bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c"
Oct 30 03:45:09.042949 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:45:09.042920    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c\": container with ID starting with bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c not found: ID does not exist" containerID="bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c"
Oct 30 03:45:09.043035 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:09.042957    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c"} err="failed to get container status \"bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c\": rpc error: code = NotFound desc = could not find container \"bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c\": container with ID starting with bb3713366fe96a6bd7374cb9f5fdab14e20293c7e7851b9148617cab1c73c68c not found: ID does not exist"
Oct 30 03:45:09.076205 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:09.076170    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz9d7\" (UniqueName: \"kubernetes.io/projected/c6b58e59-f6a3-4b4d-916f-77428fd790cf-kube-api-access-pz9d7\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:45:09.076205 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:09.076196    5981 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6b58e59-f6a3-4b4d-916f-77428fd790cf-data\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:45:09.084085 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:09.084057    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 03:45:09.087820 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:09.087799    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 03:45:10.275216 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:10.275184    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c6b58e59-f6a3-4b4d-916f-77428fd790cf" path="/var/lib/kubelet/pods/c6b58e59-f6a3-4b4d-916f-77428fd790cf/volumes"
Oct 30 03:45:12.137851 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.137813    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 03:45:12.138250 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.138152    5981 cpu_manager.go:414] "containerMap: removing container" podUID="4f7558f6-2eb0-4efb-935a-1bfcffd396a9" containerName="perses"
Oct 30 03:45:12.138250 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.138165    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f7558f6-2eb0-4efb-935a-1bfcffd396a9" containerName="perses"
Oct 30 03:45:12.138250 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.138206    5981 cpu_manager.go:414] "containerMap: removing container" podUID="c6b58e59-f6a3-4b4d-916f-77428fd790cf" containerName="seaweedfs"
Oct 30 03:45:12.138250 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.138212    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6b58e59-f6a3-4b4d-916f-77428fd790cf" containerName="seaweedfs"
Oct 30 03:45:12.138415 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.138270    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6b58e59-f6a3-4b4d-916f-77428fd790cf" containerName="seaweedfs"
Oct 30 03:45:12.138415 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.138297    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f7558f6-2eb0-4efb-935a-1bfcffd396a9" containerName="perses"
Oct 30 03:45:12.142649 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.142632    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 03:45:12.156166 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.156136    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 03:45:12.168174 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.168143    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 03:45:12.168309 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.168174    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 03:45:12.168309 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.168211    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 03:45:12.197338 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.197301    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/673047ad-906d-47ec-ba46-c044fd2cd322-data\") pod \"fake-gcs-server\" (UID: \"673047ad-906d-47ec-ba46-c044fd2cd322\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 03:45:12.197479 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.197373    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg8cc\" (UniqueName: \"kubernetes.io/projected/673047ad-906d-47ec-ba46-c044fd2cd322-kube-api-access-kg8cc\") pod \"fake-gcs-server\" (UID: \"673047ad-906d-47ec-ba46-c044fd2cd322\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 03:45:12.297846 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.297809    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg8cc\" (UniqueName: \"kubernetes.io/projected/673047ad-906d-47ec-ba46-c044fd2cd322-kube-api-access-kg8cc\") pod \"fake-gcs-server\" (UID: \"673047ad-906d-47ec-ba46-c044fd2cd322\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 03:45:12.298042 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.297932    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/673047ad-906d-47ec-ba46-c044fd2cd322-data\") pod \"fake-gcs-server\" (UID: \"673047ad-906d-47ec-ba46-c044fd2cd322\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 03:45:12.298330 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.298274    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/673047ad-906d-47ec-ba46-c044fd2cd322-data\") pod \"fake-gcs-server\" (UID: \"673047ad-906d-47ec-ba46-c044fd2cd322\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 03:45:12.318984 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.318959    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg8cc\" (UniqueName: \"kubernetes.io/projected/673047ad-906d-47ec-ba46-c044fd2cd322-kube-api-access-kg8cc\") pod \"fake-gcs-server\" (UID: \"673047ad-906d-47ec-ba46-c044fd2cd322\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 03:45:12.454791 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.454752    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 03:45:12.750588 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:12.750503    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 03:45:12.752804 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:45:12.752760    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod673047ad_906d_47ec_ba46_c044fd2cd322.slice/crio-ac20a8aa4f493b5fe488f62750413a4923d8f7193f6576f08104f3f60ae16018 WatchSource:0}: Error finding container ac20a8aa4f493b5fe488f62750413a4923d8f7193f6576f08104f3f60ae16018: Status 404 returned error can't find the container with id ac20a8aa4f493b5fe488f62750413a4923d8f7193f6576f08104f3f60ae16018
Oct 30 03:45:13.054651 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:13.054568    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-server" event={"ID":"673047ad-906d-47ec-ba46-c044fd2cd322","Type":"ContainerStarted","Data":"ac20a8aa4f493b5fe488f62750413a4923d8f7193f6576f08104f3f60ae16018"}
Oct 30 03:45:14.060626 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:14.060530    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-server" event={"ID":"673047ad-906d-47ec-ba46-c044fd2cd322","Type":"ContainerStarted","Data":"3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0"}
Oct 30 03:45:14.060626 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:14.060590    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 03:45:14.099776 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:14.099724    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/fake-gcs-server" podStartSLOduration=1.129164723 podStartE2EDuration="2.099711591s" totalImagesPullingTime="970.546868ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:45:14.099693182 +0000 UTC m=+3753.941939628" watchObservedRunningTime="2026-10-30 03:45:14.099711591 +0000 UTC m=+3753.941958029"
Oct 30 03:45:14.369637 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:45:14.369553    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:45:20.068341 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:20.068304    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 03:45:20.316993 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:20.316959    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 03:45:20.320187 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:20.320140    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 03:45:20.339532 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:20.339505    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 03:45:20.366012 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:20.365986    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m9qc\" (UniqueName: \"kubernetes.io/projected/c43171f8-fd89-4d84-8e73-0f1cc50a712d-kube-api-access-4m9qc\") pod \"fake-gcs-bucket-creator\" (UID: \"c43171f8-fd89-4d84-8e73-0f1cc50a712d\") " pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 03:45:20.467301 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:20.467247    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m9qc\" (UniqueName: \"kubernetes.io/projected/c43171f8-fd89-4d84-8e73-0f1cc50a712d-kube-api-access-4m9qc\") pod \"fake-gcs-bucket-creator\" (UID: \"c43171f8-fd89-4d84-8e73-0f1cc50a712d\") " pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 03:45:20.488876 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:20.488852    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m9qc\" (UniqueName: \"kubernetes.io/projected/c43171f8-fd89-4d84-8e73-0f1cc50a712d-kube-api-access-4m9qc\") pod \"fake-gcs-bucket-creator\" (UID: \"c43171f8-fd89-4d84-8e73-0f1cc50a712d\") " pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 03:45:20.637976 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:20.637900    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 03:45:20.929445 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:20.929418    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 03:45:20.932152 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:45:20.932128    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc43171f8_fd89_4d84_8e73_0f1cc50a712d.slice/crio-2e5aff17a4df715a35d454a37685ee42f2375da995e34e68dbef263b662211ed WatchSource:0}: Error finding container 2e5aff17a4df715a35d454a37685ee42f2375da995e34e68dbef263b662211ed: Status 404 returned error can't find the container with id 2e5aff17a4df715a35d454a37685ee42f2375da995e34e68dbef263b662211ed
Oct 30 03:45:21.094771 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:21.094739    5981 generic.go:356] "Generic (PLEG): container finished" podID="c43171f8-fd89-4d84-8e73-0f1cc50a712d" containerID="2ab2184b020f3bbe8e0039fd9d4b693f9a048050f85bce6ca35ceaea3193bd74" exitCode=0
Oct 30 03:45:21.095136 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:21.094775    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-bucket-creator" event={"ID":"c43171f8-fd89-4d84-8e73-0f1cc50a712d","Type":"ContainerDied","Data":"2ab2184b020f3bbe8e0039fd9d4b693f9a048050f85bce6ca35ceaea3193bd74"}
Oct 30 03:45:21.095136 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:21.094803    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-bucket-creator" event={"ID":"c43171f8-fd89-4d84-8e73-0f1cc50a712d","Type":"ContainerStarted","Data":"2e5aff17a4df715a35d454a37685ee42f2375da995e34e68dbef263b662211ed"}
Oct 30 03:45:22.223839 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:22.223815    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 03:45:22.282264 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:22.282237    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c43171f8-fd89-4d84-8e73-0f1cc50a712d-kube-api-access-4m9qc\" (UniqueName: \"kubernetes.io/projected/c43171f8-fd89-4d84-8e73-0f1cc50a712d-kube-api-access-4m9qc\") pod \"c43171f8-fd89-4d84-8e73-0f1cc50a712d\" (UID: \"c43171f8-fd89-4d84-8e73-0f1cc50a712d\") "
Oct 30 03:45:22.284538 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:22.284509    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c43171f8-fd89-4d84-8e73-0f1cc50a712d-kube-api-access-4m9qc" pod "c43171f8-fd89-4d84-8e73-0f1cc50a712d" (UID: "c43171f8-fd89-4d84-8e73-0f1cc50a712d"). InnerVolumeSpecName "kube-api-access-4m9qc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:45:22.383340 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:22.383218    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m9qc\" (UniqueName: \"kubernetes.io/projected/c43171f8-fd89-4d84-8e73-0f1cc50a712d-kube-api-access-4m9qc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:45:23.105744 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:23.105713    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 03:45:23.105744 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:23.105733    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-bucket-creator" event={"ID":"c43171f8-fd89-4d84-8e73-0f1cc50a712d","Type":"ContainerDied","Data":"2e5aff17a4df715a35d454a37685ee42f2375da995e34e68dbef263b662211ed"}
Oct 30 03:45:23.105941 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:23.105767    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e5aff17a4df715a35d454a37685ee42f2375da995e34e68dbef263b662211ed"
Oct 30 03:45:24.329921 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.329891    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:45:24.330312 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.330212    5981 cpu_manager.go:414] "containerMap: removing container" podUID="c43171f8-fd89-4d84-8e73-0f1cc50a712d" containerName="create-bucket"
Oct 30 03:45:24.330312 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.330222    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c43171f8-fd89-4d84-8e73-0f1cc50a712d" containerName="create-bucket"
Oct 30 03:45:24.330390 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.330320    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="c43171f8-fd89-4d84-8e73-0f1cc50a712d" containerName="create-bucket"
Oct 30 03:45:24.333245 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.333221    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:24.350701 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.350676    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:45:24.381361 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.381323    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 03:45:24.500801 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.500762    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/b9219a51-e95e-4501-8bae-bc1c41649697-plugins\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:24.501012 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.500812    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vchn5\" (UniqueName: \"kubernetes.io/projected/b9219a51-e95e-4501-8bae-bc1c41649697-kube-api-access-vchn5\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:24.501012 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.500976    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9219a51-e95e-4501-8bae-bc1c41649697-config\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:24.602182 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.602100    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/b9219a51-e95e-4501-8bae-bc1c41649697-plugins\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:24.602182 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.602142    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vchn5\" (UniqueName: \"kubernetes.io/projected/b9219a51-e95e-4501-8bae-bc1c41649697-kube-api-access-vchn5\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:24.602438 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.602196    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9219a51-e95e-4501-8bae-bc1c41649697-config\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:24.602582 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.602561    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/b9219a51-e95e-4501-8bae-bc1c41649697-plugins\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:24.602792 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.602772    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9219a51-e95e-4501-8bae-bc1c41649697-config\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:24.625852 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:24.625831    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vchn5\" (UniqueName: \"kubernetes.io/projected/b9219a51-e95e-4501-8bae-bc1c41649697-kube-api-access-vchn5\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:26.918887 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:26.918852    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:26.949329 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:26.949296    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:27.019788 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:27.019752    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:27.019958 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:27.019858    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:27.037015 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:27.036984    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:27.154242 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:27.154216    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:27.212220 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:27.212145    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:27.344788 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:27.344749    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:27.640213 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:27.640149    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:45:27.642990 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:45:27.642949    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9219a51_e95e_4501_8bae_bc1c41649697.slice/crio-55cf3dd486535e4c76edb929b8776c74cf5b6f5ecceeb04b905b135d696a607f WatchSource:0}: Error finding container 55cf3dd486535e4c76edb929b8776c74cf5b6f5ecceeb04b905b135d696a607f: Status 404 returned error can't find the container with id 55cf3dd486535e4c76edb929b8776c74cf5b6f5ecceeb04b905b135d696a607f
Oct 30 03:45:28.130457 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:28.130419    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"b9219a51-e95e-4501-8bae-bc1c41649697","Type":"ContainerStarted","Data":"1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661"}
Oct 30 03:45:28.130850 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:28.130465    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"b9219a51-e95e-4501-8bae-bc1c41649697","Type":"ContainerStarted","Data":"55cf3dd486535e4c76edb929b8776c74cf5b6f5ecceeb04b905b135d696a607f"}
Oct 30 03:45:28.130850 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:28.130498    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:28.191252 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:28.191197    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=4.191179997 podStartE2EDuration="4.191179997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:45:28.189736578 +0000 UTC m=+3768.031983026" watchObservedRunningTime="2026-10-30 03:45:28.191179997 +0000 UTC m=+3768.033426442"
Oct 30 03:45:39.138043 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:39.138002    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:45:41.013047 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:41.013006    5981 scope.go:122] "RemoveContainer" containerID="d4d7423af1c6a5d7eed4ced574ba13829aa605a1a1e28c19766ba86d60d5f7af"
Oct 30 03:45:41.022174 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:41.022147    5981 scope.go:122] "RemoveContainer" containerID="c4b7976a91b4b85f3809c7cf5ca6c848723324dde0b69384e7e0e6477b4801f4"
Oct 30 03:45:41.030253 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:41.030226    5981 scope.go:122] "RemoveContainer" containerID="d2db6e5694448a853cc24d38a40f93a730c07dcbdf34d082f786605c55b68b51"
Oct 30 03:45:41.037977 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:41.037951    5981 scope.go:122] "RemoveContainer" containerID="c3f5484dd2662485a03378f1f94fbec0d68f061f5bc1a8c9f819a0b0053c6037"
Oct 30 03:45:41.045447 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:41.045424    5981 scope.go:122] "RemoveContainer" containerID="876d7c444a3917979f7ea812c0f85ee2420826b7d89d8f277834004bd6837a98"
Oct 30 03:45:41.053034 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:41.053014    5981 scope.go:122] "RemoveContainer" containerID="b910a5a6e724b2af08da9e3b06f873754e132dbdcdf13d57dc682702924c190d"
Oct 30 03:45:41.060370 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:41.060350    5981 scope.go:122] "RemoveContainer" containerID="1f5e48bd2c9f8f75ee1d3dc1da8e13b14f8d4d5f951b98466c4257bc6a0dd658"
Oct 30 03:45:41.067896 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:41.067875    5981 scope.go:122] "RemoveContainer" containerID="d8707a2bb83e0362ccd264d9adc8b459d1faeb218b058a9dcc2f89e8f3e520e1"
Oct 30 03:45:41.075136 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:41.075113    5981 scope.go:122] "RemoveContainer" containerID="8bd968851c2581124372c64848e7b490ca35b0ef090767acbbb9da52678f5e66"
Oct 30 03:45:41.082216 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:41.082198    5981 scope.go:122] "RemoveContainer" containerID="b33f831057409d1485b5eb2f165acf708448c11f313d92e1bd63ec57724ded4a"
Oct 30 03:45:41.089538 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:45:41.089521    5981 scope.go:122] "RemoveContainer" containerID="36bb27b79304efd52723b46c27fb950cb831905f902d7b4634d1e933c09c72ff"
Oct 30 03:45:44.368887 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:45:44.368851    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:46:14.369585 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:46:14.369548    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:46:41.150885 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:46:41.150852    5981 scope.go:122] "RemoveContainer" containerID="8317b574b5cef167e87c552fdc35485b18550b0735ae717743fb676bf5eaacef"
Oct 30 03:46:41.159212 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:46:41.159195    5981 scope.go:122] "RemoveContainer" containerID="04ea73e5f65890b7cb583675300d2cfa6d5cc50a0cd0ac7293a851beab2c310b"
Oct 30 03:46:41.167143 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:46:41.167126    5981 scope.go:122] "RemoveContainer" containerID="bb889af1a3df1b47a3e100146e50f1b66faa91a5edba0475270eb9b58c60da98"
Oct 30 03:46:41.174662 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:46:41.174640    5981 scope.go:122] "RemoveContainer" containerID="87e60e3a1ea853b4bcae9a76a5fc600554d0c7074fa1f7cb3cabf4695a9d24aa"
Oct 30 03:46:41.181822 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:46:41.181804    5981 scope.go:122] "RemoveContainer" containerID="a30bd5e88cd7fe574fb056ef731dc89bf8ef2c766a10ed9eed3cb82cd3eeeb1e"
Oct 30 03:46:41.188732 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:46:41.188717    5981 scope.go:122] "RemoveContainer" containerID="2eaa0b285db403e646a2c9b5982fc7f3947a7c6c2b6f6de193b5d810b7413416"
Oct 30 03:46:41.195654 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:46:41.195634    5981 scope.go:122] "RemoveContainer" containerID="68f604e99b4400658bf55f6f42406d93b4c56712f53f6629a323cdf2ed0a569f"
Oct 30 03:46:44.370370 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:46:44.370327    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:47:10.687486 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:10.687450    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:47:10.688026 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:10.687670    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="b9219a51-e95e-4501-8bae-bc1c41649697" containerName="perses" containerID="cri-o://1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661" gracePeriod=30
Oct 30 03:47:10.938810 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:10.938753    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:11.034331 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.034264    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b9219a51-e95e-4501-8bae-bc1c41649697-kube-api-access-vchn5\" (UniqueName: \"kubernetes.io/projected/b9219a51-e95e-4501-8bae-bc1c41649697-kube-api-access-vchn5\") pod \"b9219a51-e95e-4501-8bae-bc1c41649697\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") "
Oct 30 03:47:11.034523 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.034439    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"b9219a51-e95e-4501-8bae-bc1c41649697\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") "
Oct 30 03:47:11.034523 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.034504    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9219a51-e95e-4501-8bae-bc1c41649697-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b9219a51-e95e-4501-8bae-bc1c41649697-plugins\") pod \"b9219a51-e95e-4501-8bae-bc1c41649697\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") "
Oct 30 03:47:11.034652 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.034543    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9219a51-e95e-4501-8bae-bc1c41649697-config\" (UniqueName: \"kubernetes.io/configmap/b9219a51-e95e-4501-8bae-bc1c41649697-config\") pod \"b9219a51-e95e-4501-8bae-bc1c41649697\" (UID: \"b9219a51-e95e-4501-8bae-bc1c41649697\") "
Oct 30 03:47:11.035208 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.035182    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9219a51-e95e-4501-8bae-bc1c41649697-config" pod "b9219a51-e95e-4501-8bae-bc1c41649697" (UID: "b9219a51-e95e-4501-8bae-bc1c41649697"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:47:11.039180 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.039150    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9219a51-e95e-4501-8bae-bc1c41649697-kube-api-access-vchn5" pod "b9219a51-e95e-4501-8bae-bc1c41649697" (UID: "b9219a51-e95e-4501-8bae-bc1c41649697"). InnerVolumeSpecName "kube-api-access-vchn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:47:11.040198 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.040149    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "b9219a51-e95e-4501-8bae-bc1c41649697" (UID: "b9219a51-e95e-4501-8bae-bc1c41649697"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 03:47:11.135733 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.135701    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9219a51-e95e-4501-8bae-bc1c41649697-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:47:11.136107 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.135743    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vchn5\" (UniqueName: \"kubernetes.io/projected/b9219a51-e95e-4501-8bae-bc1c41649697-kube-api-access-vchn5\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:47:11.136107 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.135770    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 03:47:11.151580 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.151554    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 03:47:11.234496 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.234410    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9219a51-e95e-4501-8bae-bc1c41649697-plugins" pod "b9219a51-e95e-4501-8bae-bc1c41649697" (UID: "b9219a51-e95e-4501-8bae-bc1c41649697"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:47:11.236670 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.236646    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 03:47:11.236752 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.236675    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/b9219a51-e95e-4501-8bae-bc1c41649697-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:47:11.574746 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.574648    5981 generic.go:356] "Generic (PLEG): container finished" podID="b9219a51-e95e-4501-8bae-bc1c41649697" containerID="1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661" exitCode=0
Oct 30 03:47:11.574746 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.574721    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:11.574746 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.574737    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"b9219a51-e95e-4501-8bae-bc1c41649697","Type":"ContainerDied","Data":"1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661"}
Oct 30 03:47:11.574989 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.574783    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"b9219a51-e95e-4501-8bae-bc1c41649697","Type":"ContainerDied","Data":"55cf3dd486535e4c76edb929b8776c74cf5b6f5ecceeb04b905b135d696a607f"}
Oct 30 03:47:11.574989 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.574807    5981 scope.go:122] "RemoveContainer" containerID="1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661"
Oct 30 03:47:11.585839 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.585819    5981 scope.go:122] "RemoveContainer" containerID="1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661"
Oct 30 03:47:11.586399 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:47:11.586368    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661\": container with ID starting with 1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661 not found: ID does not exist" containerID="1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661"
Oct 30 03:47:11.586529 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.586411    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661"} err="failed to get container status \"1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661\": rpc error: code = NotFound desc = could not find container \"1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661\": container with ID starting with 1e16bf05abfd38aeda2faff5d9b9995c53346c900416c13b73208ec2b94bd661 not found: ID does not exist"
Oct 30 03:47:11.628882 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.628844    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:47:11.641736 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.641701    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:47:11.749012 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.748978    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 03:47:11.752897 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.752869    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 03:47:11.788812 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.788775    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 03:47:11.788991 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:11.788969    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/fake-gcs-server" podUID="673047ad-906d-47ec-ba46-c044fd2cd322" containerName="fake-gcs-server" containerID="cri-o://3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0" gracePeriod=30
Oct 30 03:47:12.036845 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.036813    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 03:47:12.145571 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.145533    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/673047ad-906d-47ec-ba46-c044fd2cd322-kube-api-access-kg8cc\" (UniqueName: \"kubernetes.io/projected/673047ad-906d-47ec-ba46-c044fd2cd322-kube-api-access-kg8cc\") pod \"673047ad-906d-47ec-ba46-c044fd2cd322\" (UID: \"673047ad-906d-47ec-ba46-c044fd2cd322\") "
Oct 30 03:47:12.145769 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.145580    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/673047ad-906d-47ec-ba46-c044fd2cd322-data\" (UniqueName: \"kubernetes.io/empty-dir/673047ad-906d-47ec-ba46-c044fd2cd322-data\") pod \"673047ad-906d-47ec-ba46-c044fd2cd322\" (UID: \"673047ad-906d-47ec-ba46-c044fd2cd322\") "
Oct 30 03:47:12.145931 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.145911    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/673047ad-906d-47ec-ba46-c044fd2cd322-data" pod "673047ad-906d-47ec-ba46-c044fd2cd322" (UID: "673047ad-906d-47ec-ba46-c044fd2cd322"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:47:12.147865 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.147841    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/673047ad-906d-47ec-ba46-c044fd2cd322-kube-api-access-kg8cc" pod "673047ad-906d-47ec-ba46-c044fd2cd322" (UID: "673047ad-906d-47ec-ba46-c044fd2cd322"). InnerVolumeSpecName "kube-api-access-kg8cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:47:12.246436 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.246381    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg8cc\" (UniqueName: \"kubernetes.io/projected/673047ad-906d-47ec-ba46-c044fd2cd322-kube-api-access-kg8cc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:47:12.246436 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.246427    5981 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/673047ad-906d-47ec-ba46-c044fd2cd322-data\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:47:12.274876 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.274840    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b9219a51-e95e-4501-8bae-bc1c41649697" path="/var/lib/kubelet/pods/b9219a51-e95e-4501-8bae-bc1c41649697/volumes"
Oct 30 03:47:12.275200 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.275186    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c43171f8-fd89-4d84-8e73-0f1cc50a712d" path="/var/lib/kubelet/pods/c43171f8-fd89-4d84-8e73-0f1cc50a712d/volumes"
Oct 30 03:47:12.580749 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.580656    5981 generic.go:356] "Generic (PLEG): container finished" podID="673047ad-906d-47ec-ba46-c044fd2cd322" containerID="3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0" exitCode=0
Oct 30 03:47:12.580749 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.580701    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 03:47:12.580749 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.580708    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-server" event={"ID":"673047ad-906d-47ec-ba46-c044fd2cd322","Type":"ContainerDied","Data":"3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0"}
Oct 30 03:47:12.580749 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.580740    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-server" event={"ID":"673047ad-906d-47ec-ba46-c044fd2cd322","Type":"ContainerDied","Data":"ac20a8aa4f493b5fe488f62750413a4923d8f7193f6576f08104f3f60ae16018"}
Oct 30 03:47:12.581062 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.580758    5981 scope.go:122] "RemoveContainer" containerID="3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0"
Oct 30 03:47:12.589094 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.589071    5981 scope.go:122] "RemoveContainer" containerID="3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0"
Oct 30 03:47:12.589398 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:47:12.589375    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0\": container with ID starting with 3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0 not found: ID does not exist" containerID="3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0"
Oct 30 03:47:12.589533 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.589408    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0"} err="failed to get container status \"3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0\": rpc error: code = NotFound desc = could not find container \"3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0\": container with ID starting with 3f48e35a6d7764dbb5350fe3848ad4b6f950fe83ee41729ea0d5426119d827a0 not found: ID does not exist"
Oct 30 03:47:12.631836 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.631800    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 03:47:12.635466 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:12.635435    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 03:47:14.274437 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:14.274403    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="673047ad-906d-47ec-ba46-c044fd2cd322" path="/var/lib/kubelet/pods/673047ad-906d-47ec-ba46-c044fd2cd322/volumes"
Oct 30 03:47:14.369902 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:47:14.369863    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:47:15.664202 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.664138    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:47:15.664725 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.664704    5981 cpu_manager.go:414] "containerMap: removing container" podUID="b9219a51-e95e-4501-8bae-bc1c41649697" containerName="perses"
Oct 30 03:47:15.664813 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.664728    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9219a51-e95e-4501-8bae-bc1c41649697" containerName="perses"
Oct 30 03:47:15.664813 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.664792    5981 cpu_manager.go:414] "containerMap: removing container" podUID="673047ad-906d-47ec-ba46-c044fd2cd322" containerName="fake-gcs-server"
Oct 30 03:47:15.664813 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.664801    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="673047ad-906d-47ec-ba46-c044fd2cd322" containerName="fake-gcs-server"
Oct 30 03:47:15.664970 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.664871    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="673047ad-906d-47ec-ba46-c044fd2cd322" containerName="fake-gcs-server"
Oct 30 03:47:15.664970 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.664886    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9219a51-e95e-4501-8bae-bc1c41649697" containerName="perses"
Oct 30 03:47:15.668009 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.667990    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:15.685199 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.685176    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:47:15.742775 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.742744    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 03:47:15.742775 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.742767    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 03:47:15.743017 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.742898    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 03:47:15.743017 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.742991    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 03:47:15.778068 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.778038    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj54x\" (UniqueName: \"kubernetes.io/projected/656f1f39-c5da-482f-b522-12a127050f92-kube-api-access-lj54x\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:15.778246 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.778074    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/656f1f39-c5da-482f-b522-12a127050f92-plugins\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:15.778246 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.778204    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/656f1f39-c5da-482f-b522-12a127050f92-config\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:15.878785 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.878751    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/656f1f39-c5da-482f-b522-12a127050f92-config\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:15.878963 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.878816    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj54x\" (UniqueName: \"kubernetes.io/projected/656f1f39-c5da-482f-b522-12a127050f92-kube-api-access-lj54x\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:15.878963 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.878846    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/656f1f39-c5da-482f-b522-12a127050f92-plugins\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:15.879326 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.879263    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/656f1f39-c5da-482f-b522-12a127050f92-plugins\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:15.879550 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.879534    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/656f1f39-c5da-482f-b522-12a127050f92-config\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:15.899083 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:15.899052    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj54x\" (UniqueName: \"kubernetes.io/projected/656f1f39-c5da-482f-b522-12a127050f92-kube-api-access-lj54x\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:19.711865 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:19.711826    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:19.754902 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:19.754866    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:19.812227 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:19.812197    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:19.812364 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:19.812348    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:19.827218 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:19.827187    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:19.933395 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:19.933319    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:19.964130 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:19.964064    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:20.180450 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:20.180414    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:20.471792 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:20.471761    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:47:20.474715 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:47:20.474685    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod656f1f39_c5da_482f_b522_12a127050f92.slice/crio-9139ed3a657770f992a35d594509ac14c0b2188c51e4fe981ba0d64b89dd86ec WatchSource:0}: Error finding container 9139ed3a657770f992a35d594509ac14c0b2188c51e4fe981ba0d64b89dd86ec: Status 404 returned error can't find the container with id 9139ed3a657770f992a35d594509ac14c0b2188c51e4fe981ba0d64b89dd86ec
Oct 30 03:47:20.617912 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:20.617867    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"656f1f39-c5da-482f-b522-12a127050f92","Type":"ContainerStarted","Data":"0215ed4efc93790da69ec542ebbbf9d389add687a2eba696b6268717fb1537e9"}
Oct 30 03:47:20.618077 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:20.617922    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"656f1f39-c5da-482f-b522-12a127050f92","Type":"ContainerStarted","Data":"9139ed3a657770f992a35d594509ac14c0b2188c51e4fe981ba0d64b89dd86ec"}
Oct 30 03:47:20.618077 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:20.617971    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:20.661417 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:20.661371    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=5.661357806 podStartE2EDuration="5.661357806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:47:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:47:20.661305984 +0000 UTC m=+3880.503552429" watchObservedRunningTime="2026-10-30 03:47:20.661357806 +0000 UTC m=+3880.503604251"
Oct 30 03:47:31.624404 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:31.624368    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:33.471170 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.471132    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:47:33.471884 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.471424    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="656f1f39-c5da-482f-b522-12a127050f92" containerName="perses" containerID="cri-o://0215ed4efc93790da69ec542ebbbf9d389add687a2eba696b6268717fb1537e9" gracePeriod=30
Oct 30 03:47:33.676373 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.676323    5981 generic.go:356] "Generic (PLEG): container finished" podID="656f1f39-c5da-482f-b522-12a127050f92" containerID="0215ed4efc93790da69ec542ebbbf9d389add687a2eba696b6268717fb1537e9" exitCode=0
Oct 30 03:47:33.676592 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.676394    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"656f1f39-c5da-482f-b522-12a127050f92","Type":"ContainerDied","Data":"0215ed4efc93790da69ec542ebbbf9d389add687a2eba696b6268717fb1537e9"}
Oct 30 03:47:33.720628 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.720598    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:33.735474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.735383    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/656f1f39-c5da-482f-b522-12a127050f92-plugins\" (UniqueName: \"kubernetes.io/empty-dir/656f1f39-c5da-482f-b522-12a127050f92-plugins\") pod \"656f1f39-c5da-482f-b522-12a127050f92\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") "
Oct 30 03:47:33.735474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.735441    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/656f1f39-c5da-482f-b522-12a127050f92-config\" (UniqueName: \"kubernetes.io/configmap/656f1f39-c5da-482f-b522-12a127050f92-config\") pod \"656f1f39-c5da-482f-b522-12a127050f92\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") "
Oct 30 03:47:33.735701 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.735554    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"656f1f39-c5da-482f-b522-12a127050f92\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") "
Oct 30 03:47:33.735701 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.735612    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/656f1f39-c5da-482f-b522-12a127050f92-kube-api-access-lj54x\" (UniqueName: \"kubernetes.io/projected/656f1f39-c5da-482f-b522-12a127050f92-kube-api-access-lj54x\") pod \"656f1f39-c5da-482f-b522-12a127050f92\" (UID: \"656f1f39-c5da-482f-b522-12a127050f92\") "
Oct 30 03:47:33.735935 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.735845    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/656f1f39-c5da-482f-b522-12a127050f92-config" pod "656f1f39-c5da-482f-b522-12a127050f92" (UID: "656f1f39-c5da-482f-b522-12a127050f92"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:47:33.738087 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.738055    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/656f1f39-c5da-482f-b522-12a127050f92-kube-api-access-lj54x" pod "656f1f39-c5da-482f-b522-12a127050f92" (UID: "656f1f39-c5da-482f-b522-12a127050f92"). InnerVolumeSpecName "kube-api-access-lj54x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:47:33.738483 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.738464    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "656f1f39-c5da-482f-b522-12a127050f92" (UID: "656f1f39-c5da-482f-b522-12a127050f92"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 03:47:33.836543 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.836502    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj54x\" (UniqueName: \"kubernetes.io/projected/656f1f39-c5da-482f-b522-12a127050f92-kube-api-access-lj54x\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:47:33.836543 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.836538    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/656f1f39-c5da-482f-b522-12a127050f92-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:47:33.836763 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.836568    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 03:47:33.853707 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.853679    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 03:47:33.914161 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.914125    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/656f1f39-c5da-482f-b522-12a127050f92-plugins" pod "656f1f39-c5da-482f-b522-12a127050f92" (UID: "656f1f39-c5da-482f-b522-12a127050f92"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:47:33.937441 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.937406    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/656f1f39-c5da-482f-b522-12a127050f92-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:47:33.937441 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:33.937436    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 03:47:34.681912 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:34.681873    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"656f1f39-c5da-482f-b522-12a127050f92","Type":"ContainerDied","Data":"9139ed3a657770f992a35d594509ac14c0b2188c51e4fe981ba0d64b89dd86ec"}
Oct 30 03:47:34.682342 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:34.681926    5981 scope.go:122] "RemoveContainer" containerID="0215ed4efc93790da69ec542ebbbf9d389add687a2eba696b6268717fb1537e9"
Oct 30 03:47:34.682342 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:34.681890    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:34.734314 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:34.734273    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:47:34.747131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:34.747103    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:47:36.275043 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:36.275010    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="656f1f39-c5da-482f-b522-12a127050f92" path="/var/lib/kubelet/pods/656f1f39-c5da-482f-b522-12a127050f92/volumes"
Oct 30 03:47:38.274566 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.274524    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"]
Oct 30 03:47:38.274974 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.274956    5981 cpu_manager.go:414] "containerMap: removing container" podUID="656f1f39-c5da-482f-b522-12a127050f92" containerName="perses"
Oct 30 03:47:38.275026 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.274972    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="656f1f39-c5da-482f-b522-12a127050f92" containerName="perses"
Oct 30 03:47:38.275206 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.275186    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="656f1f39-c5da-482f-b522-12a127050f92" containerName="perses"
Oct 30 03:47:38.298586 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.298560    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"]
Oct 30 03:47:38.298759 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.298662    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"
Oct 30 03:47:38.327044 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.327022    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 03:47:38.327044 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.327031    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 03:47:38.327193 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.327052    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 03:47:38.376364 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.376326    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpr2w\" (UniqueName: \"kubernetes.io/projected/896b8c1f-e858-43ec-8ba1-50b4548487fc-kube-api-access-hpr2w\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc\" (UID: \"896b8c1f-e858-43ec-8ba1-50b4548487fc\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"
Oct 30 03:47:38.477008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.476977    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpr2w\" (UniqueName: \"kubernetes.io/projected/896b8c1f-e858-43ec-8ba1-50b4548487fc-kube-api-access-hpr2w\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc\" (UID: \"896b8c1f-e858-43ec-8ba1-50b4548487fc\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"
Oct 30 03:47:38.498382 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.498345    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpr2w\" (UniqueName: \"kubernetes.io/projected/896b8c1f-e858-43ec-8ba1-50b4548487fc-kube-api-access-hpr2w\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc\" (UID: \"896b8c1f-e858-43ec-8ba1-50b4548487fc\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"
Oct 30 03:47:38.609772 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.609685    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"
Oct 30 03:47:38.899131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:38.899072    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"]
Oct 30 03:47:38.901563 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:47:38.901532    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod896b8c1f_e858_43ec_8ba1_50b4548487fc.slice/crio-96f3a550cc7a82695e3419b3f9a8d203aa12dda929c49a1e8c82b7c1f1e0d4da WatchSource:0}: Error finding container 96f3a550cc7a82695e3419b3f9a8d203aa12dda929c49a1e8c82b7c1f1e0d4da: Status 404 returned error can't find the container with id 96f3a550cc7a82695e3419b3f9a8d203aa12dda929c49a1e8c82b7c1f1e0d4da
Oct 30 03:47:39.338617 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.338544    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:47:39.341985 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.341962    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:39.360183 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.360155    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:47:39.418143 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.418114    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 03:47:39.422102 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.422074    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"]
Oct 30 03:47:39.425500 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.425482    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:39.448721 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.448674    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 03:47:39.448721 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.448693    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-wdfsb\""
Oct 30 03:47:39.449530 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.449506    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"]
Oct 30 03:47:39.485520 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.485490    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fde63aac-5835-473c-8ba8-932c4f656501-config\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:39.485638 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.485529    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r79ll\" (UniqueName: \"kubernetes.io/projected/fde63aac-5835-473c-8ba8-932c4f656501-kube-api-access-r79ll\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:39.485638 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.485550    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/fde63aac-5835-473c-8ba8-932c4f656501-plugins\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:39.518201 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.518176    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 03:47:39.586198 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.586167    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fde63aac-5835-473c-8ba8-932c4f656501-config\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:39.586369 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.586202    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hxmr\" (UniqueName: \"kubernetes.io/projected/0606d98d-5408-4eca-bdf9-c66d718e0312-kube-api-access-6hxmr\") pod \"data-science-collector-targetallocator-7bb9765f4b-5d7p9\" (UID: \"0606d98d-5408-4eca-bdf9-c66d718e0312\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:39.586369 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.586235    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r79ll\" (UniqueName: \"kubernetes.io/projected/fde63aac-5835-473c-8ba8-932c4f656501-kube-api-access-r79ll\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:39.586369 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.586331    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/fde63aac-5835-473c-8ba8-932c4f656501-plugins\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:39.586515 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.586412    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0606d98d-5408-4eca-bdf9-c66d718e0312-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7bb9765f4b-5d7p9\" (UID: \"0606d98d-5408-4eca-bdf9-c66d718e0312\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:39.586515 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.586442    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0606d98d-5408-4eca-bdf9-c66d718e0312-ta-internal\") pod \"data-science-collector-targetallocator-7bb9765f4b-5d7p9\" (UID: \"0606d98d-5408-4eca-bdf9-c66d718e0312\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:39.586720 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.586701    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/fde63aac-5835-473c-8ba8-932c4f656501-plugins\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:39.586872 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.586854    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fde63aac-5835-473c-8ba8-932c4f656501-config\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:39.606848 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.606793    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r79ll\" (UniqueName: \"kubernetes.io/projected/fde63aac-5835-473c-8ba8-932c4f656501-kube-api-access-r79ll\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:39.687506 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.687470    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hxmr\" (UniqueName: \"kubernetes.io/projected/0606d98d-5408-4eca-bdf9-c66d718e0312-kube-api-access-6hxmr\") pod \"data-science-collector-targetallocator-7bb9765f4b-5d7p9\" (UID: \"0606d98d-5408-4eca-bdf9-c66d718e0312\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:39.687682 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.687542    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0606d98d-5408-4eca-bdf9-c66d718e0312-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7bb9765f4b-5d7p9\" (UID: \"0606d98d-5408-4eca-bdf9-c66d718e0312\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:39.687682 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.687565    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0606d98d-5408-4eca-bdf9-c66d718e0312-ta-internal\") pod \"data-science-collector-targetallocator-7bb9765f4b-5d7p9\" (UID: \"0606d98d-5408-4eca-bdf9-c66d718e0312\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:39.688262 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.688234    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0606d98d-5408-4eca-bdf9-c66d718e0312-ta-internal\") pod \"data-science-collector-targetallocator-7bb9765f4b-5d7p9\" (UID: \"0606d98d-5408-4eca-bdf9-c66d718e0312\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:39.690201 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.690177    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0606d98d-5408-4eca-bdf9-c66d718e0312-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7bb9765f4b-5d7p9\" (UID: \"0606d98d-5408-4eca-bdf9-c66d718e0312\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:39.707898 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.707873    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hxmr\" (UniqueName: \"kubernetes.io/projected/0606d98d-5408-4eca-bdf9-c66d718e0312-kube-api-access-6hxmr\") pod \"data-science-collector-targetallocator-7bb9765f4b-5d7p9\" (UID: \"0606d98d-5408-4eca-bdf9-c66d718e0312\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:39.712875 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.712845    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc" event={"ID":"896b8c1f-e858-43ec-8ba1-50b4548487fc","Type":"ContainerStarted","Data":"e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1"}
Oct 30 03:47:39.713011 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.712890    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc" event={"ID":"896b8c1f-e858-43ec-8ba1-50b4548487fc","Type":"ContainerStarted","Data":"96f3a550cc7a82695e3419b3f9a8d203aa12dda929c49a1e8c82b7c1f1e0d4da"}
Oct 30 03:47:39.737247 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.737215    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:39.753043 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:39.752998    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc" podStartSLOduration=1.752986646 podStartE2EDuration="1.752986646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:47:39.751034096 +0000 UTC m=+3899.593280541" watchObservedRunningTime="2026-10-30 03:47:39.752986646 +0000 UTC m=+3899.595233087"
Oct 30 03:47:40.030196 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.030173    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"]
Oct 30 03:47:40.032245 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:47:40.032214    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0606d98d_5408_4eca_bdf9_c66d718e0312.slice/crio-a27f11c9ed758b81a16e312ded330ffa4daa7d7f9be3657dbae5ae322088753d WatchSource:0}: Error finding container a27f11c9ed758b81a16e312ded330ffa4daa7d7f9be3657dbae5ae322088753d: Status 404 returned error can't find the container with id a27f11c9ed758b81a16e312ded330ffa4daa7d7f9be3657dbae5ae322088753d
Oct 30 03:47:40.034453 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.034423    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:47:40.034520 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.034478    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:47:40.494320 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.494275    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:40.537575 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.537547    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:40.595098 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.595066    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:40.595232 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.595212    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:40.610375 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.610348    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:40.714532 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.714499    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:40.722557 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.722528    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9" event={"ID":"0606d98d-5408-4eca-bdf9-c66d718e0312","Type":"ContainerStarted","Data":"6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac"}
Oct 30 03:47:40.722705 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.722566    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9" event={"ID":"0606d98d-5408-4eca-bdf9-c66d718e0312","Type":"ContainerStarted","Data":"a27f11c9ed758b81a16e312ded330ffa4daa7d7f9be3657dbae5ae322088753d"}
Oct 30 03:47:40.747963 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.747902    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:40.769659 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.769610    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9" podStartSLOduration=1.769599181 podStartE2EDuration="1.769599181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:47:40.768449586 +0000 UTC m=+3900.610696032" watchObservedRunningTime="2026-10-30 03:47:40.769599181 +0000 UTC m=+3900.611845623"
Oct 30 03:47:40.854154 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:40.854115    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:41.147711 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:41.147684    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:47:41.150916 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:47:41.150877    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfde63aac_5835_473c_8ba8_932c4f656501.slice/crio-e201dbda2d6b5897df127e8671f62712dd488e1526c0e3edcbb918c53a4540ee WatchSource:0}: Error finding container e201dbda2d6b5897df127e8671f62712dd488e1526c0e3edcbb918c53a4540ee: Status 404 returned error can't find the container with id e201dbda2d6b5897df127e8671f62712dd488e1526c0e3edcbb918c53a4540ee
Oct 30 03:47:41.728748 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:41.728693    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"fde63aac-5835-473c-8ba8-932c4f656501","Type":"ContainerStarted","Data":"e472f5a9940fa64758a482c6b49bcbb8da98c63ff7538f6972c03ce53dc6fb77"}
Oct 30 03:47:41.729209 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:41.728756    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"fde63aac-5835-473c-8ba8-932c4f656501","Type":"ContainerStarted","Data":"e201dbda2d6b5897df127e8671f62712dd488e1526c0e3edcbb918c53a4540ee"}
Oct 30 03:47:41.729209 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:41.728936    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:41.730885 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:41.730862    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:47:41.770548 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:41.770483    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=2.7704637439999997 podStartE2EDuration="2.770463744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:47:41.769739597 +0000 UTC m=+3901.611986068" watchObservedRunningTime="2026-10-30 03:47:41.770463744 +0000 UTC m=+3901.612710190"
Oct 30 03:47:42.005375 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.004488    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"]
Oct 30 03:47:42.017204 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.017176    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"
Oct 30 03:47:42.024877 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.024845    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"]
Oct 30 03:47:42.107981 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.107940    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5mqq\" (UniqueName: \"kubernetes.io/projected/e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e-kube-api-access-q5mqq\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c\" (UID: \"e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"
Oct 30 03:47:42.209278 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.209239    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5mqq\" (UniqueName: \"kubernetes.io/projected/e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e-kube-api-access-q5mqq\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c\" (UID: \"e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"
Oct 30 03:47:42.230530 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.230495    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5mqq\" (UniqueName: \"kubernetes.io/projected/e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e-kube-api-access-q5mqq\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c\" (UID: \"e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"
Oct 30 03:47:42.330735 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.330652    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"
Oct 30 03:47:42.639226 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.639197    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"]
Oct 30 03:47:42.641926 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:47:42.641897    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0a2f729_17bf_48c2_80a8_b94e6ddc9a8e.slice/crio-a56d5bf05636db66c807e2b1853e5ec5e9485fde38ee4ad3ff3e085a26a00a19 WatchSource:0}: Error finding container a56d5bf05636db66c807e2b1853e5ec5e9485fde38ee4ad3ff3e085a26a00a19: Status 404 returned error can't find the container with id a56d5bf05636db66c807e2b1853e5ec5e9485fde38ee4ad3ff3e085a26a00a19
Oct 30 03:47:42.735456 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.735419    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c" event={"ID":"e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e","Type":"ContainerStarted","Data":"45ed65940ca6b70200a00c66555201be593069cc8f2d5eca1e2db42f161ad164"}
Oct 30 03:47:42.735893 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.735471    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c" event={"ID":"e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e","Type":"ContainerStarted","Data":"a56d5bf05636db66c807e2b1853e5ec5e9485fde38ee4ad3ff3e085a26a00a19"}
Oct 30 03:47:42.735893 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.735801    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:47:42.798034 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.797960    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c" podStartSLOduration=1.797572857 podStartE2EDuration="1.797572857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:47:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:47:42.772779509 +0000 UTC m=+3902.615025981" watchObservedRunningTime="2026-10-30 03:47:42.797572857 +0000 UTC m=+3902.639819302"
Oct 30 03:47:42.799272 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.799244    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"]
Oct 30 03:47:42.799479 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:42.799454    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc" podUID="896b8c1f-e858-43ec-8ba1-50b4548487fc" containerName="thanos-querier" containerID="cri-o://e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1" gracePeriod=30
Oct 30 03:47:43.061263 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.061229    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"
Oct 30 03:47:43.118273 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.118236    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/896b8c1f-e858-43ec-8ba1-50b4548487fc-kube-api-access-hpr2w\" (UniqueName: \"kubernetes.io/projected/896b8c1f-e858-43ec-8ba1-50b4548487fc-kube-api-access-hpr2w\") pod \"896b8c1f-e858-43ec-8ba1-50b4548487fc\" (UID: \"896b8c1f-e858-43ec-8ba1-50b4548487fc\") "
Oct 30 03:47:43.120440 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.120410    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/896b8c1f-e858-43ec-8ba1-50b4548487fc-kube-api-access-hpr2w" pod "896b8c1f-e858-43ec-8ba1-50b4548487fc" (UID: "896b8c1f-e858-43ec-8ba1-50b4548487fc"). InnerVolumeSpecName "kube-api-access-hpr2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:47:43.220985 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.220896    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpr2w\" (UniqueName: \"kubernetes.io/projected/896b8c1f-e858-43ec-8ba1-50b4548487fc-kube-api-access-hpr2w\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:47:43.740771 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.740736    5981 generic.go:356] "Generic (PLEG): container finished" podID="896b8c1f-e858-43ec-8ba1-50b4548487fc" containerID="e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1" exitCode=0
Oct 30 03:47:43.741181 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.740784    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"
Oct 30 03:47:43.741181 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.740826    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc" event={"ID":"896b8c1f-e858-43ec-8ba1-50b4548487fc","Type":"ContainerDied","Data":"e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1"}
Oct 30 03:47:43.741181 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.740869    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc" event={"ID":"896b8c1f-e858-43ec-8ba1-50b4548487fc","Type":"ContainerDied","Data":"96f3a550cc7a82695e3419b3f9a8d203aa12dda929c49a1e8c82b7c1f1e0d4da"}
Oct 30 03:47:43.741181 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.740890    5981 scope.go:122] "RemoveContainer" containerID="e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1"
Oct 30 03:47:43.749653 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.749638    5981 scope.go:122] "RemoveContainer" containerID="e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1"
Oct 30 03:47:43.749905 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:47:43.749889    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1\": container with ID starting with e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1 not found: ID does not exist" containerID="e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1"
Oct 30 03:47:43.749956 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.749914    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1"} err="failed to get container status \"e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1\": rpc error: code = NotFound desc = could not find container \"e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1\": container with ID starting with e452dfdf253f52158f94c066411f49596308b0ea1fd5cb44572794449a810de1 not found: ID does not exist"
Oct 30 03:47:43.792667 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.792639    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"]
Oct 30 03:47:43.805400 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:43.805370    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-7lqtc"]
Oct 30 03:47:44.274105 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:44.274075    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="896b8c1f-e858-43ec-8ba1-50b4548487fc" path="/var/lib/kubelet/pods/896b8c1f-e858-43ec-8ba1-50b4548487fc/volumes"
Oct 30 03:47:44.369410 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:47:44.369378    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:47:53.744945 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:47:53.744913    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:48:14.368815 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:14.368778    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:48:14.695999 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.695963    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"]
Oct 30 03:48:14.696402 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.696388    5981 cpu_manager.go:414] "containerMap: removing container" podUID="896b8c1f-e858-43ec-8ba1-50b4548487fc" containerName="thanos-querier"
Oct 30 03:48:14.696454 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.696404    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="896b8c1f-e858-43ec-8ba1-50b4548487fc" containerName="thanos-querier"
Oct 30 03:48:14.696494 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.696487    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="896b8c1f-e858-43ec-8ba1-50b4548487fc" containerName="thanos-querier"
Oct 30 03:48:14.712041 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.712017    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:14.719492 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.719133    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"]
Oct 30 03:48:14.770872 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.770837    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fckvx\" (UniqueName: \"kubernetes.io/projected/13c78ded-9983-4366-a733-e9aed20cf97c-kube-api-access-fckvx\") pod \"data-science-collector-targetallocator-6c95d66dcc-xlc7f\" (UID: \"13c78ded-9983-4366-a733-e9aed20cf97c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:14.771049 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.770881    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/13c78ded-9983-4366-a733-e9aed20cf97c-ta-internal\") pod \"data-science-collector-targetallocator-6c95d66dcc-xlc7f\" (UID: \"13c78ded-9983-4366-a733-e9aed20cf97c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:14.771049 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.770902    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/13c78ded-9983-4366-a733-e9aed20cf97c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c95d66dcc-xlc7f\" (UID: \"13c78ded-9983-4366-a733-e9aed20cf97c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:14.872371 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.872336    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/13c78ded-9983-4366-a733-e9aed20cf97c-ta-internal\") pod \"data-science-collector-targetallocator-6c95d66dcc-xlc7f\" (UID: \"13c78ded-9983-4366-a733-e9aed20cf97c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:14.872371 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.872374    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/13c78ded-9983-4366-a733-e9aed20cf97c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c95d66dcc-xlc7f\" (UID: \"13c78ded-9983-4366-a733-e9aed20cf97c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:14.872592 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.872459    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fckvx\" (UniqueName: \"kubernetes.io/projected/13c78ded-9983-4366-a733-e9aed20cf97c-kube-api-access-fckvx\") pod \"data-science-collector-targetallocator-6c95d66dcc-xlc7f\" (UID: \"13c78ded-9983-4366-a733-e9aed20cf97c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:14.873012 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.872990    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/13c78ded-9983-4366-a733-e9aed20cf97c-ta-internal\") pod \"data-science-collector-targetallocator-6c95d66dcc-xlc7f\" (UID: \"13c78ded-9983-4366-a733-e9aed20cf97c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:14.875143 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.875116    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/13c78ded-9983-4366-a733-e9aed20cf97c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c95d66dcc-xlc7f\" (UID: \"13c78ded-9983-4366-a733-e9aed20cf97c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:14.892492 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:14.892469    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fckvx\" (UniqueName: \"kubernetes.io/projected/13c78ded-9983-4366-a733-e9aed20cf97c-kube-api-access-fckvx\") pod \"data-science-collector-targetallocator-6c95d66dcc-xlc7f\" (UID: \"13c78ded-9983-4366-a733-e9aed20cf97c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:15.025514 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:15.025428    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:15.314711 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:15.314654    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"]
Oct 30 03:48:15.317489 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:48:15.317461    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13c78ded_9983_4366_a733_e9aed20cf97c.slice/crio-2a6c4215ce061788e149f19260abff7ffa70a72d61212d04ca3af031d5f50b98 WatchSource:0}: Error finding container 2a6c4215ce061788e149f19260abff7ffa70a72d61212d04ca3af031d5f50b98: Status 404 returned error can't find the container with id 2a6c4215ce061788e149f19260abff7ffa70a72d61212d04ca3af031d5f50b98
Oct 30 03:48:15.319698 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:15.319668    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:48:15.319789 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:15.319723    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:48:15.874006 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:15.873972    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f" event={"ID":"13c78ded-9983-4366-a733-e9aed20cf97c","Type":"ContainerStarted","Data":"14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca"}
Oct 30 03:48:15.874505 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:15.874014    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f" event={"ID":"13c78ded-9983-4366-a733-e9aed20cf97c","Type":"ContainerStarted","Data":"2a6c4215ce061788e149f19260abff7ffa70a72d61212d04ca3af031d5f50b98"}
Oct 30 03:48:15.874505 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:15.874150    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:15.875925 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:15.875891    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:15.914165 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:15.914115    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f" podStartSLOduration=1.9140969939999999 podStartE2EDuration="1.914096994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:48:15.91349965 +0000 UTC m=+3935.755746107" watchObservedRunningTime="2026-10-30 03:48:15.914096994 +0000 UTC m=+3935.756343440"
Oct 30 03:48:15.979316 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:15.979253    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"]
Oct 30 03:48:15.979500 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:15.979446    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9" podUID="0606d98d-5408-4eca-bdf9-c66d718e0312" containerName="ta-container" containerID="cri-o://6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac" gracePeriod=30
Oct 30 03:48:16.226399 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.226367    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:48:16.285311 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.285251    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0606d98d-5408-4eca-bdf9-c66d718e0312-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0606d98d-5408-4eca-bdf9-c66d718e0312-data-science-collector-ta-server-cert\") pod \"0606d98d-5408-4eca-bdf9-c66d718e0312\" (UID: \"0606d98d-5408-4eca-bdf9-c66d718e0312\") "
Oct 30 03:48:16.285472 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.285340    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0606d98d-5408-4eca-bdf9-c66d718e0312-ta-internal\" (UniqueName: \"kubernetes.io/configmap/0606d98d-5408-4eca-bdf9-c66d718e0312-ta-internal\") pod \"0606d98d-5408-4eca-bdf9-c66d718e0312\" (UID: \"0606d98d-5408-4eca-bdf9-c66d718e0312\") "
Oct 30 03:48:16.285472 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.285363    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0606d98d-5408-4eca-bdf9-c66d718e0312-kube-api-access-6hxmr\" (UniqueName: \"kubernetes.io/projected/0606d98d-5408-4eca-bdf9-c66d718e0312-kube-api-access-6hxmr\") pod \"0606d98d-5408-4eca-bdf9-c66d718e0312\" (UID: \"0606d98d-5408-4eca-bdf9-c66d718e0312\") "
Oct 30 03:48:16.285708 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.285680    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0606d98d-5408-4eca-bdf9-c66d718e0312-ta-internal" pod "0606d98d-5408-4eca-bdf9-c66d718e0312" (UID: "0606d98d-5408-4eca-bdf9-c66d718e0312"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:48:16.287627 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.287596    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0606d98d-5408-4eca-bdf9-c66d718e0312-data-science-collector-ta-server-cert" pod "0606d98d-5408-4eca-bdf9-c66d718e0312" (UID: "0606d98d-5408-4eca-bdf9-c66d718e0312"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:48:16.287899 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.287880    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0606d98d-5408-4eca-bdf9-c66d718e0312-kube-api-access-6hxmr" pod "0606d98d-5408-4eca-bdf9-c66d718e0312" (UID: "0606d98d-5408-4eca-bdf9-c66d718e0312"). InnerVolumeSpecName "kube-api-access-6hxmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:48:16.386765 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.386734    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hxmr\" (UniqueName: \"kubernetes.io/projected/0606d98d-5408-4eca-bdf9-c66d718e0312-kube-api-access-6hxmr\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:16.386765 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.386762    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0606d98d-5408-4eca-bdf9-c66d718e0312-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:16.386921 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.386773    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0606d98d-5408-4eca-bdf9-c66d718e0312-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:16.880610 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.880573    5981 generic.go:356] "Generic (PLEG): container finished" podID="0606d98d-5408-4eca-bdf9-c66d718e0312" containerID="6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac" exitCode=0
Oct 30 03:48:16.881015 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.880639    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"
Oct 30 03:48:16.881015 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.880670    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9" event={"ID":"0606d98d-5408-4eca-bdf9-c66d718e0312","Type":"ContainerDied","Data":"6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac"}
Oct 30 03:48:16.881015 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.880749    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9" event={"ID":"0606d98d-5408-4eca-bdf9-c66d718e0312","Type":"ContainerDied","Data":"a27f11c9ed758b81a16e312ded330ffa4daa7d7f9be3657dbae5ae322088753d"}
Oct 30 03:48:16.881015 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.880778    5981 scope.go:122] "RemoveContainer" containerID="6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac"
Oct 30 03:48:16.889615 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.889591    5981 scope.go:122] "RemoveContainer" containerID="6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac"
Oct 30 03:48:16.890563 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:16.889971    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac\": container with ID starting with 6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac not found: ID does not exist" containerID="6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac"
Oct 30 03:48:16.890563 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.890010    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac"} err="failed to get container status \"6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac\": rpc error: code = NotFound desc = could not find container \"6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac\": container with ID starting with 6dc0f7f36c7c7dcc2907c4205f88d2117d1812c7cf950ceeed62b53a3ab899ac not found: ID does not exist"
Oct 30 03:48:16.934112 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.934080    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"]
Oct 30 03:48:16.946844 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:16.946818    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7bb9765f4b-5d7p9"]
Oct 30 03:48:17.128721 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:17.128685    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d"]
Oct 30 03:48:17.129018 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:17.129007    5981 cpu_manager.go:414] "containerMap: removing container" podUID="0606d98d-5408-4eca-bdf9-c66d718e0312" containerName="ta-container"
Oct 30 03:48:17.129087 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:17.129020    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0606d98d-5408-4eca-bdf9-c66d718e0312" containerName="ta-container"
Oct 30 03:48:17.129125 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:17.129097    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="0606d98d-5408-4eca-bdf9-c66d718e0312" containerName="ta-container"
Oct 30 03:48:17.133310 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:17.133256    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d"
Oct 30 03:48:17.144128 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:17.144108    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d"
Oct 30 03:48:17.149713 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:17.149690    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d"]
Oct 30 03:48:17.436063 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:17.435913    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d"]
Oct 30 03:48:17.438334 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:48:17.438298    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8fee537_2eb9_40b7_8c11_e071a5b27fbe.slice/crio-b74c9ec597a01de515b7b3be75b59bac6849d3f6d1e44863a23d170230e82496 WatchSource:0}: Error finding container b74c9ec597a01de515b7b3be75b59bac6849d3f6d1e44863a23d170230e82496: Status 404 returned error can't find the container with id b74c9ec597a01de515b7b3be75b59bac6849d3f6d1e44863a23d170230e82496
Oct 30 03:48:17.886894 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:17.886859    5981 generic.go:356] "Generic (PLEG): container finished" podID="f8fee537-2eb9-40b7-8c11-e071a5b27fbe" containerID="f873ed0459b580af3a183d4a3144830ecdcb8db8e11150168dfa4f29c8456dd2" exitCode=0
Oct 30 03:48:17.887334 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:17.886905    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d" event={"ID":"f8fee537-2eb9-40b7-8c11-e071a5b27fbe","Type":"ContainerDied","Data":"f873ed0459b580af3a183d4a3144830ecdcb8db8e11150168dfa4f29c8456dd2"}
Oct 30 03:48:17.887334 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:17.886959    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d" event={"ID":"f8fee537-2eb9-40b7-8c11-e071a5b27fbe","Type":"ContainerStarted","Data":"b74c9ec597a01de515b7b3be75b59bac6849d3f6d1e44863a23d170230e82496"}
Oct 30 03:48:18.274507 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:18.274477    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0606d98d-5408-4eca-bdf9-c66d718e0312" path="/var/lib/kubelet/pods/0606d98d-5408-4eca-bdf9-c66d718e0312/volumes"
Oct 30 03:48:19.018149 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.018119    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d"
Oct 30 03:48:19.173734 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.173703    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d"]
Oct 30 03:48:19.179099 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.179070    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d"]
Oct 30 03:48:19.242339 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.242312    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e3320af0b987cf"]
Oct 30 03:48:19.242632 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.242621    5981 cpu_manager.go:414] "containerMap: removing container" podUID="f8fee537-2eb9-40b7-8c11-e071a5b27fbe" containerName="curl"
Oct 30 03:48:19.242672 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.242635    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8fee537-2eb9-40b7-8c11-e071a5b27fbe" containerName="curl"
Oct 30 03:48:19.242721 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.242712    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8fee537-2eb9-40b7-8c11-e071a5b27fbe" containerName="curl"
Oct 30 03:48:19.245493 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.245477    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-perses-18e3320af0b987cf"
Oct 30 03:48:19.256141 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.256123    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-perses-18e3320af0b987cf"
Oct 30 03:48:19.261223 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.261200    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e3320af0b987cf"]
Oct 30 03:48:19.545267 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.545242    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e3320af0b987cf"]
Oct 30 03:48:19.547442 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:48:19.547413    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30acc841_5109_44ef_925a_a079e52d6744.slice/crio-e5cbd20f2e260b5a944a2923354f062f66a03876f9ecfc55ed4ed8570977dfbb WatchSource:0}: Error finding container e5cbd20f2e260b5a944a2923354f062f66a03876f9ecfc55ed4ed8570977dfbb: Status 404 returned error can't find the container with id e5cbd20f2e260b5a944a2923354f062f66a03876f9ecfc55ed4ed8570977dfbb
Oct 30 03:48:19.898196 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.898164    5981 generic.go:356] "Generic (PLEG): container finished" podID="30acc841-5109-44ef-925a-a079e52d6744" containerID="837662b52dd56aa5582451d428145a93e74010392b0e590744829173240ff0fc" exitCode=0
Oct 30 03:48:19.898395 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.898248    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-perses-18e3320af0b987cf" event={"ID":"30acc841-5109-44ef-925a-a079e52d6744","Type":"ContainerDied","Data":"837662b52dd56aa5582451d428145a93e74010392b0e590744829173240ff0fc"}
Oct 30 03:48:19.898395 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.898315    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-perses-18e3320af0b987cf" event={"ID":"30acc841-5109-44ef-925a-a079e52d6744","Type":"ContainerStarted","Data":"e5cbd20f2e260b5a944a2923354f062f66a03876f9ecfc55ed4ed8570977dfbb"}
Oct 30 03:48:19.899688 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.899670    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b74c9ec597a01de515b7b3be75b59bac6849d3f6d1e44863a23d170230e82496"
Oct 30 03:48:19.899798 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:19.899695    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d"
Oct 30 03:48:19.950394 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:19.950363    5981 status_manager.go:1045] "Failed to get status for pod" err="pods \"thanos-ingress-prometheus-18e3320a7285995d\" is forbidden: User \"system:node:ip-10-0-128-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"redhat-ods-monitoring\": no relationship found between node 'ip-10-0-128-202.ec2.internal' and this object" podUID="f8fee537-2eb9-40b7-8c11-e071a5b27fbe" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d"
Oct 30 03:48:20.274197 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:20.274119    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f8fee537-2eb9-40b7-8c11-e071a5b27fbe" path="/var/lib/kubelet/pods/f8fee537-2eb9-40b7-8c11-e071a5b27fbe/volumes"
Oct 30 03:48:20.300296 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:20.300259    5981 status_manager.go:1045] "Failed to get status for pod" err="pods \"thanos-ingress-prometheus-18e3320a7285995d\" is forbidden: User \"system:node:ip-10-0-128-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"redhat-ods-monitoring\": no relationship found between node 'ip-10-0-128-202.ec2.internal' and this object" podUID="f8fee537-2eb9-40b7-8c11-e071a5b27fbe" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e3320a7285995d"
Oct 30 03:48:21.045367 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.045344    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-perses-18e3320af0b987cf"
Oct 30 03:48:21.286787 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.286703    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e3320af0b987cf"]
Oct 30 03:48:21.293875 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.289073    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e3320af0b987cf"]
Oct 30 03:48:21.355978 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.355953    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e3320b6e835dc6"]
Oct 30 03:48:21.356330 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.356317    5981 cpu_manager.go:414] "containerMap: removing container" podUID="30acc841-5109-44ef-925a-a079e52d6744" containerName="curl"
Oct 30 03:48:21.356381 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.356331    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30acc841-5109-44ef-925a-a079e52d6744" containerName="curl"
Oct 30 03:48:21.356415 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.356396    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="30acc841-5109-44ef-925a-a079e52d6744" containerName="curl"
Oct 30 03:48:21.359195 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.359180    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e3320b6e835dc6"
Oct 30 03:48:21.369922 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.369904    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e3320b6e835dc6"
Oct 30 03:48:21.374585 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.374563    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e3320b6e835dc6"]
Oct 30 03:48:21.665706 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.665626    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e3320b6e835dc6"]
Oct 30 03:48:21.667813 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:48:21.667783    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22afedf9_8aef_4f31_8ac2_9e54eaa0cfe0.slice/crio-42af252d0e7a1377f0d066cb2770d42859cfbe05e2630abf9ddc62a7ca83cd7f WatchSource:0}: Error finding container 42af252d0e7a1377f0d066cb2770d42859cfbe05e2630abf9ddc62a7ca83cd7f: Status 404 returned error can't find the container with id 42af252d0e7a1377f0d066cb2770d42859cfbe05e2630abf9ddc62a7ca83cd7f
Oct 30 03:48:21.909774 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.909740    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-perses-18e3320af0b987cf"
Oct 30 03:48:21.909951 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.909779    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5cbd20f2e260b5a944a2923354f062f66a03876f9ecfc55ed4ed8570977dfbb"
Oct 30 03:48:21.911437 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.911407    5981 generic.go:356] "Generic (PLEG): container finished" podID="22afedf9-8aef-4f31-8ac2-9e54eaa0cfe0" containerID="ce8b0d0708bbc155f8c14ca8af60ebef61ee92b43be2ba40b0e52ce597045808" exitCode=0
Oct 30 03:48:21.911539 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.911467    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e3320b6e835dc6" event={"ID":"22afedf9-8aef-4f31-8ac2-9e54eaa0cfe0","Type":"ContainerDied","Data":"ce8b0d0708bbc155f8c14ca8af60ebef61ee92b43be2ba40b0e52ce597045808"}
Oct 30 03:48:21.911539 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:21.911496    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e3320b6e835dc6" event={"ID":"22afedf9-8aef-4f31-8ac2-9e54eaa0cfe0","Type":"ContainerStarted","Data":"42af252d0e7a1377f0d066cb2770d42859cfbe05e2630abf9ddc62a7ca83cd7f"}
Oct 30 03:48:21.962395 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:21.962364    5981 status_manager.go:1045] "Failed to get status for pod" err="pods \"thanos-ingress-perses-18e3320af0b987cf\" is forbidden: User \"system:node:ip-10-0-128-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"redhat-ods-monitoring\": no relationship found between node 'ip-10-0-128-202.ec2.internal' and this object" podUID="30acc841-5109-44ef-925a-a079e52d6744" pod="redhat-ods-monitoring/thanos-ingress-perses-18e3320af0b987cf"
Oct 30 03:48:22.274308 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:22.274211    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="30acc841-5109-44ef-925a-a079e52d6744" path="/var/lib/kubelet/pods/30acc841-5109-44ef-925a-a079e52d6744/volumes"
Oct 30 03:48:23.039095 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.039068    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e3320b6e835dc6"
Oct 30 03:48:23.401850 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.401814    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e3320b6e835dc6"]
Oct 30 03:48:23.408423 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.408393    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e3320b6e835dc6"]
Oct 30 03:48:23.472071 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.472042    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e3320becd62a22"]
Oct 30 03:48:23.472424 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.472410    5981 cpu_manager.go:414] "containerMap: removing container" podUID="22afedf9-8aef-4f31-8ac2-9e54eaa0cfe0" containerName="curl"
Oct 30 03:48:23.472470 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.472428    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22afedf9-8aef-4f31-8ac2-9e54eaa0cfe0" containerName="curl"
Oct 30 03:48:23.472512 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.472501    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="22afedf9-8aef-4f31-8ac2-9e54eaa0cfe0" containerName="curl"
Oct 30 03:48:23.475317 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.475300    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e3320becd62a22"
Oct 30 03:48:23.486095 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.486076    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e3320becd62a22"
Oct 30 03:48:23.491861 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.491841    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e3320becd62a22"]
Oct 30 03:48:23.776565 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.776488    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e3320becd62a22"]
Oct 30 03:48:23.779404 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:48:23.779370    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4688a635_0425_4b42_8922_86a99e024292.slice/crio-0faf4f4ddf0b7ad8ff7eedd537cfd01dd5beec71dc8863afe9328e34a73af6ba WatchSource:0}: Error finding container 0faf4f4ddf0b7ad8ff7eedd537cfd01dd5beec71dc8863afe9328e34a73af6ba: Status 404 returned error can't find the container with id 0faf4f4ddf0b7ad8ff7eedd537cfd01dd5beec71dc8863afe9328e34a73af6ba
Oct 30 03:48:23.921845 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.921814    5981 generic.go:356] "Generic (PLEG): container finished" podID="4688a635-0425-4b42-8922-86a99e024292" containerID="698c42d9c4d51808dfa08f58cfef5f27fca9f82041c66ad4857e26adaf2ea766" exitCode=0
Oct 30 03:48:23.921996 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.921908    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e3320becd62a22" event={"ID":"4688a635-0425-4b42-8922-86a99e024292","Type":"ContainerDied","Data":"698c42d9c4d51808dfa08f58cfef5f27fca9f82041c66ad4857e26adaf2ea766"}
Oct 30 03:48:23.921996 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.921955    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e3320becd62a22" event={"ID":"4688a635-0425-4b42-8922-86a99e024292","Type":"ContainerStarted","Data":"0faf4f4ddf0b7ad8ff7eedd537cfd01dd5beec71dc8863afe9328e34a73af6ba"}
Oct 30 03:48:23.923227 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.923208    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e3320b6e835dc6"
Oct 30 03:48:23.923227 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:23.923236    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42af252d0e7a1377f0d066cb2770d42859cfbe05e2630abf9ddc62a7ca83cd7f"
Oct 30 03:48:23.974605 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:23.974576    5981 status_manager.go:1045] "Failed to get status for pod" err="pods \"thanos-ingress-korrel8r-18e3320b6e835dc6\" is forbidden: User \"system:node:ip-10-0-128-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"redhat-ods-monitoring\": no relationship found between node 'ip-10-0-128-202.ec2.internal' and this object" podUID="22afedf9-8aef-4f31-8ac2-9e54eaa0cfe0" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e3320b6e835dc6"
Oct 30 03:48:24.275569 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:24.275535    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="22afedf9-8aef-4f31-8ac2-9e54eaa0cfe0" path="/var/lib/kubelet/pods/22afedf9-8aef-4f31-8ac2-9e54eaa0cfe0/volumes"
Oct 30 03:48:25.047455 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.047433    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e3320becd62a22"
Oct 30 03:48:25.517894 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.517856    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e3320becd62a22"]
Oct 30 03:48:25.521536 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.521510    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e3320becd62a22"]
Oct 30 03:48:25.607392 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.607359    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d"]
Oct 30 03:48:25.607716 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.607704    5981 cpu_manager.go:414] "containerMap: removing container" podUID="4688a635-0425-4b42-8922-86a99e024292" containerName="curl"
Oct 30 03:48:25.607774 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.607717    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4688a635-0425-4b42-8922-86a99e024292" containerName="curl"
Oct 30 03:48:25.607805 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.607785    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="4688a635-0425-4b42-8922-86a99e024292" containerName="curl"
Oct 30 03:48:25.610548 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.610530    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d"
Oct 30 03:48:25.629754 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.629730    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"thanos-ingress-probe-18e3320c69df9ac9\"/\"default-dockercfg-b5k6c\""
Oct 30 03:48:25.630728 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.630711    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d"]
Oct 30 03:48:25.634200 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.634178    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d"
Oct 30 03:48:25.927511 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.927482    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d"]
Oct 30 03:48:25.928895 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:48:25.928866    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7663e9de_faf5_4a1f_a840_728d4ae862cf.slice/crio-9b9f9bace3ef578238777cb470d7da9c4db437a5fbefa1215acd8797a5a969b3 WatchSource:0}: Error finding container 9b9f9bace3ef578238777cb470d7da9c4db437a5fbefa1215acd8797a5a969b3: Status 404 returned error can't find the container with id 9b9f9bace3ef578238777cb470d7da9c4db437a5fbefa1215acd8797a5a969b3
Oct 30 03:48:25.941342 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.941315    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e3320becd62a22"
Oct 30 03:48:25.941342 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:25.941328    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0faf4f4ddf0b7ad8ff7eedd537cfd01dd5beec71dc8863afe9328e34a73af6ba"
Oct 30 03:48:25.964848 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:25.964819    5981 status_manager.go:1045] "Failed to get status for pod" err="pods \"thanos-ingress-authenticated-proxy-18e3320becd62a22\" is forbidden: User \"system:node:ip-10-0-128-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"redhat-ods-monitoring\": no relationship found between node 'ip-10-0-128-202.ec2.internal' and this object" podUID="4688a635-0425-4b42-8922-86a99e024292" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e3320becd62a22"
Oct 30 03:48:26.274808 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:26.274726    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4688a635-0425-4b42-8922-86a99e024292" path="/var/lib/kubelet/pods/4688a635-0425-4b42-8922-86a99e024292/volumes"
Oct 30 03:48:26.947669 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:26.947630    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d" event={"ID":"7663e9de-faf5-4a1f-a840-728d4ae862cf","Type":"ContainerStarted","Data":"4a2ea3abb310cfbcb72f0e8cc52966c2c5d01857d4efab14115b3a03019bcc72"}
Oct 30 03:48:26.948140 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:26.947680    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d" event={"ID":"7663e9de-faf5-4a1f-a840-728d4ae862cf","Type":"ContainerStarted","Data":"9b9f9bace3ef578238777cb470d7da9c4db437a5fbefa1215acd8797a5a969b3"}
Oct 30 03:48:26.986983 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:26.986930    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d" podStartSLOduration=1.9869173390000001 podStartE2EDuration="1.986917339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:48:26.985884916 +0000 UTC m=+3946.828131358" watchObservedRunningTime="2026-10-30 03:48:26.986917339 +0000 UTC m=+3946.829163761"
Oct 30 03:48:29.310950 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.310911    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"]
Oct 30 03:48:29.314371 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.314351    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:29.333317 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.333271    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"]
Oct 30 03:48:29.401862 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.401827    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx2qh\" (UniqueName: \"kubernetes.io/projected/8a9d631c-63a4-4405-8ed2-e39f87bf61af-kube-api-access-fx2qh\") pod \"data-science-collector-targetallocator-6d59b7d9cb-7h67n\" (UID: \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:29.402007 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.401873    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a9d631c-63a4-4405-8ed2-e39f87bf61af-ta-internal\") pod \"data-science-collector-targetallocator-6d59b7d9cb-7h67n\" (UID: \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:29.402007 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.401914    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a9d631c-63a4-4405-8ed2-e39f87bf61af-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6d59b7d9cb-7h67n\" (UID: \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:29.502413 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.502371    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2qh\" (UniqueName: \"kubernetes.io/projected/8a9d631c-63a4-4405-8ed2-e39f87bf61af-kube-api-access-fx2qh\") pod \"data-science-collector-targetallocator-6d59b7d9cb-7h67n\" (UID: \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:29.502617 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.502431    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a9d631c-63a4-4405-8ed2-e39f87bf61af-ta-internal\") pod \"data-science-collector-targetallocator-6d59b7d9cb-7h67n\" (UID: \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:29.502617 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.502465    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a9d631c-63a4-4405-8ed2-e39f87bf61af-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6d59b7d9cb-7h67n\" (UID: \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:29.503123 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.503093    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a9d631c-63a4-4405-8ed2-e39f87bf61af-ta-internal\") pod \"data-science-collector-targetallocator-6d59b7d9cb-7h67n\" (UID: \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:29.505154 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.505120    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a9d631c-63a4-4405-8ed2-e39f87bf61af-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6d59b7d9cb-7h67n\" (UID: \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:29.522856 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.522824    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx2qh\" (UniqueName: \"kubernetes.io/projected/8a9d631c-63a4-4405-8ed2-e39f87bf61af-kube-api-access-fx2qh\") pod \"data-science-collector-targetallocator-6d59b7d9cb-7h67n\" (UID: \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:29.626157 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.626083    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:29.919310 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.919266    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"]
Oct 30 03:48:29.921088 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:48:29.921058    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a9d631c_63a4_4405_8ed2_e39f87bf61af.slice/crio-e575201788418793cf7131b651ce5731bd4fd18fd38eee5c8d1eafa6bc67137f WatchSource:0}: Error finding container e575201788418793cf7131b651ce5731bd4fd18fd38eee5c8d1eafa6bc67137f: Status 404 returned error can't find the container with id e575201788418793cf7131b651ce5731bd4fd18fd38eee5c8d1eafa6bc67137f
Oct 30 03:48:29.923363 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.923331    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:48:29.923458 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.923384    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:48:29.961773 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:29.961744    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n" event={"ID":"8a9d631c-63a4-4405-8ed2-e39f87bf61af","Type":"ContainerStarted","Data":"e575201788418793cf7131b651ce5731bd4fd18fd38eee5c8d1eafa6bc67137f"}
Oct 30 03:48:30.968782 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:30.968742    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n" event={"ID":"8a9d631c-63a4-4405-8ed2-e39f87bf61af","Type":"ContainerStarted","Data":"8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69"}
Oct 30 03:48:30.969307 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:30.969002    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:30.970594 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:30.970573    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:31.009739 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.009693    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n" podStartSLOduration=2.009678357 podStartE2EDuration="2.009678357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:48:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:48:31.009061113 +0000 UTC m=+3950.851307553" watchObservedRunningTime="2026-10-30 03:48:31.009678357 +0000 UTC m=+3950.851924864"
Oct 30 03:48:31.075770 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.075737    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"]
Oct 30 03:48:31.075945 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.075924    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f" podUID="13c78ded-9983-4366-a733-e9aed20cf97c" containerName="ta-container" containerID="cri-o://14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca" gracePeriod=30
Oct 30 03:48:31.326806 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.326780    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:31.416836 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.416806    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/13c78ded-9983-4366-a733-e9aed20cf97c-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/13c78ded-9983-4366-a733-e9aed20cf97c-data-science-collector-ta-server-cert\") pod \"13c78ded-9983-4366-a733-e9aed20cf97c\" (UID: \"13c78ded-9983-4366-a733-e9aed20cf97c\") "
Oct 30 03:48:31.416999 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.416843    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13c78ded-9983-4366-a733-e9aed20cf97c-kube-api-access-fckvx\" (UniqueName: \"kubernetes.io/projected/13c78ded-9983-4366-a733-e9aed20cf97c-kube-api-access-fckvx\") pod \"13c78ded-9983-4366-a733-e9aed20cf97c\" (UID: \"13c78ded-9983-4366-a733-e9aed20cf97c\") "
Oct 30 03:48:31.416999 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.416985    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/13c78ded-9983-4366-a733-e9aed20cf97c-ta-internal\" (UniqueName: \"kubernetes.io/configmap/13c78ded-9983-4366-a733-e9aed20cf97c-ta-internal\") pod \"13c78ded-9983-4366-a733-e9aed20cf97c\" (UID: \"13c78ded-9983-4366-a733-e9aed20cf97c\") "
Oct 30 03:48:31.417419 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.417385    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13c78ded-9983-4366-a733-e9aed20cf97c-ta-internal" pod "13c78ded-9983-4366-a733-e9aed20cf97c" (UID: "13c78ded-9983-4366-a733-e9aed20cf97c"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:48:31.419467 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.419444    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13c78ded-9983-4366-a733-e9aed20cf97c-data-science-collector-ta-server-cert" pod "13c78ded-9983-4366-a733-e9aed20cf97c" (UID: "13c78ded-9983-4366-a733-e9aed20cf97c"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:48:31.419541 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.419510    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13c78ded-9983-4366-a733-e9aed20cf97c-kube-api-access-fckvx" pod "13c78ded-9983-4366-a733-e9aed20cf97c" (UID: "13c78ded-9983-4366-a733-e9aed20cf97c"). InnerVolumeSpecName "kube-api-access-fckvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:48:31.517951 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.517925    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/13c78ded-9983-4366-a733-e9aed20cf97c-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:31.517951 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.517951    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/13c78ded-9983-4366-a733-e9aed20cf97c-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:31.518099 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.517962    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fckvx\" (UniqueName: \"kubernetes.io/projected/13c78ded-9983-4366-a733-e9aed20cf97c-kube-api-access-fckvx\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:31.975049 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.975015    5981 generic.go:356] "Generic (PLEG): container finished" podID="13c78ded-9983-4366-a733-e9aed20cf97c" containerID="14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca" exitCode=0
Oct 30 03:48:31.975520 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.975058    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"
Oct 30 03:48:31.975520 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.975105    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f" event={"ID":"13c78ded-9983-4366-a733-e9aed20cf97c","Type":"ContainerDied","Data":"14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca"}
Oct 30 03:48:31.975520 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.975158    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f" event={"ID":"13c78ded-9983-4366-a733-e9aed20cf97c","Type":"ContainerDied","Data":"2a6c4215ce061788e149f19260abff7ffa70a72d61212d04ca3af031d5f50b98"}
Oct 30 03:48:31.975520 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.975178    5981 scope.go:122] "RemoveContainer" containerID="14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca"
Oct 30 03:48:31.977080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.977057    5981 generic.go:356] "Generic (PLEG): container finished" podID="7663e9de-faf5-4a1f-a840-728d4ae862cf" containerID="4a2ea3abb310cfbcb72f0e8cc52966c2c5d01857d4efab14115b3a03019bcc72" exitCode=0
Oct 30 03:48:31.977180 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.977120    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d" event={"ID":"7663e9de-faf5-4a1f-a840-728d4ae862cf","Type":"ContainerDied","Data":"4a2ea3abb310cfbcb72f0e8cc52966c2c5d01857d4efab14115b3a03019bcc72"}
Oct 30 03:48:31.984084 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.984069    5981 scope.go:122] "RemoveContainer" containerID="14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca"
Oct 30 03:48:31.984375 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:31.984358    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca\": container with ID starting with 14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca not found: ID does not exist" containerID="14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca"
Oct 30 03:48:31.984425 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:31.984383    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca"} err="failed to get container status \"14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca\": rpc error: code = NotFound desc = could not find container \"14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca\": container with ID starting with 14fff7d2c19c699c570d1c77dfacf3b75f199acf657fc3ac1e930326563dfbca not found: ID does not exist"
Oct 30 03:48:32.066077 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:32.066034    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"]
Oct 30 03:48:32.070323 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:32.070278    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c95d66dcc-xlc7f"]
Oct 30 03:48:32.275116 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:32.275036    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="13c78ded-9983-4366-a733-e9aed20cf97c" path="/var/lib/kubelet/pods/13c78ded-9983-4366-a733-e9aed20cf97c/volumes"
Oct 30 03:48:33.113426 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:33.113401    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d"
Oct 30 03:48:33.707599 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:33.707563    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d"]
Oct 30 03:48:33.711012 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:33.710983    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d"]
Oct 30 03:48:33.989504 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:33.989426    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b9f9bace3ef578238777cb470d7da9c4db437a5fbefa1215acd8797a5a969b3"
Oct 30 03:48:33.989504 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:33.989448    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d"
Oct 30 03:48:34.011350 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:34.011317    5981 status_manager.go:1045] "Failed to get status for pod" err="pods \"thanos-ingress-untrusted-18e3320c6b001c1d\" is forbidden: User \"system:node:ip-10-0-128-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"thanos-ingress-probe-18e3320c69df9ac9\": no relationship found between node 'ip-10-0-128-202.ec2.internal' and this object" podUID="7663e9de-faf5-4a1f-a840-728d4ae862cf" pod="thanos-ingress-probe-18e3320c69df9ac9/thanos-ingress-untrusted-18e3320c6b001c1d"
Oct 30 03:48:34.274559 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:34.274483    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7663e9de-faf5-4a1f-a840-728d4ae862cf" path="/var/lib/kubelet/pods/7663e9de-faf5-4a1f-a840-728d4ae862cf/volumes"
Oct 30 03:48:39.863839 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:39.863800    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"]
Oct 30 03:48:39.864216 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:39.864133    5981 cpu_manager.go:414] "containerMap: removing container" podUID="13c78ded-9983-4366-a733-e9aed20cf97c" containerName="ta-container"
Oct 30 03:48:39.864216 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:39.864143    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13c78ded-9983-4366-a733-e9aed20cf97c" containerName="ta-container"
Oct 30 03:48:39.864216 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:39.864167    5981 cpu_manager.go:414] "containerMap: removing container" podUID="7663e9de-faf5-4a1f-a840-728d4ae862cf" containerName="curl"
Oct 30 03:48:39.864216 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:39.864172    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7663e9de-faf5-4a1f-a840-728d4ae862cf" containerName="curl"
Oct 30 03:48:39.864374 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:39.864223    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="7663e9de-faf5-4a1f-a840-728d4ae862cf" containerName="curl"
Oct 30 03:48:39.864374 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:39.864235    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="13c78ded-9983-4366-a733-e9aed20cf97c" containerName="ta-container"
Oct 30 03:48:39.867310 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:39.867271    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:39.891027 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:39.890994    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"]
Oct 30 03:48:39.991577 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:39.991540    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8474b76f48-xpqmm\" (UID: \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:39.991724 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:39.991681    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-ta-internal\") pod \"data-science-collector-targetallocator-8474b76f48-xpqmm\" (UID: \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:39.991781 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:39.991722    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gn4v\" (UniqueName: \"kubernetes.io/projected/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-kube-api-access-5gn4v\") pod \"data-science-collector-targetallocator-8474b76f48-xpqmm\" (UID: \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:40.092834 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:40.092801    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-ta-internal\") pod \"data-science-collector-targetallocator-8474b76f48-xpqmm\" (UID: \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:40.092834 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:40.092844    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gn4v\" (UniqueName: \"kubernetes.io/projected/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-kube-api-access-5gn4v\") pod \"data-science-collector-targetallocator-8474b76f48-xpqmm\" (UID: \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:40.093036 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:40.092877    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8474b76f48-xpqmm\" (UID: \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:40.093524 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:40.093501    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-ta-internal\") pod \"data-science-collector-targetallocator-8474b76f48-xpqmm\" (UID: \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:40.095469 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:40.095449    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8474b76f48-xpqmm\" (UID: \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:40.113392 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:40.113369    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gn4v\" (UniqueName: \"kubernetes.io/projected/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-kube-api-access-5gn4v\") pod \"data-science-collector-targetallocator-8474b76f48-xpqmm\" (UID: \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:40.178363 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:40.178337    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:40.469009 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:40.468937    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"]
Oct 30 03:48:40.472103 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:48:40.472073    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1ad0f28_75ee_42d0_ae4f_c899d19b9b6d.slice/crio-8cfdb13bfc9e18ffd44fe8ff954e765ab960bd6db6b6fb05eee56eb0eb20ab10 WatchSource:0}: Error finding container 8cfdb13bfc9e18ffd44fe8ff954e765ab960bd6db6b6fb05eee56eb0eb20ab10: Status 404 returned error can't find the container with id 8cfdb13bfc9e18ffd44fe8ff954e765ab960bd6db6b6fb05eee56eb0eb20ab10
Oct 30 03:48:40.474369 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:40.474335    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:48:40.474481 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:40.474402    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:48:41.023760 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.023724    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm" event={"ID":"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d","Type":"ContainerStarted","Data":"9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa"}
Oct 30 03:48:41.024125 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.023772    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm" event={"ID":"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d","Type":"ContainerStarted","Data":"8cfdb13bfc9e18ffd44fe8ff954e765ab960bd6db6b6fb05eee56eb0eb20ab10"}
Oct 30 03:48:41.024125 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.023886    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:41.025547 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.025523    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:41.066018 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.065968    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm" podStartSLOduration=2.065955657 podStartE2EDuration="2.065955657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:48:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:48:41.06536984 +0000 UTC m=+3960.907616285" watchObservedRunningTime="2026-10-30 03:48:41.065955657 +0000 UTC m=+3960.908202092"
Oct 30 03:48:41.147687 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.147653    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"]
Oct 30 03:48:41.147929 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.147896    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n" podUID="8a9d631c-63a4-4405-8ed2-e39f87bf61af" containerName="ta-container" containerID="cri-o://8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69" gracePeriod=30
Oct 30 03:48:41.393624 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.393598    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:41.504464 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.504435    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a9d631c-63a4-4405-8ed2-e39f87bf61af-ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a9d631c-63a4-4405-8ed2-e39f87bf61af-ta-internal\") pod \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\" (UID: \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\") "
Oct 30 03:48:41.504633 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.504521    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a9d631c-63a4-4405-8ed2-e39f87bf61af-kube-api-access-fx2qh\" (UniqueName: \"kubernetes.io/projected/8a9d631c-63a4-4405-8ed2-e39f87bf61af-kube-api-access-fx2qh\") pod \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\" (UID: \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\") "
Oct 30 03:48:41.504633 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.504564    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8a9d631c-63a4-4405-8ed2-e39f87bf61af-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a9d631c-63a4-4405-8ed2-e39f87bf61af-data-science-collector-ta-server-cert\") pod \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\" (UID: \"8a9d631c-63a4-4405-8ed2-e39f87bf61af\") "
Oct 30 03:48:41.504865 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.504846    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9d631c-63a4-4405-8ed2-e39f87bf61af-ta-internal" pod "8a9d631c-63a4-4405-8ed2-e39f87bf61af" (UID: "8a9d631c-63a4-4405-8ed2-e39f87bf61af"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:48:41.506747 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.506720    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a9d631c-63a4-4405-8ed2-e39f87bf61af-data-science-collector-ta-server-cert" pod "8a9d631c-63a4-4405-8ed2-e39f87bf61af" (UID: "8a9d631c-63a4-4405-8ed2-e39f87bf61af"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:48:41.506852 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.506818    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9d631c-63a4-4405-8ed2-e39f87bf61af-kube-api-access-fx2qh" pod "8a9d631c-63a4-4405-8ed2-e39f87bf61af" (UID: "8a9d631c-63a4-4405-8ed2-e39f87bf61af"). InnerVolumeSpecName "kube-api-access-fx2qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:48:41.605455 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.605388    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a9d631c-63a4-4405-8ed2-e39f87bf61af-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:41.605455 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.605419    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx2qh\" (UniqueName: \"kubernetes.io/projected/8a9d631c-63a4-4405-8ed2-e39f87bf61af-kube-api-access-fx2qh\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:41.605455 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:41.605436    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a9d631c-63a4-4405-8ed2-e39f87bf61af-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:42.029683 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:42.029651    5981 generic.go:356] "Generic (PLEG): container finished" podID="8a9d631c-63a4-4405-8ed2-e39f87bf61af" containerID="8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69" exitCode=0
Oct 30 03:48:42.030178 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:42.029709    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"
Oct 30 03:48:42.030178 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:42.029744    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n" event={"ID":"8a9d631c-63a4-4405-8ed2-e39f87bf61af","Type":"ContainerDied","Data":"8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69"}
Oct 30 03:48:42.030178 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:42.029783    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n" event={"ID":"8a9d631c-63a4-4405-8ed2-e39f87bf61af","Type":"ContainerDied","Data":"e575201788418793cf7131b651ce5731bd4fd18fd38eee5c8d1eafa6bc67137f"}
Oct 30 03:48:42.030178 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:42.029801    5981 scope.go:122] "RemoveContainer" containerID="8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69"
Oct 30 03:48:42.041095 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:42.041075    5981 scope.go:122] "RemoveContainer" containerID="8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69"
Oct 30 03:48:42.041660 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:42.041641    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69\": container with ID starting with 8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69 not found: ID does not exist" containerID="8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69"
Oct 30 03:48:42.041776 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:42.041667    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69"} err="failed to get container status \"8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69\": rpc error: code = NotFound desc = could not find container \"8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69\": container with ID starting with 8e155c5a0d07c5672c4df2613af6dbf4acee07610c1ddc513d97430c177ecd69 not found: ID does not exist"
Oct 30 03:48:42.088494 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:42.088467    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"]
Oct 30 03:48:42.101218 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:42.101187    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d59b7d9cb-7h67n"]
Oct 30 03:48:42.274499 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:42.274467    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a9d631c-63a4-4405-8ed2-e39f87bf61af" path="/var/lib/kubelet/pods/8a9d631c-63a4-4405-8ed2-e39f87bf61af/volumes"
Oct 30 03:48:44.369166 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:44.369132    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:48:49.308747 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.308715    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"]
Oct 30 03:48:49.311067 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.309097    5981 cpu_manager.go:414] "containerMap: removing container" podUID="8a9d631c-63a4-4405-8ed2-e39f87bf61af" containerName="ta-container"
Oct 30 03:48:49.311067 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.309109    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a9d631c-63a4-4405-8ed2-e39f87bf61af" containerName="ta-container"
Oct 30 03:48:49.311067 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.309171    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a9d631c-63a4-4405-8ed2-e39f87bf61af" containerName="ta-container"
Oct 30 03:48:49.312033 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.312016    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:49.329558 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.329530    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"]
Oct 30 03:48:49.474418 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.474377    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7mt6\" (UniqueName: \"kubernetes.io/projected/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-kube-api-access-j7mt6\") pod \"data-science-collector-targetallocator-f47ff55cf-n42rm\" (UID: \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:49.474598 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.474437    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-ta-internal\") pod \"data-science-collector-targetallocator-f47ff55cf-n42rm\" (UID: \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:49.474642 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.474587    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-f47ff55cf-n42rm\" (UID: \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:49.575578 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.575467    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-ta-internal\") pod \"data-science-collector-targetallocator-f47ff55cf-n42rm\" (UID: \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:49.575755 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.575589    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-f47ff55cf-n42rm\" (UID: \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:49.575755 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.575641    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7mt6\" (UniqueName: \"kubernetes.io/projected/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-kube-api-access-j7mt6\") pod \"data-science-collector-targetallocator-f47ff55cf-n42rm\" (UID: \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:49.576127 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.576103    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-ta-internal\") pod \"data-science-collector-targetallocator-f47ff55cf-n42rm\" (UID: \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:49.578400 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.578373    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-f47ff55cf-n42rm\" (UID: \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:49.595836 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.595807    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7mt6\" (UniqueName: \"kubernetes.io/projected/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-kube-api-access-j7mt6\") pod \"data-science-collector-targetallocator-f47ff55cf-n42rm\" (UID: \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:49.624075 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.624028    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:49.919732 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.919705    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"]
Oct 30 03:48:49.922111 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:48:49.922079    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf85e72d8_6a8b_4c96_8ea7_8eaf76d73125.slice/crio-176a8628cb86bd223ec0509233f8d957e0df5ef0bb596677ba4d4e561df7e6f9 WatchSource:0}: Error finding container 176a8628cb86bd223ec0509233f8d957e0df5ef0bb596677ba4d4e561df7e6f9: Status 404 returned error can't find the container with id 176a8628cb86bd223ec0509233f8d957e0df5ef0bb596677ba4d4e561df7e6f9
Oct 30 03:48:49.924454 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.924423    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:48:49.924531 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:49.924481    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:48:50.067355 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.067318    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm" event={"ID":"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125","Type":"ContainerStarted","Data":"5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3"}
Oct 30 03:48:50.067355 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.067362    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm" event={"ID":"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125","Type":"ContainerStarted","Data":"176a8628cb86bd223ec0509233f8d957e0df5ef0bb596677ba4d4e561df7e6f9"}
Oct 30 03:48:50.067617 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.067389    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:50.068523 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.068495    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm" podUID="f85e72d8-6a8b-4c96-8ea7-8eaf76d73125" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.116:8080/readyz\": dial tcp 10.134.0.116:8080: connect: connection refused"
Oct 30 03:48:50.109883 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.109822    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm" podStartSLOduration=1.109808294 podStartE2EDuration="1.109808294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:48:50.109189941 +0000 UTC m=+3969.951436387" watchObservedRunningTime="2026-10-30 03:48:50.109808294 +0000 UTC m=+3969.952054739"
Oct 30 03:48:50.719591 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.719560    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 03:48:50.724602 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.724580    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.741157 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.741130    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 03:48:50.753219 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.753184    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 03:48:50.753485 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.753450    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 03:48:50.753485 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.753480    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-wtzv9\""
Oct 30 03:48:50.753639 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.753521    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 03:48:50.766398 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.766372    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 03:48:50.766398 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.766391    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 03:48:50.890427 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.890390    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.890599 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.890515    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.890599 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.890591    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.890723 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.890640    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j9gg\" (UniqueName: \"kubernetes.io/projected/59f3dd25-8378-430a-a7ca-f2b2655495fa-kube-api-access-5j9gg\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.890723 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.890703    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.890825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.890804    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/59f3dd25-8378-430a-a7ca-f2b2655495fa-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.991312 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.991216    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/59f3dd25-8378-430a-a7ca-f2b2655495fa-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.991312 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.991254    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.991528 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.991338    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.991528 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.991375    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.991528 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.991414    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j9gg\" (UniqueName: \"kubernetes.io/projected/59f3dd25-8378-430a-a7ca-f2b2655495fa-kube-api-access-5j9gg\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.991528 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.991440    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.992080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.992050    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/59f3dd25-8378-430a-a7ca-f2b2655495fa-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.994137 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.994111    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.994339 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.994307    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.994675 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.994655    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:50.994730 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:50.994704    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:51.011057 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.011036    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j9gg\" (UniqueName: \"kubernetes.io/projected/59f3dd25-8378-430a-a7ca-f2b2655495fa-kube-api-access-5j9gg\") pod \"data-science-collector-collector-1\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:51.037342 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.037316    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:51.073832 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.073803    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:48:51.143470 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.143424    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"]
Oct 30 03:48:51.143676 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.143626    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm" podUID="f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d" containerName="ta-container" containerID="cri-o://9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa" gracePeriod=30
Oct 30 03:48:51.345318 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.345270    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 03:48:51.349063 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:48:51.349032    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f3dd25_8378_430a_a7ca_f2b2655495fa.slice/crio-511e7f0c17d54341fb9b3423c81bebf5d6a43bc8190f2184dbeb01987d811a77 WatchSource:0}: Error finding container 511e7f0c17d54341fb9b3423c81bebf5d6a43bc8190f2184dbeb01987d811a77: Status 404 returned error can't find the container with id 511e7f0c17d54341fb9b3423c81bebf5d6a43bc8190f2184dbeb01987d811a77
Oct 30 03:48:51.351404 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.351374    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:48:51.351488 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.351432    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:48:51.384717 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.384695    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:51.497329 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.497299    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-ta-internal\" (UniqueName: \"kubernetes.io/configmap/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-ta-internal\") pod \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\" (UID: \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\") "
Oct 30 03:48:51.497500 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.497374    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-kube-api-access-5gn4v\" (UniqueName: \"kubernetes.io/projected/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-kube-api-access-5gn4v\") pod \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\" (UID: \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\") "
Oct 30 03:48:51.497500 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.497403    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-data-science-collector-ta-server-cert\") pod \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\" (UID: \"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d\") "
Oct 30 03:48:51.497769 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.497739    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-ta-internal" pod "f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d" (UID: "f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:48:51.499635 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.499608    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-data-science-collector-ta-server-cert" pod "f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d" (UID: "f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:48:51.499725 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.499667    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-kube-api-access-5gn4v" pod "f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d" (UID: "f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d"). InnerVolumeSpecName "kube-api-access-5gn4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:48:51.598489 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.598461    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:51.598489 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.598488    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gn4v\" (UniqueName: \"kubernetes.io/projected/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-kube-api-access-5gn4v\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:51.598655 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:51.598499    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:52.078148 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.078107    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"59f3dd25-8378-430a-a7ca-f2b2655495fa","Type":"ContainerStarted","Data":"d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87"}
Oct 30 03:48:52.078612 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.078207    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"59f3dd25-8378-430a-a7ca-f2b2655495fa","Type":"ContainerStarted","Data":"511e7f0c17d54341fb9b3423c81bebf5d6a43bc8190f2184dbeb01987d811a77"}
Oct 30 03:48:52.079599 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.079578    5981 generic.go:356] "Generic (PLEG): container finished" podID="f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d" containerID="9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa" exitCode=0
Oct 30 03:48:52.079670 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.079634    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"
Oct 30 03:48:52.079670 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.079656    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm" event={"ID":"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d","Type":"ContainerDied","Data":"9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa"}
Oct 30 03:48:52.079743 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.079691    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm" event={"ID":"f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d","Type":"ContainerDied","Data":"8cfdb13bfc9e18ffd44fe8ff954e765ab960bd6db6b6fb05eee56eb0eb20ab10"}
Oct 30 03:48:52.079743 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.079707    5981 scope.go:122] "RemoveContainer" containerID="9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa"
Oct 30 03:48:52.088845 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.088823    5981 scope.go:122] "RemoveContainer" containerID="9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa"
Oct 30 03:48:52.089112 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:52.089094    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa\": container with ID starting with 9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa not found: ID does not exist" containerID="9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa"
Oct 30 03:48:52.089159 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.089120    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa"} err="failed to get container status \"9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa\": rpc error: code = NotFound desc = could not find container \"9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa\": container with ID starting with 9f444f4b9b9e25b7cde3cdb02a587370374532d53dfe02afabf1d27192fcaefa not found: ID does not exist"
Oct 30 03:48:52.120447 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.120389    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=2.120369082 podStartE2EDuration="2.120369082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:48:52.119589793 +0000 UTC m=+3971.961836231" watchObservedRunningTime="2026-10-30 03:48:52.120369082 +0000 UTC m=+3971.962615528"
Oct 30 03:48:52.157088 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.157053    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"]
Oct 30 03:48:52.160946 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.160916    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8474b76f48-xpqmm"]
Oct 30 03:48:52.274930 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:52.274900    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d" path="/var/lib/kubelet/pods/f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d/volumes"
Oct 30 03:48:58.332276 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.332243    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 03:48:58.332699 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.332439    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="59f3dd25-8378-430a-a7ca-f2b2655495fa" containerName="otc-container" containerID="cri-o://d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87" gracePeriod=30
Oct 30 03:48:58.558515 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.548631    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"]
Oct 30 03:48:58.558515 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.549169    5981 cpu_manager.go:414] "containerMap: removing container" podUID="f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d" containerName="ta-container"
Oct 30 03:48:58.558515 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.549187    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d" containerName="ta-container"
Oct 30 03:48:58.558515 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.549303    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="f1ad0f28-75ee-42d0-ae4f-c899d19b9b6d" containerName="ta-container"
Oct 30 03:48:58.560094 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.560065    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"]
Oct 30 03:48:58.560259 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.560199    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:48:58.594683 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.594633    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:58.660965 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.660933    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hnfc\" (UniqueName: \"kubernetes.io/projected/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-kube-api-access-7hnfc\") pod \"data-science-collector-targetallocator-5678fcffd-ltk9d\" (UID: \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:48:58.661141 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.661073    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-ta-internal\") pod \"data-science-collector-targetallocator-5678fcffd-ltk9d\" (UID: \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:48:58.661141 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.661101    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5678fcffd-ltk9d\" (UID: \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:48:58.761508 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.761481    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-otlp-tls-certs\") pod \"59f3dd25-8378-430a-a7ca-f2b2655495fa\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") "
Oct 30 03:48:58.761699 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.761526    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-data-science-collector-ta-client-cert\") pod \"59f3dd25-8378-430a-a7ca-f2b2655495fa\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") "
Oct 30 03:48:58.761699 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.761547    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59f3dd25-8378-430a-a7ca-f2b2655495fa-otc-internal\" (UniqueName: \"kubernetes.io/configmap/59f3dd25-8378-430a-a7ca-f2b2655495fa-otc-internal\") pod \"59f3dd25-8378-430a-a7ca-f2b2655495fa\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") "
Oct 30 03:48:58.761699 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.761682    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-tls-certs\") pod \"59f3dd25-8378-430a-a7ca-f2b2655495fa\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") "
Oct 30 03:48:58.761875 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.761724    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59f3dd25-8378-430a-a7ca-f2b2655495fa-kube-api-access-5j9gg\" (UniqueName: \"kubernetes.io/projected/59f3dd25-8378-430a-a7ca-f2b2655495fa-kube-api-access-5j9gg\") pod \"59f3dd25-8378-430a-a7ca-f2b2655495fa\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") "
Oct 30 03:48:58.761875 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.761801    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-monitoring-tls-certs\") pod \"59f3dd25-8378-430a-a7ca-f2b2655495fa\" (UID: \"59f3dd25-8378-430a-a7ca-f2b2655495fa\") "
Oct 30 03:48:58.761981 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.761923    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5678fcffd-ltk9d\" (UID: \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:48:58.761981 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.761942    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59f3dd25-8378-430a-a7ca-f2b2655495fa-otc-internal" pod "59f3dd25-8378-430a-a7ca-f2b2655495fa" (UID: "59f3dd25-8378-430a-a7ca-f2b2655495fa"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:48:58.763428 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.762158    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hnfc\" (UniqueName: \"kubernetes.io/projected/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-kube-api-access-7hnfc\") pod \"data-science-collector-targetallocator-5678fcffd-ltk9d\" (UID: \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:48:58.763428 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.762365    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-ta-internal\") pod \"data-science-collector-targetallocator-5678fcffd-ltk9d\" (UID: \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:48:58.763428 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.762443    5981 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/59f3dd25-8378-430a-a7ca-f2b2655495fa-otc-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:58.763428 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.763380    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-ta-internal\") pod \"data-science-collector-targetallocator-5678fcffd-ltk9d\" (UID: \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:48:58.764172 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.764142    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59f3dd25-8378-430a-a7ca-f2b2655495fa-kube-api-access-5j9gg" pod "59f3dd25-8378-430a-a7ca-f2b2655495fa" (UID: "59f3dd25-8378-430a-a7ca-f2b2655495fa"). InnerVolumeSpecName "kube-api-access-5j9gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:48:58.764428 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.764398    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-tls-certs" pod "59f3dd25-8378-430a-a7ca-f2b2655495fa" (UID: "59f3dd25-8378-430a-a7ca-f2b2655495fa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:48:58.764515 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.764471    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-otlp-tls-certs" pod "59f3dd25-8378-430a-a7ca-f2b2655495fa" (UID: "59f3dd25-8378-430a-a7ca-f2b2655495fa"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:48:58.764853 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.764820    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-monitoring-tls-certs" pod "59f3dd25-8378-430a-a7ca-f2b2655495fa" (UID: "59f3dd25-8378-430a-a7ca-f2b2655495fa"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:48:58.765000 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.764981    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5678fcffd-ltk9d\" (UID: \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:48:58.765582 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.765560    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-data-science-collector-ta-client-cert" pod "59f3dd25-8378-430a-a7ca-f2b2655495fa" (UID: "59f3dd25-8378-430a-a7ca-f2b2655495fa"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:48:58.781902 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.781881    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hnfc\" (UniqueName: \"kubernetes.io/projected/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-kube-api-access-7hnfc\") pod \"data-science-collector-targetallocator-5678fcffd-ltk9d\" (UID: \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:48:58.863602 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.863534    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-data-science-collector-ta-client-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:58.863602 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.863560    5981 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:58.863602 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.863570    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j9gg\" (UniqueName: \"kubernetes.io/projected/59f3dd25-8378-430a-a7ca-f2b2655495fa-kube-api-access-5j9gg\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:58.863602 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.863578    5981 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-monitoring-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:58.863602 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.863602    5981 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/59f3dd25-8378-430a-a7ca-f2b2655495fa-otlp-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:48:58.875433 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:58.875409    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:48:59.112728 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:59.112696    5981 generic.go:356] "Generic (PLEG): container finished" podID="59f3dd25-8378-430a-a7ca-f2b2655495fa" containerID="d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87" exitCode=0
Oct 30 03:48:59.112883 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:59.112743    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 03:48:59.112883 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:59.112780    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"59f3dd25-8378-430a-a7ca-f2b2655495fa","Type":"ContainerDied","Data":"d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87"}
Oct 30 03:48:59.112883 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:59.112836    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"59f3dd25-8378-430a-a7ca-f2b2655495fa","Type":"ContainerDied","Data":"511e7f0c17d54341fb9b3423c81bebf5d6a43bc8190f2184dbeb01987d811a77"}
Oct 30 03:48:59.112883 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:59.112861    5981 scope.go:122] "RemoveContainer" containerID="d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87"
Oct 30 03:48:59.128994 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:59.128972    5981 scope.go:122] "RemoveContainer" containerID="d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87"
Oct 30 03:48:59.129306 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:48:59.129266    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87\": container with ID starting with d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87 not found: ID does not exist" containerID="d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87"
Oct 30 03:48:59.129388 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:59.129317    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87"} err="failed to get container status \"d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87\": rpc error: code = NotFound desc = could not find container \"d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87\": container with ID starting with d17b132dccc0b5bc2d60ac16ecd7e2291a10fd097ec85652a5a514eb2abb9f87 not found: ID does not exist"
Oct 30 03:48:59.164661 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:59.164636    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 03:48:59.168769 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:59.168748    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"]
Oct 30 03:48:59.178402 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:59.178378    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 03:48:59.178616 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:59.178579    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:48:59.178703 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:48:59.178645    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:49:00.120226 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.120181    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d" event={"ID":"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b","Type":"ContainerStarted","Data":"536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625"}
Oct 30 03:49:00.120226 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.120228    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d" event={"ID":"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b","Type":"ContainerStarted","Data":"d4511f11e242c4c3265490c59116ba0f1f4a84dce612ca4d67a948aac311add0"}
Oct 30 03:49:00.120790 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.120252    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:49:00.122508 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.122485    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:49:00.160878 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.160827    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d" podStartSLOduration=2.160811647 podStartE2EDuration="2.160811647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:49:00.159659821 +0000 UTC m=+3980.001906266" watchObservedRunningTime="2026-10-30 03:49:00.160811647 +0000 UTC m=+3980.003058088"
Oct 30 03:49:00.238840 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.238796    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"]
Oct 30 03:49:00.239016 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.238974    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm" podUID="f85e72d8-6a8b-4c96-8ea7-8eaf76d73125" containerName="ta-container" containerID="cri-o://5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3" gracePeriod=30
Oct 30 03:49:00.275815 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.275787    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59f3dd25-8378-430a-a7ca-f2b2655495fa" path="/var/lib/kubelet/pods/59f3dd25-8378-430a-a7ca-f2b2655495fa/volumes"
Oct 30 03:49:00.475826 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.475801    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:49:00.578399 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.578367    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-ta-internal\" (UniqueName: \"kubernetes.io/configmap/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-ta-internal\") pod \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\" (UID: \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\") "
Oct 30 03:49:00.578542 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.578411    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-data-science-collector-ta-server-cert\") pod \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\" (UID: \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\") "
Oct 30 03:49:00.578542 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.578480    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-kube-api-access-j7mt6\" (UniqueName: \"kubernetes.io/projected/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-kube-api-access-j7mt6\") pod \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\" (UID: \"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125\") "
Oct 30 03:49:00.578760 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.578737    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-ta-internal" pod "f85e72d8-6a8b-4c96-8ea7-8eaf76d73125" (UID: "f85e72d8-6a8b-4c96-8ea7-8eaf76d73125"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:49:00.580692 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.580665    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-kube-api-access-j7mt6" pod "f85e72d8-6a8b-4c96-8ea7-8eaf76d73125" (UID: "f85e72d8-6a8b-4c96-8ea7-8eaf76d73125"). InnerVolumeSpecName "kube-api-access-j7mt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:49:00.580808 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.580710    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-data-science-collector-ta-server-cert" pod "f85e72d8-6a8b-4c96-8ea7-8eaf76d73125" (UID: "f85e72d8-6a8b-4c96-8ea7-8eaf76d73125"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:49:00.679433 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.679363    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:00.679433 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.679390    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7mt6\" (UniqueName: \"kubernetes.io/projected/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-kube-api-access-j7mt6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:00.679433 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.679402    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:00.736802 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.736769    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 03:49:00.737131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.737116    5981 cpu_manager.go:414] "containerMap: removing container" podUID="f85e72d8-6a8b-4c96-8ea7-8eaf76d73125" containerName="ta-container"
Oct 30 03:49:00.737175 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.737133    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f85e72d8-6a8b-4c96-8ea7-8eaf76d73125" containerName="ta-container"
Oct 30 03:49:00.737175 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.737150    5981 cpu_manager.go:414] "containerMap: removing container" podUID="59f3dd25-8378-430a-a7ca-f2b2655495fa" containerName="otc-container"
Oct 30 03:49:00.737175 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.737155    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59f3dd25-8378-430a-a7ca-f2b2655495fa" containerName="otc-container"
Oct 30 03:49:00.737270 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.737238    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="f85e72d8-6a8b-4c96-8ea7-8eaf76d73125" containerName="ta-container"
Oct 30 03:49:00.737270 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.737248    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="59f3dd25-8378-430a-a7ca-f2b2655495fa" containerName="otc-container"
Oct 30 03:49:00.740319 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.740274    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.759327 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.757664    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-6d9d4583\""
Oct 30 03:49:00.759327 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.758459    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 03:49:00.759327 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.758561    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-wtzv9\""
Oct 30 03:49:00.759327 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.758635    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 03:49:00.759327 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.758724    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 03:49:00.770255 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.770229    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 03:49:00.771171 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.771147    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 03:49:00.780490 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.780468    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xbwc\" (UniqueName: \"kubernetes.io/projected/92e26693-3c1a-46ac-9231-733880a713a1-kube-api-access-6xbwc\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.780667 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.780509    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.780667 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.780534    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.780795 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.780740    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.780852 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.780801    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.780942 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.780919    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/92e26693-3c1a-46ac-9231-733880a713a1-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.882043 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.882009    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xbwc\" (UniqueName: \"kubernetes.io/projected/92e26693-3c1a-46ac-9231-733880a713a1-kube-api-access-6xbwc\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.882043 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.882048    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.882315 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.882067    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.882315 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.882095    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.882315 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.882223    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.882508 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.882335    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/92e26693-3c1a-46ac-9231-733880a713a1-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.883267 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.883238    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/92e26693-3c1a-46ac-9231-733880a713a1-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.884937 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.884913    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.885045 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.884937    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.885045 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.885002    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.885237 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.885222    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:00.901850 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:00.901830    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xbwc\" (UniqueName: \"kubernetes.io/projected/92e26693-3c1a-46ac-9231-733880a713a1-kube-api-access-6xbwc\") pod \"data-science-collector-collector-0\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:01.053719 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.053649    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:01.127583 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.127551    5981 generic.go:356] "Generic (PLEG): container finished" podID="f85e72d8-6a8b-4c96-8ea7-8eaf76d73125" containerID="5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3" exitCode=0
Oct 30 03:49:01.127949 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.127595    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"
Oct 30 03:49:01.127949 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.127628    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm" event={"ID":"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125","Type":"ContainerDied","Data":"5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3"}
Oct 30 03:49:01.127949 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.127674    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm" event={"ID":"f85e72d8-6a8b-4c96-8ea7-8eaf76d73125","Type":"ContainerDied","Data":"176a8628cb86bd223ec0509233f8d957e0df5ef0bb596677ba4d4e561df7e6f9"}
Oct 30 03:49:01.127949 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.127696    5981 scope.go:122] "RemoveContainer" containerID="5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3"
Oct 30 03:49:01.137037 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.137018    5981 scope.go:122] "RemoveContainer" containerID="5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3"
Oct 30 03:49:01.137323 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:49:01.137302    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3\": container with ID starting with 5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3 not found: ID does not exist" containerID="5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3"
Oct 30 03:49:01.137378 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.137334    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3"} err="failed to get container status \"5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3\": rpc error: code = NotFound desc = could not find container \"5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3\": container with ID starting with 5ada3f60915edd15ccfbcbef25577a5e880e1dcf05796cdfb51620028e4cd4a3 not found: ID does not exist"
Oct 30 03:49:01.179627 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.179603    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"]
Oct 30 03:49:01.184977 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.184958    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f47ff55cf-n42rm"]
Oct 30 03:49:01.346413 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.346322    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 03:49:01.348634 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:49:01.348603    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e26693_3c1a_46ac_9231_733880a713a1.slice/crio-7406964d81b72b6e3c66c04dc13b58f742735720e47206299e9e81620335c71c WatchSource:0}: Error finding container 7406964d81b72b6e3c66c04dc13b58f742735720e47206299e9e81620335c71c: Status 404 returned error can't find the container with id 7406964d81b72b6e3c66c04dc13b58f742735720e47206299e9e81620335c71c
Oct 30 03:49:01.350921 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.350893    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:49:01.351003 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:01.350957    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:49:02.139820 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:02.139778    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"92e26693-3c1a-46ac-9231-733880a713a1","Type":"ContainerStarted","Data":"82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d"}
Oct 30 03:49:02.140299 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:02.139877    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"92e26693-3c1a-46ac-9231-733880a713a1","Type":"ContainerStarted","Data":"7406964d81b72b6e3c66c04dc13b58f742735720e47206299e9e81620335c71c"}
Oct 30 03:49:02.183126 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:02.183078    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.183064839 podStartE2EDuration="2.183064839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:49:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:49:02.18198403 +0000 UTC m=+3982.024230486" watchObservedRunningTime="2026-10-30 03:49:02.183064839 +0000 UTC m=+3982.025311277"
Oct 30 03:49:02.275224 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:02.275188    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f85e72d8-6a8b-4c96-8ea7-8eaf76d73125" path="/var/lib/kubelet/pods/f85e72d8-6a8b-4c96-8ea7-8eaf76d73125/volumes"
Oct 30 03:49:07.295943 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.295899    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"]
Oct 30 03:49:07.299788 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.299764    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:07.330550 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.330511    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"]
Oct 30 03:49:07.340171 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.340080    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w925b\" (UniqueName: \"kubernetes.io/projected/c797b101-a296-4e59-8e6e-afed942d63c3-kube-api-access-w925b\") pod \"data-science-collector-targetallocator-6c6f7b6b77-gbckh\" (UID: \"c797b101-a296-4e59-8e6e-afed942d63c3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:07.340390 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.340356    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c797b101-a296-4e59-8e6e-afed942d63c3-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c6f7b6b77-gbckh\" (UID: \"c797b101-a296-4e59-8e6e-afed942d63c3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:07.340457 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.340393    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c797b101-a296-4e59-8e6e-afed942d63c3-ta-internal\") pod \"data-science-collector-targetallocator-6c6f7b6b77-gbckh\" (UID: \"c797b101-a296-4e59-8e6e-afed942d63c3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:07.441850 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.441809    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c797b101-a296-4e59-8e6e-afed942d63c3-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c6f7b6b77-gbckh\" (UID: \"c797b101-a296-4e59-8e6e-afed942d63c3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:07.442057 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.441867    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c797b101-a296-4e59-8e6e-afed942d63c3-ta-internal\") pod \"data-science-collector-targetallocator-6c6f7b6b77-gbckh\" (UID: \"c797b101-a296-4e59-8e6e-afed942d63c3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:07.442057 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.441903    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w925b\" (UniqueName: \"kubernetes.io/projected/c797b101-a296-4e59-8e6e-afed942d63c3-kube-api-access-w925b\") pod \"data-science-collector-targetallocator-6c6f7b6b77-gbckh\" (UID: \"c797b101-a296-4e59-8e6e-afed942d63c3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:07.442584 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.442554    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c797b101-a296-4e59-8e6e-afed942d63c3-ta-internal\") pod \"data-science-collector-targetallocator-6c6f7b6b77-gbckh\" (UID: \"c797b101-a296-4e59-8e6e-afed942d63c3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:07.444468 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.444451    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c797b101-a296-4e59-8e6e-afed942d63c3-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c6f7b6b77-gbckh\" (UID: \"c797b101-a296-4e59-8e6e-afed942d63c3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:07.461877 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.461847    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w925b\" (UniqueName: \"kubernetes.io/projected/c797b101-a296-4e59-8e6e-afed942d63c3-kube-api-access-w925b\") pod \"data-science-collector-targetallocator-6c6f7b6b77-gbckh\" (UID: \"c797b101-a296-4e59-8e6e-afed942d63c3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:07.612593 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.612511    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:07.909386 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.909359    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"]
Oct 30 03:49:07.910973 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:49:07.910943    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc797b101_a296_4e59_8e6e_afed942d63c3.slice/crio-e82e31171197efeb206a4d634257a71489dad7f128dc60cf7b8325d73287e03d WatchSource:0}: Error finding container e82e31171197efeb206a4d634257a71489dad7f128dc60cf7b8325d73287e03d: Status 404 returned error can't find the container with id e82e31171197efeb206a4d634257a71489dad7f128dc60cf7b8325d73287e03d
Oct 30 03:49:07.913112 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.913078    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:49:07.913217 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:07.913148    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:49:08.170987 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:08.170888    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh" event={"ID":"c797b101-a296-4e59-8e6e-afed942d63c3","Type":"ContainerStarted","Data":"62ee31f308921b5add2f31215bb1d6f458b5afdd87e7b2f2e735d3cb96055f24"}
Oct 30 03:49:08.170987 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:08.170942    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh" event={"ID":"c797b101-a296-4e59-8e6e-afed942d63c3","Type":"ContainerStarted","Data":"e82e31171197efeb206a4d634257a71489dad7f128dc60cf7b8325d73287e03d"}
Oct 30 03:49:08.171184 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:08.171164    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:08.172387 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:08.172362    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh" podUID="c797b101-a296-4e59-8e6e-afed942d63c3" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.120:8080/readyz\": dial tcp 10.134.0.120:8080: connect: connection refused"
Oct 30 03:49:08.211480 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:08.211377    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh" podStartSLOduration=1.211359624 podStartE2EDuration="1.211359624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:49:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:49:08.210402886 +0000 UTC m=+3988.052649330" watchObservedRunningTime="2026-10-30 03:49:08.211359624 +0000 UTC m=+3988.053606068"
Oct 30 03:49:09.176546 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.176519    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:09.250019 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.249986    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"]
Oct 30 03:49:09.250260 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.250230    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d" podUID="8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b" containerName="ta-container" containerID="cri-o://536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625" gracePeriod=30
Oct 30 03:49:09.300410 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.300378    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 03:49:09.300631 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.300596    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="92e26693-3c1a-46ac-9231-733880a713a1" containerName="otc-container" containerID="cri-o://82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d" gracePeriod=30
Oct 30 03:49:09.496819 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.496784    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:49:09.662650 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.662615    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-kube-api-access-7hnfc\" (UniqueName: \"kubernetes.io/projected/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-kube-api-access-7hnfc\") pod \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\" (UID: \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\") "
Oct 30 03:49:09.662650 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.662653    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-ta-internal\" (UniqueName: \"kubernetes.io/configmap/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-ta-internal\") pod \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\" (UID: \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\") "
Oct 30 03:49:09.662907 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.662676    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-data-science-collector-ta-server-cert\") pod \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\" (UID: \"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b\") "
Oct 30 03:49:09.663045 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.663021    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-ta-internal" pod "8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b" (UID: "8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:49:09.664931 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.664910    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-data-science-collector-ta-server-cert" pod "8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b" (UID: "8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:49:09.665053 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.664933    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-kube-api-access-7hnfc" pod "8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b" (UID: "8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b"). InnerVolumeSpecName "kube-api-access-7hnfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:49:09.763894 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.763811    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hnfc\" (UniqueName: \"kubernetes.io/projected/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-kube-api-access-7hnfc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:09.763894 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.763839    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:09.763894 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:09.763850    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:10.181340 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.181308    5981 generic.go:356] "Generic (PLEG): container finished" podID="8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b" containerID="536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625" exitCode=0
Oct 30 03:49:10.181746 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.181345    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"
Oct 30 03:49:10.181746 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.181386    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d" event={"ID":"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b","Type":"ContainerDied","Data":"536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625"}
Oct 30 03:49:10.181746 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.181425    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d" event={"ID":"8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b","Type":"ContainerDied","Data":"d4511f11e242c4c3265490c59116ba0f1f4a84dce612ca4d67a948aac311add0"}
Oct 30 03:49:10.181746 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.181447    5981 scope.go:122] "RemoveContainer" containerID="536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625"
Oct 30 03:49:10.190781 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.190764    5981 scope.go:122] "RemoveContainer" containerID="536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625"
Oct 30 03:49:10.191069 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:49:10.191051    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625\": container with ID starting with 536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625 not found: ID does not exist" containerID="536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625"
Oct 30 03:49:10.191112 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.191078    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625"} err="failed to get container status \"536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625\": rpc error: code = NotFound desc = could not find container \"536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625\": container with ID starting with 536d468e8f1e5244e87b3a6e240bc7f3a827918cbb9854fe70e82ff4b12bf625 not found: ID does not exist"
Oct 30 03:49:10.233157 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.233129    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"]
Oct 30 03:49:10.245801 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.245773    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5678fcffd-ltk9d"]
Oct 30 03:49:10.275077 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.275049    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b" path="/var/lib/kubelet/pods/8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b/volumes"
Oct 30 03:49:10.541233 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.541206    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:10.671934 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.671905    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-otlp-tls-certs\") pod \"92e26693-3c1a-46ac-9231-733880a713a1\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") "
Oct 30 03:49:10.672121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.671943    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92e26693-3c1a-46ac-9231-733880a713a1-kube-api-access-6xbwc\" (UniqueName: \"kubernetes.io/projected/92e26693-3c1a-46ac-9231-733880a713a1-kube-api-access-6xbwc\") pod \"92e26693-3c1a-46ac-9231-733880a713a1\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") "
Oct 30 03:49:10.672121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.671982    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-tls-certs\") pod \"92e26693-3c1a-46ac-9231-733880a713a1\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") "
Oct 30 03:49:10.672121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.672014    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-monitoring-tls-certs\") pod \"92e26693-3c1a-46ac-9231-733880a713a1\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") "
Oct 30 03:49:10.672121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.672042    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92e26693-3c1a-46ac-9231-733880a713a1-otc-internal\" (UniqueName: \"kubernetes.io/configmap/92e26693-3c1a-46ac-9231-733880a713a1-otc-internal\") pod \"92e26693-3c1a-46ac-9231-733880a713a1\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") "
Oct 30 03:49:10.672121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.672088    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-data-science-collector-ta-client-cert\") pod \"92e26693-3c1a-46ac-9231-733880a713a1\" (UID: \"92e26693-3c1a-46ac-9231-733880a713a1\") "
Oct 30 03:49:10.672592 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.672557    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92e26693-3c1a-46ac-9231-733880a713a1-otc-internal" pod "92e26693-3c1a-46ac-9231-733880a713a1" (UID: "92e26693-3c1a-46ac-9231-733880a713a1"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:49:10.674400 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.674367    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-data-science-collector-ta-client-cert" pod "92e26693-3c1a-46ac-9231-733880a713a1" (UID: "92e26693-3c1a-46ac-9231-733880a713a1"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:49:10.674501 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.674381    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92e26693-3c1a-46ac-9231-733880a713a1-kube-api-access-6xbwc" pod "92e26693-3c1a-46ac-9231-733880a713a1" (UID: "92e26693-3c1a-46ac-9231-733880a713a1"). InnerVolumeSpecName "kube-api-access-6xbwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:49:10.674501 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.674425    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-otlp-tls-certs" pod "92e26693-3c1a-46ac-9231-733880a713a1" (UID: "92e26693-3c1a-46ac-9231-733880a713a1"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:49:10.674917 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.674901    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-monitoring-tls-certs" pod "92e26693-3c1a-46ac-9231-733880a713a1" (UID: "92e26693-3c1a-46ac-9231-733880a713a1"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:49:10.674963 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.674930    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-tls-certs" pod "92e26693-3c1a-46ac-9231-733880a713a1" (UID: "92e26693-3c1a-46ac-9231-733880a713a1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:49:10.773250 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.773189    5981 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:10.773250 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.773213    5981 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-monitoring-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:10.773250 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.773222    5981 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/92e26693-3c1a-46ac-9231-733880a713a1-otc-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:10.773250 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.773232    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-data-science-collector-ta-client-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:10.773250 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.773240    5981 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/92e26693-3c1a-46ac-9231-733880a713a1-otlp-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:10.773250 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:10.773248    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xbwc\" (UniqueName: \"kubernetes.io/projected/92e26693-3c1a-46ac-9231-733880a713a1-kube-api-access-6xbwc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:11.188583 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:11.188546    5981 generic.go:356] "Generic (PLEG): container finished" podID="92e26693-3c1a-46ac-9231-733880a713a1" containerID="82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d" exitCode=0
Oct 30 03:49:11.189030 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:11.188613    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 03:49:11.189030 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:11.188628    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"92e26693-3c1a-46ac-9231-733880a713a1","Type":"ContainerDied","Data":"82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d"}
Oct 30 03:49:11.189030 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:11.188734    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"92e26693-3c1a-46ac-9231-733880a713a1","Type":"ContainerDied","Data":"7406964d81b72b6e3c66c04dc13b58f742735720e47206299e9e81620335c71c"}
Oct 30 03:49:11.189030 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:11.188772    5981 scope.go:122] "RemoveContainer" containerID="82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d"
Oct 30 03:49:11.199017 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:11.198999    5981 scope.go:122] "RemoveContainer" containerID="82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d"
Oct 30 03:49:11.199341 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:49:11.199321    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d\": container with ID starting with 82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d not found: ID does not exist" containerID="82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d"
Oct 30 03:49:11.199431 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:11.199348    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d"} err="failed to get container status \"82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d\": rpc error: code = NotFound desc = could not find container \"82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d\": container with ID starting with 82260dbd5db3a8f91e18ee3c054a7a3ec09661153612485ace6c61e7b3cc139d not found: ID does not exist"
Oct 30 03:49:11.241765 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:11.241734    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 03:49:11.255528 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:11.255500    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 03:49:12.047621 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.047587    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"]
Oct 30 03:49:12.047890 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.047849    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c" podUID="e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e" containerName="thanos-querier" containerID="cri-o://45ed65940ca6b70200a00c66555201be593069cc8f2d5eca1e2db42f161ad164" gracePeriod=30
Oct 30 03:49:12.197505 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.197466    5981 generic.go:356] "Generic (PLEG): container finished" podID="e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e" containerID="45ed65940ca6b70200a00c66555201be593069cc8f2d5eca1e2db42f161ad164" exitCode=0
Oct 30 03:49:12.197917 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.197744    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c" event={"ID":"e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e","Type":"ContainerDied","Data":"45ed65940ca6b70200a00c66555201be593069cc8f2d5eca1e2db42f161ad164"}
Oct 30 03:49:12.275650 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.275617    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92e26693-3c1a-46ac-9231-733880a713a1" path="/var/lib/kubelet/pods/92e26693-3c1a-46ac-9231-733880a713a1/volumes"
Oct 30 03:49:12.317351 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.317326    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"
Oct 30 03:49:12.386084 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.386056    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e-kube-api-access-q5mqq\" (UniqueName: \"kubernetes.io/projected/e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e-kube-api-access-q5mqq\") pod \"e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e\" (UID: \"e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e\") "
Oct 30 03:49:12.388270 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.388245    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e-kube-api-access-q5mqq" pod "e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e" (UID: "e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e"). InnerVolumeSpecName "kube-api-access-q5mqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:49:12.486646 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.486615    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5mqq\" (UniqueName: \"kubernetes.io/projected/e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e-kube-api-access-q5mqq\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:12.936121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.936089    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"]
Oct 30 03:49:12.936379 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.936348    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh" podUID="c797b101-a296-4e59-8e6e-afed942d63c3" containerName="ta-container" containerID="cri-o://62ee31f308921b5add2f31215bb1d6f458b5afdd87e7b2f2e735d3cb96055f24" gracePeriod=30
Oct 30 03:49:12.996547 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.996517    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:49:12.996741 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:12.996715    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="fde63aac-5835-473c-8ba8-932c4f656501" containerName="perses" containerID="cri-o://e472f5a9940fa64758a482c6b49bcbb8da98c63ff7538f6972c03ce53dc6fb77" gracePeriod=30
Oct 30 03:49:13.206012 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.205976    5981 generic.go:356] "Generic (PLEG): container finished" podID="fde63aac-5835-473c-8ba8-932c4f656501" containerID="e472f5a9940fa64758a482c6b49bcbb8da98c63ff7538f6972c03ce53dc6fb77" exitCode=0
Oct 30 03:49:13.206479 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.206075    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"fde63aac-5835-473c-8ba8-932c4f656501","Type":"ContainerDied","Data":"e472f5a9940fa64758a482c6b49bcbb8da98c63ff7538f6972c03ce53dc6fb77"}
Oct 30 03:49:13.207827 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.207797    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"
Oct 30 03:49:13.207964 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.207820    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c" event={"ID":"e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e","Type":"ContainerDied","Data":"a56d5bf05636db66c807e2b1853e5ec5e9485fde38ee4ad3ff3e085a26a00a19"}
Oct 30 03:49:13.207964 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.207884    5981 scope.go:122] "RemoveContainer" containerID="45ed65940ca6b70200a00c66555201be593069cc8f2d5eca1e2db42f161ad164"
Oct 30 03:49:13.209724 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.209703    5981 generic.go:356] "Generic (PLEG): container finished" podID="c797b101-a296-4e59-8e6e-afed942d63c3" containerID="62ee31f308921b5add2f31215bb1d6f458b5afdd87e7b2f2e735d3cb96055f24" exitCode=0
Oct 30 03:49:13.209841 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.209814    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh" event={"ID":"c797b101-a296-4e59-8e6e-afed942d63c3","Type":"ContainerDied","Data":"62ee31f308921b5add2f31215bb1d6f458b5afdd87e7b2f2e735d3cb96055f24"}
Oct 30 03:49:13.241699 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.241678    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:13.262221 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.262192    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"]
Oct 30 03:49:13.268310 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.268251    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vxr8c"]
Oct 30 03:49:13.270007 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.269985    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:13.292671 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.292636    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fde63aac-5835-473c-8ba8-932c4f656501-config\" (UniqueName: \"kubernetes.io/configmap/fde63aac-5835-473c-8ba8-932c4f656501-config\") pod \"fde63aac-5835-473c-8ba8-932c4f656501\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") "
Oct 30 03:49:13.292759 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.292684    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c797b101-a296-4e59-8e6e-afed942d63c3-ta-internal\" (UniqueName: \"kubernetes.io/configmap/c797b101-a296-4e59-8e6e-afed942d63c3-ta-internal\") pod \"c797b101-a296-4e59-8e6e-afed942d63c3\" (UID: \"c797b101-a296-4e59-8e6e-afed942d63c3\") "
Oct 30 03:49:13.292759 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.292706    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c797b101-a296-4e59-8e6e-afed942d63c3-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c797b101-a296-4e59-8e6e-afed942d63c3-data-science-collector-ta-server-cert\") pod \"c797b101-a296-4e59-8e6e-afed942d63c3\" (UID: \"c797b101-a296-4e59-8e6e-afed942d63c3\") "
Oct 30 03:49:13.292832 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.292814    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"fde63aac-5835-473c-8ba8-932c4f656501\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") "
Oct 30 03:49:13.293027 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.293006    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fde63aac-5835-473c-8ba8-932c4f656501-config" pod "fde63aac-5835-473c-8ba8-932c4f656501" (UID: "fde63aac-5835-473c-8ba8-932c4f656501"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:49:13.293080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.293065    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c797b101-a296-4e59-8e6e-afed942d63c3-ta-internal" pod "c797b101-a296-4e59-8e6e-afed942d63c3" (UID: "c797b101-a296-4e59-8e6e-afed942d63c3"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:49:13.293124 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.293105    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fde63aac-5835-473c-8ba8-932c4f656501-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:13.295056 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.295035    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c797b101-a296-4e59-8e6e-afed942d63c3-data-science-collector-ta-server-cert" pod "c797b101-a296-4e59-8e6e-afed942d63c3" (UID: "c797b101-a296-4e59-8e6e-afed942d63c3"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:49:13.295571 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.295553    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "fde63aac-5835-473c-8ba8-932c4f656501" (UID: "fde63aac-5835-473c-8ba8-932c4f656501"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 03:49:13.394140 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.394110    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c797b101-a296-4e59-8e6e-afed942d63c3-kube-api-access-w925b\" (UniqueName: \"kubernetes.io/projected/c797b101-a296-4e59-8e6e-afed942d63c3-kube-api-access-w925b\") pod \"c797b101-a296-4e59-8e6e-afed942d63c3\" (UID: \"c797b101-a296-4e59-8e6e-afed942d63c3\") "
Oct 30 03:49:13.394320 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.394156    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fde63aac-5835-473c-8ba8-932c4f656501-kube-api-access-r79ll\" (UniqueName: \"kubernetes.io/projected/fde63aac-5835-473c-8ba8-932c4f656501-kube-api-access-r79ll\") pod \"fde63aac-5835-473c-8ba8-932c4f656501\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") "
Oct 30 03:49:13.394320 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.394180    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fde63aac-5835-473c-8ba8-932c4f656501-plugins\" (UniqueName: \"kubernetes.io/empty-dir/fde63aac-5835-473c-8ba8-932c4f656501-plugins\") pod \"fde63aac-5835-473c-8ba8-932c4f656501\" (UID: \"fde63aac-5835-473c-8ba8-932c4f656501\") "
Oct 30 03:49:13.394409 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.394381    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c797b101-a296-4e59-8e6e-afed942d63c3-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:13.394409 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.394393    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c797b101-a296-4e59-8e6e-afed942d63c3-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:13.394484 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.394415    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 03:49:13.396476 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.396447    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde63aac-5835-473c-8ba8-932c4f656501-kube-api-access-r79ll" pod "fde63aac-5835-473c-8ba8-932c4f656501" (UID: "fde63aac-5835-473c-8ba8-932c4f656501"). InnerVolumeSpecName "kube-api-access-r79ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:49:13.396563 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.396544    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c797b101-a296-4e59-8e6e-afed942d63c3-kube-api-access-w925b" pod "c797b101-a296-4e59-8e6e-afed942d63c3" (UID: "c797b101-a296-4e59-8e6e-afed942d63c3"). InnerVolumeSpecName "kube-api-access-w925b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:49:13.408420 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.408403    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 03:49:13.495080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.495009    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r79ll\" (UniqueName: \"kubernetes.io/projected/fde63aac-5835-473c-8ba8-932c4f656501-kube-api-access-r79ll\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:13.495080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.495046    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 03:49:13.495080 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.495064    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w925b\" (UniqueName: \"kubernetes.io/projected/c797b101-a296-4e59-8e6e-afed942d63c3-kube-api-access-w925b\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:13.541212 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.541177    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde63aac-5835-473c-8ba8-932c4f656501-plugins" pod "fde63aac-5835-473c-8ba8-932c4f656501" (UID: "fde63aac-5835-473c-8ba8-932c4f656501"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:49:13.595687 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:13.595653    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/fde63aac-5835-473c-8ba8-932c4f656501-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:14.217089 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:14.217053    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:14.217574 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:14.217083    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"fde63aac-5835-473c-8ba8-932c4f656501","Type":"ContainerDied","Data":"e201dbda2d6b5897df127e8671f62712dd488e1526c0e3edcbb918c53a4540ee"}
Oct 30 03:49:14.217574 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:14.217139    5981 scope.go:122] "RemoveContainer" containerID="e472f5a9940fa64758a482c6b49bcbb8da98c63ff7538f6972c03ce53dc6fb77"
Oct 30 03:49:14.219757 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:14.219728    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh" event={"ID":"c797b101-a296-4e59-8e6e-afed942d63c3","Type":"ContainerDied","Data":"e82e31171197efeb206a4d634257a71489dad7f128dc60cf7b8325d73287e03d"}
Oct 30 03:49:14.219757 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:14.219747    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"
Oct 30 03:49:14.226992 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:14.226793    5981 scope.go:122] "RemoveContainer" containerID="62ee31f308921b5add2f31215bb1d6f458b5afdd87e7b2f2e735d3cb96055f24"
Oct 30 03:49:14.275827 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:14.275795    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e" path="/var/lib/kubelet/pods/e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e/volumes"
Oct 30 03:49:14.276110 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:14.276091    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:49:14.282793 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:14.282774    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:49:14.308004 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:14.307980    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"]
Oct 30 03:49:14.309923 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:14.309902    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6f7b6b77-gbckh"]
Oct 30 03:49:14.368813 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:49:14.368746    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:49:16.274092 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:16.274060    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c797b101-a296-4e59-8e6e-afed942d63c3" path="/var/lib/kubelet/pods/c797b101-a296-4e59-8e6e-afed942d63c3/volumes"
Oct 30 03:49:16.274506 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:16.274492    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fde63aac-5835-473c-8ba8-932c4f656501" path="/var/lib/kubelet/pods/fde63aac-5835-473c-8ba8-932c4f656501/volumes"
Oct 30 03:49:19.978549 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978519    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"]
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978828    5981 cpu_manager.go:414] "containerMap: removing container" podUID="fde63aac-5835-473c-8ba8-932c4f656501" containerName="perses"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978838    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fde63aac-5835-473c-8ba8-932c4f656501" containerName="perses"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978847    5981 cpu_manager.go:414] "containerMap: removing container" podUID="92e26693-3c1a-46ac-9231-733880a713a1" containerName="otc-container"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978852    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92e26693-3c1a-46ac-9231-733880a713a1" containerName="otc-container"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978865    5981 cpu_manager.go:414] "containerMap: removing container" podUID="8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b" containerName="ta-container"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978870    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b" containerName="ta-container"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978883    5981 cpu_manager.go:414] "containerMap: removing container" podUID="c797b101-a296-4e59-8e6e-afed942d63c3" containerName="ta-container"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978888    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c797b101-a296-4e59-8e6e-afed942d63c3" containerName="ta-container"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978906    5981 cpu_manager.go:414] "containerMap: removing container" podUID="e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e" containerName="thanos-querier"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978911    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e" containerName="thanos-querier"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978975    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d8eacc7-f6b1-4ae5-a8fd-8eecb9c6463b" containerName="ta-container"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978984    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="c797b101-a296-4e59-8e6e-afed942d63c3" containerName="ta-container"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.978992    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0a2f729-17bf-48c2-80a8-b94e6ddc9a8e" containerName="thanos-querier"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.979000    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="fde63aac-5835-473c-8ba8-932c4f656501" containerName="perses"
Oct 30 03:49:19.979008 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.979004    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="92e26693-3c1a-46ac-9231-733880a713a1" containerName="otc-container"
Oct 30 03:49:19.982144 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.982123    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"
Oct 30 03:49:19.998417 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.998390    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 03:49:19.998789 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:19.998754    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"]
Oct 30 03:49:20.010739 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:20.010710    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 03:49:20.010739 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:20.010710    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 03:49:20.052031 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:20.051991    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kqvt\" (UniqueName: \"kubernetes.io/projected/73297a5b-ce80-4b65-b337-9e0a1eec996f-kube-api-access-5kqvt\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5\" (UID: \"73297a5b-ce80-4b65-b337-9e0a1eec996f\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"
Oct 30 03:49:20.153115 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:20.153085    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kqvt\" (UniqueName: \"kubernetes.io/projected/73297a5b-ce80-4b65-b337-9e0a1eec996f-kube-api-access-5kqvt\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5\" (UID: \"73297a5b-ce80-4b65-b337-9e0a1eec996f\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"
Oct 30 03:49:20.173025 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:20.172998    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kqvt\" (UniqueName: \"kubernetes.io/projected/73297a5b-ce80-4b65-b337-9e0a1eec996f-kube-api-access-5kqvt\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5\" (UID: \"73297a5b-ce80-4b65-b337-9e0a1eec996f\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"
Oct 30 03:49:20.295508 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:20.295432    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"
Oct 30 03:49:20.584101 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:20.584074    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"]
Oct 30 03:49:20.586332 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:49:20.586307    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73297a5b_ce80_4b65_b337_9e0a1eec996f.slice/crio-aa7cc62af2153e884415da2543df9556365a0c5056d18990fcb83be836dc778f WatchSource:0}: Error finding container aa7cc62af2153e884415da2543df9556365a0c5056d18990fcb83be836dc778f: Status 404 returned error can't find the container with id aa7cc62af2153e884415da2543df9556365a0c5056d18990fcb83be836dc778f
Oct 30 03:49:21.040062 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.040027    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:49:21.043534 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.043502    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:21.068491 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.068456    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:49:21.101455 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.101422    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 03:49:21.254492 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.254454    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5" event={"ID":"73297a5b-ce80-4b65-b337-9e0a1eec996f","Type":"ContainerStarted","Data":"632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13"}
Oct 30 03:49:21.254686 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.254508    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5" event={"ID":"73297a5b-ce80-4b65-b337-9e0a1eec996f","Type":"ContainerStarted","Data":"aa7cc62af2153e884415da2543df9556365a0c5056d18990fcb83be836dc778f"}
Oct 30 03:49:21.263652 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.263620    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a10f7a71-ea9c-4635-89af-901fc91f91d6-config\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:21.263780 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.263695    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57xqc\" (UniqueName: \"kubernetes.io/projected/a10f7a71-ea9c-4635-89af-901fc91f91d6-kube-api-access-57xqc\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:21.263840 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.263779    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/a10f7a71-ea9c-4635-89af-901fc91f91d6-plugins\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:21.306642 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.306558    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5" podStartSLOduration=2.306545296 podStartE2EDuration="2.306545296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:49:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:49:21.305670561 +0000 UTC m=+4001.147917017" watchObservedRunningTime="2026-10-30 03:49:21.306545296 +0000 UTC m=+4001.148791736"
Oct 30 03:49:21.353747 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.353709    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"]
Oct 30 03:49:21.357024 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.356997    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:21.364700 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.364674    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a10f7a71-ea9c-4635-89af-901fc91f91d6-config\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:21.364816 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.364762    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57xqc\" (UniqueName: \"kubernetes.io/projected/a10f7a71-ea9c-4635-89af-901fc91f91d6-kube-api-access-57xqc\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:21.364883 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.364828    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/a10f7a71-ea9c-4635-89af-901fc91f91d6-plugins\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:21.365211 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.365187    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/a10f7a71-ea9c-4635-89af-901fc91f91d6-plugins\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:21.365476 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.365456    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a10f7a71-ea9c-4635-89af-901fc91f91d6-config\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:21.383698 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.383672    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"]
Oct 30 03:49:21.387225 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.387198    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 03:49:21.387520 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.387503    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 03:49:21.387520 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.387509    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-jmxzf\""
Oct 30 03:49:21.390626 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.390602    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57xqc\" (UniqueName: \"kubernetes.io/projected/a10f7a71-ea9c-4635-89af-901fc91f91d6-kube-api-access-57xqc\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:21.465847 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.465818    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-ta-internal\") pod \"data-science-collector-targetallocator-779ccc95f5-fnxbw\" (UID: \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:21.465973 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.465864    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-779ccc95f5-fnxbw\" (UID: \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:21.465973 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.465887    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m59x4\" (UniqueName: \"kubernetes.io/projected/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-kube-api-access-m59x4\") pod \"data-science-collector-targetallocator-779ccc95f5-fnxbw\" (UID: \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:21.567221 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.567130    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-ta-internal\") pod \"data-science-collector-targetallocator-779ccc95f5-fnxbw\" (UID: \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:21.567221 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.567187    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-779ccc95f5-fnxbw\" (UID: \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:21.567442 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.567332    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m59x4\" (UniqueName: \"kubernetes.io/projected/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-kube-api-access-m59x4\") pod \"data-science-collector-targetallocator-779ccc95f5-fnxbw\" (UID: \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:21.567914 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.567890    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-ta-internal\") pod \"data-science-collector-targetallocator-779ccc95f5-fnxbw\" (UID: \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:21.569792 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.569774    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-779ccc95f5-fnxbw\" (UID: \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:21.588517 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.588486    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m59x4\" (UniqueName: \"kubernetes.io/projected/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-kube-api-access-m59x4\") pod \"data-science-collector-targetallocator-779ccc95f5-fnxbw\" (UID: \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:21.671599 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.671559    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:21.963875 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.963850    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"]
Oct 30 03:49:21.966185 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:49:21.966158    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5f5d1c5_6817_4f5b_8aec_c6026e42a355.slice/crio-023fdfa3a782ce9eccf3a68d0de288223dd1c055c2d2cc0271cbef4bd066dc8d WatchSource:0}: Error finding container 023fdfa3a782ce9eccf3a68d0de288223dd1c055c2d2cc0271cbef4bd066dc8d: Status 404 returned error can't find the container with id 023fdfa3a782ce9eccf3a68d0de288223dd1c055c2d2cc0271cbef4bd066dc8d
Oct 30 03:49:21.968483 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.968452    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:49:21.968566 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:21.968510    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:49:22.260482 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:22.260381    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw" event={"ID":"f5f5d1c5-6817-4f5b-8aec-c6026e42a355","Type":"ContainerStarted","Data":"1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa"}
Oct 30 03:49:22.260482 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:22.260435    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw" event={"ID":"f5f5d1c5-6817-4f5b-8aec-c6026e42a355","Type":"ContainerStarted","Data":"023fdfa3a782ce9eccf3a68d0de288223dd1c055c2d2cc0271cbef4bd066dc8d"}
Oct 30 03:49:22.301449 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:22.301383    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw" podStartSLOduration=1.301364476 podStartE2EDuration="1.301364476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:49:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:49:22.300904131 +0000 UTC m=+4002.143150577" watchObservedRunningTime="2026-10-30 03:49:22.301364476 +0000 UTC m=+4002.143610922"
Oct 30 03:49:22.777617 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:22.777585    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:22.820567 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:22.820533    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:22.878116 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:22.878081    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:22.878343 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:22.878232    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:22.893158 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:22.893131    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:22.993783 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:22.993752    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:23.024498 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:23.024466    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:23.154605 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:23.154578    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:23.264826 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:23.264791    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:23.266341 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:23.266321    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:23.444803 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:23.444776    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:49:23.447358 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:49:23.447336    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda10f7a71_ea9c_4635_89af_901fc91f91d6.slice/crio-3afdd7ed1b6c0d1e955b94779bd735abc74e8089285c70ff38706a156d02279d WatchSource:0}: Error finding container 3afdd7ed1b6c0d1e955b94779bd735abc74e8089285c70ff38706a156d02279d: Status 404 returned error can't find the container with id 3afdd7ed1b6c0d1e955b94779bd735abc74e8089285c70ff38706a156d02279d
Oct 30 03:49:23.673850 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:23.673806    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"]
Oct 30 03:49:23.679168 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:23.679136    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"
Oct 30 03:49:23.693453 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:23.693428    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"]
Oct 30 03:49:23.785573 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:23.785484    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq9qr\" (UniqueName: \"kubernetes.io/projected/0fc06c46-ad7d-4afe-8cb1-c286058a2cf1-kube-api-access-tq9qr\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6\" (UID: \"0fc06c46-ad7d-4afe-8cb1-c286058a2cf1\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"
Oct 30 03:49:23.886211 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:23.886178    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq9qr\" (UniqueName: \"kubernetes.io/projected/0fc06c46-ad7d-4afe-8cb1-c286058a2cf1-kube-api-access-tq9qr\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6\" (UID: \"0fc06c46-ad7d-4afe-8cb1-c286058a2cf1\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"
Oct 30 03:49:23.907212 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:23.907167    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq9qr\" (UniqueName: \"kubernetes.io/projected/0fc06c46-ad7d-4afe-8cb1-c286058a2cf1-kube-api-access-tq9qr\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6\" (UID: \"0fc06c46-ad7d-4afe-8cb1-c286058a2cf1\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"
Oct 30 03:49:23.993243 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:23.993208    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"
Oct 30 03:49:24.277227 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:24.277193    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"a10f7a71-ea9c-4635-89af-901fc91f91d6","Type":"ContainerStarted","Data":"1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082"}
Oct 30 03:49:24.277723 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:24.277236    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"a10f7a71-ea9c-4635-89af-901fc91f91d6","Type":"ContainerStarted","Data":"3afdd7ed1b6c0d1e955b94779bd735abc74e8089285c70ff38706a156d02279d"}
Oct 30 03:49:24.295264 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:24.295235    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"]
Oct 30 03:49:24.316990 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:24.316925    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=4.316905922 podStartE2EDuration="4.316905922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:49:24.315493256 +0000 UTC m=+4004.157739701" watchObservedRunningTime="2026-10-30 03:49:24.316905922 +0000 UTC m=+4004.159152378"
Oct 30 03:49:25.281118 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:25.281080    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6" event={"ID":"0fc06c46-ad7d-4afe-8cb1-c286058a2cf1","Type":"ContainerStarted","Data":"29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622"}
Oct 30 03:49:25.281118 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:25.281125    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6" event={"ID":"0fc06c46-ad7d-4afe-8cb1-c286058a2cf1","Type":"ContainerStarted","Data":"b9b9e6719acc5368d3b33930e3f5df344bb0db9191da168480fcc96484df0393"}
Oct 30 03:49:25.281615 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:25.281338    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:25.329097 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:25.328426    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6" podStartSLOduration=2.328407189 podStartE2EDuration="2.328407189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:49:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:49:25.327724772 +0000 UTC m=+4005.169971217" watchObservedRunningTime="2026-10-30 03:49:25.328407189 +0000 UTC m=+4005.170653636"
Oct 30 03:49:25.356214 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:25.356178    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"]
Oct 30 03:49:25.356433 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:25.356364    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5" podUID="73297a5b-ce80-4b65-b337-9e0a1eec996f" containerName="thanos-querier" containerID="cri-o://632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13" gracePeriod=30
Oct 30 03:49:25.623731 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:25.623698    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"
Oct 30 03:49:25.704077 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:25.704042    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73297a5b-ce80-4b65-b337-9e0a1eec996f-kube-api-access-5kqvt\" (UniqueName: \"kubernetes.io/projected/73297a5b-ce80-4b65-b337-9e0a1eec996f-kube-api-access-5kqvt\") pod \"73297a5b-ce80-4b65-b337-9e0a1eec996f\" (UID: \"73297a5b-ce80-4b65-b337-9e0a1eec996f\") "
Oct 30 03:49:25.706226 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:25.706199    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73297a5b-ce80-4b65-b337-9e0a1eec996f-kube-api-access-5kqvt" pod "73297a5b-ce80-4b65-b337-9e0a1eec996f" (UID: "73297a5b-ce80-4b65-b337-9e0a1eec996f"). InnerVolumeSpecName "kube-api-access-5kqvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:49:25.805210 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:25.805138    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kqvt\" (UniqueName: \"kubernetes.io/projected/73297a5b-ce80-4b65-b337-9e0a1eec996f-kube-api-access-5kqvt\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:26.285931 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:26.285897    5981 generic.go:356] "Generic (PLEG): container finished" podID="73297a5b-ce80-4b65-b337-9e0a1eec996f" containerID="632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13" exitCode=0
Oct 30 03:49:26.286346 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:26.285947    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"
Oct 30 03:49:26.286346 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:26.285985    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5" event={"ID":"73297a5b-ce80-4b65-b337-9e0a1eec996f","Type":"ContainerDied","Data":"632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13"}
Oct 30 03:49:26.286346 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:26.286027    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5" event={"ID":"73297a5b-ce80-4b65-b337-9e0a1eec996f","Type":"ContainerDied","Data":"aa7cc62af2153e884415da2543df9556365a0c5056d18990fcb83be836dc778f"}
Oct 30 03:49:26.286346 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:26.286044    5981 scope.go:122] "RemoveContainer" containerID="632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13"
Oct 30 03:49:26.295118 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:26.295098    5981 scope.go:122] "RemoveContainer" containerID="632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13"
Oct 30 03:49:26.295408 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:49:26.295389    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13\": container with ID starting with 632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13 not found: ID does not exist" containerID="632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13"
Oct 30 03:49:26.295482 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:26.295421    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13"} err="failed to get container status \"632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13\": rpc error: code = NotFound desc = could not find container \"632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13\": container with ID starting with 632dc30cce2bb2de6ed696941fe4cd861b8b3d6acb6a49c814f1130a64b58c13 not found: ID does not exist"
Oct 30 03:49:26.337114 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:26.337090    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"]
Oct 30 03:49:26.338704 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:26.338684    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-kp6f5"]
Oct 30 03:49:28.274989 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:28.274947    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="73297a5b-ce80-4b65-b337-9e0a1eec996f" path="/var/lib/kubelet/pods/73297a5b-ce80-4b65-b337-9e0a1eec996f/volumes"
Oct 30 03:49:36.288176 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:36.288147    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:49:41.282831 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:41.282797    5981 scope.go:122] "RemoveContainer" containerID="a40350c27587f85c4a30857642ebfc04a33cb0442105f0d3d0548aa1bec2b74a"
Oct 30 03:49:44.368674 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:49:44.368638    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:49:46.960308 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:46.960248    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"]
Oct 30 03:49:46.960730 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:46.960604    5981 cpu_manager.go:414] "containerMap: removing container" podUID="73297a5b-ce80-4b65-b337-9e0a1eec996f" containerName="thanos-querier"
Oct 30 03:49:46.960730 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:46.960618    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73297a5b-ce80-4b65-b337-9e0a1eec996f" containerName="thanos-querier"
Oct 30 03:49:46.963825 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:46.961276    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="73297a5b-ce80-4b65-b337-9e0a1eec996f" containerName="thanos-querier"
Oct 30 03:49:46.965974 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:46.965945    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:46.985540 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:46.985495    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"]
Oct 30 03:49:47.086605 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.086569    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d54b\" (UniqueName: \"kubernetes.io/projected/741bd2f1-b967-4283-b295-44a2861b9c34-kube-api-access-7d54b\") pod \"data-science-collector-targetallocator-6848cf8687-lzz2k\" (UID: \"741bd2f1-b967-4283-b295-44a2861b9c34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:47.086605 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.086617    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/741bd2f1-b967-4283-b295-44a2861b9c34-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6848cf8687-lzz2k\" (UID: \"741bd2f1-b967-4283-b295-44a2861b9c34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:47.086834 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.086647    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/741bd2f1-b967-4283-b295-44a2861b9c34-ta-internal\") pod \"data-science-collector-targetallocator-6848cf8687-lzz2k\" (UID: \"741bd2f1-b967-4283-b295-44a2861b9c34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:47.188009 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.187975    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d54b\" (UniqueName: \"kubernetes.io/projected/741bd2f1-b967-4283-b295-44a2861b9c34-kube-api-access-7d54b\") pod \"data-science-collector-targetallocator-6848cf8687-lzz2k\" (UID: \"741bd2f1-b967-4283-b295-44a2861b9c34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:47.188009 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.188019    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/741bd2f1-b967-4283-b295-44a2861b9c34-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6848cf8687-lzz2k\" (UID: \"741bd2f1-b967-4283-b295-44a2861b9c34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:47.188228 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.188042    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/741bd2f1-b967-4283-b295-44a2861b9c34-ta-internal\") pod \"data-science-collector-targetallocator-6848cf8687-lzz2k\" (UID: \"741bd2f1-b967-4283-b295-44a2861b9c34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:47.188744 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.188688    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/741bd2f1-b967-4283-b295-44a2861b9c34-ta-internal\") pod \"data-science-collector-targetallocator-6848cf8687-lzz2k\" (UID: \"741bd2f1-b967-4283-b295-44a2861b9c34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:47.190829 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.190800    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/741bd2f1-b967-4283-b295-44a2861b9c34-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6848cf8687-lzz2k\" (UID: \"741bd2f1-b967-4283-b295-44a2861b9c34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:47.208337 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.208308    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d54b\" (UniqueName: \"kubernetes.io/projected/741bd2f1-b967-4283-b295-44a2861b9c34-kube-api-access-7d54b\") pod \"data-science-collector-targetallocator-6848cf8687-lzz2k\" (UID: \"741bd2f1-b967-4283-b295-44a2861b9c34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:47.278413 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.278334    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:47.574855 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.574829    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"]
Oct 30 03:49:47.577117 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:49:47.577088    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod741bd2f1_b967_4283_b295_44a2861b9c34.slice/crio-81749fb37b57e1023b48b54bd36f8421926aebfadadccc36cba0bbc9efbb83e2 WatchSource:0}: Error finding container 81749fb37b57e1023b48b54bd36f8421926aebfadadccc36cba0bbc9efbb83e2: Status 404 returned error can't find the container with id 81749fb37b57e1023b48b54bd36f8421926aebfadadccc36cba0bbc9efbb83e2
Oct 30 03:49:47.579505 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.579472    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:49:47.579597 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:47.579528    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:49:48.399651 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.399618    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k" event={"ID":"741bd2f1-b967-4283-b295-44a2861b9c34","Type":"ContainerStarted","Data":"a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2"}
Oct 30 03:49:48.399651 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.399656    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k" event={"ID":"741bd2f1-b967-4283-b295-44a2861b9c34","Type":"ContainerStarted","Data":"81749fb37b57e1023b48b54bd36f8421926aebfadadccc36cba0bbc9efbb83e2"}
Oct 30 03:49:48.400085 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.399778    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:48.401467 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.401446    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:48.439638 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.439582    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k" podStartSLOduration=2.439562016 podStartE2EDuration="2.439562016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:49:48.43883348 +0000 UTC m=+4028.281079936" watchObservedRunningTime="2026-10-30 03:49:48.439562016 +0000 UTC m=+4028.281808456"
Oct 30 03:49:48.507503 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.507473    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"]
Oct 30 03:49:48.507682 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.507652    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw" podUID="f5f5d1c5-6817-4f5b-8aec-c6026e42a355" containerName="ta-container" containerID="cri-o://1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa" gracePeriod=30
Oct 30 03:49:48.755246 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.755220    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:48.903317 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.903259    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-data-science-collector-ta-server-cert\") pod \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\" (UID: \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\") "
Oct 30 03:49:48.903513 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.903384    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-kube-api-access-m59x4\" (UniqueName: \"kubernetes.io/projected/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-kube-api-access-m59x4\") pod \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\" (UID: \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\") "
Oct 30 03:49:48.903513 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.903420    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-ta-internal\" (UniqueName: \"kubernetes.io/configmap/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-ta-internal\") pod \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\" (UID: \"f5f5d1c5-6817-4f5b-8aec-c6026e42a355\") "
Oct 30 03:49:48.903821 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.903797    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-ta-internal" pod "f5f5d1c5-6817-4f5b-8aec-c6026e42a355" (UID: "f5f5d1c5-6817-4f5b-8aec-c6026e42a355"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:49:48.905509 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.905483    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-data-science-collector-ta-server-cert" pod "f5f5d1c5-6817-4f5b-8aec-c6026e42a355" (UID: "f5f5d1c5-6817-4f5b-8aec-c6026e42a355"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:49:48.905604 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:48.905584    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-kube-api-access-m59x4" pod "f5f5d1c5-6817-4f5b-8aec-c6026e42a355" (UID: "f5f5d1c5-6817-4f5b-8aec-c6026e42a355"). InnerVolumeSpecName "kube-api-access-m59x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:49:49.004502 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:49.004424    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m59x4\" (UniqueName: \"kubernetes.io/projected/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-kube-api-access-m59x4\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:49.004502 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:49.004451    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:49.004502 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:49.004461    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f5f5d1c5-6817-4f5b-8aec-c6026e42a355-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:49.405388 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:49.405356    5981 generic.go:356] "Generic (PLEG): container finished" podID="f5f5d1c5-6817-4f5b-8aec-c6026e42a355" containerID="1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa" exitCode=0
Oct 30 03:49:49.405791 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:49.405402    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"
Oct 30 03:49:49.405791 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:49.405437    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw" event={"ID":"f5f5d1c5-6817-4f5b-8aec-c6026e42a355","Type":"ContainerDied","Data":"1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa"}
Oct 30 03:49:49.405791 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:49.405479    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw" event={"ID":"f5f5d1c5-6817-4f5b-8aec-c6026e42a355","Type":"ContainerDied","Data":"023fdfa3a782ce9eccf3a68d0de288223dd1c055c2d2cc0271cbef4bd066dc8d"}
Oct 30 03:49:49.405791 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:49.405495    5981 scope.go:122] "RemoveContainer" containerID="1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa"
Oct 30 03:49:49.415081 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:49.415064    5981 scope.go:122] "RemoveContainer" containerID="1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa"
Oct 30 03:49:49.415364 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:49:49.415344    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa\": container with ID starting with 1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa not found: ID does not exist" containerID="1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa"
Oct 30 03:49:49.415445 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:49.415375    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa"} err="failed to get container status \"1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa\": rpc error: code = NotFound desc = could not find container \"1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa\": container with ID starting with 1bffdc5fde11c43aed9fcd19a70f0cb159e9b596cb19ab834174a8e1bbba32aa not found: ID does not exist"
Oct 30 03:49:49.457112 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:49.457088    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"]
Oct 30 03:49:49.470101 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:49.470071    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-fnxbw"]
Oct 30 03:49:50.276762 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:50.276730    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5f5d1c5-6817-4f5b-8aec-c6026e42a355" path="/var/lib/kubelet/pods/f5f5d1c5-6817-4f5b-8aec-c6026e42a355/volumes"
Oct 30 03:49:52.578413 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.578380    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"]
Oct 30 03:49:52.578787 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.578727    5981 cpu_manager.go:414] "containerMap: removing container" podUID="f5f5d1c5-6817-4f5b-8aec-c6026e42a355" containerName="ta-container"
Oct 30 03:49:52.578787 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.578739    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5f5d1c5-6817-4f5b-8aec-c6026e42a355" containerName="ta-container"
Oct 30 03:49:52.578856 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.578796    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5f5d1c5-6817-4f5b-8aec-c6026e42a355" containerName="ta-container"
Oct 30 03:49:52.583066 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.583046    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:52.599006 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.598978    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"]
Oct 30 03:49:52.633696 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.633667    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-779ccc95f5-b5tjb\" (UID: \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:52.633916 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.633894    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-ta-internal\") pod \"data-science-collector-targetallocator-779ccc95f5-b5tjb\" (UID: \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:52.633982 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.633971    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxrkl\" (UniqueName: \"kubernetes.io/projected/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-kube-api-access-vxrkl\") pod \"data-science-collector-targetallocator-779ccc95f5-b5tjb\" (UID: \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:52.734516 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.734482    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxrkl\" (UniqueName: \"kubernetes.io/projected/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-kube-api-access-vxrkl\") pod \"data-science-collector-targetallocator-779ccc95f5-b5tjb\" (UID: \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:52.734715 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.734539    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-779ccc95f5-b5tjb\" (UID: \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:52.734715 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.734595    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-ta-internal\") pod \"data-science-collector-targetallocator-779ccc95f5-b5tjb\" (UID: \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:52.735276 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.735251    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-ta-internal\") pod \"data-science-collector-targetallocator-779ccc95f5-b5tjb\" (UID: \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:52.737145 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.737123    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-779ccc95f5-b5tjb\" (UID: \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:52.755055 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.755031    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxrkl\" (UniqueName: \"kubernetes.io/projected/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-kube-api-access-vxrkl\") pod \"data-science-collector-targetallocator-779ccc95f5-b5tjb\" (UID: \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:52.894777 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:52.894693    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:53.187848 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:53.187822    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"]
Oct 30 03:49:53.189532 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:49:53.189500    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dab0b19_5da7_4f30_8f18_d9be4ffe70e0.slice/crio-744a59d6cfd5da91a25f1012e26ef35557e5f4c32d34d48396b72a187eb02d61 WatchSource:0}: Error finding container 744a59d6cfd5da91a25f1012e26ef35557e5f4c32d34d48396b72a187eb02d61: Status 404 returned error can't find the container with id 744a59d6cfd5da91a25f1012e26ef35557e5f4c32d34d48396b72a187eb02d61
Oct 30 03:49:53.191696 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:53.191657    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:49:53.191800 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:53.191735    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 03:49:53.424760 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:53.424727    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb" event={"ID":"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0","Type":"ContainerStarted","Data":"997bd331f93ce5a1558cada611db0b77e0841f2c19bdc5440f2ecbc58c6fab52"}
Oct 30 03:49:53.424957 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:53.424771    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb" event={"ID":"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0","Type":"ContainerStarted","Data":"744a59d6cfd5da91a25f1012e26ef35557e5f4c32d34d48396b72a187eb02d61"}
Oct 30 03:49:53.424957 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:53.424904    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:53.426004 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:53.425978    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb" podUID="3dab0b19-5da7-4f30-8f18-d9be4ffe70e0" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.126:8080/readyz\": dial tcp 10.134.0.126:8080: connect: connection refused"
Oct 30 03:49:53.465624 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:53.465528    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb" podStartSLOduration=1.465516479 podStartE2EDuration="1.465516479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:49:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:49:53.464843751 +0000 UTC m=+4033.307090215" watchObservedRunningTime="2026-10-30 03:49:53.465516479 +0000 UTC m=+4033.307762925"
Oct 30 03:49:54.430635 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.430604    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:49:54.501309 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.501257    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"]
Oct 30 03:49:54.501468 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.501431    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k" podUID="741bd2f1-b967-4283-b295-44a2861b9c34" containerName="ta-container" containerID="cri-o://a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2" gracePeriod=30
Oct 30 03:49:54.740572 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.740547    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:54.750657 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.750635    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/741bd2f1-b967-4283-b295-44a2861b9c34-ta-internal\" (UniqueName: \"kubernetes.io/configmap/741bd2f1-b967-4283-b295-44a2861b9c34-ta-internal\") pod \"741bd2f1-b967-4283-b295-44a2861b9c34\" (UID: \"741bd2f1-b967-4283-b295-44a2861b9c34\") "
Oct 30 03:49:54.750716 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.750666    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/741bd2f1-b967-4283-b295-44a2861b9c34-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/741bd2f1-b967-4283-b295-44a2861b9c34-data-science-collector-ta-server-cert\") pod \"741bd2f1-b967-4283-b295-44a2861b9c34\" (UID: \"741bd2f1-b967-4283-b295-44a2861b9c34\") "
Oct 30 03:49:54.750716 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.750693    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/741bd2f1-b967-4283-b295-44a2861b9c34-kube-api-access-7d54b\" (UniqueName: \"kubernetes.io/projected/741bd2f1-b967-4283-b295-44a2861b9c34-kube-api-access-7d54b\") pod \"741bd2f1-b967-4283-b295-44a2861b9c34\" (UID: \"741bd2f1-b967-4283-b295-44a2861b9c34\") "
Oct 30 03:49:54.750996 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.750967    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741bd2f1-b967-4283-b295-44a2861b9c34-ta-internal" pod "741bd2f1-b967-4283-b295-44a2861b9c34" (UID: "741bd2f1-b967-4283-b295-44a2861b9c34"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:49:54.752864 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.752834    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741bd2f1-b967-4283-b295-44a2861b9c34-data-science-collector-ta-server-cert" pod "741bd2f1-b967-4283-b295-44a2861b9c34" (UID: "741bd2f1-b967-4283-b295-44a2861b9c34"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:49:54.752933 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.752884    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741bd2f1-b967-4283-b295-44a2861b9c34-kube-api-access-7d54b" pod "741bd2f1-b967-4283-b295-44a2861b9c34" (UID: "741bd2f1-b967-4283-b295-44a2861b9c34"). InnerVolumeSpecName "kube-api-access-7d54b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:49:54.852224 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.852194    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/741bd2f1-b967-4283-b295-44a2861b9c34-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:54.852224 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.852221    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/741bd2f1-b967-4283-b295-44a2861b9c34-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:54.852429 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:54.852232    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d54b\" (UniqueName: \"kubernetes.io/projected/741bd2f1-b967-4283-b295-44a2861b9c34-kube-api-access-7d54b\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:49:55.434905 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:55.434871    5981 generic.go:356] "Generic (PLEG): container finished" podID="741bd2f1-b967-4283-b295-44a2861b9c34" containerID="a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2" exitCode=0
Oct 30 03:49:55.435354 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:55.434916    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"
Oct 30 03:49:55.435354 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:55.434963    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k" event={"ID":"741bd2f1-b967-4283-b295-44a2861b9c34","Type":"ContainerDied","Data":"a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2"}
Oct 30 03:49:55.435354 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:55.435007    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k" event={"ID":"741bd2f1-b967-4283-b295-44a2861b9c34","Type":"ContainerDied","Data":"81749fb37b57e1023b48b54bd36f8421926aebfadadccc36cba0bbc9efbb83e2"}
Oct 30 03:49:55.435354 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:55.435028    5981 scope.go:122] "RemoveContainer" containerID="a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2"
Oct 30 03:49:55.444400 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:55.444383    5981 scope.go:122] "RemoveContainer" containerID="a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2"
Oct 30 03:49:55.444664 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:49:55.444645    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2\": container with ID starting with a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2 not found: ID does not exist" containerID="a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2"
Oct 30 03:49:55.444717 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:55.444672    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2"} err="failed to get container status \"a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2\": rpc error: code = NotFound desc = could not find container \"a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2\": container with ID starting with a2161ea9031791bfa4cb3a225760a57569f071180b30b4d7deb34ba89610d6e2 not found: ID does not exist"
Oct 30 03:49:55.485760 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:55.485728    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"]
Oct 30 03:49:55.498685 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:55.498660    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6848cf8687-lzz2k"]
Oct 30 03:49:56.274603 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:49:56.274571    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="741bd2f1-b967-4283-b295-44a2861b9c34" path="/var/lib/kubelet/pods/741bd2f1-b967-4283-b295-44a2861b9c34/volumes"
Oct 30 03:50:14.368873 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:50:14.368834    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:50:36.601240 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:36.601164    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"]
Oct 30 03:50:36.601656 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:36.601407    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6" podUID="0fc06c46-ad7d-4afe-8cb1-c286058a2cf1" containerName="thanos-querier" containerID="cri-o://29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622" gracePeriod=30
Oct 30 03:50:36.859750 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:36.859688    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"
Oct 30 03:50:36.919259 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:36.919226    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0fc06c46-ad7d-4afe-8cb1-c286058a2cf1-kube-api-access-tq9qr\" (UniqueName: \"kubernetes.io/projected/0fc06c46-ad7d-4afe-8cb1-c286058a2cf1-kube-api-access-tq9qr\") pod \"0fc06c46-ad7d-4afe-8cb1-c286058a2cf1\" (UID: \"0fc06c46-ad7d-4afe-8cb1-c286058a2cf1\") "
Oct 30 03:50:36.921660 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:36.921634    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fc06c46-ad7d-4afe-8cb1-c286058a2cf1-kube-api-access-tq9qr" pod "0fc06c46-ad7d-4afe-8cb1-c286058a2cf1" (UID: "0fc06c46-ad7d-4afe-8cb1-c286058a2cf1"). InnerVolumeSpecName "kube-api-access-tq9qr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:50:37.020941 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.020903    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq9qr\" (UniqueName: \"kubernetes.io/projected/0fc06c46-ad7d-4afe-8cb1-c286058a2cf1-kube-api-access-tq9qr\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:50:37.475402 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.475366    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"]
Oct 30 03:50:37.475642 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.475611    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb" podUID="3dab0b19-5da7-4f30-8f18-d9be4ffe70e0" containerName="ta-container" containerID="cri-o://997bd331f93ce5a1558cada611db0b77e0841f2c19bdc5440f2ecbc58c6fab52" gracePeriod=30
Oct 30 03:50:37.585877 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.585836    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:50:37.586067 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.586039    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="a10f7a71-ea9c-4635-89af-901fc91f91d6" containerName="perses" containerID="cri-o://1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082" gracePeriod=30
Oct 30 03:50:37.630228 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.630195    5981 generic.go:356] "Generic (PLEG): container finished" podID="0fc06c46-ad7d-4afe-8cb1-c286058a2cf1" containerID="29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622" exitCode=0
Oct 30 03:50:37.630749 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.630271    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"
Oct 30 03:50:37.630749 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.630342    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6" event={"ID":"0fc06c46-ad7d-4afe-8cb1-c286058a2cf1","Type":"ContainerDied","Data":"29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622"}
Oct 30 03:50:37.630749 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.630395    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6" event={"ID":"0fc06c46-ad7d-4afe-8cb1-c286058a2cf1","Type":"ContainerDied","Data":"b9b9e6719acc5368d3b33930e3f5df344bb0db9191da168480fcc96484df0393"}
Oct 30 03:50:37.630749 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.630414    5981 scope.go:122] "RemoveContainer" containerID="29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622"
Oct 30 03:50:37.632194 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.632168    5981 generic.go:356] "Generic (PLEG): container finished" podID="3dab0b19-5da7-4f30-8f18-d9be4ffe70e0" containerID="997bd331f93ce5a1558cada611db0b77e0841f2c19bdc5440f2ecbc58c6fab52" exitCode=0
Oct 30 03:50:37.632334 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.632193    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb" event={"ID":"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0","Type":"ContainerDied","Data":"997bd331f93ce5a1558cada611db0b77e0841f2c19bdc5440f2ecbc58c6fab52"}
Oct 30 03:50:37.690856 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.690827    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"]
Oct 30 03:50:37.698068 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.698040    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-shdv6"]
Oct 30 03:50:37.698601 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.698581    5981 scope.go:122] "RemoveContainer" containerID="29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622"
Oct 30 03:50:37.699011 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:50:37.698985    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622\": container with ID starting with 29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622 not found: ID does not exist" containerID="29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622"
Oct 30 03:50:37.699121 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.699024    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622"} err="failed to get container status \"29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622\": rpc error: code = NotFound desc = could not find container \"29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622\": container with ID starting with 29334f5fa93a2ae7c9184578248b0064fd29f4a91c86a8741f9da256fba7a622 not found: ID does not exist"
Oct 30 03:50:37.728540 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.728478    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:50:37.827855 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.827825    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-data-science-collector-ta-server-cert\") pod \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\" (UID: \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\") "
Oct 30 03:50:37.828000 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.827869    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-kube-api-access-vxrkl\" (UniqueName: \"kubernetes.io/projected/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-kube-api-access-vxrkl\") pod \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\" (UID: \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\") "
Oct 30 03:50:37.828000 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.827923    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-ta-internal\" (UniqueName: \"kubernetes.io/configmap/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-ta-internal\") pod \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\" (UID: \"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0\") "
Oct 30 03:50:37.828351 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.828324    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-ta-internal" pod "3dab0b19-5da7-4f30-8f18-d9be4ffe70e0" (UID: "3dab0b19-5da7-4f30-8f18-d9be4ffe70e0"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:50:37.830135 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.830108    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-data-science-collector-ta-server-cert" pod "3dab0b19-5da7-4f30-8f18-d9be4ffe70e0" (UID: "3dab0b19-5da7-4f30-8f18-d9be4ffe70e0"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 03:50:37.830244 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.830220    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-kube-api-access-vxrkl" pod "3dab0b19-5da7-4f30-8f18-d9be4ffe70e0" (UID: "3dab0b19-5da7-4f30-8f18-d9be4ffe70e0"). InnerVolumeSpecName "kube-api-access-vxrkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:50:37.843027 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.843004    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:50:37.928869 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.928838    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"a10f7a71-ea9c-4635-89af-901fc91f91d6\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") "
Oct 30 03:50:37.929036 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.928899    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a10f7a71-ea9c-4635-89af-901fc91f91d6-plugins\" (UniqueName: \"kubernetes.io/empty-dir/a10f7a71-ea9c-4635-89af-901fc91f91d6-plugins\") pod \"a10f7a71-ea9c-4635-89af-901fc91f91d6\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") "
Oct 30 03:50:37.929036 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.928944    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a10f7a71-ea9c-4635-89af-901fc91f91d6-kube-api-access-57xqc\" (UniqueName: \"kubernetes.io/projected/a10f7a71-ea9c-4635-89af-901fc91f91d6-kube-api-access-57xqc\") pod \"a10f7a71-ea9c-4635-89af-901fc91f91d6\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") "
Oct 30 03:50:37.929036 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.929025    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a10f7a71-ea9c-4635-89af-901fc91f91d6-config\" (UniqueName: \"kubernetes.io/configmap/a10f7a71-ea9c-4635-89af-901fc91f91d6-config\") pod \"a10f7a71-ea9c-4635-89af-901fc91f91d6\" (UID: \"a10f7a71-ea9c-4635-89af-901fc91f91d6\") "
Oct 30 03:50:37.929301 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.929252    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:50:37.929497 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.929276    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxrkl\" (UniqueName: \"kubernetes.io/projected/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-kube-api-access-vxrkl\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:50:37.929497 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.929323    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:50:37.929497 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.929460    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a10f7a71-ea9c-4635-89af-901fc91f91d6-config" pod "a10f7a71-ea9c-4635-89af-901fc91f91d6" (UID: "a10f7a71-ea9c-4635-89af-901fc91f91d6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 03:50:37.931391 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.931364    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a10f7a71-ea9c-4635-89af-901fc91f91d6-kube-api-access-57xqc" pod "a10f7a71-ea9c-4635-89af-901fc91f91d6" (UID: "a10f7a71-ea9c-4635-89af-901fc91f91d6"). InnerVolumeSpecName "kube-api-access-57xqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:50:37.931726 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:37.931706    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "a10f7a71-ea9c-4635-89af-901fc91f91d6" (UID: "a10f7a71-ea9c-4635-89af-901fc91f91d6"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 03:50:38.030667 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.030590    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57xqc\" (UniqueName: \"kubernetes.io/projected/a10f7a71-ea9c-4635-89af-901fc91f91d6-kube-api-access-57xqc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:50:38.030667 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.030620    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a10f7a71-ea9c-4635-89af-901fc91f91d6-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:50:38.030667 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.030649    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 03:50:38.044086 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.044063    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 03:50:38.077736 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.077703    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a10f7a71-ea9c-4635-89af-901fc91f91d6-plugins" pod "a10f7a71-ea9c-4635-89af-901fc91f91d6" (UID: "a10f7a71-ea9c-4635-89af-901fc91f91d6"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 03:50:38.131131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.131103    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 03:50:38.131131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.131126    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/a10f7a71-ea9c-4635-89af-901fc91f91d6-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:50:38.274225 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.274195    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0fc06c46-ad7d-4afe-8cb1-c286058a2cf1" path="/var/lib/kubelet/pods/0fc06c46-ad7d-4afe-8cb1-c286058a2cf1/volumes"
Oct 30 03:50:38.637889 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.637808    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"
Oct 30 03:50:38.637889 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.637808    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb" event={"ID":"3dab0b19-5da7-4f30-8f18-d9be4ffe70e0","Type":"ContainerDied","Data":"744a59d6cfd5da91a25f1012e26ef35557e5f4c32d34d48396b72a187eb02d61"}
Oct 30 03:50:38.638409 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.637924    5981 scope.go:122] "RemoveContainer" containerID="997bd331f93ce5a1558cada611db0b77e0841f2c19bdc5440f2ecbc58c6fab52"
Oct 30 03:50:38.639489 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.639361    5981 generic.go:356] "Generic (PLEG): container finished" podID="a10f7a71-ea9c-4635-89af-901fc91f91d6" containerID="1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082" exitCode=0
Oct 30 03:50:38.639489 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.639417    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 03:50:38.639489 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.639449    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"a10f7a71-ea9c-4635-89af-901fc91f91d6","Type":"ContainerDied","Data":"1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082"}
Oct 30 03:50:38.639489 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.639487    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"a10f7a71-ea9c-4635-89af-901fc91f91d6","Type":"ContainerDied","Data":"3afdd7ed1b6c0d1e955b94779bd735abc74e8089285c70ff38706a156d02279d"}
Oct 30 03:50:38.647278 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.647244    5981 scope.go:122] "RemoveContainer" containerID="1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082"
Oct 30 03:50:38.655144 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.655125    5981 scope.go:122] "RemoveContainer" containerID="1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082"
Oct 30 03:50:38.655441 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:50:38.655424    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082\": container with ID starting with 1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082 not found: ID does not exist" containerID="1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082"
Oct 30 03:50:38.655495 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.655449    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082"} err="failed to get container status \"1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082\": rpc error: code = NotFound desc = could not find container \"1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082\": container with ID starting with 1aadd4f2b10a7bb584fce9230bddb402b3a1a7df4640807980694614c854d082 not found: ID does not exist"
Oct 30 03:50:38.690058 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.690036    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:50:38.693858 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.693838    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 03:50:38.728200 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.728165    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"]
Oct 30 03:50:38.729891 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:38.729871    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-779ccc95f5-b5tjb"]
Oct 30 03:50:39.867312 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867262    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 03:50:39.867692 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867628    5981 cpu_manager.go:414] "containerMap: removing container" podUID="3dab0b19-5da7-4f30-8f18-d9be4ffe70e0" containerName="ta-container"
Oct 30 03:50:39.867692 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867641    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3dab0b19-5da7-4f30-8f18-d9be4ffe70e0" containerName="ta-container"
Oct 30 03:50:39.867692 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867654    5981 cpu_manager.go:414] "containerMap: removing container" podUID="0fc06c46-ad7d-4afe-8cb1-c286058a2cf1" containerName="thanos-querier"
Oct 30 03:50:39.867692 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867659    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0fc06c46-ad7d-4afe-8cb1-c286058a2cf1" containerName="thanos-querier"
Oct 30 03:50:39.867692 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867677    5981 cpu_manager.go:414] "containerMap: removing container" podUID="a10f7a71-ea9c-4635-89af-901fc91f91d6" containerName="perses"
Oct 30 03:50:39.867692 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867682    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a10f7a71-ea9c-4635-89af-901fc91f91d6" containerName="perses"
Oct 30 03:50:39.867692 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867691    5981 cpu_manager.go:414] "containerMap: removing container" podUID="741bd2f1-b967-4283-b295-44a2861b9c34" containerName="ta-container"
Oct 30 03:50:39.867904 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867696    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="741bd2f1-b967-4283-b295-44a2861b9c34" containerName="ta-container"
Oct 30 03:50:39.867904 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867748    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="a10f7a71-ea9c-4635-89af-901fc91f91d6" containerName="perses"
Oct 30 03:50:39.867904 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867755    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="741bd2f1-b967-4283-b295-44a2861b9c34" containerName="ta-container"
Oct 30 03:50:39.867904 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867764    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="3dab0b19-5da7-4f30-8f18-d9be4ffe70e0" containerName="ta-container"
Oct 30 03:50:39.867904 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.867771    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="0fc06c46-ad7d-4afe-8cb1-c286058a2cf1" containerName="thanos-querier"
Oct 30 03:50:39.892798 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.892768    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 03:50:39.892981 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.892865    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:50:39.908490 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.908460    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 03:50:39.908657 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.908554    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 03:50:39.921517 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.921496    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 03:50:39.948222 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.948196    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9f6855eb-e461-4674-a574-7ae6457d0af9-data\") pod \"seaweedfs\" (UID: \"9f6855eb-e461-4674-a574-7ae6457d0af9\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:50:39.948388 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:39.948235    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9bfl\" (UniqueName: \"kubernetes.io/projected/9f6855eb-e461-4674-a574-7ae6457d0af9-kube-api-access-s9bfl\") pod \"seaweedfs\" (UID: \"9f6855eb-e461-4674-a574-7ae6457d0af9\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:50:40.048615 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:40.048577    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9f6855eb-e461-4674-a574-7ae6457d0af9-data\") pod \"seaweedfs\" (UID: \"9f6855eb-e461-4674-a574-7ae6457d0af9\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:50:40.048615 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:40.048621    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9bfl\" (UniqueName: \"kubernetes.io/projected/9f6855eb-e461-4674-a574-7ae6457d0af9-kube-api-access-s9bfl\") pod \"seaweedfs\" (UID: \"9f6855eb-e461-4674-a574-7ae6457d0af9\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:50:40.048948 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:40.048924    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9f6855eb-e461-4674-a574-7ae6457d0af9-data\") pod \"seaweedfs\" (UID: \"9f6855eb-e461-4674-a574-7ae6457d0af9\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:50:40.068892 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:40.068868    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9bfl\" (UniqueName: \"kubernetes.io/projected/9f6855eb-e461-4674-a574-7ae6457d0af9-kube-api-access-s9bfl\") pod \"seaweedfs\" (UID: \"9f6855eb-e461-4674-a574-7ae6457d0af9\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:50:40.207014 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:40.206980    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:50:40.280517 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:40.280483    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3dab0b19-5da7-4f30-8f18-d9be4ffe70e0" path="/var/lib/kubelet/pods/3dab0b19-5da7-4f30-8f18-d9be4ffe70e0/volumes"
Oct 30 03:50:40.280915 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:40.280899    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a10f7a71-ea9c-4635-89af-901fc91f91d6" path="/var/lib/kubelet/pods/a10f7a71-ea9c-4635-89af-901fc91f91d6/volumes"
Oct 30 03:50:40.496149 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:40.496121    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 03:50:40.498832 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:50:40.498803    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f6855eb_e461_4674_a574_7ae6457d0af9.slice/crio-8d1e74d37602d57cef8f9eb6b92a08cfc1ffe086fc5fcfe907f1e6ebca219a7c WatchSource:0}: Error finding container 8d1e74d37602d57cef8f9eb6b92a08cfc1ffe086fc5fcfe907f1e6ebca219a7c: Status 404 returned error can't find the container with id 8d1e74d37602d57cef8f9eb6b92a08cfc1ffe086fc5fcfe907f1e6ebca219a7c
Oct 30 03:50:40.657987 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:40.657941    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"9f6855eb-e461-4674-a574-7ae6457d0af9","Type":"ContainerStarted","Data":"3f286a3b43c3e04706541919c0be19bc9fa97414046bedf48f617316c3432771"}
Oct 30 03:50:40.658156 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:40.657994    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"9f6855eb-e461-4674-a574-7ae6457d0af9","Type":"ContainerStarted","Data":"8d1e74d37602d57cef8f9eb6b92a08cfc1ffe086fc5fcfe907f1e6ebca219a7c"}
Oct 30 03:50:40.658156 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:40.658038    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:50:40.696484 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:40.696393    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/seaweedfs" podStartSLOduration=1.696377956 podStartE2EDuration="1.696377956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:50:40.695763018 +0000 UTC m=+4080.538009463" watchObservedRunningTime="2026-10-30 03:50:40.696377956 +0000 UTC m=+4080.538624402"
Oct 30 03:50:44.368903 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:50:44.368869    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:50:51.664645 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:51.664616    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 03:50:52.060881 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:52.060801    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 03:50:52.064051 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:52.064034    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:50:52.077759 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:52.077734    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 03:50:52.156517 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:52.156489    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b2ks\" (UniqueName: \"kubernetes.io/projected/a9850e21-692a-482e-a4e7-a41f44932f2e-kube-api-access-8b2ks\") pod \"seaweedfs-bucket-creator\" (UID: \"a9850e21-692a-482e-a4e7-a41f44932f2e\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:50:52.257778 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:52.257738    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b2ks\" (UniqueName: \"kubernetes.io/projected/a9850e21-692a-482e-a4e7-a41f44932f2e-kube-api-access-8b2ks\") pod \"seaweedfs-bucket-creator\" (UID: \"a9850e21-692a-482e-a4e7-a41f44932f2e\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:50:52.279494 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:52.279469    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b2ks\" (UniqueName: \"kubernetes.io/projected/a9850e21-692a-482e-a4e7-a41f44932f2e-kube-api-access-8b2ks\") pod \"seaweedfs-bucket-creator\" (UID: \"a9850e21-692a-482e-a4e7-a41f44932f2e\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:50:52.379119 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:52.379052    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:50:52.668105 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:52.667960    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 03:50:52.670510 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:50:52.670481    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9850e21_692a_482e_a4e7_a41f44932f2e.slice/crio-bfdfb09d6cda0e0e22f7baae80c21f62815c742cb276a50c115b2418aef5f465 WatchSource:0}: Error finding container bfdfb09d6cda0e0e22f7baae80c21f62815c742cb276a50c115b2418aef5f465: Status 404 returned error can't find the container with id bfdfb09d6cda0e0e22f7baae80c21f62815c742cb276a50c115b2418aef5f465
Oct 30 03:50:52.706309 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:52.706260    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"a9850e21-692a-482e-a4e7-a41f44932f2e","Type":"ContainerStarted","Data":"bfdfb09d6cda0e0e22f7baae80c21f62815c742cb276a50c115b2418aef5f465"}
Oct 30 03:50:53.711935 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:53.711899    5981 generic.go:356] "Generic (PLEG): container finished" podID="a9850e21-692a-482e-a4e7-a41f44932f2e" containerID="d4968c44c3ac19e5b47af343d085ab381c22fbf5e90c492d76729ddada0eabbb" exitCode=0
Oct 30 03:50:53.712351 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:53.711980    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"a9850e21-692a-482e-a4e7-a41f44932f2e","Type":"ContainerDied","Data":"d4968c44c3ac19e5b47af343d085ab381c22fbf5e90c492d76729ddada0eabbb"}
Oct 30 03:50:54.841452 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:54.841423    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:50:54.981785 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:54.981696    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a9850e21-692a-482e-a4e7-a41f44932f2e-kube-api-access-8b2ks\" (UniqueName: \"kubernetes.io/projected/a9850e21-692a-482e-a4e7-a41f44932f2e-kube-api-access-8b2ks\") pod \"a9850e21-692a-482e-a4e7-a41f44932f2e\" (UID: \"a9850e21-692a-482e-a4e7-a41f44932f2e\") "
Oct 30 03:50:54.983729 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:54.983709    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9850e21-692a-482e-a4e7-a41f44932f2e-kube-api-access-8b2ks" pod "a9850e21-692a-482e-a4e7-a41f44932f2e" (UID: "a9850e21-692a-482e-a4e7-a41f44932f2e"). InnerVolumeSpecName "kube-api-access-8b2ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 03:50:55.082858 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:55.082823    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b2ks\" (UniqueName: \"kubernetes.io/projected/a9850e21-692a-482e-a4e7-a41f44932f2e-kube-api-access-8b2ks\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 03:50:55.721780 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:55.721750    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 03:50:55.721780 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:55.721768    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"a9850e21-692a-482e-a4e7-a41f44932f2e","Type":"ContainerDied","Data":"bfdfb09d6cda0e0e22f7baae80c21f62815c742cb276a50c115b2418aef5f465"}
Oct 30 03:50:55.721990 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:55.721804    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfdfb09d6cda0e0e22f7baae80c21f62815c742cb276a50c115b2418aef5f465"
Oct 30 03:50:59.602875 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.602840    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"]
Oct 30 03:50:59.603265 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.603250    5981 cpu_manager.go:414] "containerMap: removing container" podUID="a9850e21-692a-482e-a4e7-a41f44932f2e" containerName="create-bucket"
Oct 30 03:50:59.603346 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.603267    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9850e21-692a-482e-a4e7-a41f44932f2e" containerName="create-bucket"
Oct 30 03:50:59.603388 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.603355    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9850e21-692a-482e-a4e7-a41f44932f2e" containerName="create-bucket"
Oct 30 03:50:59.606398 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.606375    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.624928 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.624857    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-config\""
Oct 30 03:50:59.638128 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.638106    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-distributor-grpc\""
Oct 30 03:50:59.638263 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.638167    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-distributor-http\""
Oct 30 03:50:59.638263 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.638242    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-dockercfg-ssglj\""
Oct 30 03:50:59.639002 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.638982    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"]
Oct 30 03:50:59.722728 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.722696    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-config\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.722728 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.722732    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-grpc\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.723013 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.722812    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.723013 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.722842    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-http\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.723013 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.722958    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trcsh\" (UniqueName: \"kubernetes.io/projected/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-kube-api-access-trcsh\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.725233 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.725219    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ca-bundle\""
Oct 30 03:50:59.824237 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.824209    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trcsh\" (UniqueName: \"kubernetes.io/projected/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-kube-api-access-trcsh\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.824440 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.824254    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-config\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.824440 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.824274    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-grpc\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.824440 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.824386    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.824440 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.824412    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-http\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.825027 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.824998    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-config\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.825141 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.825045    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.826850 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.826822    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-grpc\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.826850 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.826845    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-http\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.844582 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.844561    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trcsh\" (UniqueName: \"kubernetes.io/projected/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-kube-api-access-trcsh\") pod \"data-science-lokistack-distributor-58947679b7-2vwkw\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:50:59.877984 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.877931    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"]
Oct 30 03:50:59.881578 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.881558    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:50:59.900408 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.900379    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-querier-grpc\""
Oct 30 03:50:59.900408 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.900398    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"]
Oct 30 03:50:59.900634 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.900384    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"test-loki-shared-secret\""
Oct 30 03:50:59.900634 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.900391    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-querier-http\""
Oct 30 03:50:59.921029 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:50:59.921007    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:51:00.026100 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.026069    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.026252 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.026119    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtw2c\" (UniqueName: \"kubernetes.io/projected/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-kube-api-access-wtw2c\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.026252 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.026199    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.026252 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.026237    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.026454 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.026368    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-config\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.026454 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.026413    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-test-loki-shared-secret\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.057159 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.057126    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"]
Oct 30 03:51:00.060824 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.060799    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.080192 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.080164    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"]
Oct 30 03:51:00.100081 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.100052    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-query-frontend-grpc\""
Oct 30 03:51:00.100081 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.100065    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-query-frontend-http\""
Oct 30 03:51:00.127302 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.127258    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.127423 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.127357    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-config\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.127464 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.127420    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-test-loki-shared-secret\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.127554 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.127533    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.127616 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.127579    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-config\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.127774 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.127755    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtw2c\" (UniqueName: \"kubernetes.io/projected/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-kube-api-access-wtw2c\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.127848 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.127795    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.127848 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.127839    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmcd5\" (UniqueName: \"kubernetes.io/projected/2d1c78bb-acd7-4895-976a-c0352eb65287-kube-api-access-gmcd5\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.127958 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.127871    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.127958 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.127915    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.127958 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.127951    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.128300 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.128225    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-config\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.128300 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.128258    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.130591 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.130562    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-test-loki-shared-secret\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.130684 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.130618    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.130965 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.130950    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.152236 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.152209    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtw2c\" (UniqueName: \"kubernetes.io/projected/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-kube-api-access-wtw2c\") pod \"data-science-lokistack-querier-84985db556-znrd7\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.194405 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.194381    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:00.216823 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.216799    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"]
Oct 30 03:51:00.217716 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:51:00.217686    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2eeec2d_f433_4e6a_88c8_e51e9e581a19.slice/crio-8ea293448b0f677ccb6d9dd785ea452f578d6dd855856bf1f4fb4008c2761887 WatchSource:0}: Error finding container 8ea293448b0f677ccb6d9dd785ea452f578d6dd855856bf1f4fb4008c2761887: Status 404 returned error can't find the container with id 8ea293448b0f677ccb6d9dd785ea452f578d6dd855856bf1f4fb4008c2761887
Oct 30 03:51:00.219938 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.219918    5981 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 03:51:00.228512 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.228489    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.228608 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.228538    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.228671 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.228629    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-config\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.228729 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.228666    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.228729 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.228699    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmcd5\" (UniqueName: \"kubernetes.io/projected/2d1c78bb-acd7-4895-976a-c0352eb65287-kube-api-access-gmcd5\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.229273 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.229248    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.229533 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.229507    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-config\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.232334 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.231457    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.239889 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.231530    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.255272 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.255241    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmcd5\" (UniqueName: \"kubernetes.io/projected/2d1c78bb-acd7-4895-976a-c0352eb65287-kube-api-access-gmcd5\") pod \"data-science-lokistack-query-frontend-f746fc66d-599ch\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.373465 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.373430    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:00.494565 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.494539    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"]
Oct 30 03:51:00.496652 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:51:00.496622    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafbed4d_54a9_4aa3_a3a8_e2c9c2446d77.slice/crio-92f933fcc9e598786e57e9b5cdd8d240adf780772d7e0cf59c59f63c602902e8 WatchSource:0}: Error finding container 92f933fcc9e598786e57e9b5cdd8d240adf780772d7e0cf59c59f63c602902e8: Status 404 returned error can't find the container with id 92f933fcc9e598786e57e9b5cdd8d240adf780772d7e0cf59c59f63c602902e8
Oct 30 03:51:00.665926 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.665897    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"]
Oct 30 03:51:00.667441 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:51:00.667414    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1c78bb_acd7_4895_976a_c0352eb65287.slice/crio-3f958f0f301c85988041e5f198c554ffa3675301183c668de9fef2c5f3b83078 WatchSource:0}: Error finding container 3f958f0f301c85988041e5f198c554ffa3675301183c668de9fef2c5f3b83078: Status 404 returned error can't find the container with id 3f958f0f301c85988041e5f198c554ffa3675301183c668de9fef2c5f3b83078
Oct 30 03:51:00.744605 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.744572    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw" event={"ID":"d2eeec2d-f433-4e6a-88c8-e51e9e581a19","Type":"ContainerStarted","Data":"8ea293448b0f677ccb6d9dd785ea452f578d6dd855856bf1f4fb4008c2761887"}
Oct 30 03:51:00.745868 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.745844    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch" event={"ID":"2d1c78bb-acd7-4895-976a-c0352eb65287","Type":"ContainerStarted","Data":"3f958f0f301c85988041e5f198c554ffa3675301183c668de9fef2c5f3b83078"}
Oct 30 03:51:00.747089 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:00.747069    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7" event={"ID":"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77","Type":"ContainerStarted","Data":"92f933fcc9e598786e57e9b5cdd8d240adf780772d7e0cf59c59f63c602902e8"}
Oct 30 03:51:03.766016 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:03.765903    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw" event={"ID":"d2eeec2d-f433-4e6a-88c8-e51e9e581a19","Type":"ContainerStarted","Data":"35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f"}
Oct 30 03:51:03.766016 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:03.765979    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:51:03.767533 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:03.767503    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch" event={"ID":"2d1c78bb-acd7-4895-976a-c0352eb65287","Type":"ContainerStarted","Data":"02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190"}
Oct 30 03:51:03.767641 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:03.767547    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:03.769012 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:03.768985    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7" event={"ID":"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77","Type":"ContainerStarted","Data":"0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad"}
Oct 30 03:51:03.769151 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:03.769035    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:03.823685 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:03.823637    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw" podStartSLOduration=1.895410518 podStartE2EDuration="4.823623209s" totalImagesPullingTime="2.928212691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:51:03.822837542 +0000 UTC m=+4103.665083987" watchObservedRunningTime="2026-10-30 03:51:03.823623209 +0000 UTC m=+4103.665869654"
Oct 30 03:51:03.866319 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:03.865745    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch" podStartSLOduration=1.109968302 podStartE2EDuration="3.865729347s" totalImagesPullingTime="2.755761045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:51:03.864642135 +0000 UTC m=+4103.706888579" watchObservedRunningTime="2026-10-30 03:51:03.865729347 +0000 UTC m=+4103.707975791"
Oct 30 03:51:03.906131 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:03.906068    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7" podStartSLOduration=2.248549259 podStartE2EDuration="4.906049193s" totalImagesPullingTime="2.657499934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 03:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:51:03.905839539 +0000 UTC m=+4103.748085991" watchObservedRunningTime="2026-10-30 03:51:03.906049193 +0000 UTC m=+4103.748295638"
Oct 30 03:51:14.369544 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:51:14.369504    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:51:24.779829 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:24.779788    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 03:51:24.780430 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:24.780187    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 03:51:24.780531 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:24.780509    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 03:51:35.017940 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.017905    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 03:51:35.023103 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.023082    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.054455 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.054422    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-index-gateway-http\""
Oct 30 03:51:35.054579 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.054474    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-index-gateway-grpc\""
Oct 30 03:51:35.055464 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.055444    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 03:51:35.145005 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.144970    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-http\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.145204 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.145030    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-config\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.145204 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.145124    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-test-loki-shared-secret\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.145359 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.145238    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-grpc\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.145359 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.145274    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.145476 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.145367    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh2c9\" (UniqueName: \"kubernetes.io/projected/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-kube-api-access-gh2c9\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.246419 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.246376    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-test-loki-shared-secret\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.246601 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.246484    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-grpc\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.246601 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.246515    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.246601 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.246542    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh2c9\" (UniqueName: \"kubernetes.io/projected/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-kube-api-access-gh2c9\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.246601 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.246574    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-http\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.246821 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.246743    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-config\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.247400 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.247349    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.247539 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.247478    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-config\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.249145 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.249098    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-grpc\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.249256 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.249201    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-http\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.249345 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.249327    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-test-loki-shared-secret\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:35.267207 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:35.267182    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh2c9\" (UniqueName: \"kubernetes.io/projected/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-kube-api-access-gh2c9\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:38.778751 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:38.778708    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:38.808560 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:38.808528    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:38.880013 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:38.879977    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:38.880196 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:38.880141    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:38.895014 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:38.894991    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") DevicePath \"csi-845912705a98225ae51b5905bbffe10957591938b1f46be132bc8c5fbf658fdf\"" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:40.063173 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:40.063142    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/6e1ac281192f43a36c3572fbc5542f9568d0a8effd15d35de030edf273b16d7b/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:40.088410 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:40.088384    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:40.134845 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:40.134816    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:40.430823 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:40.430798    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 03:51:40.432666 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:51:40.432630    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97673d2b_c3ca_4a9f_ba93_8287ab9a0941.slice/crio-36b92e6e44012b01b95acea1936f7f96a521dcf8f8a1e7c10d9a78020093ddf8 WatchSource:0}: Error finding container 36b92e6e44012b01b95acea1936f7f96a521dcf8f8a1e7c10d9a78020093ddf8: Status 404 returned error can't find the container with id 36b92e6e44012b01b95acea1936f7f96a521dcf8f8a1e7c10d9a78020093ddf8
Oct 30 03:51:40.939239 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:40.939197    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" event={"ID":"97673d2b-c3ca-4a9f-ba93-8287ab9a0941","Type":"ContainerStarted","Data":"856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129"}
Oct 30 03:51:40.939471 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:40.939298    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" event={"ID":"97673d2b-c3ca-4a9f-ba93-8287ab9a0941","Type":"ContainerStarted","Data":"36b92e6e44012b01b95acea1936f7f96a521dcf8f8a1e7c10d9a78020093ddf8"}
Oct 30 03:51:40.939471 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:40.939430    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:51:40.981495 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:40.981446    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" podStartSLOduration=9.981433251 podStartE2EDuration="9.981433251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:51:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:51:40.979805798 +0000 UTC m=+4140.822052242" watchObservedRunningTime="2026-10-30 03:51:40.981433251 +0000 UTC m=+4140.823679696"
Oct 30 03:51:41.359970 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:51:41.359883    5981 scope.go:122] "RemoveContainer" containerID="2ab2184b020f3bbe8e0039fd9d4b693f9a048050f85bce6ca35ceaea3193bd74"
Oct 30 03:51:44.369510 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:51:44.369474    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:52:01.950347 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:52:01.950254    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 03:52:14.368506 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:52:14.368461    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:52:44.368619 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:52:44.368576    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:53:14.369747 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:53:14.369706    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:53:21.390254 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.390166    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 03:53:21.394138 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.394113    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.425679 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.425648    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-grpc\""
Oct 30 03:53:21.425833 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.425762    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-http\""
Oct 30 03:53:21.426655 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.426635    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 03:53:21.619269 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.619234    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.619474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.619302    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.619474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.619418    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-config\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.619474 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.619455    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kkdt\" (UniqueName: \"kubernetes.io/projected/7e9dfbba-9279-489e-b021-1258cef2f209-kube-api-access-5kkdt\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.619653 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.619552    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-test-loki-shared-secret\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.619653 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.619581    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.720420 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.720387    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-test-loki-shared-secret\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.720420 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.720421    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.720631 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.720471    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.720631 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.720502    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.720631 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.720525    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-config\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.720631 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.720542    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kkdt\" (UniqueName: \"kubernetes.io/projected/7e9dfbba-9279-489e-b021-1258cef2f209-kube-api-access-5kkdt\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.721333 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.721257    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-config\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.721460 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.721423    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.723073 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.723041    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.723168 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.723085    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.723373 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.723354    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-test-loki-shared-secret\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:21.742507 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:21.742483    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kkdt\" (UniqueName: \"kubernetes.io/projected/7e9dfbba-9279-489e-b021-1258cef2f209-kube-api-access-5kkdt\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:28.487858 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:28.487822    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-936a7126-5683-41c9-899c-dcab125a2108\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:28.488309 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:28.487888    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-354b3a14-d107-4b0d-a319-d0e427ea30eb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:28.518208 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:28.518170    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-936a7126-5683-41c9-899c-dcab125a2108\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:28.518384 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:28.518214    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-354b3a14-d107-4b0d-a319-d0e427ea30eb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:28.589473 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:28.589445    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-936a7126-5683-41c9-899c-dcab125a2108\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:28.589636 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:28.589509    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-354b3a14-d107-4b0d-a319-d0e427ea30eb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:28.589636 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:28.589602    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-354b3a14-d107-4b0d-a319-d0e427ea30eb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:28.589636 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:28.589626    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-936a7126-5683-41c9-899c-dcab125a2108\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:28.605610 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:28.605578    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-354b3a14-d107-4b0d-a319-d0e427ea30eb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") DevicePath \"csi-f8d06963301dcade090cc7f81df3d08051280b96bec9cb3d256d38c6fca5477d\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:28.605729 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:28.605578    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-936a7126-5683-41c9-899c-dcab125a2108\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") DevicePath \"csi-8d358d45986e0435eb40de1caa7d1eb98239efd4a8832550922d21b99e8a5189\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:28.846575 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:28.846538    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-354b3a14-d107-4b0d-a319-d0e427ea30eb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/bd527562f7b97df8c633d0e271fb2c9c67e742337f9544fe3ba802e713564b9f/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:28.873072 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:28.873036    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-354b3a14-d107-4b0d-a319-d0e427ea30eb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:35.928693 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:35.928659    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-936a7126-5683-41c9-899c-dcab125a2108\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/4e264e3e69579800e1690d3dbbd40e4e6742aab7b33d3263cc34dacdfcbc972d/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:35.954478 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:35.954452    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-936a7126-5683-41c9-899c-dcab125a2108\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d\") pod \"data-science-lokistack-ingester-2\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:36.105339 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:36.105304    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:36.409816 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:36.409791    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 03:53:36.412532 ip-10-0-128-202 kubenswrapper[5981]: W1030 03:53:36.412493    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9dfbba_9279_489e_b021_1258cef2f209.slice/crio-df6431c606b7d1950f50fa06f7d6cfcb44cb920d145f9e3a097bcd243cb93bd8 WatchSource:0}: Error finding container df6431c606b7d1950f50fa06f7d6cfcb44cb920d145f9e3a097bcd243cb93bd8: Status 404 returned error can't find the container with id df6431c606b7d1950f50fa06f7d6cfcb44cb920d145f9e3a097bcd243cb93bd8
Oct 30 03:53:36.453945 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:36.453913    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" event={"ID":"7e9dfbba-9279-489e-b021-1258cef2f209","Type":"ContainerStarted","Data":"df6431c606b7d1950f50fa06f7d6cfcb44cb920d145f9e3a097bcd243cb93bd8"}
Oct 30 03:53:37.459359 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:37.459315    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" event={"ID":"7e9dfbba-9279-489e-b021-1258cef2f209","Type":"ContainerStarted","Data":"a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3"}
Oct 30 03:53:37.459758 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:37.459396    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:53:37.503357 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:37.503307    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podStartSLOduration=19.503295464 podStartE2EDuration="19.503295464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 03:53:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 03:53:37.502000651 +0000 UTC m=+4257.344247097" watchObservedRunningTime="2026-10-30 03:53:37.503295464 +0000 UTC m=+4257.345541900"
Oct 30 03:53:44.369402 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:53:44.369361    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:53:58.468899 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:53:58.468859    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podUID="7e9dfbba-9279-489e-b021-1258cef2f209" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 03:54:08.468014 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:54:08.467967    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podUID="7e9dfbba-9279-489e-b021-1258cef2f209" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 03:54:14.368934 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:54:14.368898    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:54:18.468374 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:54:18.468337    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podUID="7e9dfbba-9279-489e-b021-1258cef2f209" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 03:54:28.468247 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:54:28.468208    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 03:54:41.392925 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:54:41.392893    5981 scope.go:122] "RemoveContainer" containerID="4a2ea3abb310cfbcb72f0e8cc52966c2c5d01857d4efab14115b3a03019bcc72"
Oct 30 03:54:41.401492 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:54:41.401473    5981 scope.go:122] "RemoveContainer" containerID="698c42d9c4d51808dfa08f58cfef5f27fca9f82041c66ad4857e26adaf2ea766"
Oct 30 03:54:41.408938 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:54:41.408917    5981 scope.go:122] "RemoveContainer" containerID="ce8b0d0708bbc155f8c14ca8af60ebef61ee92b43be2ba40b0e52ce597045808"
Oct 30 03:54:41.416030 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:54:41.416013    5981 scope.go:122] "RemoveContainer" containerID="f873ed0459b580af3a183d4a3144830ecdcb8db8e11150168dfa4f29c8456dd2"
Oct 30 03:54:41.423124 ip-10-0-128-202 kubenswrapper[5981]: I1030 03:54:41.423106    5981 scope.go:122] "RemoveContainer" containerID="837662b52dd56aa5582451d428145a93e74010392b0e590744829173240ff0fc"
Oct 30 03:54:44.369707 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:54:44.369670    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:55:14.368843 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:55:14.368802    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:55:44.368664 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:55:44.368620    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:56:14.369440 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:56:14.369403    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:56:44.369395 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:56:44.369360    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:57:14.369345 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:57:14.369311    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:57:44.368993 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:57:44.368954    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:58:14.369366 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:58:14.369263    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:58:44.368559 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:58:44.368521    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:59:14.369441 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:59:14.369404    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 03:59:44.368428 ip-10-0-128-202 kubenswrapper[5981]: E1030 03:59:44.368385    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:00:14.368714 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:00:14.368673    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:00:44.369002 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:00:44.368963    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:01:14.368969 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:01:14.368895    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:01:44.369761 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:01:44.369723    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:02:14.369853 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:02:14.369812    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:02:44.369020 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:02:44.368981    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:03:14.369445 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:03:14.369403    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:03:44.368539 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:03:44.368475    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:04:14.369043 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:04:14.368999    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:04:44.370480 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:04:44.370442    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:05:14.369564 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:05:14.369527    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:05:44.368794 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:05:44.368760    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:06:14.368755 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:06:14.368713    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:06:44.368847 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:06:44.368804    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:07:14.369939 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:07:14.369856    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:07:44.370512 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:07:44.370474    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:08:14.369261 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:08:14.369209    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:08:44.369111 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:08:44.369076    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:09:14.368563 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:09:14.368524    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:09:44.370258 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:09:44.370216    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:09:49.681388 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:49.681349    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 04:09:49.683580 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:49.681580    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podUID="7e9dfbba-9279-489e-b021-1258cef2f209" containerName="loki-ingester" containerID="cri-o://a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3" gracePeriod=600
Oct 30 04:09:49.785507 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:49.785472    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:09:49.785707 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:49.785668    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" podUID="97673d2b-c3ca-4a9f-ba93-8287ab9a0941" containerName="loki-index-gateway" containerID="cri-o://856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129" gracePeriod=30
Oct 30 04:09:50.059840 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.059813    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.128480 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.128449    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-test-loki-shared-secret\") pod \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") "
Oct 30 04:09:50.128661 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.128570    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") "
Oct 30 04:09:50.128661 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.128634    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-kube-api-access-gh2c9\" (UniqueName: \"kubernetes.io/projected/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-kube-api-access-gh2c9\") pod \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") "
Oct 30 04:09:50.128833 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.128684    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-config\" (UniqueName: \"kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-config\") pod \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") "
Oct 30 04:09:50.128833 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.128733    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-http\") pod \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") "
Oct 30 04:09:50.128833 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.128815    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-grpc\") pod \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") "
Oct 30 04:09:50.129020 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.128990    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-ca-bundle\") pod \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\" (UID: \"97673d2b-c3ca-4a9f-ba93-8287ab9a0941\") "
Oct 30 04:09:50.129547 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.129519    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-ca-bundle" pod "97673d2b-c3ca-4a9f-ba93-8287ab9a0941" (UID: "97673d2b-c3ca-4a9f-ba93-8287ab9a0941"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:50.130500 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.130471    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-config" pod "97673d2b-c3ca-4a9f-ba93-8287ab9a0941" (UID: "97673d2b-c3ca-4a9f-ba93-8287ab9a0941"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:50.131604 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.131575    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-http" pod "97673d2b-c3ca-4a9f-ba93-8287ab9a0941" (UID: "97673d2b-c3ca-4a9f-ba93-8287ab9a0941"). InnerVolumeSpecName "data-science-lokistack-index-gateway-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:50.131742 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.131653    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-test-loki-shared-secret" pod "97673d2b-c3ca-4a9f-ba93-8287ab9a0941" (UID: "97673d2b-c3ca-4a9f-ba93-8287ab9a0941"). InnerVolumeSpecName "test-loki-shared-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:50.131742 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.131715    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-kube-api-access-gh2c9" pod "97673d2b-c3ca-4a9f-ba93-8287ab9a0941" (UID: "97673d2b-c3ca-4a9f-ba93-8287ab9a0941"). InnerVolumeSpecName "kube-api-access-gh2c9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:09:50.131928 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.131901    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-grpc" pod "97673d2b-c3ca-4a9f-ba93-8287ab9a0941" (UID: "97673d2b-c3ca-4a9f-ba93-8287ab9a0941"). InnerVolumeSpecName "data-science-lokistack-index-gateway-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:50.132920 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.132900    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476" pod "97673d2b-c3ca-4a9f-ba93-8287ab9a0941" (UID: "97673d2b-c3ca-4a9f-ba93-8287ab9a0941"). InnerVolumeSpecName "pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 04:09:50.229897 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.229839    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:50.229897 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.229866    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-http\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:50.229897 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.229877    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-index-gateway-grpc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:50.229897 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.229887    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-data-science-lokistack-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:50.229897 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.229897    5981 reconciler_common.go:299] "Volume detached for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-test-loki-shared-secret\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:50.230140 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.229929    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 04:09:50.230140 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.229942    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh2c9\" (UniqueName: \"kubernetes.io/projected/97673d2b-c3ca-4a9f-ba93-8287ab9a0941-kube-api-access-gh2c9\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:50.243444 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.243425    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476") on node "ip-10-0-128-202.ec2.internal"
Oct 30 04:09:50.330937 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.330903    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-845912705a98225ae51b5905bbffe10957591938b1f46be132bc8c5fbf658fdf\""
Oct 30 04:09:50.448358 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.448334    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:50.532647 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.532568    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-test-loki-shared-secret\") pod \"7e9dfbba-9279-489e-b021-1258cef2f209\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") "
Oct 30 04:09:50.532647 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.532630    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-config\" (UniqueName: \"kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-config\") pod \"7e9dfbba-9279-489e-b021-1258cef2f209\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") "
Oct 30 04:09:50.532853 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.532656    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ca-bundle\") pod \"7e9dfbba-9279-489e-b021-1258cef2f209\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") "
Oct 30 04:09:50.532853 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.532685    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e9dfbba-9279-489e-b021-1258cef2f209-kube-api-access-5kkdt\" (UniqueName: \"kubernetes.io/projected/7e9dfbba-9279-489e-b021-1258cef2f209-kube-api-access-5kkdt\") pod \"7e9dfbba-9279-489e-b021-1258cef2f209\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") "
Oct 30 04:09:50.532853 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.532702    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-grpc\") pod \"7e9dfbba-9279-489e-b021-1258cef2f209\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") "
Oct 30 04:09:50.532853 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.532814    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d\") pod \"7e9dfbba-9279-489e-b021-1258cef2f209\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") "
Oct 30 04:09:50.533079 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.532877    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b\") pod \"7e9dfbba-9279-489e-b021-1258cef2f209\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") "
Oct 30 04:09:50.533079 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.532923    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-http\") pod \"7e9dfbba-9279-489e-b021-1258cef2f209\" (UID: \"7e9dfbba-9279-489e-b021-1258cef2f209\") "
Oct 30 04:09:50.533178 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.533092    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ca-bundle" pod "7e9dfbba-9279-489e-b021-1258cef2f209" (UID: "7e9dfbba-9279-489e-b021-1258cef2f209"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:50.533239 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.533222    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-config" pod "7e9dfbba-9279-489e-b021-1258cef2f209" (UID: "7e9dfbba-9279-489e-b021-1258cef2f209"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:50.533400 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.533276    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:50.535475 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.535449    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e9dfbba-9279-489e-b021-1258cef2f209-kube-api-access-5kkdt" pod "7e9dfbba-9279-489e-b021-1258cef2f209" (UID: "7e9dfbba-9279-489e-b021-1258cef2f209"). InnerVolumeSpecName "kube-api-access-5kkdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:09:50.535947 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.535900    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-grpc" pod "7e9dfbba-9279-489e-b021-1258cef2f209" (UID: "7e9dfbba-9279-489e-b021-1258cef2f209"). InnerVolumeSpecName "data-science-lokistack-ingester-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:50.536050 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.535942    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-http" pod "7e9dfbba-9279-489e-b021-1258cef2f209" (UID: "7e9dfbba-9279-489e-b021-1258cef2f209"). InnerVolumeSpecName "data-science-lokistack-ingester-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:50.536050 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.535923    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-test-loki-shared-secret" pod "7e9dfbba-9279-489e-b021-1258cef2f209" (UID: "7e9dfbba-9279-489e-b021-1258cef2f209"). InnerVolumeSpecName "test-loki-shared-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:50.536140 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.536045    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d" pod "7e9dfbba-9279-489e-b021-1258cef2f209" (UID: "7e9dfbba-9279-489e-b021-1258cef2f209"). InnerVolumeSpecName "pvc-936a7126-5683-41c9-899c-dcab125a2108". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 04:09:50.536201 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.536187    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b" pod "7e9dfbba-9279-489e-b021-1258cef2f209" (UID: "7e9dfbba-9279-489e-b021-1258cef2f209"). InnerVolumeSpecName "pvc-354b3a14-d107-4b0d-a319-d0e427ea30eb". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 04:09:50.619937 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.619908    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 04:09:50.620253 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.620241    5981 cpu_manager.go:414] "containerMap: removing container" podUID="7e9dfbba-9279-489e-b021-1258cef2f209" containerName="loki-ingester"
Oct 30 04:09:50.620308 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.620254    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e9dfbba-9279-489e-b021-1258cef2f209" containerName="loki-ingester"
Oct 30 04:09:50.620308 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.620303    5981 cpu_manager.go:414] "containerMap: removing container" podUID="97673d2b-c3ca-4a9f-ba93-8287ab9a0941" containerName="loki-index-gateway"
Oct 30 04:09:50.620383 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.620308    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="97673d2b-c3ca-4a9f-ba93-8287ab9a0941" containerName="loki-index-gateway"
Oct 30 04:09:50.620383 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.620361    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="97673d2b-c3ca-4a9f-ba93-8287ab9a0941" containerName="loki-index-gateway"
Oct 30 04:09:50.620383 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.620372    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e9dfbba-9279-489e-b021-1258cef2f209" containerName="loki-ingester"
Oct 30 04:09:50.623615 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.623594    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.634662 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.634641    5981 reconciler_common.go:299] "Volume detached for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-test-loki-shared-secret\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:50.634770 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.634666    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e9dfbba-9279-489e-b021-1258cef2f209-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:50.634770 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.634681    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kkdt\" (UniqueName: \"kubernetes.io/projected/7e9dfbba-9279-489e-b021-1258cef2f209-kube-api-access-5kkdt\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:50.634770 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.634690    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-grpc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:50.634770 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.634718    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-936a7126-5683-41c9-899c-dcab125a2108\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 04:09:50.634770 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.634734    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-354b3a14-d107-4b0d-a319-d0e427ea30eb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 04:09:50.634770 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.634744    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/7e9dfbba-9279-489e-b021-1258cef2f209-data-science-lokistack-ingester-http\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:50.640933 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.640909    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 04:09:50.648085 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.648067    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-936a7126-5683-41c9-899c-dcab125a2108" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d") on node "ip-10-0-128-202.ec2.internal"
Oct 30 04:09:50.649194 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.649178    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-354b3a14-d107-4b0d-a319-d0e427ea30eb" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b") on node "ip-10-0-128-202.ec2.internal"
Oct 30 04:09:50.659595 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.659577    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"test-loki-lifecycle-secret\""
Oct 30 04:09:50.659719 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.659701    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-compactor-grpc\""
Oct 30 04:09:50.659780 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.659725    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-compactor-http\""
Oct 30 04:09:50.682186 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.682152    5981 generic.go:356] "Generic (PLEG): container finished" podID="97673d2b-c3ca-4a9f-ba93-8287ab9a0941" containerID="856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129" exitCode=0
Oct 30 04:09:50.682623 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.682203    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.682623 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.682227    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" event={"ID":"97673d2b-c3ca-4a9f-ba93-8287ab9a0941","Type":"ContainerDied","Data":"856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129"}
Oct 30 04:09:50.682623 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.682273    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" event={"ID":"97673d2b-c3ca-4a9f-ba93-8287ab9a0941","Type":"ContainerDied","Data":"36b92e6e44012b01b95acea1936f7f96a521dcf8f8a1e7c10d9a78020093ddf8"}
Oct 30 04:09:50.682623 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.682313    5981 scope.go:122] "RemoveContainer" containerID="856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129"
Oct 30 04:09:50.683653 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.683630    5981 generic.go:356] "Generic (PLEG): container finished" podID="7e9dfbba-9279-489e-b021-1258cef2f209" containerID="a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3" exitCode=0
Oct 30 04:09:50.683768 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.683667    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:50.683768 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.683718    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" event={"ID":"7e9dfbba-9279-489e-b021-1258cef2f209","Type":"ContainerDied","Data":"a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3"}
Oct 30 04:09:50.683768 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.683758    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" event={"ID":"7e9dfbba-9279-489e-b021-1258cef2f209","Type":"ContainerDied","Data":"df6431c606b7d1950f50fa06f7d6cfcb44cb920d145f9e3a097bcd243cb93bd8"}
Oct 30 04:09:50.692414 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.692209    5981 scope.go:122] "RemoveContainer" containerID="856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129"
Oct 30 04:09:50.692544 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:09:50.692521    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129\": container with ID starting with 856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129 not found: ID does not exist" containerID="856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129"
Oct 30 04:09:50.692612 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.692556    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129"} err="failed to get container status \"856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129\": rpc error: code = NotFound desc = could not find container \"856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129\": container with ID starting with 856ddc95e87458c805ac8c6ecdeee4b120bebbc2d0d7e0c0f41ec498640d5129 not found: ID does not exist"
Oct 30 04:09:50.692612 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.692579    5981 scope.go:122] "RemoveContainer" containerID="a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3"
Oct 30 04:09:50.704673 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.704655    5981 scope.go:122] "RemoveContainer" containerID="a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3"
Oct 30 04:09:50.704942 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:09:50.704921    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3\": container with ID starting with a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3 not found: ID does not exist" containerID="a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3"
Oct 30 04:09:50.704990 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.704954    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3"} err="failed to get container status \"a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3\": rpc error: code = NotFound desc = could not find container \"a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3\": container with ID starting with a01814217c032a3ef1ffb103b74719ba3b9be709c91678c3e54ec19369e447d3 not found: ID does not exist"
Oct 30 04:09:50.735528 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.735276    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-config\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.735528 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.735408    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-http\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.735528 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.735445    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.735528 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.735491    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-grpc\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.735821 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.735562    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-test-loki-lifecycle-secret\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.735821 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.735612    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n49c5\" (UniqueName: \"kubernetes.io/projected/8026ef28-64c5-4de5-8839-a5a215263d2e-kube-api-access-n49c5\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.735821 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.735721    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-936a7126-5683-41c9-899c-dcab125a2108\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ae481f104a8cef7d\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-8d358d45986e0435eb40de1caa7d1eb98239efd4a8832550922d21b99e8a5189\""
Oct 30 04:09:50.735821 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.735735    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-354b3a14-d107-4b0d-a319-d0e427ea30eb\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bbde2f5ca1f07e8b\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-f8d06963301dcade090cc7f81df3d08051280b96bec9cb3d256d38c6fca5477d\""
Oct 30 04:09:50.736335 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.736314    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:09:50.738275 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.738250    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:09:50.775023 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.774977    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 04:09:50.777225 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.777203    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:09:50.784690 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.784641    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.785249 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.785231    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 04:09:50.799545 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.799520    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:09:50.800380 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.800341    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-index-gateway-grpc\""
Oct 30 04:09:50.800467 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.800422    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-index-gateway-http\""
Oct 30 04:09:50.820763 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.820736    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 04:09:50.824962 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.824934    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:50.836846 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.836812    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-test-loki-lifecycle-secret\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.836979 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.836857    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-config\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.836979 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.836888    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-grpc\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.836979 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.836931    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6dqh\" (UniqueName: \"kubernetes.io/projected/aee34cc5-78ad-41ca-965e-125c4217e9d8-kube-api-access-j6dqh\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.837186 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.837098    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-http\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.837186 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.837138    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-http\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.837186 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.837168    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.837420 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.837222    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-grpc\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.837420 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.837253    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-test-loki-lifecycle-secret\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.837420 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.837277    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n49c5\" (UniqueName: \"kubernetes.io/projected/8026ef28-64c5-4de5-8839-a5a215263d2e-kube-api-access-n49c5\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.837420 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.837341    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-config\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.837420 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.837409    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.837716 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.837671    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-config\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.841024 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.840534    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.841739 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.841686    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-http\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.842669 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.842647    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 04:09:50.844638 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.843767    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-test-loki-lifecycle-secret\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.847624 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.847580    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-grpc\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.858132 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.858107    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n49c5\" (UniqueName: \"kubernetes.io/projected/8026ef28-64c5-4de5-8839-a5a215263d2e-kube-api-access-n49c5\") pod \"data-science-lokistack-compactor-0\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:50.900302 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.900268    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-http\""
Oct 30 04:09:50.900418 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.900372    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-grpc\""
Oct 30 04:09:50.938408 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.938380    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-http\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.938540 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.938431    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-config\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.938540 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.938464    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.938540 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.938503    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-test-loki-lifecycle-secret\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.938540 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.938534    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-grpc\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.938752 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.938551    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6dqh\" (UniqueName: \"kubernetes.io/projected/aee34cc5-78ad-41ca-965e-125c4217e9d8-kube-api-access-j6dqh\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.939337 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.939251    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.939518 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.939378    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-config\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.941237 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.941212    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-grpc\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.941726 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.941699    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-http\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.941869 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.941855    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-test-loki-lifecycle-secret\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:50.958466 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:50.958448    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6dqh\" (UniqueName: \"kubernetes.io/projected/aee34cc5-78ad-41ca-965e-125c4217e9d8-kube-api-access-j6dqh\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:51.039564 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.039499    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-config\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.039564 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.039550    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.039698 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.039637    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.039734 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.039710    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.039772 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.039739    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xth2\" (UniqueName: \"kubernetes.io/projected/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-kube-api-access-7xth2\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.039845 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.039829    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-test-loki-lifecycle-secret\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.140948 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.140913    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.141110 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.140979    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.141110 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.141058    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.141110 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.141084    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xth2\" (UniqueName: \"kubernetes.io/projected/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-kube-api-access-7xth2\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.141246 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.141146    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-test-loki-lifecycle-secret\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.141246 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.141178    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-config\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.141767 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.141734    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.141983 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.141963    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-config\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.143771 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.143752    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.144364 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.144342    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.144485 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.144468    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-test-loki-lifecycle-secret\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:51.160812 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:51.160792    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xth2\" (UniqueName: \"kubernetes.io/projected/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-kube-api-access-7xth2\") pod \"data-science-lokistack-ingester-2\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:52.275016 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:52.274982    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7e9dfbba-9279-489e-b021-1258cef2f209" path="/var/lib/kubelet/pods/7e9dfbba-9279-489e-b021-1258cef2f209/volumes"
Oct 30 04:09:52.275439 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:52.275424    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="97673d2b-c3ca-4a9f-ba93-8287ab9a0941" path="/var/lib/kubelet/pods/97673d2b-c3ca-4a9f-ba93-8287ab9a0941/volumes"
Oct 30 04:09:52.710505 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:52.710475    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:09:52.714630 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:52.714601    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 04:09:52.728505 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:09:52.728466    5981 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[storage], unattached volumes=[storage], failed to process volumes=[]: context canceled" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" podUID="aee34cc5-78ad-41ca-965e-125c4217e9d8"
Oct 30 04:09:52.729375 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:09:52.729320    5981 csi_plugin.go:220] "Failed to get volume attachment" err="volumeattachments.storage.k8s.io \"csi-d38e5390403e15d5ab531a36199f727efc376896c0678cd9882da2252ddf6021\" is forbidden: User \"system:node:ip-10-0-128-202.ec2.internal\" cannot get resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope: no relationship found between node 'ip-10-0-128-202.ec2.internal' and this object" attachmentName="csi-d38e5390403e15d5ab531a36199f727efc376896c0678cd9882da2252ddf6021"
Oct 30 04:09:52.729513 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:09:52.729391    5981 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[storage], unattached volumes=[storage], failed to process volumes=[]: context canceled" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0" podUID="8026ef28-64c5-4de5-8839-a5a215263d2e"
Oct 30 04:09:52.793899 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:52.793867    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"]
Oct 30 04:09:52.794154 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:52.794129    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7" podUID="fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77" containerName="loki-querier" containerID="cri-o://0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad" gracePeriod=30
Oct 30 04:09:52.800553 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:52.800527    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 04:09:52.821848 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:52.821815    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"]
Oct 30 04:09:52.822057 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:52.822029    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch" podUID="2d1c78bb-acd7-4895-976a-c0352eb65287" containerName="loki-query-frontend" containerID="cri-o://02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190" gracePeriod=30
Oct 30 04:09:52.834709 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:09:52.834676    5981 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[storage wal], unattached volumes=[storage wal], failed to process volumes=[]: context canceled" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2" podUID="4e16b09b-e3ec-4f46-b01e-c8dac4f21d91"
Oct 30 04:09:52.846212 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:52.846185    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"]
Oct 30 04:09:52.846423 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:52.846401    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw" podUID="d2eeec2d-f433-4e6a-88c8-e51e9e581a19" containerName="loki-distributor" containerID="cri-o://35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f" gracePeriod=30
Oct 30 04:09:53.117795 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.117773    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 04:09:53.259576 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.259551    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 04:09:53.261684 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.261660    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-ca-bundle\") pod \"2d1c78bb-acd7-4895-976a-c0352eb65287\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") "
Oct 30 04:09:53.261814 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.261758    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-http\") pod \"2d1c78bb-acd7-4895-976a-c0352eb65287\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") "
Oct 30 04:09:53.261863 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.261822    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-grpc\") pod \"2d1c78bb-acd7-4895-976a-c0352eb65287\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") "
Oct 30 04:09:53.261975 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.261942    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-config\" (UniqueName: \"kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-config\") pod \"2d1c78bb-acd7-4895-976a-c0352eb65287\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") "
Oct 30 04:09:53.262031 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.261992    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d1c78bb-acd7-4895-976a-c0352eb65287-kube-api-access-gmcd5\" (UniqueName: \"kubernetes.io/projected/2d1c78bb-acd7-4895-976a-c0352eb65287-kube-api-access-gmcd5\") pod \"2d1c78bb-acd7-4895-976a-c0352eb65287\" (UID: \"2d1c78bb-acd7-4895-976a-c0352eb65287\") "
Oct 30 04:09:53.262104 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.262082    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-ca-bundle" pod "2d1c78bb-acd7-4895-976a-c0352eb65287" (UID: "2d1c78bb-acd7-4895-976a-c0352eb65287"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:53.262329 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.262307    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-config" pod "2d1c78bb-acd7-4895-976a-c0352eb65287" (UID: "2d1c78bb-acd7-4895-976a-c0352eb65287"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:53.262468 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.262454    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.262528 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.262474    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d1c78bb-acd7-4895-976a-c0352eb65287-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.264188 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.264141    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d1c78bb-acd7-4895-976a-c0352eb65287-kube-api-access-gmcd5" pod "2d1c78bb-acd7-4895-976a-c0352eb65287" (UID: "2d1c78bb-acd7-4895-976a-c0352eb65287"). InnerVolumeSpecName "kube-api-access-gmcd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:09:53.264443 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.264426    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-grpc" pod "2d1c78bb-acd7-4895-976a-c0352eb65287" (UID: "2d1c78bb-acd7-4895-976a-c0352eb65287"). InnerVolumeSpecName "data-science-lokistack-query-frontend-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.264520 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.264452    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-http" pod "2d1c78bb-acd7-4895-976a-c0352eb65287" (UID: "2d1c78bb-acd7-4895-976a-c0352eb65287"). InnerVolumeSpecName "data-science-lokistack-query-frontend-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.362980 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.362941    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-config\" (UniqueName: \"kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-config\") pod \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") "
Oct 30 04:09:53.363447 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.363026    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-grpc\") pod \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") "
Oct 30 04:09:53.363447 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.363083    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-kube-api-access-wtw2c\" (UniqueName: \"kubernetes.io/projected/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-kube-api-access-wtw2c\") pod \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") "
Oct 30 04:09:53.363447 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.363180    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-ca-bundle\") pod \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") "
Oct 30 04:09:53.363447 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.363213    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-http\") pod \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") "
Oct 30 04:09:53.363447 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.363275    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-test-loki-shared-secret\") pod \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\" (UID: \"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77\") "
Oct 30 04:09:53.363707 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.363533    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-config" pod "fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77" (UID: "fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:53.363707 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.363589    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-ca-bundle" pod "fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77" (UID: "fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:53.363707 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.363618    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-http\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.363707 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.363640    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/2d1c78bb-acd7-4895-976a-c0352eb65287-data-science-lokistack-query-frontend-grpc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.363707 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.363675    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmcd5\" (UniqueName: \"kubernetes.io/projected/2d1c78bb-acd7-4895-976a-c0352eb65287-kube-api-access-gmcd5\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.363707 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.363690    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.365558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.365530    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-grpc" pod "fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77" (UID: "fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77"). InnerVolumeSpecName "data-science-lokistack-querier-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.365558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.365544    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-kube-api-access-wtw2c" pod "fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77" (UID: "fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77"). InnerVolumeSpecName "kube-api-access-wtw2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:09:53.365558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.365550    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-http" pod "fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77" (UID: "fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77"). InnerVolumeSpecName "data-science-lokistack-querier-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.365750 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.365663    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-test-loki-shared-secret" pod "fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77" (UID: "fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77"). InnerVolumeSpecName "test-loki-shared-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.464378 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.464349    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-grpc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.464378 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.464374    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtw2c\" (UniqueName: \"kubernetes.io/projected/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-kube-api-access-wtw2c\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.464552 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.464386    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.464552 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.464395    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-data-science-lokistack-querier-http\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.464552 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.464404    5981 reconciler_common.go:299] "Volume detached for volume \"test-loki-shared-secret\" (UniqueName: \"kubernetes.io/secret/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77-test-loki-shared-secret\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.700474 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.700441    5981 generic.go:356] "Generic (PLEG): container finished" podID="2d1c78bb-acd7-4895-976a-c0352eb65287" containerID="02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190" exitCode=0
Oct 30 04:09:53.700657 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.700494    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"
Oct 30 04:09:53.700657 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.700522    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch" event={"ID":"2d1c78bb-acd7-4895-976a-c0352eb65287","Type":"ContainerDied","Data":"02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190"}
Oct 30 04:09:53.700657 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.700578    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch" event={"ID":"2d1c78bb-acd7-4895-976a-c0352eb65287","Type":"ContainerDied","Data":"3f958f0f301c85988041e5f198c554ffa3675301183c668de9fef2c5f3b83078"}
Oct 30 04:09:53.700657 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.700607    5981 scope.go:122] "RemoveContainer" containerID="02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190"
Oct 30 04:09:53.701926 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.701904    5981 generic.go:356] "Generic (PLEG): container finished" podID="fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77" containerID="0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad" exitCode=0
Oct 30 04:09:53.702028 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.701953    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"
Oct 30 04:09:53.702028 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.701989    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7" event={"ID":"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77","Type":"ContainerDied","Data":"0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad"}
Oct 30 04:09:53.702131 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.702047    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7" event={"ID":"fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77","Type":"ContainerDied","Data":"92f933fcc9e598786e57e9b5cdd8d240adf780772d7e0cf59c59f63c602902e8"}
Oct 30 04:09:53.702131 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.702101    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:53.702217 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.702137    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:53.702270 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.702232    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:53.710826 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.710795    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:53.711543 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.711523    5981 scope.go:122] "RemoveContainer" containerID="02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190"
Oct 30 04:09:53.711841 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:09:53.711813    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190\": container with ID starting with 02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190 not found: ID does not exist" containerID="02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190"
Oct 30 04:09:53.711957 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.711850    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190"} err="failed to get container status \"02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190\": rpc error: code = NotFound desc = could not find container \"02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190\": container with ID starting with 02f00d2280c6482e72df1ef2302c8ecf732e809d244fbaaf88543753f1703190 not found: ID does not exist"
Oct 30 04:09:53.711957 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.711874    5981 scope.go:122] "RemoveContainer" containerID="0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad"
Oct 30 04:09:53.715652 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.715633    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:53.719412 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.719394    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:53.720975 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.720961    5981 scope.go:122] "RemoveContainer" containerID="0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad"
Oct 30 04:09:53.721223 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:09:53.721205    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad\": container with ID starting with 0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad not found: ID does not exist" containerID="0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad"
Oct 30 04:09:53.721271 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.721231    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad"} err="failed to get container status \"0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad\": rpc error: code = NotFound desc = could not find container \"0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad\": container with ID starting with 0b5e5db06406d382af8fd309433d9541316ef34765b80c9cfe586aed82d82aad not found: ID does not exist"
Oct 30 04:09:53.753094 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.753066    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"]
Oct 30 04:09:53.765988 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.765962    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-599ch"]
Oct 30 04:09:53.792061 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.792037    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"]
Oct 30 04:09:53.795956 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.795936    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-84985db556-znrd7"]
Oct 30 04:09:53.867441 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867411    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-ca-bundle\") pod \"aee34cc5-78ad-41ca-965e-125c4217e9d8\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") "
Oct 30 04:09:53.867587 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867445    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-test-loki-lifecycle-secret\") pod \"aee34cc5-78ad-41ca-965e-125c4217e9d8\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") "
Oct 30 04:09:53.867587 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867467    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-http\") pod \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") "
Oct 30 04:09:53.867587 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867491    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-http\") pod \"aee34cc5-78ad-41ca-965e-125c4217e9d8\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") "
Oct 30 04:09:53.867587 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867515    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-http\") pod \"8026ef28-64c5-4de5-8839-a5a215263d2e\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") "
Oct 30 04:09:53.867587 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867559    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-config\" (UniqueName: \"kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-config\") pod \"8026ef28-64c5-4de5-8839-a5a215263d2e\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") "
Oct 30 04:09:53.867587 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867585    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8026ef28-64c5-4de5-8839-a5a215263d2e-kube-api-access-n49c5\" (UniqueName: \"kubernetes.io/projected/8026ef28-64c5-4de5-8839-a5a215263d2e-kube-api-access-n49c5\") pod \"8026ef28-64c5-4de5-8839-a5a215263d2e\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") "
Oct 30 04:09:53.867908 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867616    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aee34cc5-78ad-41ca-965e-125c4217e9d8-kube-api-access-j6dqh\" (UniqueName: \"kubernetes.io/projected/aee34cc5-78ad-41ca-965e-125c4217e9d8-kube-api-access-j6dqh\") pod \"aee34cc5-78ad-41ca-965e-125c4217e9d8\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") "
Oct 30 04:09:53.867908 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867661    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ca-bundle\") pod \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") "
Oct 30 04:09:53.867908 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867692    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-grpc\") pod \"8026ef28-64c5-4de5-8839-a5a215263d2e\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") "
Oct 30 04:09:53.867908 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867720    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-grpc\") pod \"aee34cc5-78ad-41ca-965e-125c4217e9d8\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") "
Oct 30 04:09:53.867908 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867747    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-config\" (UniqueName: \"kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-config\") pod \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") "
Oct 30 04:09:53.867908 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867801    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-test-loki-lifecycle-secret\") pod \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") "
Oct 30 04:09:53.867908 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867837    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-ca-bundle\") pod \"8026ef28-64c5-4de5-8839-a5a215263d2e\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") "
Oct 30 04:09:53.867908 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867876    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-test-loki-lifecycle-secret\") pod \"8026ef28-64c5-4de5-8839-a5a215263d2e\" (UID: \"8026ef28-64c5-4de5-8839-a5a215263d2e\") "
Oct 30 04:09:53.867908 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867875    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-ca-bundle" pod "aee34cc5-78ad-41ca-965e-125c4217e9d8" (UID: "aee34cc5-78ad-41ca-965e-125c4217e9d8"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:53.867908 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867905    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-config\" (UniqueName: \"kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-config\") pod \"aee34cc5-78ad-41ca-965e-125c4217e9d8\" (UID: \"aee34cc5-78ad-41ca-965e-125c4217e9d8\") "
Oct 30 04:09:53.868428 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867941    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-grpc\") pod \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") "
Oct 30 04:09:53.868428 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.867984    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-config" pod "8026ef28-64c5-4de5-8839-a5a215263d2e" (UID: "8026ef28-64c5-4de5-8839-a5a215263d2e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:53.868428 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.868020    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-kube-api-access-7xth2\" (UniqueName: \"kubernetes.io/projected/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-kube-api-access-7xth2\") pod \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\" (UID: \"4e16b09b-e3ec-4f46-b01e-c8dac4f21d91\") "
Oct 30 04:09:53.868428 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.868306    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-config" pod "4e16b09b-e3ec-4f46-b01e-c8dac4f21d91" (UID: "4e16b09b-e3ec-4f46-b01e-c8dac4f21d91"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:53.868954 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.868890    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-config" pod "aee34cc5-78ad-41ca-965e-125c4217e9d8" (UID: "aee34cc5-78ad-41ca-965e-125c4217e9d8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:53.869408 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.869359    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ca-bundle" pod "4e16b09b-e3ec-4f46-b01e-c8dac4f21d91" (UID: "4e16b09b-e3ec-4f46-b01e-c8dac4f21d91"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:53.869704 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.869678    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-ca-bundle" pod "8026ef28-64c5-4de5-8839-a5a215263d2e" (UID: "8026ef28-64c5-4de5-8839-a5a215263d2e"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:09:53.869936 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.869917    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.870017 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.869943    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.870017 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.869957    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.870017 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.869972    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.870017 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.869986    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.870017 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.870000    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.871974 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.871941    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-test-loki-lifecycle-secret" pod "4e16b09b-e3ec-4f46-b01e-c8dac4f21d91" (UID: "4e16b09b-e3ec-4f46-b01e-c8dac4f21d91"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.872060 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.871972    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-http" pod "8026ef28-64c5-4de5-8839-a5a215263d2e" (UID: "8026ef28-64c5-4de5-8839-a5a215263d2e"). InnerVolumeSpecName "data-science-lokistack-compactor-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.872125 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.872064    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-http" pod "4e16b09b-e3ec-4f46-b01e-c8dac4f21d91" (UID: "4e16b09b-e3ec-4f46-b01e-c8dac4f21d91"). InnerVolumeSpecName "data-science-lokistack-ingester-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.872307 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.872201    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8026ef28-64c5-4de5-8839-a5a215263d2e-kube-api-access-n49c5" pod "8026ef28-64c5-4de5-8839-a5a215263d2e" (UID: "8026ef28-64c5-4de5-8839-a5a215263d2e"). InnerVolumeSpecName "kube-api-access-n49c5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:09:53.872307 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.872261    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-test-loki-lifecycle-secret" pod "aee34cc5-78ad-41ca-965e-125c4217e9d8" (UID: "aee34cc5-78ad-41ca-965e-125c4217e9d8"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.872647 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.872572    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-http" pod "aee34cc5-78ad-41ca-965e-125c4217e9d8" (UID: "aee34cc5-78ad-41ca-965e-125c4217e9d8"). InnerVolumeSpecName "data-science-lokistack-index-gateway-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.872910 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.872859    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aee34cc5-78ad-41ca-965e-125c4217e9d8-kube-api-access-j6dqh" pod "aee34cc5-78ad-41ca-965e-125c4217e9d8" (UID: "aee34cc5-78ad-41ca-965e-125c4217e9d8"). InnerVolumeSpecName "kube-api-access-j6dqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:09:53.873000 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.872965    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-grpc" pod "4e16b09b-e3ec-4f46-b01e-c8dac4f21d91" (UID: "4e16b09b-e3ec-4f46-b01e-c8dac4f21d91"). InnerVolumeSpecName "data-science-lokistack-ingester-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.873164 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.873143    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-kube-api-access-7xth2" pod "4e16b09b-e3ec-4f46-b01e-c8dac4f21d91" (UID: "4e16b09b-e3ec-4f46-b01e-c8dac4f21d91"). InnerVolumeSpecName "kube-api-access-7xth2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:09:53.873556 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.873521    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-grpc" pod "8026ef28-64c5-4de5-8839-a5a215263d2e" (UID: "8026ef28-64c5-4de5-8839-a5a215263d2e"). InnerVolumeSpecName "data-science-lokistack-compactor-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.873646 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.873614    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-grpc" pod "aee34cc5-78ad-41ca-965e-125c4217e9d8" (UID: "aee34cc5-78ad-41ca-965e-125c4217e9d8"). InnerVolumeSpecName "data-science-lokistack-index-gateway-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.874084 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.874066    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-test-loki-lifecycle-secret" pod "8026ef28-64c5-4de5-8839-a5a215263d2e" (UID: "8026ef28-64c5-4de5-8839-a5a215263d2e"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:09:53.971362 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.971272    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xth2\" (UniqueName: \"kubernetes.io/projected/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-kube-api-access-7xth2\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.971362 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.971311    5981 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-test-loki-lifecycle-secret\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.971362 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.971321    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-http\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.971362 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.971330    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-http\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.971362 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.971341    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-http\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.971362 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.971349    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n49c5\" (UniqueName: \"kubernetes.io/projected/8026ef28-64c5-4de5-8839-a5a215263d2e-kube-api-access-n49c5\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.971362 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.971357    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6dqh\" (UniqueName: \"kubernetes.io/projected/aee34cc5-78ad-41ca-965e-125c4217e9d8-kube-api-access-j6dqh\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.971362 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.971366    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-data-science-lokistack-compactor-grpc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.971713 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.971376    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/aee34cc5-78ad-41ca-965e-125c4217e9d8-data-science-lokistack-index-gateway-grpc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.971713 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.971384    5981 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-test-loki-lifecycle-secret\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.971713 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.971395    5981 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/8026ef28-64c5-4de5-8839-a5a215263d2e-test-loki-lifecycle-secret\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:53.971713 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:53.971403    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91-data-science-lokistack-ingester-grpc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:09:54.279643 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:54.277323    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d1c78bb-acd7-4895-976a-c0352eb65287" path="/var/lib/kubelet/pods/2d1c78bb-acd7-4895-976a-c0352eb65287/volumes"
Oct 30 04:09:54.279643 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:54.277902    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77" path="/var/lib/kubelet/pods/fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77/volumes"
Oct 30 04:09:54.708494 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:54.708468    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-2"
Oct 30 04:09:54.708979 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:54.708468    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:09:54.708979 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:54.708470    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 04:09:54.778052 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:54.778006    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw" podUID="d2eeec2d-f433-4e6a-88c8-e51e9e581a19" containerName="loki-distributor" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 04:09:54.800924 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:54.800861    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:09:54.802014 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:54.801986    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:09:54.862500 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:54.862465    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 04:09:54.866200 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:54.866174    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-2"]
Oct 30 04:09:54.925738 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:54.925707    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 04:09:54.929528 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:54.929501    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 04:09:56.275668 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:56.275632    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e16b09b-e3ec-4f46-b01e-c8dac4f21d91" path="/var/lib/kubelet/pods/4e16b09b-e3ec-4f46-b01e-c8dac4f21d91/volumes"
Oct 30 04:09:56.276032 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:56.276015    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8026ef28-64c5-4de5-8839-a5a215263d2e" path="/var/lib/kubelet/pods/8026ef28-64c5-4de5-8839-a5a215263d2e/volumes"
Oct 30 04:09:56.276386 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:56.276369    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aee34cc5-78ad-41ca-965e-125c4217e9d8" path="/var/lib/kubelet/pods/aee34cc5-78ad-41ca-965e-125c4217e9d8/volumes"
Oct 30 04:09:57.090931 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.090886    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"]
Oct 30 04:09:57.091522 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.091502    5981 cpu_manager.go:414] "containerMap: removing container" podUID="fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77" containerName="loki-querier"
Oct 30 04:09:57.091574 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.091527    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77" containerName="loki-querier"
Oct 30 04:09:57.091574 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.091567    5981 cpu_manager.go:414] "containerMap: removing container" podUID="2d1c78bb-acd7-4895-976a-c0352eb65287" containerName="loki-query-frontend"
Oct 30 04:09:57.091654 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.091576    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d1c78bb-acd7-4895-976a-c0352eb65287" containerName="loki-query-frontend"
Oct 30 04:09:57.091686 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.091662    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="fafbed4d-54a9-4aa3-a3a8-e2c9c2446d77" containerName="loki-querier"
Oct 30 04:09:57.091686 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.091681    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d1c78bb-acd7-4895-976a-c0352eb65287" containerName="loki-query-frontend"
Oct 30 04:09:57.095321 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.095297    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.114452 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.114422    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"]
Oct 30 04:09:57.149993 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.149967    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"test-loki-lifecycle-secret\""
Oct 30 04:09:57.150197 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.150179    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-querier-grpc\""
Oct 30 04:09:57.150257 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.150181    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-querier-http\""
Oct 30 04:09:57.150341 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.150270    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-dockercfg-sk4rz\""
Oct 30 04:09:57.200106 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.200074    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.200106 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.200106    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.200387 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.200132    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.200387 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.200306    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-test-loki-lifecycle-secret\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.200387 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.200338    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-config\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.200561 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.200443    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vvbh\" (UniqueName: \"kubernetes.io/projected/2c3ce17c-c721-42a2-801d-9cdcf133de45-kube-api-access-5vvbh\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.245697 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.245664    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"]
Oct 30 04:09:57.249055 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.249032    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.268887 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.268859    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"]
Oct 30 04:09:57.301729 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.301694    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.302192 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.301751    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.302192 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.301809    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-test-loki-lifecycle-secret\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.302192 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.301837    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-config\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.302192 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.301908    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vvbh\" (UniqueName: \"kubernetes.io/projected/2c3ce17c-c721-42a2-801d-9cdcf133de45-kube-api-access-5vvbh\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.302192 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.301959    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.302799 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.302722    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-config\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.302799 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.302719    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.304476 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.304452    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.304668 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.304651    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-test-loki-lifecycle-secret\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.304707 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.304652    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.322582 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.322560    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vvbh\" (UniqueName: \"kubernetes.io/projected/2c3ce17c-c721-42a2-801d-9cdcf133de45-kube-api-access-5vvbh\") pod \"data-science-lokistack-querier-56ffbd5fdc-b6dc6\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.340423 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.340395    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-query-frontend-http\""
Oct 30 04:09:57.340547 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.340475    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-query-frontend-grpc\""
Oct 30 04:09:57.402769 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.402739    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.402918 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.402782    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.402918 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.402809    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-config\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.403037 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.402993    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xfhc\" (UniqueName: \"kubernetes.io/projected/846074a9-8b30-438d-81f5-d4bf818db3ad-kube-api-access-2xfhc\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.403093 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.403070    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.410733 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.410704    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:57.503974 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.503933    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.504447 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.504015    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.504447 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.504058    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-config\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.504447 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.504114    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xfhc\" (UniqueName: \"kubernetes.io/projected/846074a9-8b30-438d-81f5-d4bf818db3ad-kube-api-access-2xfhc\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.504447 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.504183    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.504792 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.504736    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.505022 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.505004    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-config\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.507265 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.507238    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.507431 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.507408    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.528955 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.528926    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xfhc\" (UniqueName: \"kubernetes.io/projected/846074a9-8b30-438d-81f5-d4bf818db3ad-kube-api-access-2xfhc\") pod \"data-science-lokistack-query-frontend-f746fc66d-djqmk\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.562468 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.562432    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:57.703872 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.703813    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"]
Oct 30 04:09:57.706084 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:09:57.706059    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3ce17c_c721_42a2_801d_9cdcf133de45.slice/crio-5777581b84f0608442660a50fb19ccfaff425c9578cac0ebd16209ecc6405287 WatchSource:0}: Error finding container 5777581b84f0608442660a50fb19ccfaff425c9578cac0ebd16209ecc6405287: Status 404 returned error can't find the container with id 5777581b84f0608442660a50fb19ccfaff425c9578cac0ebd16209ecc6405287
Oct 30 04:09:57.723401 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.723374    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6" event={"ID":"2c3ce17c-c721-42a2-801d-9cdcf133de45","Type":"ContainerStarted","Data":"5777581b84f0608442660a50fb19ccfaff425c9578cac0ebd16209ecc6405287"}
Oct 30 04:09:57.854940 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:57.854914    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"]
Oct 30 04:09:57.857465 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:09:57.857439    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846074a9_8b30_438d_81f5_d4bf818db3ad.slice/crio-dc033b5afb1ef30c1bd511b3b1ecd064d9b5345558b8558215292dc2e046ee5d WatchSource:0}: Error finding container dc033b5afb1ef30c1bd511b3b1ecd064d9b5345558b8558215292dc2e046ee5d: Status 404 returned error can't find the container with id dc033b5afb1ef30c1bd511b3b1ecd064d9b5345558b8558215292dc2e046ee5d
Oct 30 04:09:58.728768 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:58.728729    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk" event={"ID":"846074a9-8b30-438d-81f5-d4bf818db3ad","Type":"ContainerStarted","Data":"adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a"}
Oct 30 04:09:58.729192 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:58.728789    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk" event={"ID":"846074a9-8b30-438d-81f5-d4bf818db3ad","Type":"ContainerStarted","Data":"dc033b5afb1ef30c1bd511b3b1ecd064d9b5345558b8558215292dc2e046ee5d"}
Oct 30 04:09:58.729192 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:58.728818    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:09:58.736648 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:58.736614    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6" event={"ID":"2c3ce17c-c721-42a2-801d-9cdcf133de45","Type":"ContainerStarted","Data":"3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0"}
Oct 30 04:09:58.736788 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:58.736731    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:09:58.769877 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:58.769828    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk" podStartSLOduration=1.769814848 podStartE2EDuration="1.769814848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:09:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:09:58.769144475 +0000 UTC m=+5238.611390922" watchObservedRunningTime="2026-10-30 04:09:58.769814848 +0000 UTC m=+5238.612061271"
Oct 30 04:09:58.809953 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:09:58.809902    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6" podStartSLOduration=1.809890148 podStartE2EDuration="1.809890148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:09:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:09:58.809184468 +0000 UTC m=+5238.651430912" watchObservedRunningTime="2026-10-30 04:09:58.809890148 +0000 UTC m=+5238.652136594"
Oct 30 04:10:04.778171 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:04.778127    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw" podUID="d2eeec2d-f433-4e6a-88c8-e51e9e581a19" containerName="loki-distributor" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 04:10:13.599311 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.599255    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 04:10:13.656564 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.656527    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-config\" (UniqueName: \"kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-config\") pod \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") "
Oct 30 04:10:13.656755 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.656589    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-grpc\") pod \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") "
Oct 30 04:10:13.656755 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.656643    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-kube-api-access-trcsh\" (UniqueName: \"kubernetes.io/projected/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-kube-api-access-trcsh\") pod \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") "
Oct 30 04:10:13.656755 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.656698    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-http\") pod \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") "
Oct 30 04:10:13.656905 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.656756    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-ca-bundle\") pod \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\" (UID: \"d2eeec2d-f433-4e6a-88c8-e51e9e581a19\") "
Oct 30 04:10:13.657046 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.657014    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-config" pod "d2eeec2d-f433-4e6a-88c8-e51e9e581a19" (UID: "d2eeec2d-f433-4e6a-88c8-e51e9e581a19"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:10:13.657399 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.657370    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-ca-bundle" pod "d2eeec2d-f433-4e6a-88c8-e51e9e581a19" (UID: "d2eeec2d-f433-4e6a-88c8-e51e9e581a19"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:10:13.659233 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.659207    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-grpc" pod "d2eeec2d-f433-4e6a-88c8-e51e9e581a19" (UID: "d2eeec2d-f433-4e6a-88c8-e51e9e581a19"). InnerVolumeSpecName "data-science-lokistack-distributor-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:10:13.659377 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.659228    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-http" pod "d2eeec2d-f433-4e6a-88c8-e51e9e581a19" (UID: "d2eeec2d-f433-4e6a-88c8-e51e9e581a19"). InnerVolumeSpecName "data-science-lokistack-distributor-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:10:13.659748 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.659723    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-kube-api-access-trcsh" pod "d2eeec2d-f433-4e6a-88c8-e51e9e581a19" (UID: "d2eeec2d-f433-4e6a-88c8-e51e9e581a19"). InnerVolumeSpecName "kube-api-access-trcsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:10:13.758397 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.758350    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-grpc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:10:13.758397 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.758388    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trcsh\" (UniqueName: \"kubernetes.io/projected/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-kube-api-access-trcsh\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:10:13.758397 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.758399    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-distributor-http\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:10:13.758397 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.758408    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-data-science-lokistack-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:10:13.758683 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.758418    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2eeec2d-f433-4e6a-88c8-e51e9e581a19-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:10:13.802488 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.802450    5981 generic.go:356] "Generic (PLEG): container finished" podID="d2eeec2d-f433-4e6a-88c8-e51e9e581a19" containerID="35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f" exitCode=0
Oct 30 04:10:13.802672 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.802502    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"
Oct 30 04:10:13.802672 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.802527    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw" event={"ID":"d2eeec2d-f433-4e6a-88c8-e51e9e581a19","Type":"ContainerDied","Data":"35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f"}
Oct 30 04:10:13.802672 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.802606    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw" event={"ID":"d2eeec2d-f433-4e6a-88c8-e51e9e581a19","Type":"ContainerDied","Data":"8ea293448b0f677ccb6d9dd785ea452f578d6dd855856bf1f4fb4008c2761887"}
Oct 30 04:10:13.802672 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.802627    5981 scope.go:122] "RemoveContainer" containerID="35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f"
Oct 30 04:10:13.811916 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.811894    5981 scope.go:122] "RemoveContainer" containerID="35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f"
Oct 30 04:10:13.812199 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:10:13.812183    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f\": container with ID starting with 35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f not found: ID does not exist" containerID="35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f"
Oct 30 04:10:13.812239 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.812208    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f"} err="failed to get container status \"35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f\": rpc error: code = NotFound desc = could not find container \"35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f\": container with ID starting with 35f2c087df1669c66272cb4976fffe030506cb9776bb8add2891ba1973ee3e2f not found: ID does not exist"
Oct 30 04:10:13.855729 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.855690    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"]
Oct 30 04:10:13.859851 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:13.859820    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-58947679b7-2vwkw"]
Oct 30 04:10:14.275352 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:14.275317    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2eeec2d-f433-4e6a-88c8-e51e9e581a19" path="/var/lib/kubelet/pods/d2eeec2d-f433-4e6a-88c8-e51e9e581a19/volumes"
Oct 30 04:10:14.369661 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:10:14.369622    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:10:19.746541 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:19.746509    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:10:19.747004 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:19.746986    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:10:23.371444 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.371408    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:10:23.371918 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.371766    5981 cpu_manager.go:414] "containerMap: removing container" podUID="d2eeec2d-f433-4e6a-88c8-e51e9e581a19" containerName="loki-distributor"
Oct 30 04:10:23.371918 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.371777    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2eeec2d-f433-4e6a-88c8-e51e9e581a19" containerName="loki-distributor"
Oct 30 04:10:23.371918 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.371832    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2eeec2d-f433-4e6a-88c8-e51e9e581a19" containerName="loki-distributor"
Oct 30 04:10:23.376046 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.376019    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.406007 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.405975    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-index-gateway-http\""
Oct 30 04:10:23.406159 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.406059    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-index-gateway-grpc\""
Oct 30 04:10:23.406917 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.406895    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:10:23.444180 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.444151    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-grpc\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.444338 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.444211    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjxr4\" (UniqueName: \"kubernetes.io/projected/9e0fafca-4572-4150-a4f3-14955b19cf82-kube-api-access-vjxr4\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.444422 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.444391    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-config\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.444483 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.444429    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.444542 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.444490    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-http\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.444542 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.444530    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-test-loki-lifecycle-secret\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.545270 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.545219    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-config\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.545270 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.545268    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.545544 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.545311    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-http\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.545544 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.545334    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-test-loki-lifecycle-secret\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.545544 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.545359    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-grpc\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.545544 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.545419    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjxr4\" (UniqueName: \"kubernetes.io/projected/9e0fafca-4572-4150-a4f3-14955b19cf82-kube-api-access-vjxr4\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.546022 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.545993    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.546324 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.546076    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-config\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.547995 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.547965    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-http\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.548150 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.548126    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-grpc\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.548212 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.548193    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-test-loki-lifecycle-secret\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:23.565274 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:23.565247    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjxr4\" (UniqueName: \"kubernetes.io/projected/9e0fafca-4572-4150-a4f3-14955b19cf82-kube-api-access-vjxr4\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:29.195681 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:29.195634    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:29.226554 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:29.226520    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:29.296534 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:29.296496    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:29.296713 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:29.296657    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:29.311816 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:29.311791    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") DevicePath \"csi-845912705a98225ae51b5905bbffe10957591938b1f46be132bc8c5fbf658fdf\"" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:29.418718 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:29.418686    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/6e1ac281192f43a36c3572fbc5542f9568d0a8effd15d35de030edf273b16d7b/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:29.445258 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:29.445229    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"data-science-lokistack-index-gateway-1\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") " pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:29.689299 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:29.689223    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:29.996567 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:29.996542    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:10:29.998507 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:10:29.998479    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0fafca_4572_4150_a4f3_14955b19cf82.slice/crio-07f473340c47a8d196ce9a4dfe5332bfc27564d6ac735afb2c63bdc289b0c2df WatchSource:0}: Error finding container 07f473340c47a8d196ce9a4dfe5332bfc27564d6ac735afb2c63bdc289b0c2df: Status 404 returned error can't find the container with id 07f473340c47a8d196ce9a4dfe5332bfc27564d6ac735afb2c63bdc289b0c2df
Oct 30 04:10:30.879160 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:30.879121    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" event={"ID":"9e0fafca-4572-4150-a4f3-14955b19cf82","Type":"ContainerStarted","Data":"c0e391eadcd9592aa804479e6f5dd98ec7f64c859a45e427822218ecbdd018fa"}
Oct 30 04:10:30.879608 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:30.879169    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" event={"ID":"9e0fafca-4572-4150-a4f3-14955b19cf82","Type":"ContainerStarted","Data":"07f473340c47a8d196ce9a4dfe5332bfc27564d6ac735afb2c63bdc289b0c2df"}
Oct 30 04:10:30.879608 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:30.879254    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:30.921566 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:30.921509    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" podStartSLOduration=7.921491494 podStartE2EDuration="7.921491494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 04:10:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:10:30.920662608 +0000 UTC m=+5270.762909052" watchObservedRunningTime="2026-10-30 04:10:30.921491494 +0000 UTC m=+5270.763737940"
Oct 30 04:10:44.369028 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:10:44.368993    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:10:50.406658 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.406624    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-1"]
Oct 30 04:10:50.411649 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.411626    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.427872 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.427844    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-1"]
Oct 30 04:10:50.439898 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.439872    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-http\""
Oct 30 04:10:50.440034 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.439931    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-grpc\""
Oct 30 04:10:50.588394 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.588356    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-config\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.588394 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.588395    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.588655 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.588416    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzplm\" (UniqueName: \"kubernetes.io/projected/22799503-7f62-41a4-a22d-dd2a8779cded-kube-api-access-vzplm\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.588655 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.588558    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.588655 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.588603    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-test-loki-lifecycle-secret\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.588655 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.588636    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.689839 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.689749    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.689839 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.689820    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-test-loki-lifecycle-secret\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.690046 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.689859    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.690046 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.689998    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-config\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.690130 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.690055    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.690130 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.690090    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzplm\" (UniqueName: \"kubernetes.io/projected/22799503-7f62-41a4-a22d-dd2a8779cded-kube-api-access-vzplm\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.690825 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.690800    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.691073 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.691049    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-config\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.692681 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.692654    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.692839 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.692820    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-test-loki-lifecycle-secret\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.692939 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.692920    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:50.710504 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:50.710484    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzplm\" (UniqueName: \"kubernetes.io/projected/22799503-7f62-41a4-a22d-dd2a8779cded-kube-api-access-vzplm\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:51.895089 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:51.895057    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:10:59.575410 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.575367    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-6acba876-4b26-4d86-82a3-9597067b448e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.575938 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.575465    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-fe9d2922-c444-4fae-a23f-25a28559cb0b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.606204 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.606164    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-6acba876-4b26-4d86-82a3-9597067b448e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.606204 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.606198    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-fe9d2922-c444-4fae-a23f-25a28559cb0b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.676740 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.676697    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-fe9d2922-c444-4fae-a23f-25a28559cb0b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.676952 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.676759    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-6acba876-4b26-4d86-82a3-9597067b448e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.676952 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.676861    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-fe9d2922-c444-4fae-a23f-25a28559cb0b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.676952 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.676921    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-6acba876-4b26-4d86-82a3-9597067b448e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.695579 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.695550    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-6acba876-4b26-4d86-82a3-9597067b448e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") DevicePath \"csi-ec32bc4cf6b8f07a700415d3fe3afba7569d7e6db1612689e787e942f0452cfd\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.695726 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.695581    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-fe9d2922-c444-4fae-a23f-25a28559cb0b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") DevicePath \"csi-56e559e1dc1443387221bcc1b64380a5be1f49275fcb801ff8d7642679bfac8c\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.803400 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.803363    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-6acba876-4b26-4d86-82a3-9597067b448e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/7230c46a45bf313912a2ed81d5eb4c8b90077d8ed7189436af8d364ee20bac80/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.812759 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.812727    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-fe9d2922-c444-4fae-a23f-25a28559cb0b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/84bf2a1793914136c47db119cd10a17b4f6b9dae3231cb12f25dff5e3840823b/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.835211 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.835136    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-6acba876-4b26-4d86-82a3-9597067b448e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:10:59.839869 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:10:59.839832    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-fe9d2922-c444-4fae-a23f-25a28559cb0b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe\") pod \"data-science-lokistack-ingester-1\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:11:00.023527 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:11:00.023490    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:11:00.327339 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:11:00.327315    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-1"]
Oct 30 04:11:00.329353 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:11:00.329324    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22799503_7f62_41a4_a22d_dd2a8779cded.slice/crio-f283d31e0b5f139e4034b846858b94c88aefd435aeed6559198ea942156253a7 WatchSource:0}: Error finding container f283d31e0b5f139e4034b846858b94c88aefd435aeed6559198ea942156253a7: Status 404 returned error can't find the container with id f283d31e0b5f139e4034b846858b94c88aefd435aeed6559198ea942156253a7
Oct 30 04:11:01.009831 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:11:01.009793    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" event={"ID":"22799503-7f62-41a4-a22d-dd2a8779cded","Type":"ContainerStarted","Data":"c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab"}
Oct 30 04:11:01.010305 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:11:01.009853    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" event={"ID":"22799503-7f62-41a4-a22d-dd2a8779cded","Type":"ContainerStarted","Data":"f283d31e0b5f139e4034b846858b94c88aefd435aeed6559198ea942156253a7"}
Oct 30 04:11:01.010305 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:11:01.009965    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:11:01.052446 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:11:01.052389    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" podStartSLOduration=11.052371812 podStartE2EDuration="11.052371812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 04:10:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:11:01.051514901 +0000 UTC m=+5300.893761371" watchObservedRunningTime="2026-10-30 04:11:01.052371812 +0000 UTC m=+5300.894618258"
Oct 30 04:11:14.368360 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:11:14.368324    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:11:22.020158 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:11:22.020064    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" podUID="22799503-7f62-41a4-a22d-dd2a8779cded" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 04:11:32.018518 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:11:32.018465    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" podUID="22799503-7f62-41a4-a22d-dd2a8779cded" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 04:11:42.019895 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:11:42.019857    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:11:44.370342 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:11:44.370308    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:12:14.369594 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:12:14.369554    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:12:34.648996 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.648954    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"]
Oct 30 04:12:34.653610 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.653587    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:34.671415 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.671386    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"]
Oct 30 04:12:34.683363 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.683331    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-headless-tls\""
Oct 30 04:12:34.683532 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.683368    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-60155212\""
Oct 30 04:12:34.748012 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.747977    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2e83ec3c-437c-454f-aabf-9958973db157-otc-internal\") pod \"data-science-usage-logs-collector-6d8f74f69b-fl49t\" (UID: \"2e83ec3c-437c-454f-aabf-9958973db157\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:34.748191 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.748046    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e83ec3c-437c-454f-aabf-9958973db157-otlp-tls-certs\") pod \"data-science-usage-logs-collector-6d8f74f69b-fl49t\" (UID: \"2e83ec3c-437c-454f-aabf-9958973db157\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:34.748191 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.748171    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v6rp\" (UniqueName: \"kubernetes.io/projected/2e83ec3c-437c-454f-aabf-9958973db157-kube-api-access-7v6rp\") pod \"data-science-usage-logs-collector-6d8f74f69b-fl49t\" (UID: \"2e83ec3c-437c-454f-aabf-9958973db157\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:34.848618 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.848583    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e83ec3c-437c-454f-aabf-9958973db157-otlp-tls-certs\") pod \"data-science-usage-logs-collector-6d8f74f69b-fl49t\" (UID: \"2e83ec3c-437c-454f-aabf-9958973db157\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:34.848808 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.848645    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v6rp\" (UniqueName: \"kubernetes.io/projected/2e83ec3c-437c-454f-aabf-9958973db157-kube-api-access-7v6rp\") pod \"data-science-usage-logs-collector-6d8f74f69b-fl49t\" (UID: \"2e83ec3c-437c-454f-aabf-9958973db157\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:34.848808 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.848720    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2e83ec3c-437c-454f-aabf-9958973db157-otc-internal\") pod \"data-science-usage-logs-collector-6d8f74f69b-fl49t\" (UID: \"2e83ec3c-437c-454f-aabf-9958973db157\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:34.849408 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.849380    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2e83ec3c-437c-454f-aabf-9958973db157-otc-internal\") pod \"data-science-usage-logs-collector-6d8f74f69b-fl49t\" (UID: \"2e83ec3c-437c-454f-aabf-9958973db157\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:34.851089 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.851068    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e83ec3c-437c-454f-aabf-9958973db157-otlp-tls-certs\") pod \"data-science-usage-logs-collector-6d8f74f69b-fl49t\" (UID: \"2e83ec3c-437c-454f-aabf-9958973db157\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:34.870571 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.870546    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v6rp\" (UniqueName: \"kubernetes.io/projected/2e83ec3c-437c-454f-aabf-9958973db157-kube-api-access-7v6rp\") pod \"data-science-usage-logs-collector-6d8f74f69b-fl49t\" (UID: \"2e83ec3c-437c-454f-aabf-9958973db157\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:34.967934 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:34.967857    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:35.272203 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:35.272173    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"]
Oct 30 04:12:35.273744 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:12:35.273713    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e83ec3c_437c_454f_aabf_9958973db157.slice/crio-f862a20479fb687f3fdd832506c06a27c534cfeac358c54262275010f07b26ab WatchSource:0}: Error finding container f862a20479fb687f3fdd832506c06a27c534cfeac358c54262275010f07b26ab: Status 404 returned error can't find the container with id f862a20479fb687f3fdd832506c06a27c534cfeac358c54262275010f07b26ab
Oct 30 04:12:35.275950 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:35.275914    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:12:35.276045 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:35.275973    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:12:35.412763 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:35.412726    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t" event={"ID":"2e83ec3c-437c-454f-aabf-9958973db157","Type":"ContainerStarted","Data":"97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1"}
Oct 30 04:12:35.412973 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:35.412783    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t" event={"ID":"2e83ec3c-437c-454f-aabf-9958973db157","Type":"ContainerStarted","Data":"f862a20479fb687f3fdd832506c06a27c534cfeac358c54262275010f07b26ab"}
Oct 30 04:12:35.455844 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:35.455798    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t" podStartSLOduration=1.455783438 podStartE2EDuration="1.455783438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:12:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:12:35.454667329 +0000 UTC m=+5395.296913824" watchObservedRunningTime="2026-10-30 04:12:35.455783438 +0000 UTC m=+5395.298029882"
Oct 30 04:12:38.278480 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.278444    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:12:38.279082 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.279047    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" podUID="9e0fafca-4572-4150-a4f3-14955b19cf82" containerName="loki-index-gateway" containerID="cri-o://c0e391eadcd9592aa804479e6f5dd98ec7f64c859a45e427822218ecbdd018fa" gracePeriod=30
Oct 30 04:12:38.316151 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.316122    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-1"]
Oct 30 04:12:38.316400 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.316374    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" podUID="22799503-7f62-41a4-a22d-dd2a8779cded" containerName="loki-ingester" containerID="cri-o://c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab" gracePeriod=600
Oct 30 04:12:38.333049 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.333013    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"]
Oct 30 04:12:38.333322 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.333268    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6" podUID="2c3ce17c-c721-42a2-801d-9cdcf133de45" containerName="loki-querier" containerID="cri-o://3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0" gracePeriod=30
Oct 30 04:12:38.341343 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.341277    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"]
Oct 30 04:12:38.341548 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.341497    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk" podUID="846074a9-8b30-438d-81f5-d4bf818db3ad" containerName="loki-query-frontend" containerID="cri-o://adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a" gracePeriod=30
Oct 30 04:12:38.427054 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.427023    5981 generic.go:356] "Generic (PLEG): container finished" podID="9e0fafca-4572-4150-a4f3-14955b19cf82" containerID="c0e391eadcd9592aa804479e6f5dd98ec7f64c859a45e427822218ecbdd018fa" exitCode=0
Oct 30 04:12:38.427216 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.427109    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" event={"ID":"9e0fafca-4572-4150-a4f3-14955b19cf82","Type":"ContainerDied","Data":"c0e391eadcd9592aa804479e6f5dd98ec7f64c859a45e427822218ecbdd018fa"}
Oct 30 04:12:38.488995 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.487602    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"]
Oct 30 04:12:38.488995 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.487867    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t" podUID="2e83ec3c-437c-454f-aabf-9958973db157" containerName="otc-container" containerID="cri-o://97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1" gracePeriod=30
Oct 30 04:12:38.659349 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.659321    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:12:38.661570 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.661541    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:12:38.775103 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.775071    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.786581    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-test-loki-lifecycle-secret\") pod \"9e0fafca-4572-4150-a4f3-14955b19cf82\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") "
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.786665    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/846074a9-8b30-438d-81f5-d4bf818db3ad-kube-api-access-2xfhc\" (UniqueName: \"kubernetes.io/projected/846074a9-8b30-438d-81f5-d4bf818db3ad-kube-api-access-2xfhc\") pod \"846074a9-8b30-438d-81f5-d4bf818db3ad\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") "
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.786715    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-grpc\") pod \"9e0fafca-4572-4150-a4f3-14955b19cf82\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") "
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.786845    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") pod \"9e0fafca-4572-4150-a4f3-14955b19cf82\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") "
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.786895    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-grpc\") pod \"846074a9-8b30-438d-81f5-d4bf818db3ad\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") "
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.786924    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-http\") pod \"9e0fafca-4572-4150-a4f3-14955b19cf82\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") "
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.786964    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-config\" (UniqueName: \"kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-config\") pod \"846074a9-8b30-438d-81f5-d4bf818db3ad\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") "
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.787003    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-config\" (UniqueName: \"kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-config\") pod \"9e0fafca-4572-4150-a4f3-14955b19cf82\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") "
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.787040    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-ca-bundle\") pod \"846074a9-8b30-438d-81f5-d4bf818db3ad\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") "
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.787073    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-http\") pod \"846074a9-8b30-438d-81f5-d4bf818db3ad\" (UID: \"846074a9-8b30-438d-81f5-d4bf818db3ad\") "
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.787111    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-ca-bundle\") pod \"9e0fafca-4572-4150-a4f3-14955b19cf82\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") "
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.787150    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e0fafca-4572-4150-a4f3-14955b19cf82-kube-api-access-vjxr4\" (UniqueName: \"kubernetes.io/projected/9e0fafca-4572-4150-a4f3-14955b19cf82-kube-api-access-vjxr4\") pod \"9e0fafca-4572-4150-a4f3-14955b19cf82\" (UID: \"9e0fafca-4572-4150-a4f3-14955b19cf82\") "
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.787546    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-ca-bundle" pod "846074a9-8b30-438d-81f5-d4bf818db3ad" (UID: "846074a9-8b30-438d-81f5-d4bf818db3ad"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.787763    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-config" pod "846074a9-8b30-438d-81f5-d4bf818db3ad" (UID: "846074a9-8b30-438d-81f5-d4bf818db3ad"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:12:38.788108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.788001    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-config" pod "9e0fafca-4572-4150-a4f3-14955b19cf82" (UID: "9e0fafca-4572-4150-a4f3-14955b19cf82"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:12:38.789026 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.788412    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-ca-bundle" pod "9e0fafca-4572-4150-a4f3-14955b19cf82" (UID: "9e0fafca-4572-4150-a4f3-14955b19cf82"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:12:38.790364 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.790320    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0fafca-4572-4150-a4f3-14955b19cf82-kube-api-access-vjxr4" pod "9e0fafca-4572-4150-a4f3-14955b19cf82" (UID: "9e0fafca-4572-4150-a4f3-14955b19cf82"). InnerVolumeSpecName "kube-api-access-vjxr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:12:38.790864 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.790838    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-test-loki-lifecycle-secret" pod "9e0fafca-4572-4150-a4f3-14955b19cf82" (UID: "9e0fafca-4572-4150-a4f3-14955b19cf82"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:38.791526 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.791494    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-grpc" pod "9e0fafca-4572-4150-a4f3-14955b19cf82" (UID: "9e0fafca-4572-4150-a4f3-14955b19cf82"). InnerVolumeSpecName "data-science-lokistack-index-gateway-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:38.791526 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.791503    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-grpc" pod "846074a9-8b30-438d-81f5-d4bf818db3ad" (UID: "846074a9-8b30-438d-81f5-d4bf818db3ad"). InnerVolumeSpecName "data-science-lokistack-query-frontend-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:38.791873 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.791845    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476" pod "9e0fafca-4572-4150-a4f3-14955b19cf82" (UID: "9e0fafca-4572-4150-a4f3-14955b19cf82"). InnerVolumeSpecName "pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 04:12:38.792131 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.792108    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846074a9-8b30-438d-81f5-d4bf818db3ad-kube-api-access-2xfhc" pod "846074a9-8b30-438d-81f5-d4bf818db3ad" (UID: "846074a9-8b30-438d-81f5-d4bf818db3ad"). InnerVolumeSpecName "kube-api-access-2xfhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:12:38.792533 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.792516    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-http" pod "846074a9-8b30-438d-81f5-d4bf818db3ad" (UID: "846074a9-8b30-438d-81f5-d4bf818db3ad"). InnerVolumeSpecName "data-science-lokistack-query-frontend-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:38.793518 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.793495    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-http" pod "9e0fafca-4572-4150-a4f3-14955b19cf82" (UID: "9e0fafca-4572-4150-a4f3-14955b19cf82"). InnerVolumeSpecName "data-science-lokistack-index-gateway-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:38.888780 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.888685    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e83ec3c-437c-454f-aabf-9958973db157-otc-internal\" (UniqueName: \"kubernetes.io/configmap/2e83ec3c-437c-454f-aabf-9958973db157-otc-internal\") pod \"2e83ec3c-437c-454f-aabf-9958973db157\" (UID: \"2e83ec3c-437c-454f-aabf-9958973db157\") "
Oct 30 04:12:38.888957 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.888799    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e83ec3c-437c-454f-aabf-9958973db157-kube-api-access-7v6rp\" (UniqueName: \"kubernetes.io/projected/2e83ec3c-437c-454f-aabf-9958973db157-kube-api-access-7v6rp\") pod \"2e83ec3c-437c-454f-aabf-9958973db157\" (UID: \"2e83ec3c-437c-454f-aabf-9958973db157\") "
Oct 30 04:12:38.888957 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.888849    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e83ec3c-437c-454f-aabf-9958973db157-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e83ec3c-437c-454f-aabf-9958973db157-otlp-tls-certs\") pod \"2e83ec3c-437c-454f-aabf-9958973db157\" (UID: \"2e83ec3c-437c-454f-aabf-9958973db157\") "
Oct 30 04:12:38.889098 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889076    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xfhc\" (UniqueName: \"kubernetes.io/projected/846074a9-8b30-438d-81f5-d4bf818db3ad-kube-api-access-2xfhc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.889151 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889101    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-grpc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.889151 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889106    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e83ec3c-437c-454f-aabf-9958973db157-otc-internal" pod "2e83ec3c-437c-454f-aabf-9958973db157" (UID: "2e83ec3c-437c-454f-aabf-9958973db157"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:12:38.889151 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889137    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 04:12:38.889328 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889154    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-grpc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.889328 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889170    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-index-gateway-http\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.889328 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889183    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.889328 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889195    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.889328 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889208    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.889328 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889217    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/846074a9-8b30-438d-81f5-d4bf818db3ad-data-science-lokistack-query-frontend-http\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.889328 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889231    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e0fafca-4572-4150-a4f3-14955b19cf82-data-science-lokistack-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.889328 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889240    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjxr4\" (UniqueName: \"kubernetes.io/projected/9e0fafca-4572-4150-a4f3-14955b19cf82-kube-api-access-vjxr4\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.889328 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.889249    5981 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/9e0fafca-4572-4150-a4f3-14955b19cf82-test-loki-lifecycle-secret\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.891191 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.891160    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e83ec3c-437c-454f-aabf-9958973db157-otlp-tls-certs" pod "2e83ec3c-437c-454f-aabf-9958973db157" (UID: "2e83ec3c-437c-454f-aabf-9958973db157"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:38.891399 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.891227    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e83ec3c-437c-454f-aabf-9958973db157-kube-api-access-7v6rp" pod "2e83ec3c-437c-454f-aabf-9958973db157" (UID: "2e83ec3c-437c-454f-aabf-9958973db157"). InnerVolumeSpecName "kube-api-access-7v6rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:12:38.898802 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.898782    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476") on node "ip-10-0-128-202.ec2.internal"
Oct 30 04:12:38.917574 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.917550    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:12:38.990225 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.990188    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-grpc\") pod \"2c3ce17c-c721-42a2-801d-9cdcf133de45\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") "
Oct 30 04:12:38.990444 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.990270    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c3ce17c-c721-42a2-801d-9cdcf133de45-kube-api-access-5vvbh\" (UniqueName: \"kubernetes.io/projected/2c3ce17c-c721-42a2-801d-9cdcf133de45-kube-api-access-5vvbh\") pod \"2c3ce17c-c721-42a2-801d-9cdcf133de45\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") "
Oct 30 04:12:38.990444 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.990322    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-test-loki-lifecycle-secret\") pod \"2c3ce17c-c721-42a2-801d-9cdcf133de45\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") "
Oct 30 04:12:38.990444 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.990345    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-http\") pod \"2c3ce17c-c721-42a2-801d-9cdcf133de45\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") "
Oct 30 04:12:38.990444 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.990410    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-ca-bundle\") pod \"2c3ce17c-c721-42a2-801d-9cdcf133de45\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") "
Oct 30 04:12:38.990656 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.990457    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-config\" (UniqueName: \"kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-config\") pod \"2c3ce17c-c721-42a2-801d-9cdcf133de45\" (UID: \"2c3ce17c-c721-42a2-801d-9cdcf133de45\") "
Oct 30 04:12:38.990746 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.990725    5981 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2e83ec3c-437c-454f-aabf-9958973db157-otc-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.990815 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.990754    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-ecbc86f5-becc-4ef5-8d97-df4874712b55\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0599848a2f7418476\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-845912705a98225ae51b5905bbffe10957591938b1f46be132bc8c5fbf658fdf\""
Oct 30 04:12:38.990815 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.990770    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v6rp\" (UniqueName: \"kubernetes.io/projected/2e83ec3c-437c-454f-aabf-9958973db157-kube-api-access-7v6rp\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.990815 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.990784    5981 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e83ec3c-437c-454f-aabf-9958973db157-otlp-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:38.990937 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.990829    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-ca-bundle" pod "2c3ce17c-c721-42a2-801d-9cdcf133de45" (UID: "2c3ce17c-c721-42a2-801d-9cdcf133de45"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:12:38.990937 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.990844    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-config" pod "2c3ce17c-c721-42a2-801d-9cdcf133de45" (UID: "2c3ce17c-c721-42a2-801d-9cdcf133de45"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:12:38.992657 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.992632    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-grpc" pod "2c3ce17c-c721-42a2-801d-9cdcf133de45" (UID: "2c3ce17c-c721-42a2-801d-9cdcf133de45"). InnerVolumeSpecName "data-science-lokistack-querier-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:38.992830 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.992810    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-test-loki-lifecycle-secret" pod "2c3ce17c-c721-42a2-801d-9cdcf133de45" (UID: "2c3ce17c-c721-42a2-801d-9cdcf133de45"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:38.993101 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.993085    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-http" pod "2c3ce17c-c721-42a2-801d-9cdcf133de45" (UID: "2c3ce17c-c721-42a2-801d-9cdcf133de45"). InnerVolumeSpecName "data-science-lokistack-querier-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:38.993149 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:38.993107    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3ce17c-c721-42a2-801d-9cdcf133de45-kube-api-access-5vvbh" pod "2c3ce17c-c721-42a2-801d-9cdcf133de45" (UID: "2c3ce17c-c721-42a2-801d-9cdcf133de45"). InnerVolumeSpecName "kube-api-access-5vvbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:12:39.091779 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.091737    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:39.091779 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.091773    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c3ce17c-c721-42a2-801d-9cdcf133de45-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:39.091779 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.091783    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-grpc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:39.092026 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.091793    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vvbh\" (UniqueName: \"kubernetes.io/projected/2c3ce17c-c721-42a2-801d-9cdcf133de45-kube-api-access-5vvbh\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:39.092026 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.091803    5981 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-test-loki-lifecycle-secret\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:39.092026 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.091813    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/2c3ce17c-c721-42a2-801d-9cdcf133de45-data-science-lokistack-querier-http\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:39.257046 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.257022    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:12:39.267855 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.267828    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 04:12:39.272379 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.272347    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 04:12:39.313864 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.313834    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 04:12:39.314360 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.314011    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/seaweedfs" podUID="9f6855eb-e461-4674-a574-7ae6457d0af9" containerName="seaweedfs" containerID="cri-o://3f286a3b43c3e04706541919c0be19bc9fa97414046bedf48f617316c3432771" gracePeriod=30
Oct 30 04:12:39.394482 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.394436    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-config\" (UniqueName: \"kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-config\") pod \"22799503-7f62-41a4-a22d-dd2a8779cded\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") "
Oct 30 04:12:39.394691 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.394490    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-grpc\") pod \"22799503-7f62-41a4-a22d-dd2a8779cded\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") "
Oct 30 04:12:39.394691 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.394623    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5\") pod \"22799503-7f62-41a4-a22d-dd2a8779cded\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") "
Oct 30 04:12:39.394691 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.394686    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe\") pod \"22799503-7f62-41a4-a22d-dd2a8779cded\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") "
Oct 30 04:12:39.394863 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.394744    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ca-bundle\") pod \"22799503-7f62-41a4-a22d-dd2a8779cded\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") "
Oct 30 04:12:39.394863 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.394776    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-test-loki-lifecycle-secret\") pod \"22799503-7f62-41a4-a22d-dd2a8779cded\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") "
Oct 30 04:12:39.394976 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.394871    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-http\") pod \"22799503-7f62-41a4-a22d-dd2a8779cded\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") "
Oct 30 04:12:39.394976 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.394917    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22799503-7f62-41a4-a22d-dd2a8779cded-kube-api-access-vzplm\" (UniqueName: \"kubernetes.io/projected/22799503-7f62-41a4-a22d-dd2a8779cded-kube-api-access-vzplm\") pod \"22799503-7f62-41a4-a22d-dd2a8779cded\" (UID: \"22799503-7f62-41a4-a22d-dd2a8779cded\") "
Oct 30 04:12:39.395406 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.394914    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-config" pod "22799503-7f62-41a4-a22d-dd2a8779cded" (UID: "22799503-7f62-41a4-a22d-dd2a8779cded"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:12:39.395406 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.395081    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ca-bundle" pod "22799503-7f62-41a4-a22d-dd2a8779cded" (UID: "22799503-7f62-41a4-a22d-dd2a8779cded"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:12:39.395558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.395399    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:39.395558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.395428    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ca-bundle\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:39.397513 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.397486    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-test-loki-lifecycle-secret" pod "22799503-7f62-41a4-a22d-dd2a8779cded" (UID: "22799503-7f62-41a4-a22d-dd2a8779cded"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:39.397636 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.397510    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-http" pod "22799503-7f62-41a4-a22d-dd2a8779cded" (UID: "22799503-7f62-41a4-a22d-dd2a8779cded"). InnerVolumeSpecName "data-science-lokistack-ingester-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:39.397636 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.397552    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-grpc" pod "22799503-7f62-41a4-a22d-dd2a8779cded" (UID: "22799503-7f62-41a4-a22d-dd2a8779cded"). InnerVolumeSpecName "data-science-lokistack-ingester-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:12:39.397924 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.397898    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22799503-7f62-41a4-a22d-dd2a8779cded-kube-api-access-vzplm" pod "22799503-7f62-41a4-a22d-dd2a8779cded" (UID: "22799503-7f62-41a4-a22d-dd2a8779cded"). InnerVolumeSpecName "kube-api-access-vzplm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:12:39.398207 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.398185    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5" pod "22799503-7f62-41a4-a22d-dd2a8779cded" (UID: "22799503-7f62-41a4-a22d-dd2a8779cded"). InnerVolumeSpecName "pvc-6acba876-4b26-4d86-82a3-9597067b448e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 04:12:39.398401 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.398385    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe" pod "22799503-7f62-41a4-a22d-dd2a8779cded" (UID: "22799503-7f62-41a4-a22d-dd2a8779cded"). InnerVolumeSpecName "pvc-fe9d2922-c444-4fae-a23f-25a28559cb0b". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 04:12:39.433335 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.433229    5981 generic.go:356] "Generic (PLEG): container finished" podID="2c3ce17c-c721-42a2-801d-9cdcf133de45" containerID="3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0" exitCode=0
Oct 30 04:12:39.433335 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.433274    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"
Oct 30 04:12:39.433335 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.433321    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6" event={"ID":"2c3ce17c-c721-42a2-801d-9cdcf133de45","Type":"ContainerDied","Data":"3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0"}
Oct 30 04:12:39.433630 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.433373    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6" event={"ID":"2c3ce17c-c721-42a2-801d-9cdcf133de45","Type":"ContainerDied","Data":"5777581b84f0608442660a50fb19ccfaff425c9578cac0ebd16209ecc6405287"}
Oct 30 04:12:39.433630 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.433398    5981 scope.go:122] "RemoveContainer" containerID="3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0"
Oct 30 04:12:39.434744 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.434724    5981 generic.go:356] "Generic (PLEG): container finished" podID="22799503-7f62-41a4-a22d-dd2a8779cded" containerID="c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab" exitCode=0
Oct 30 04:12:39.434846 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.434768    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1"
Oct 30 04:12:39.434846 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.434791    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" event={"ID":"22799503-7f62-41a4-a22d-dd2a8779cded","Type":"ContainerDied","Data":"c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab"}
Oct 30 04:12:39.434846 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.434825    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-1" event={"ID":"22799503-7f62-41a4-a22d-dd2a8779cded","Type":"ContainerDied","Data":"f283d31e0b5f139e4034b846858b94c88aefd435aeed6559198ea942156253a7"}
Oct 30 04:12:39.436411 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.436391    5981 generic.go:356] "Generic (PLEG): container finished" podID="2e83ec3c-437c-454f-aabf-9958973db157" containerID="97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1" exitCode=0
Oct 30 04:12:39.436521 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.436440    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"
Oct 30 04:12:39.436521 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.436504    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t" event={"ID":"2e83ec3c-437c-454f-aabf-9958973db157","Type":"ContainerDied","Data":"97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1"}
Oct 30 04:12:39.436639 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.436541    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t" event={"ID":"2e83ec3c-437c-454f-aabf-9958973db157","Type":"ContainerDied","Data":"f862a20479fb687f3fdd832506c06a27c534cfeac358c54262275010f07b26ab"}
Oct 30 04:12:39.438043 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.438019    5981 generic.go:356] "Generic (PLEG): container finished" podID="846074a9-8b30-438d-81f5-d4bf818db3ad" containerID="adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a" exitCode=0
Oct 30 04:12:39.438246 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.438075    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"
Oct 30 04:12:39.438246 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.438097    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk" event={"ID":"846074a9-8b30-438d-81f5-d4bf818db3ad","Type":"ContainerDied","Data":"adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a"}
Oct 30 04:12:39.438246 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.438140    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk" event={"ID":"846074a9-8b30-438d-81f5-d4bf818db3ad","Type":"ContainerDied","Data":"dc033b5afb1ef30c1bd511b3b1ecd064d9b5345558b8558215292dc2e046ee5d"}
Oct 30 04:12:39.439852 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.439760    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1" event={"ID":"9e0fafca-4572-4150-a4f3-14955b19cf82","Type":"ContainerDied","Data":"07f473340c47a8d196ce9a4dfe5332bfc27564d6ac735afb2c63bdc289b0c2df"}
Oct 30 04:12:39.439852 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.439798    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-index-gateway-1"
Oct 30 04:12:39.445413 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.445394    5981 scope.go:122] "RemoveContainer" containerID="3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0"
Oct 30 04:12:39.445762 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:12:39.445720    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0\": container with ID starting with 3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0 not found: ID does not exist" containerID="3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0"
Oct 30 04:12:39.446254 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.445757    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0"} err="failed to get container status \"3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0\": rpc error: code = NotFound desc = could not find container \"3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0\": container with ID starting with 3a3b8c89ee27e1160ba499b274d14c0c88560d8ea75dc581c7ac53a06d7b2ec0 not found: ID does not exist"
Oct 30 04:12:39.446254 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.445780    5981 scope.go:122] "RemoveContainer" containerID="c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab"
Oct 30 04:12:39.456697 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.456675    5981 scope.go:122] "RemoveContainer" containerID="c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab"
Oct 30 04:12:39.456957 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:12:39.456941    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab\": container with ID starting with c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab not found: ID does not exist" containerID="c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab"
Oct 30 04:12:39.457026 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.456966    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab"} err="failed to get container status \"c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab\": rpc error: code = NotFound desc = could not find container \"c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab\": container with ID starting with c5f547c3c9feb76140576d87d242264cb813b21e10a5ec1f808a04c80449a9ab not found: ID does not exist"
Oct 30 04:12:39.457026 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.456982    5981 scope.go:122] "RemoveContainer" containerID="97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1"
Oct 30 04:12:39.465345 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.465323    5981 scope.go:122] "RemoveContainer" containerID="97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1"
Oct 30 04:12:39.465675 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:12:39.465652    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1\": container with ID starting with 97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1 not found: ID does not exist" containerID="97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1"
Oct 30 04:12:39.465728 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.465684    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1"} err="failed to get container status \"97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1\": rpc error: code = NotFound desc = could not find container \"97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1\": container with ID starting with 97d5cd97b4a8167c20dedfb822586af383a4077cd358258d8f0858bf15a42ec1 not found: ID does not exist"
Oct 30 04:12:39.465728 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.465702    5981 scope.go:122] "RemoveContainer" containerID="adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a"
Oct 30 04:12:39.477150 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.477131    5981 scope.go:122] "RemoveContainer" containerID="adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a"
Oct 30 04:12:39.477473 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:12:39.477452    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a\": container with ID starting with adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a not found: ID does not exist" containerID="adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a"
Oct 30 04:12:39.477561 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.477486    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a"} err="failed to get container status \"adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a\": rpc error: code = NotFound desc = could not find container \"adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a\": container with ID starting with adb5fa182bb7c46b1405e54bbc81156474c6116b0ea99a17da41b1657861015a not found: ID does not exist"
Oct 30 04:12:39.477561 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.477512    5981 scope.go:122] "RemoveContainer" containerID="c0e391eadcd9592aa804479e6f5dd98ec7f64c859a45e427822218ecbdd018fa"
Oct 30 04:12:39.496107 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.496080    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-grpc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:39.496298 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.496124    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-6acba876-4b26-4d86-82a3-9597067b448e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 04:12:39.496298 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.496139    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-fe9d2922-c444-4fae-a23f-25a28559cb0b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 04:12:39.496298 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.496150    5981 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-test-loki-lifecycle-secret\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:39.496298 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.496160    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/22799503-7f62-41a4-a22d-dd2a8779cded-data-science-lokistack-ingester-http\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:39.496298 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.496170    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzplm\" (UniqueName: \"kubernetes.io/projected/22799503-7f62-41a4-a22d-dd2a8779cded-kube-api-access-vzplm\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:12:39.505915 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.505896    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-fe9d2922-c444-4fae-a23f-25a28559cb0b" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe") on node "ip-10-0-128-202.ec2.internal"
Oct 30 04:12:39.509215 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.509195    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-6acba876-4b26-4d86-82a3-9597067b448e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5") on node "ip-10-0-128-202.ec2.internal"
Oct 30 04:12:39.516390 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.516365    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"]
Oct 30 04:12:39.520079 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.520055    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-56ffbd5fdc-b6dc6"]
Oct 30 04:12:39.588734 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.588696    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"]
Oct 30 04:12:39.596510 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.596482    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-f746fc66d-djqmk"]
Oct 30 04:12:39.596826 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.596800    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-6acba876-4b26-4d86-82a3-9597067b448e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0440facc99ae98de5\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-ec32bc4cf6b8f07a700415d3fe3afba7569d7e6db1612689e787e942f0452cfd\""
Oct 30 04:12:39.596875 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.596834    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-fe9d2922-c444-4fae-a23f-25a28559cb0b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-010dfbf7cdb61bbbe\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-56e559e1dc1443387221bcc1b64380a5be1f49275fcb801ff8d7642679bfac8c\""
Oct 30 04:12:39.633837 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.633802    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:12:39.637165 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.637138    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-index-gateway-1"]
Oct 30 04:12:39.672442 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.672301    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"]
Oct 30 04:12:39.677679 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.677651    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-6d8f74f69b-fl49t"]
Oct 30 04:12:39.713895 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.713815    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-1"]
Oct 30 04:12:39.717929 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:39.717903    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-1"]
Oct 30 04:12:40.276936 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:40.276901    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="22799503-7f62-41a4-a22d-dd2a8779cded" path="/var/lib/kubelet/pods/22799503-7f62-41a4-a22d-dd2a8779cded/volumes"
Oct 30 04:12:40.277564 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:40.277541    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c3ce17c-c721-42a2-801d-9cdcf133de45" path="/var/lib/kubelet/pods/2c3ce17c-c721-42a2-801d-9cdcf133de45/volumes"
Oct 30 04:12:40.278106 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:40.278076    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e83ec3c-437c-454f-aabf-9958973db157" path="/var/lib/kubelet/pods/2e83ec3c-437c-454f-aabf-9958973db157/volumes"
Oct 30 04:12:40.278623 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:40.278605    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="846074a9-8b30-438d-81f5-d4bf818db3ad" path="/var/lib/kubelet/pods/846074a9-8b30-438d-81f5-d4bf818db3ad/volumes"
Oct 30 04:12:40.279040 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:40.279022    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e0fafca-4572-4150-a4f3-14955b19cf82" path="/var/lib/kubelet/pods/9e0fafca-4572-4150-a4f3-14955b19cf82/volumes"
Oct 30 04:12:40.279376 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:40.279360    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a9850e21-692a-482e-a4e7-a41f44932f2e" path="/var/lib/kubelet/pods/a9850e21-692a-482e-a4e7-a41f44932f2e/volumes"
Oct 30 04:12:41.582678 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:12:41.582645    5981 scope.go:122] "RemoveContainer" containerID="d4968c44c3ac19e5b47af343d085ab381c22fbf5e90c492d76729ddada0eabbb"
Oct 30 04:12:44.368273 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:12:44.368240    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:13:04.551792 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:04.551760    5981 generic.go:356] "Generic (PLEG): container finished" podID="9f6855eb-e461-4674-a574-7ae6457d0af9" containerID="3f286a3b43c3e04706541919c0be19bc9fa97414046bedf48f617316c3432771" exitCode=0
Oct 30 04:13:04.552246 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:04.551832    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"9f6855eb-e461-4674-a574-7ae6457d0af9","Type":"ContainerDied","Data":"3f286a3b43c3e04706541919c0be19bc9fa97414046bedf48f617316c3432771"}
Oct 30 04:13:04.552246 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:04.551884    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"9f6855eb-e461-4674-a574-7ae6457d0af9","Type":"ContainerDied","Data":"8d1e74d37602d57cef8f9eb6b92a08cfc1ffe086fc5fcfe907f1e6ebca219a7c"}
Oct 30 04:13:04.552246 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:04.551900    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d1e74d37602d57cef8f9eb6b92a08cfc1ffe086fc5fcfe907f1e6ebca219a7c"
Oct 30 04:13:04.562762 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:04.562738    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 04:13:04.614617 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:04.614584    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f6855eb-e461-4674-a574-7ae6457d0af9-kube-api-access-s9bfl\" (UniqueName: \"kubernetes.io/projected/9f6855eb-e461-4674-a574-7ae6457d0af9-kube-api-access-s9bfl\") pod \"9f6855eb-e461-4674-a574-7ae6457d0af9\" (UID: \"9f6855eb-e461-4674-a574-7ae6457d0af9\") "
Oct 30 04:13:04.614786 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:04.614679    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f6855eb-e461-4674-a574-7ae6457d0af9-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6855eb-e461-4674-a574-7ae6457d0af9-data\") pod \"9f6855eb-e461-4674-a574-7ae6457d0af9\" (UID: \"9f6855eb-e461-4674-a574-7ae6457d0af9\") "
Oct 30 04:13:04.616416 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:04.616383    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6855eb-e461-4674-a574-7ae6457d0af9-data" pod "9f6855eb-e461-4674-a574-7ae6457d0af9" (UID: "9f6855eb-e461-4674-a574-7ae6457d0af9"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:13:04.616739 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:04.616715    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f6855eb-e461-4674-a574-7ae6457d0af9-kube-api-access-s9bfl" pod "9f6855eb-e461-4674-a574-7ae6457d0af9" (UID: "9f6855eb-e461-4674-a574-7ae6457d0af9"). InnerVolumeSpecName "kube-api-access-s9bfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:13:04.715398 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:04.715323    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9bfl\" (UniqueName: \"kubernetes.io/projected/9f6855eb-e461-4674-a574-7ae6457d0af9-kube-api-access-s9bfl\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:13:04.715398 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:04.715348    5981 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9f6855eb-e461-4674-a574-7ae6457d0af9-data\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:13:05.556451 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:05.556419    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 04:13:05.607591 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:05.607549    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 04:13:05.609326 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:05.609269    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 04:13:06.274614 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:06.274577    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f6855eb-e461-4674-a574-7ae6457d0af9" path="/var/lib/kubelet/pods/9f6855eb-e461-4674-a574-7ae6457d0af9/volumes"
Oct 30 04:13:10.960682 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.960650    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"]
Oct 30 04:13:10.961163 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961125    5981 cpu_manager.go:414] "containerMap: removing container" podUID="2e83ec3c-437c-454f-aabf-9958973db157" containerName="otc-container"
Oct 30 04:13:10.961163 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961144    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e83ec3c-437c-454f-aabf-9958973db157" containerName="otc-container"
Oct 30 04:13:10.961332 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961176    5981 cpu_manager.go:414] "containerMap: removing container" podUID="9f6855eb-e461-4674-a574-7ae6457d0af9" containerName="seaweedfs"
Oct 30 04:13:10.961332 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961183    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f6855eb-e461-4674-a574-7ae6457d0af9" containerName="seaweedfs"
Oct 30 04:13:10.961332 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961203    5981 cpu_manager.go:414] "containerMap: removing container" podUID="2c3ce17c-c721-42a2-801d-9cdcf133de45" containerName="loki-querier"
Oct 30 04:13:10.961332 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961213    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c3ce17c-c721-42a2-801d-9cdcf133de45" containerName="loki-querier"
Oct 30 04:13:10.961332 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961223    5981 cpu_manager.go:414] "containerMap: removing container" podUID="9e0fafca-4572-4150-a4f3-14955b19cf82" containerName="loki-index-gateway"
Oct 30 04:13:10.961332 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961230    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e0fafca-4572-4150-a4f3-14955b19cf82" containerName="loki-index-gateway"
Oct 30 04:13:10.961332 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961247    5981 cpu_manager.go:414] "containerMap: removing container" podUID="846074a9-8b30-438d-81f5-d4bf818db3ad" containerName="loki-query-frontend"
Oct 30 04:13:10.961332 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961255    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="846074a9-8b30-438d-81f5-d4bf818db3ad" containerName="loki-query-frontend"
Oct 30 04:13:10.961332 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961266    5981 cpu_manager.go:414] "containerMap: removing container" podUID="22799503-7f62-41a4-a22d-dd2a8779cded" containerName="loki-ingester"
Oct 30 04:13:10.961332 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961273    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22799503-7f62-41a4-a22d-dd2a8779cded" containerName="loki-ingester"
Oct 30 04:13:10.961821 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961442    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c3ce17c-c721-42a2-801d-9cdcf133de45" containerName="loki-querier"
Oct 30 04:13:10.961821 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961457    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e0fafca-4572-4150-a4f3-14955b19cf82" containerName="loki-index-gateway"
Oct 30 04:13:10.961821 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961469    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="846074a9-8b30-438d-81f5-d4bf818db3ad" containerName="loki-query-frontend"
Oct 30 04:13:10.961821 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961480    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="22799503-7f62-41a4-a22d-dd2a8779cded" containerName="loki-ingester"
Oct 30 04:13:10.961821 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961491    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e83ec3c-437c-454f-aabf-9958973db157" containerName="otc-container"
Oct 30 04:13:10.961821 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.961504    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f6855eb-e461-4674-a574-7ae6457d0af9" containerName="seaweedfs"
Oct 30 04:13:10.965892 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.965870    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"
Oct 30 04:13:10.980611 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.980587    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"]
Oct 30 04:13:10.993112 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.993081    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 04:13:10.993112 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.993097    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 04:13:10.993112 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:10.993078    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 04:13:11.071189 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:11.071149    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbdvx\" (UniqueName: \"kubernetes.io/projected/36d693d5-419e-4e01-8092-5b3ac00e2d5e-kube-api-access-rbdvx\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v\" (UID: \"36d693d5-419e-4e01-8092-5b3ac00e2d5e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"
Oct 30 04:13:11.171858 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:11.171821    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbdvx\" (UniqueName: \"kubernetes.io/projected/36d693d5-419e-4e01-8092-5b3ac00e2d5e-kube-api-access-rbdvx\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v\" (UID: \"36d693d5-419e-4e01-8092-5b3ac00e2d5e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"
Oct 30 04:13:11.191814 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:11.191785    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbdvx\" (UniqueName: \"kubernetes.io/projected/36d693d5-419e-4e01-8092-5b3ac00e2d5e-kube-api-access-rbdvx\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v\" (UID: \"36d693d5-419e-4e01-8092-5b3ac00e2d5e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"
Oct 30 04:13:11.278060 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:11.277969    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"
Oct 30 04:13:11.569142 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:11.569117    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"]
Oct 30 04:13:11.571275 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:13:11.571249    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36d693d5_419e_4e01_8092_5b3ac00e2d5e.slice/crio-38546e0f26ec85210d618b0c7156b14b64ada7d6cd8537fe197fdb2930a374b5 WatchSource:0}: Error finding container 38546e0f26ec85210d618b0c7156b14b64ada7d6cd8537fe197fdb2930a374b5: Status 404 returned error can't find the container with id 38546e0f26ec85210d618b0c7156b14b64ada7d6cd8537fe197fdb2930a374b5
Oct 30 04:13:11.588272 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:11.588240    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v" event={"ID":"36d693d5-419e-4e01-8092-5b3ac00e2d5e","Type":"ContainerStarted","Data":"38546e0f26ec85210d618b0c7156b14b64ada7d6cd8537fe197fdb2930a374b5"}
Oct 30 04:13:11.959326 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:11.959273    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:13:11.962692 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:11.962670    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:11.979895 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:11.979857    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:13:12.005217 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.005190    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 04:13:12.028344 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.028312    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"]
Oct 30 04:13:12.031524 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.031493    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:12.051341 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.051316    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"]
Oct 30 04:13:12.051885 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.051869    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-892f9\""
Oct 30 04:13:12.051936 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.051870    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 04:13:12.078501 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.078474    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d0797970-8341-4fe6-a021-f748c60dd7b8-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-855b8f9fd5-6s5fh\" (UID: \"d0797970-8341-4fe6-a021-f748c60dd7b8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:12.078633 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.078531    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d0797970-8341-4fe6-a021-f748c60dd7b8-ta-internal\") pod \"data-science-collector-targetallocator-855b8f9fd5-6s5fh\" (UID: \"d0797970-8341-4fe6-a021-f748c60dd7b8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:12.078633 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.078621    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pdzj\" (UniqueName: \"kubernetes.io/projected/d0797970-8341-4fe6-a021-f748c60dd7b8-kube-api-access-9pdzj\") pod \"data-science-collector-targetallocator-855b8f9fd5-6s5fh\" (UID: \"d0797970-8341-4fe6-a021-f748c60dd7b8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:12.105524 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.105502    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 04:13:12.179384 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.179192    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cc188594-db08-4280-8ddb-13905559df3d-config\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:12.179384 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.179263    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d0797970-8341-4fe6-a021-f748c60dd7b8-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-855b8f9fd5-6s5fh\" (UID: \"d0797970-8341-4fe6-a021-f748c60dd7b8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:12.179631 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.179380    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6hsw\" (UniqueName: \"kubernetes.io/projected/cc188594-db08-4280-8ddb-13905559df3d-kube-api-access-m6hsw\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:12.179631 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.179480    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d0797970-8341-4fe6-a021-f748c60dd7b8-ta-internal\") pod \"data-science-collector-targetallocator-855b8f9fd5-6s5fh\" (UID: \"d0797970-8341-4fe6-a021-f748c60dd7b8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:12.179631 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.179605    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pdzj\" (UniqueName: \"kubernetes.io/projected/d0797970-8341-4fe6-a021-f748c60dd7b8-kube-api-access-9pdzj\") pod \"data-science-collector-targetallocator-855b8f9fd5-6s5fh\" (UID: \"d0797970-8341-4fe6-a021-f748c60dd7b8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:12.179787 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.179633    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/cc188594-db08-4280-8ddb-13905559df3d-plugins\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:12.180233 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.180212    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d0797970-8341-4fe6-a021-f748c60dd7b8-ta-internal\") pod \"data-science-collector-targetallocator-855b8f9fd5-6s5fh\" (UID: \"d0797970-8341-4fe6-a021-f748c60dd7b8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:12.182032 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.182011    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d0797970-8341-4fe6-a021-f748c60dd7b8-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-855b8f9fd5-6s5fh\" (UID: \"d0797970-8341-4fe6-a021-f748c60dd7b8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:12.204841 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.204821    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pdzj\" (UniqueName: \"kubernetes.io/projected/d0797970-8341-4fe6-a021-f748c60dd7b8-kube-api-access-9pdzj\") pod \"data-science-collector-targetallocator-855b8f9fd5-6s5fh\" (UID: \"d0797970-8341-4fe6-a021-f748c60dd7b8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:12.280886 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.280805    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cc188594-db08-4280-8ddb-13905559df3d-config\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:12.280886 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.280873    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6hsw\" (UniqueName: \"kubernetes.io/projected/cc188594-db08-4280-8ddb-13905559df3d-kube-api-access-m6hsw\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:12.281095 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.280941    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/cc188594-db08-4280-8ddb-13905559df3d-plugins\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:12.281324 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.281305    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/cc188594-db08-4280-8ddb-13905559df3d-plugins\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:12.281472 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.281456    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cc188594-db08-4280-8ddb-13905559df3d-config\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:12.300644 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.300620    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6hsw\" (UniqueName: \"kubernetes.io/projected/cc188594-db08-4280-8ddb-13905559df3d-kube-api-access-m6hsw\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:12.343561 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.343538    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:12.594514 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.594417    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v" event={"ID":"36d693d5-419e-4e01-8092-5b3ac00e2d5e","Type":"ContainerStarted","Data":"f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad"}
Oct 30 04:13:12.634120 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.634058    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v" podStartSLOduration=2.634040412 podStartE2EDuration="2.634040412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:13:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:13:12.633254501 +0000 UTC m=+5432.475500945" watchObservedRunningTime="2026-10-30 04:13:12.634040412 +0000 UTC m=+5432.476286857"
Oct 30 04:13:12.637219 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.637188    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"]
Oct 30 04:13:12.639880 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:13:12.639847    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0797970_8341_4fe6_a021_f748c60dd7b8.slice/crio-52e11486ee5bc0c401b1eaf6181039c33720df6271ef02b78aa38bd248e5f319 WatchSource:0}: Error finding container 52e11486ee5bc0c401b1eaf6181039c33720df6271ef02b78aa38bd248e5f319: Status 404 returned error can't find the container with id 52e11486ee5bc0c401b1eaf6181039c33720df6271ef02b78aa38bd248e5f319
Oct 30 04:13:12.642278 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.642240    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:13:12.642385 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:12.642334    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:13:13.600543 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:13.600500    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh" event={"ID":"d0797970-8341-4fe6-a021-f748c60dd7b8","Type":"ContainerStarted","Data":"0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a"}
Oct 30 04:13:13.600543 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:13.600546    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh" event={"ID":"d0797970-8341-4fe6-a021-f748c60dd7b8","Type":"ContainerStarted","Data":"52e11486ee5bc0c401b1eaf6181039c33720df6271ef02b78aa38bd248e5f319"}
Oct 30 04:13:13.639855 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:13.639803    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh" podStartSLOduration=1.639786357 podStartE2EDuration="1.639786357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:13:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:13:13.639594503 +0000 UTC m=+5433.481840930" watchObservedRunningTime="2026-10-30 04:13:13.639786357 +0000 UTC m=+5433.482032803"
Oct 30 04:13:14.369317 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:13:14.369259    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:13:14.400648 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.400616    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:14.431002 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.430970    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:14.440762 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.440732    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"]
Oct 30 04:13:14.444171 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.444156    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"
Oct 30 04:13:14.462497 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.462468    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"]
Oct 30 04:13:14.501493 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.501462    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:14.501663 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.501601    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:14.516357 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.516331    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:14.602068 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.602032    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpxht\" (UniqueName: \"kubernetes.io/projected/1a73a277-ebe1-4d28-b36a-5cd18861d451-kube-api-access-bpxht\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-95x29\" (UID: \"1a73a277-ebe1-4d28-b36a-5cd18861d451\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"
Oct 30 04:13:14.605318 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.605274    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:14.607130 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.607109    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:14.619103 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.619082    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:14.649812 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.649784    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:14.674087 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.674054    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:14.703473 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.703437    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpxht\" (UniqueName: \"kubernetes.io/projected/1a73a277-ebe1-4d28-b36a-5cd18861d451-kube-api-access-bpxht\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-95x29\" (UID: \"1a73a277-ebe1-4d28-b36a-5cd18861d451\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"
Oct 30 04:13:14.730190 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.730165    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpxht\" (UniqueName: \"kubernetes.io/projected/1a73a277-ebe1-4d28-b36a-5cd18861d451-kube-api-access-bpxht\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-95x29\" (UID: \"1a73a277-ebe1-4d28-b36a-5cd18861d451\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"
Oct 30 04:13:14.758966 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.758931    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"
Oct 30 04:13:14.963228 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:14.963204    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:13:14.965148 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:13:14.965120    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc188594_db08_4280_8ddb_13905559df3d.slice/crio-1bcc522237c8fabb15ea74130e6d3be6c6efec2e62f86a121b439868024335b8 WatchSource:0}: Error finding container 1bcc522237c8fabb15ea74130e6d3be6c6efec2e62f86a121b439868024335b8: Status 404 returned error can't find the container with id 1bcc522237c8fabb15ea74130e6d3be6c6efec2e62f86a121b439868024335b8
Oct 30 04:13:15.067542 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:15.067467    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"]
Oct 30 04:13:15.070253 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:13:15.070229    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a73a277_ebe1_4d28_b36a_5cd18861d451.slice/crio-c4a3319a6c15bd2502f92829be842916b252a167dc3dd929d59adbbab83d8837 WatchSource:0}: Error finding container c4a3319a6c15bd2502f92829be842916b252a167dc3dd929d59adbbab83d8837: Status 404 returned error can't find the container with id c4a3319a6c15bd2502f92829be842916b252a167dc3dd929d59adbbab83d8837
Oct 30 04:13:15.611897 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:15.611396    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29" event={"ID":"1a73a277-ebe1-4d28-b36a-5cd18861d451","Type":"ContainerStarted","Data":"b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d"}
Oct 30 04:13:15.611897 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:15.611451    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29" event={"ID":"1a73a277-ebe1-4d28-b36a-5cd18861d451","Type":"ContainerStarted","Data":"c4a3319a6c15bd2502f92829be842916b252a167dc3dd929d59adbbab83d8837"}
Oct 30 04:13:15.613156 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:15.613123    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"cc188594-db08-4280-8ddb-13905559df3d","Type":"ContainerStarted","Data":"cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5"}
Oct 30 04:13:15.613275 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:15.613161    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"cc188594-db08-4280-8ddb-13905559df3d","Type":"ContainerStarted","Data":"1bcc522237c8fabb15ea74130e6d3be6c6efec2e62f86a121b439868024335b8"}
Oct 30 04:13:15.670688 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:15.670610    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29" podStartSLOduration=1.670591571 podStartE2EDuration="1.670591571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:13:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:13:15.650298041 +0000 UTC m=+5435.492544502" watchObservedRunningTime="2026-10-30 04:13:15.670591571 +0000 UTC m=+5435.512838016"
Oct 30 04:13:15.671685 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:15.671659    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"]
Oct 30 04:13:15.671890 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:15.671844    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v" podUID="36d693d5-419e-4e01-8092-5b3ac00e2d5e" containerName="thanos-querier" containerID="cri-o://f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad" gracePeriod=30
Oct 30 04:13:15.689784 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:15.689722    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=4.689701876 podStartE2EDuration="4.689701876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 04:13:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:13:15.688550636 +0000 UTC m=+5435.530797082" watchObservedRunningTime="2026-10-30 04:13:15.689701876 +0000 UTC m=+5435.531948314"
Oct 30 04:13:15.928910 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:15.928881    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"
Oct 30 04:13:16.015238 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.015199    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36d693d5-419e-4e01-8092-5b3ac00e2d5e-kube-api-access-rbdvx\" (UniqueName: \"kubernetes.io/projected/36d693d5-419e-4e01-8092-5b3ac00e2d5e-kube-api-access-rbdvx\") pod \"36d693d5-419e-4e01-8092-5b3ac00e2d5e\" (UID: \"36d693d5-419e-4e01-8092-5b3ac00e2d5e\") "
Oct 30 04:13:16.017502 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.017471    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36d693d5-419e-4e01-8092-5b3ac00e2d5e-kube-api-access-rbdvx" pod "36d693d5-419e-4e01-8092-5b3ac00e2d5e" (UID: "36d693d5-419e-4e01-8092-5b3ac00e2d5e"). InnerVolumeSpecName "kube-api-access-rbdvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:13:16.116667 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.116633    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbdvx\" (UniqueName: \"kubernetes.io/projected/36d693d5-419e-4e01-8092-5b3ac00e2d5e-kube-api-access-rbdvx\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:13:16.619217 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.619137    5981 generic.go:356] "Generic (PLEG): container finished" podID="36d693d5-419e-4e01-8092-5b3ac00e2d5e" containerID="f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad" exitCode=0
Oct 30 04:13:16.619217 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.619184    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"
Oct 30 04:13:16.619775 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.619222    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v" event={"ID":"36d693d5-419e-4e01-8092-5b3ac00e2d5e","Type":"ContainerDied","Data":"f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad"}
Oct 30 04:13:16.619775 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.619262    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v" event={"ID":"36d693d5-419e-4e01-8092-5b3ac00e2d5e","Type":"ContainerDied","Data":"38546e0f26ec85210d618b0c7156b14b64ada7d6cd8537fe197fdb2930a374b5"}
Oct 30 04:13:16.619775 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.619293    5981 scope.go:122] "RemoveContainer" containerID="f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad"
Oct 30 04:13:16.619775 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.619644    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:16.627756 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.627740    5981 scope.go:122] "RemoveContainer" containerID="f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad"
Oct 30 04:13:16.628060 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:13:16.628037    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad\": container with ID starting with f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad not found: ID does not exist" containerID="f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad"
Oct 30 04:13:16.628104 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.628071    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad"} err="failed to get container status \"f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad\": rpc error: code = NotFound desc = could not find container \"f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad\": container with ID starting with f7b1614e81a3a8604d370ee6e8fd1a3a7cc4125aff94f17420be5a1e644c7cad not found: ID does not exist"
Oct 30 04:13:16.670960 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.670920    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"]
Oct 30 04:13:16.679700 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:16.679665    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-jd82v"]
Oct 30 04:13:18.274342 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:18.274302    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36d693d5-419e-4e01-8092-5b3ac00e2d5e" path="/var/lib/kubelet/pods/36d693d5-419e-4e01-8092-5b3ac00e2d5e/volumes"
Oct 30 04:13:27.628398 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:27.628368    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:13:41.616170 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:41.616134    5981 scope.go:122] "RemoveContainer" containerID="3f286a3b43c3e04706541919c0be19bc9fa97414046bedf48f617316c3432771"
Oct 30 04:13:44.369678 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:13:44.369645    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:13:50.489500 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.489462    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"]
Oct 30 04:13:50.489910 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.489796    5981 cpu_manager.go:414] "containerMap: removing container" podUID="36d693d5-419e-4e01-8092-5b3ac00e2d5e" containerName="thanos-querier"
Oct 30 04:13:50.489910 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.489806    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36d693d5-419e-4e01-8092-5b3ac00e2d5e" containerName="thanos-querier"
Oct 30 04:13:50.489910 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.489888    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="36d693d5-419e-4e01-8092-5b3ac00e2d5e" containerName="thanos-querier"
Oct 30 04:13:50.495945 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.495922    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:50.511894 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.511863    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"]
Oct 30 04:13:50.622749 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.622709    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9f93b002-0e9d-4500-926f-28e79d614439-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-554bf8fcd-q7qtn\" (UID: \"9f93b002-0e9d-4500-926f-28e79d614439\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:50.622932 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.622759    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djbsv\" (UniqueName: \"kubernetes.io/projected/9f93b002-0e9d-4500-926f-28e79d614439-kube-api-access-djbsv\") pod \"data-science-collector-targetallocator-554bf8fcd-q7qtn\" (UID: \"9f93b002-0e9d-4500-926f-28e79d614439\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:50.622932 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.622897    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9f93b002-0e9d-4500-926f-28e79d614439-ta-internal\") pod \"data-science-collector-targetallocator-554bf8fcd-q7qtn\" (UID: \"9f93b002-0e9d-4500-926f-28e79d614439\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:50.723581 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.723538    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9f93b002-0e9d-4500-926f-28e79d614439-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-554bf8fcd-q7qtn\" (UID: \"9f93b002-0e9d-4500-926f-28e79d614439\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:50.723770 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.723595    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djbsv\" (UniqueName: \"kubernetes.io/projected/9f93b002-0e9d-4500-926f-28e79d614439-kube-api-access-djbsv\") pod \"data-science-collector-targetallocator-554bf8fcd-q7qtn\" (UID: \"9f93b002-0e9d-4500-926f-28e79d614439\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:50.723770 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.723654    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9f93b002-0e9d-4500-926f-28e79d614439-ta-internal\") pod \"data-science-collector-targetallocator-554bf8fcd-q7qtn\" (UID: \"9f93b002-0e9d-4500-926f-28e79d614439\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:50.724332 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.724276    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9f93b002-0e9d-4500-926f-28e79d614439-ta-internal\") pod \"data-science-collector-targetallocator-554bf8fcd-q7qtn\" (UID: \"9f93b002-0e9d-4500-926f-28e79d614439\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:50.726219 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.726188    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9f93b002-0e9d-4500-926f-28e79d614439-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-554bf8fcd-q7qtn\" (UID: \"9f93b002-0e9d-4500-926f-28e79d614439\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:50.743502 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.743440    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djbsv\" (UniqueName: \"kubernetes.io/projected/9f93b002-0e9d-4500-926f-28e79d614439-kube-api-access-djbsv\") pod \"data-science-collector-targetallocator-554bf8fcd-q7qtn\" (UID: \"9f93b002-0e9d-4500-926f-28e79d614439\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:50.807875 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:50.807837    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:51.098976 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:51.098872    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"]
Oct 30 04:13:51.102832 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:13:51.102795    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f93b002_0e9d_4500_926f_28e79d614439.slice/crio-b8dea7204e7796c45323c6d8a0910429443b6af7a3e55ff1911f4c242b5f6f5d WatchSource:0}: Error finding container b8dea7204e7796c45323c6d8a0910429443b6af7a3e55ff1911f4c242b5f6f5d: Status 404 returned error can't find the container with id b8dea7204e7796c45323c6d8a0910429443b6af7a3e55ff1911f4c242b5f6f5d
Oct 30 04:13:51.105450 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:51.105409    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:13:51.105558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:51.105487    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:13:51.769103 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:51.769069    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn" event={"ID":"9f93b002-0e9d-4500-926f-28e79d614439","Type":"ContainerStarted","Data":"546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6"}
Oct 30 04:13:51.769560 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:51.769111    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn" event={"ID":"9f93b002-0e9d-4500-926f-28e79d614439","Type":"ContainerStarted","Data":"b8dea7204e7796c45323c6d8a0910429443b6af7a3e55ff1911f4c242b5f6f5d"}
Oct 30 04:13:51.769560 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:51.769225    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:51.770992 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:51.770972    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:13:51.807139 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:51.807091    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn" podStartSLOduration=1.80708011 podStartE2EDuration="1.80708011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:13:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:13:51.807052716 +0000 UTC m=+5471.649299173" watchObservedRunningTime="2026-10-30 04:13:51.80708011 +0000 UTC m=+5471.649326555"
Oct 30 04:13:51.872208 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:51.872178    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"]
Oct 30 04:13:51.872411 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:51.872372    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh" podUID="d0797970-8341-4fe6-a021-f748c60dd7b8" containerName="ta-container" containerID="cri-o://0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a" gracePeriod=30
Oct 30 04:13:52.125266 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.125233    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:52.239201 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.239168    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0797970-8341-4fe6-a021-f748c60dd7b8-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d0797970-8341-4fe6-a021-f748c60dd7b8-data-science-collector-ta-server-cert\") pod \"d0797970-8341-4fe6-a021-f748c60dd7b8\" (UID: \"d0797970-8341-4fe6-a021-f748c60dd7b8\") "
Oct 30 04:13:52.239391 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.239249    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0797970-8341-4fe6-a021-f748c60dd7b8-ta-internal\" (UniqueName: \"kubernetes.io/configmap/d0797970-8341-4fe6-a021-f748c60dd7b8-ta-internal\") pod \"d0797970-8341-4fe6-a021-f748c60dd7b8\" (UID: \"d0797970-8341-4fe6-a021-f748c60dd7b8\") "
Oct 30 04:13:52.239391 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.239344    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0797970-8341-4fe6-a021-f748c60dd7b8-kube-api-access-9pdzj\" (UniqueName: \"kubernetes.io/projected/d0797970-8341-4fe6-a021-f748c60dd7b8-kube-api-access-9pdzj\") pod \"d0797970-8341-4fe6-a021-f748c60dd7b8\" (UID: \"d0797970-8341-4fe6-a021-f748c60dd7b8\") "
Oct 30 04:13:52.239642 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.239615    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0797970-8341-4fe6-a021-f748c60dd7b8-ta-internal" pod "d0797970-8341-4fe6-a021-f748c60dd7b8" (UID: "d0797970-8341-4fe6-a021-f748c60dd7b8"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:13:52.241550 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.241528    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0797970-8341-4fe6-a021-f748c60dd7b8-data-science-collector-ta-server-cert" pod "d0797970-8341-4fe6-a021-f748c60dd7b8" (UID: "d0797970-8341-4fe6-a021-f748c60dd7b8"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:13:52.241630 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.241556    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0797970-8341-4fe6-a021-f748c60dd7b8-kube-api-access-9pdzj" pod "d0797970-8341-4fe6-a021-f748c60dd7b8" (UID: "d0797970-8341-4fe6-a021-f748c60dd7b8"). InnerVolumeSpecName "kube-api-access-9pdzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:13:52.340040 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.339988    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pdzj\" (UniqueName: \"kubernetes.io/projected/d0797970-8341-4fe6-a021-f748c60dd7b8-kube-api-access-9pdzj\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:13:52.340040 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.340012    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d0797970-8341-4fe6-a021-f748c60dd7b8-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:13:52.340040 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.340024    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d0797970-8341-4fe6-a021-f748c60dd7b8-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:13:52.773983 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.773947    5981 generic.go:356] "Generic (PLEG): container finished" podID="d0797970-8341-4fe6-a021-f748c60dd7b8" containerID="0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a" exitCode=0
Oct 30 04:13:52.774425 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.773994    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"
Oct 30 04:13:52.774425 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.774029    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh" event={"ID":"d0797970-8341-4fe6-a021-f748c60dd7b8","Type":"ContainerDied","Data":"0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a"}
Oct 30 04:13:52.774425 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.774075    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh" event={"ID":"d0797970-8341-4fe6-a021-f748c60dd7b8","Type":"ContainerDied","Data":"52e11486ee5bc0c401b1eaf6181039c33720df6271ef02b78aa38bd248e5f319"}
Oct 30 04:13:52.774425 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.774095    5981 scope.go:122] "RemoveContainer" containerID="0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a"
Oct 30 04:13:52.782567 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.782547    5981 scope.go:122] "RemoveContainer" containerID="0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a"
Oct 30 04:13:52.782838 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:13:52.782819    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a\": container with ID starting with 0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a not found: ID does not exist" containerID="0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a"
Oct 30 04:13:52.782903 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.782854    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a"} err="failed to get container status \"0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a\": rpc error: code = NotFound desc = could not find container \"0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a\": container with ID starting with 0cce0773fdb30364bb01b68b0f7e86c47020a698910b1e3896bd7adc7a8d6c1a not found: ID does not exist"
Oct 30 04:13:52.824620 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.824596    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"]
Oct 30 04:13:52.838234 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:52.838190    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-855b8f9fd5-6s5fh"]
Oct 30 04:13:54.275140 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:54.275103    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0797970-8341-4fe6-a021-f748c60dd7b8" path="/var/lib/kubelet/pods/d0797970-8341-4fe6-a021-f748c60dd7b8/volumes"
Oct 30 04:13:58.473605 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.473561    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"]
Oct 30 04:13:58.474052 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.473931    5981 cpu_manager.go:414] "containerMap: removing container" podUID="d0797970-8341-4fe6-a021-f748c60dd7b8" containerName="ta-container"
Oct 30 04:13:58.474052 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.473944    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0797970-8341-4fe6-a021-f748c60dd7b8" containerName="ta-container"
Oct 30 04:13:58.474052 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.473999    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0797970-8341-4fe6-a021-f748c60dd7b8" containerName="ta-container"
Oct 30 04:13:58.476019 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.476000    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:58.494481 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.494453    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"]
Oct 30 04:13:58.596692 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.596653    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5dcb787995-qmrhd\" (UID: \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:58.596692 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.596695    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh5mw\" (UniqueName: \"kubernetes.io/projected/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-kube-api-access-fh5mw\") pod \"data-science-collector-targetallocator-5dcb787995-qmrhd\" (UID: \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:58.596895 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.596793    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-ta-internal\") pod \"data-science-collector-targetallocator-5dcb787995-qmrhd\" (UID: \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:58.697421 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.697385    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5dcb787995-qmrhd\" (UID: \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:58.697586 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.697431    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh5mw\" (UniqueName: \"kubernetes.io/projected/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-kube-api-access-fh5mw\") pod \"data-science-collector-targetallocator-5dcb787995-qmrhd\" (UID: \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:58.697586 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.697470    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-ta-internal\") pod \"data-science-collector-targetallocator-5dcb787995-qmrhd\" (UID: \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:58.698150 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.698119    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-ta-internal\") pod \"data-science-collector-targetallocator-5dcb787995-qmrhd\" (UID: \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:58.700023 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.700001    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5dcb787995-qmrhd\" (UID: \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:58.717638 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.717609    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh5mw\" (UniqueName: \"kubernetes.io/projected/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-kube-api-access-fh5mw\") pod \"data-science-collector-targetallocator-5dcb787995-qmrhd\" (UID: \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:58.786433 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:58.786342    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:59.079264 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:59.079236    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"]
Oct 30 04:13:59.081409 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:13:59.081381    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4eae310_ce3d_4e51_a03c_5c5c8684ef78.slice/crio-e69f07c9ec938c0d97028fe539aac777fb515f12dc91570346dd384f3204ad13 WatchSource:0}: Error finding container e69f07c9ec938c0d97028fe539aac777fb515f12dc91570346dd384f3204ad13: Status 404 returned error can't find the container with id e69f07c9ec938c0d97028fe539aac777fb515f12dc91570346dd384f3204ad13
Oct 30 04:13:59.083635 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:59.083582    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:13:59.083722 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:59.083660    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:13:59.806964 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:59.806914    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd" event={"ID":"c4eae310-ce3d-4e51-a03c-5c5c8684ef78","Type":"ContainerStarted","Data":"1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f"}
Oct 30 04:13:59.807411 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:59.806974    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd" event={"ID":"c4eae310-ce3d-4e51-a03c-5c5c8684ef78","Type":"ContainerStarted","Data":"e69f07c9ec938c0d97028fe539aac777fb515f12dc91570346dd384f3204ad13"}
Oct 30 04:13:59.807411 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:59.807094    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:59.808916 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:59.808896    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:13:59.848254 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:59.848203    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd" podStartSLOduration=1.84819052 podStartE2EDuration="1.84819052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:13:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:13:59.847646337 +0000 UTC m=+5479.689892783" watchObservedRunningTime="2026-10-30 04:13:59.84819052 +0000 UTC m=+5479.690436962"
Oct 30 04:13:59.913500 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:59.913465    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"]
Oct 30 04:13:59.913694 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:13:59.913667    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn" podUID="9f93b002-0e9d-4500-926f-28e79d614439" containerName="ta-container" containerID="cri-o://546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6" gracePeriod=30
Oct 30 04:14:00.154315 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.154267    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:14:00.310100 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.310024    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f93b002-0e9d-4500-926f-28e79d614439-ta-internal\" (UniqueName: \"kubernetes.io/configmap/9f93b002-0e9d-4500-926f-28e79d614439-ta-internal\") pod \"9f93b002-0e9d-4500-926f-28e79d614439\" (UID: \"9f93b002-0e9d-4500-926f-28e79d614439\") "
Oct 30 04:14:00.310300 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.310111    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f93b002-0e9d-4500-926f-28e79d614439-kube-api-access-djbsv\" (UniqueName: \"kubernetes.io/projected/9f93b002-0e9d-4500-926f-28e79d614439-kube-api-access-djbsv\") pod \"9f93b002-0e9d-4500-926f-28e79d614439\" (UID: \"9f93b002-0e9d-4500-926f-28e79d614439\") "
Oct 30 04:14:00.310300 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.310135    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f93b002-0e9d-4500-926f-28e79d614439-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9f93b002-0e9d-4500-926f-28e79d614439-data-science-collector-ta-server-cert\") pod \"9f93b002-0e9d-4500-926f-28e79d614439\" (UID: \"9f93b002-0e9d-4500-926f-28e79d614439\") "
Oct 30 04:14:00.310438 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.310392    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f93b002-0e9d-4500-926f-28e79d614439-ta-internal" pod "9f93b002-0e9d-4500-926f-28e79d614439" (UID: "9f93b002-0e9d-4500-926f-28e79d614439"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:14:00.312449 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.312425    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f93b002-0e9d-4500-926f-28e79d614439-data-science-collector-ta-server-cert" pod "9f93b002-0e9d-4500-926f-28e79d614439" (UID: "9f93b002-0e9d-4500-926f-28e79d614439"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:14:00.312645 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.312624    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f93b002-0e9d-4500-926f-28e79d614439-kube-api-access-djbsv" pod "9f93b002-0e9d-4500-926f-28e79d614439" (UID: "9f93b002-0e9d-4500-926f-28e79d614439"). InnerVolumeSpecName "kube-api-access-djbsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:14:00.411514 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.411463    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djbsv\" (UniqueName: \"kubernetes.io/projected/9f93b002-0e9d-4500-926f-28e79d614439-kube-api-access-djbsv\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:00.411680 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.411516    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9f93b002-0e9d-4500-926f-28e79d614439-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:00.411680 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.411536    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9f93b002-0e9d-4500-926f-28e79d614439-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:00.812648 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.812611    5981 generic.go:356] "Generic (PLEG): container finished" podID="9f93b002-0e9d-4500-926f-28e79d614439" containerID="546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6" exitCode=0
Oct 30 04:14:00.813180 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.812670    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"
Oct 30 04:14:00.813180 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.812706    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn" event={"ID":"9f93b002-0e9d-4500-926f-28e79d614439","Type":"ContainerDied","Data":"546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6"}
Oct 30 04:14:00.813180 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.812780    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn" event={"ID":"9f93b002-0e9d-4500-926f-28e79d614439","Type":"ContainerDied","Data":"b8dea7204e7796c45323c6d8a0910429443b6af7a3e55ff1911f4c242b5f6f5d"}
Oct 30 04:14:00.813180 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.812821    5981 scope.go:122] "RemoveContainer" containerID="546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6"
Oct 30 04:14:00.823578 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.823553    5981 scope.go:122] "RemoveContainer" containerID="546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6"
Oct 30 04:14:00.823886 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:14:00.823867    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6\": container with ID starting with 546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6 not found: ID does not exist" containerID="546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6"
Oct 30 04:14:00.823956 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.823896    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6"} err="failed to get container status \"546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6\": rpc error: code = NotFound desc = could not find container \"546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6\": container with ID starting with 546953d6d0067e4d0046d746c779daab285b456419497b66a9498fa303dffff6 not found: ID does not exist"
Oct 30 04:14:00.863929 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.863901    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"]
Oct 30 04:14:00.876990 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:00.876964    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-554bf8fcd-q7qtn"]
Oct 30 04:14:02.274823 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:02.274776    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f93b002-0e9d-4500-926f-28e79d614439" path="/var/lib/kubelet/pods/9f93b002-0e9d-4500-926f-28e79d614439/volumes"
Oct 30 04:14:14.368207 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:14:14.368171    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:14:30.158344 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.158254    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"]
Oct 30 04:14:30.158723 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.158606    5981 cpu_manager.go:414] "containerMap: removing container" podUID="9f93b002-0e9d-4500-926f-28e79d614439" containerName="ta-container"
Oct 30 04:14:30.158723 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.158617    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f93b002-0e9d-4500-926f-28e79d614439" containerName="ta-container"
Oct 30 04:14:30.158723 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.158681    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f93b002-0e9d-4500-926f-28e79d614439" containerName="ta-container"
Oct 30 04:14:30.161244 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.161224    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:30.192169 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.192146    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"]
Oct 30 04:14:30.263617 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.263581    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-cfbc8584-s6mrx\" (UID: \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:30.263739 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.263626    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-ta-internal\") pod \"data-science-collector-targetallocator-cfbc8584-s6mrx\" (UID: \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:30.263739 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.263644    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2bk9\" (UniqueName: \"kubernetes.io/projected/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-kube-api-access-m2bk9\") pod \"data-science-collector-targetallocator-cfbc8584-s6mrx\" (UID: \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:30.364339 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.364308    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-cfbc8584-s6mrx\" (UID: \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:30.364511 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.364366    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-ta-internal\") pod \"data-science-collector-targetallocator-cfbc8584-s6mrx\" (UID: \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:30.364511 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.364393    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2bk9\" (UniqueName: \"kubernetes.io/projected/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-kube-api-access-m2bk9\") pod \"data-science-collector-targetallocator-cfbc8584-s6mrx\" (UID: \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:30.365017 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.364989    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-ta-internal\") pod \"data-science-collector-targetallocator-cfbc8584-s6mrx\" (UID: \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:30.366938 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.366918    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-cfbc8584-s6mrx\" (UID: \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:30.384093 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.384072    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2bk9\" (UniqueName: \"kubernetes.io/projected/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-kube-api-access-m2bk9\") pod \"data-science-collector-targetallocator-cfbc8584-s6mrx\" (UID: \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:30.472417 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.472335    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:30.762927 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.762899    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"]
Oct 30 04:14:30.765415 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:14:30.765379    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8dd4939b_eb52_4b79_b053_f0fb5d5807c5.slice/crio-236b80e25209ac6621e44bd960bb783d3e5c9f321d9dbaaee273731166f1c657 WatchSource:0}: Error finding container 236b80e25209ac6621e44bd960bb783d3e5c9f321d9dbaaee273731166f1c657: Status 404 returned error can't find the container with id 236b80e25209ac6621e44bd960bb783d3e5c9f321d9dbaaee273731166f1c657
Oct 30 04:14:30.767654 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.767625    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:14:30.767745 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.767682    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:14:30.942125 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.942094    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx" event={"ID":"8dd4939b-eb52-4b79-b053-f0fb5d5807c5","Type":"ContainerStarted","Data":"367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd"}
Oct 30 04:14:30.942345 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.942135    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx" event={"ID":"8dd4939b-eb52-4b79-b053-f0fb5d5807c5","Type":"ContainerStarted","Data":"236b80e25209ac6621e44bd960bb783d3e5c9f321d9dbaaee273731166f1c657"}
Oct 30 04:14:30.942432 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.942342    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:30.944800 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.944768    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx" podUID="8dd4939b-eb52-4b79-b053-f0fb5d5807c5" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.148:8080/readyz\": dial tcp 10.134.0.148:8080: connect: connection refused"
Oct 30 04:14:30.982154 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:30.982112    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx" podStartSLOduration=0.982098579 podStartE2EDuration="982.098579ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:14:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:14:30.980921694 +0000 UTC m=+5510.823168141" watchObservedRunningTime="2026-10-30 04:14:30.982098579 +0000 UTC m=+5510.824345023"
Oct 30 04:14:31.947198 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:31.947166    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:32.012661 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.012625    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"]
Oct 30 04:14:32.012858 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.012830    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd" podUID="c4eae310-ce3d-4e51-a03c-5c5c8684ef78" containerName="ta-container" containerID="cri-o://1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f" gracePeriod=30
Oct 30 04:14:32.252906 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.252883    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:14:32.382961 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.382923    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-kube-api-access-fh5mw\" (UniqueName: \"kubernetes.io/projected/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-kube-api-access-fh5mw\") pod \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\" (UID: \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\") "
Oct 30 04:14:32.383129 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.382976    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-ta-internal\" (UniqueName: \"kubernetes.io/configmap/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-ta-internal\") pod \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\" (UID: \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\") "
Oct 30 04:14:32.383129 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.383048    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-data-science-collector-ta-server-cert\") pod \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\" (UID: \"c4eae310-ce3d-4e51-a03c-5c5c8684ef78\") "
Oct 30 04:14:32.383379 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.383355    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-ta-internal" pod "c4eae310-ce3d-4e51-a03c-5c5c8684ef78" (UID: "c4eae310-ce3d-4e51-a03c-5c5c8684ef78"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:14:32.385194 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.385169    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-kube-api-access-fh5mw" pod "c4eae310-ce3d-4e51-a03c-5c5c8684ef78" (UID: "c4eae310-ce3d-4e51-a03c-5c5c8684ef78"). InnerVolumeSpecName "kube-api-access-fh5mw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:14:32.385308 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.385266    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-data-science-collector-ta-server-cert" pod "c4eae310-ce3d-4e51-a03c-5c5c8684ef78" (UID: "c4eae310-ce3d-4e51-a03c-5c5c8684ef78"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:14:32.484150 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.484077    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh5mw\" (UniqueName: \"kubernetes.io/projected/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-kube-api-access-fh5mw\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:32.484150 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.484105    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:32.484150 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.484118    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c4eae310-ce3d-4e51-a03c-5c5c8684ef78-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:32.951255 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.951215    5981 generic.go:356] "Generic (PLEG): container finished" podID="c4eae310-ce3d-4e51-a03c-5c5c8684ef78" containerID="1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f" exitCode=0
Oct 30 04:14:32.951710 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.951300    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"
Oct 30 04:14:32.951710 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.951309    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd" event={"ID":"c4eae310-ce3d-4e51-a03c-5c5c8684ef78","Type":"ContainerDied","Data":"1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f"}
Oct 30 04:14:32.951710 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.951362    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd" event={"ID":"c4eae310-ce3d-4e51-a03c-5c5c8684ef78","Type":"ContainerDied","Data":"e69f07c9ec938c0d97028fe539aac777fb515f12dc91570346dd384f3204ad13"}
Oct 30 04:14:32.951710 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.951380    5981 scope.go:122] "RemoveContainer" containerID="1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f"
Oct 30 04:14:32.960152 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.960136    5981 scope.go:122] "RemoveContainer" containerID="1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f"
Oct 30 04:14:32.960458 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:14:32.960438    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f\": container with ID starting with 1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f not found: ID does not exist" containerID="1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f"
Oct 30 04:14:32.960520 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:32.960466    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f"} err="failed to get container status \"1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f\": rpc error: code = NotFound desc = could not find container \"1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f\": container with ID starting with 1e201e59ff0e737d621a20acf271b985b76c47c2aebb702a17dffb5eb24e7a9f not found: ID does not exist"
Oct 30 04:14:33.002040 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:33.002013    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"]
Oct 30 04:14:33.014816 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:33.014792    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5dcb787995-qmrhd"]
Oct 30 04:14:34.275024 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:34.274985    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c4eae310-ce3d-4e51-a03c-5c5c8684ef78" path="/var/lib/kubelet/pods/c4eae310-ce3d-4e51-a03c-5c5c8684ef78/volumes"
Oct 30 04:14:34.623063 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:34.622966    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"]
Oct 30 04:14:34.623241 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:34.623158    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29" podUID="1a73a277-ebe1-4d28-b36a-5cd18861d451" containerName="thanos-querier" containerID="cri-o://b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d" gracePeriod=30
Oct 30 04:14:34.887728 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:34.887664    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"
Oct 30 04:14:34.961875 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:34.961845    5981 generic.go:356] "Generic (PLEG): container finished" podID="1a73a277-ebe1-4d28-b36a-5cd18861d451" containerID="b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d" exitCode=0
Oct 30 04:14:34.962089 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:34.961891    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"
Oct 30 04:14:34.962089 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:34.961904    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29" event={"ID":"1a73a277-ebe1-4d28-b36a-5cd18861d451","Type":"ContainerDied","Data":"b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d"}
Oct 30 04:14:34.962089 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:34.961945    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29" event={"ID":"1a73a277-ebe1-4d28-b36a-5cd18861d451","Type":"ContainerDied","Data":"c4a3319a6c15bd2502f92829be842916b252a167dc3dd929d59adbbab83d8837"}
Oct 30 04:14:34.962089 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:34.961967    5981 scope.go:122] "RemoveContainer" containerID="b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d"
Oct 30 04:14:34.971053 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:34.971030    5981 scope.go:122] "RemoveContainer" containerID="b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d"
Oct 30 04:14:34.971424 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:14:34.971402    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d\": container with ID starting with b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d not found: ID does not exist" containerID="b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d"
Oct 30 04:14:34.971505 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:34.971434    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d"} err="failed to get container status \"b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d\": rpc error: code = NotFound desc = could not find container \"b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d\": container with ID starting with b99d941a535bffb102515b657727c29e080428ef24f941b9a67cf16b2e83a58d not found: ID does not exist"
Oct 30 04:14:35.010434 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:35.010396    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a73a277-ebe1-4d28-b36a-5cd18861d451-kube-api-access-bpxht\" (UniqueName: \"kubernetes.io/projected/1a73a277-ebe1-4d28-b36a-5cd18861d451-kube-api-access-bpxht\") pod \"1a73a277-ebe1-4d28-b36a-5cd18861d451\" (UID: \"1a73a277-ebe1-4d28-b36a-5cd18861d451\") "
Oct 30 04:14:35.012641 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:35.012610    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a73a277-ebe1-4d28-b36a-5cd18861d451-kube-api-access-bpxht" pod "1a73a277-ebe1-4d28-b36a-5cd18861d451" (UID: "1a73a277-ebe1-4d28-b36a-5cd18861d451"). InnerVolumeSpecName "kube-api-access-bpxht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:14:35.111531 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:35.111487    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpxht\" (UniqueName: \"kubernetes.io/projected/1a73a277-ebe1-4d28-b36a-5cd18861d451-kube-api-access-bpxht\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:35.306544 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:35.306504    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"]
Oct 30 04:14:35.311823 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:35.311790    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-95x29"]
Oct 30 04:14:35.875629 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:35.875596    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"]
Oct 30 04:14:35.875838 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:35.875777    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx" podUID="8dd4939b-eb52-4b79-b053-f0fb5d5807c5" containerName="ta-container" containerID="cri-o://367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd" gracePeriod=30
Oct 30 04:14:35.978491 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:35.978456    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:14:35.978704 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:35.978634    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="cc188594-db08-4280-8ddb-13905559df3d" containerName="perses" containerID="cri-o://cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5" gracePeriod=30
Oct 30 04:14:36.134911 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.134839    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:36.221254 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.221226    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-ta-internal\" (UniqueName: \"kubernetes.io/configmap/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-ta-internal\") pod \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\" (UID: \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\") "
Oct 30 04:14:36.221420 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.221301    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-data-science-collector-ta-server-cert\") pod \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\" (UID: \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\") "
Oct 30 04:14:36.221420 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.221333    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-kube-api-access-m2bk9\" (UniqueName: \"kubernetes.io/projected/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-kube-api-access-m2bk9\") pod \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\" (UID: \"8dd4939b-eb52-4b79-b053-f0fb5d5807c5\") "
Oct 30 04:14:36.221682 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.221649    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-ta-internal" pod "8dd4939b-eb52-4b79-b053-f0fb5d5807c5" (UID: "8dd4939b-eb52-4b79-b053-f0fb5d5807c5"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:14:36.223696 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.223670    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-kube-api-access-m2bk9" pod "8dd4939b-eb52-4b79-b053-f0fb5d5807c5" (UID: "8dd4939b-eb52-4b79-b053-f0fb5d5807c5"). InnerVolumeSpecName "kube-api-access-m2bk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:14:36.223778 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.223701    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-data-science-collector-ta-server-cert" pod "8dd4939b-eb52-4b79-b053-f0fb5d5807c5" (UID: "8dd4939b-eb52-4b79-b053-f0fb5d5807c5"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:14:36.230534 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.230513    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:36.276159 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.276118    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a73a277-ebe1-4d28-b36a-5cd18861d451" path="/var/lib/kubelet/pods/1a73a277-ebe1-4d28-b36a-5cd18861d451/volumes"
Oct 30 04:14:36.322719 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.322674    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc188594-db08-4280-8ddb-13905559df3d-kube-api-access-m6hsw\" (UniqueName: \"kubernetes.io/projected/cc188594-db08-4280-8ddb-13905559df3d-kube-api-access-m6hsw\") pod \"cc188594-db08-4280-8ddb-13905559df3d\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") "
Oct 30 04:14:36.323129 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.322740    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc188594-db08-4280-8ddb-13905559df3d-config\" (UniqueName: \"kubernetes.io/configmap/cc188594-db08-4280-8ddb-13905559df3d-config\") pod \"cc188594-db08-4280-8ddb-13905559df3d\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") "
Oct 30 04:14:36.323129 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.322776    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc188594-db08-4280-8ddb-13905559df3d-plugins\" (UniqueName: \"kubernetes.io/empty-dir/cc188594-db08-4280-8ddb-13905559df3d-plugins\") pod \"cc188594-db08-4280-8ddb-13905559df3d\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") "
Oct 30 04:14:36.323129 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.322901    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"cc188594-db08-4280-8ddb-13905559df3d\" (UID: \"cc188594-db08-4280-8ddb-13905559df3d\") "
Oct 30 04:14:36.323251 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.323159    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc188594-db08-4280-8ddb-13905559df3d-config" pod "cc188594-db08-4280-8ddb-13905559df3d" (UID: "cc188594-db08-4280-8ddb-13905559df3d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:14:36.323251 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.323235    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:36.323348 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.323259    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2bk9\" (UniqueName: \"kubernetes.io/projected/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-kube-api-access-m2bk9\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:36.323348 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.323276    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8dd4939b-eb52-4b79-b053-f0fb5d5807c5-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:36.323348 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.323310    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cc188594-db08-4280-8ddb-13905559df3d-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:36.325266 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.325239    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc188594-db08-4280-8ddb-13905559df3d-kube-api-access-m6hsw" pod "cc188594-db08-4280-8ddb-13905559df3d" (UID: "cc188594-db08-4280-8ddb-13905559df3d"). InnerVolumeSpecName "kube-api-access-m6hsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:14:36.326177 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.326153    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "cc188594-db08-4280-8ddb-13905559df3d" (UID: "cc188594-db08-4280-8ddb-13905559df3d"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 04:14:36.424377 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.424343    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6hsw\" (UniqueName: \"kubernetes.io/projected/cc188594-db08-4280-8ddb-13905559df3d-kube-api-access-m6hsw\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:36.424546 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.424395    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 04:14:36.437998 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.437975    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 04:14:36.474371 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.474334    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc188594-db08-4280-8ddb-13905559df3d-plugins" pod "cc188594-db08-4280-8ddb-13905559df3d" (UID: "cc188594-db08-4280-8ddb-13905559df3d"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:14:36.525501 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.525464    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/cc188594-db08-4280-8ddb-13905559df3d-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:36.525501 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.525495    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 04:14:36.973998 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.973966    5981 generic.go:356] "Generic (PLEG): container finished" podID="8dd4939b-eb52-4b79-b053-f0fb5d5807c5" containerID="367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd" exitCode=0
Oct 30 04:14:36.974206 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.974010    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"
Oct 30 04:14:36.974206 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.974058    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx" event={"ID":"8dd4939b-eb52-4b79-b053-f0fb5d5807c5","Type":"ContainerDied","Data":"367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd"}
Oct 30 04:14:36.974206 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.974101    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx" event={"ID":"8dd4939b-eb52-4b79-b053-f0fb5d5807c5","Type":"ContainerDied","Data":"236b80e25209ac6621e44bd960bb783d3e5c9f321d9dbaaee273731166f1c657"}
Oct 30 04:14:36.974206 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.974124    5981 scope.go:122] "RemoveContainer" containerID="367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd"
Oct 30 04:14:36.975507 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.975430    5981 generic.go:356] "Generic (PLEG): container finished" podID="cc188594-db08-4280-8ddb-13905559df3d" containerID="cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5" exitCode=0
Oct 30 04:14:36.975507 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.975481    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:36.975507 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.975480    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"cc188594-db08-4280-8ddb-13905559df3d","Type":"ContainerDied","Data":"cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5"}
Oct 30 04:14:36.975694 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.975516    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"cc188594-db08-4280-8ddb-13905559df3d","Type":"ContainerDied","Data":"1bcc522237c8fabb15ea74130e6d3be6c6efec2e62f86a121b439868024335b8"}
Oct 30 04:14:36.982973 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.982958    5981 scope.go:122] "RemoveContainer" containerID="367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd"
Oct 30 04:14:36.983262 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:14:36.983243    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd\": container with ID starting with 367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd not found: ID does not exist" containerID="367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd"
Oct 30 04:14:36.983349 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.983269    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd"} err="failed to get container status \"367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd\": rpc error: code = NotFound desc = could not find container \"367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd\": container with ID starting with 367d66c743ecece12fa48efd6c5d49324f867003295052dbf98388e820dca0dd not found: ID does not exist"
Oct 30 04:14:36.983349 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.983305    5981 scope.go:122] "RemoveContainer" containerID="cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5"
Oct 30 04:14:36.991032 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.991015    5981 scope.go:122] "RemoveContainer" containerID="cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5"
Oct 30 04:14:36.991356 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:14:36.991327    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5\": container with ID starting with cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5 not found: ID does not exist" containerID="cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5"
Oct 30 04:14:36.991449 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:36.991359    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5"} err="failed to get container status \"cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5\": rpc error: code = NotFound desc = could not find container \"cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5\": container with ID starting with cebff42fdd97e7cd6e8e3fe3fa97a497feef123da9bed4c2d3dc1a031c97d4d5 not found: ID does not exist"
Oct 30 04:14:37.026937 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:37.026900    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:14:37.039998 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:37.039966    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:14:37.074778 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:37.074730    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"]
Oct 30 04:14:37.076866 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:37.076840    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-cfbc8584-s6mrx"]
Oct 30 04:14:38.274696 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:38.274659    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8dd4939b-eb52-4b79-b053-f0fb5d5807c5" path="/var/lib/kubelet/pods/8dd4939b-eb52-4b79-b053-f0fb5d5807c5/volumes"
Oct 30 04:14:38.275131 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:38.275080    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc188594-db08-4280-8ddb-13905559df3d" path="/var/lib/kubelet/pods/cc188594-db08-4280-8ddb-13905559df3d/volumes"
Oct 30 04:14:42.004940 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.004907    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"]
Oct 30 04:14:42.005333 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.005226    5981 cpu_manager.go:414] "containerMap: removing container" podUID="1a73a277-ebe1-4d28-b36a-5cd18861d451" containerName="thanos-querier"
Oct 30 04:14:42.005333 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.005238    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a73a277-ebe1-4d28-b36a-5cd18861d451" containerName="thanos-querier"
Oct 30 04:14:42.005333 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.005251    5981 cpu_manager.go:414] "containerMap: removing container" podUID="cc188594-db08-4280-8ddb-13905559df3d" containerName="perses"
Oct 30 04:14:42.005333 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.005256    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc188594-db08-4280-8ddb-13905559df3d" containerName="perses"
Oct 30 04:14:42.005333 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.005270    5981 cpu_manager.go:414] "containerMap: removing container" podUID="c4eae310-ce3d-4e51-a03c-5c5c8684ef78" containerName="ta-container"
Oct 30 04:14:42.005333 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.005276    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c4eae310-ce3d-4e51-a03c-5c5c8684ef78" containerName="ta-container"
Oct 30 04:14:42.005333 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.005311    5981 cpu_manager.go:414] "containerMap: removing container" podUID="8dd4939b-eb52-4b79-b053-f0fb5d5807c5" containerName="ta-container"
Oct 30 04:14:42.005333 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.005316    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8dd4939b-eb52-4b79-b053-f0fb5d5807c5" containerName="ta-container"
Oct 30 04:14:42.005580 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.005370    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a73a277-ebe1-4d28-b36a-5cd18861d451" containerName="thanos-querier"
Oct 30 04:14:42.005580 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.005379    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc188594-db08-4280-8ddb-13905559df3d" containerName="perses"
Oct 30 04:14:42.005580 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.005386    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="c4eae310-ce3d-4e51-a03c-5c5c8684ef78" containerName="ta-container"
Oct 30 04:14:42.005580 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.005393    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="8dd4939b-eb52-4b79-b053-f0fb5d5807c5" containerName="ta-container"
Oct 30 04:14:42.028194 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.028159    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"]
Oct 30 04:14:42.028411 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.028278    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"
Oct 30 04:14:42.045366 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.045342    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 04:14:42.058396 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.058359    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 04:14:42.058522 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.058401    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 04:14:42.071504 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.071474    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvzqt\" (UniqueName: \"kubernetes.io/projected/f938c15c-51ad-41ca-a9f7-38989dc83a07-kube-api-access-tvzqt\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl\" (UID: \"f938c15c-51ad-41ca-a9f7-38989dc83a07\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"
Oct 30 04:14:42.172274 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.172235    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvzqt\" (UniqueName: \"kubernetes.io/projected/f938c15c-51ad-41ca-a9f7-38989dc83a07-kube-api-access-tvzqt\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl\" (UID: \"f938c15c-51ad-41ca-a9f7-38989dc83a07\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"
Oct 30 04:14:42.192108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.192077    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvzqt\" (UniqueName: \"kubernetes.io/projected/f938c15c-51ad-41ca-a9f7-38989dc83a07-kube-api-access-tvzqt\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl\" (UID: \"f938c15c-51ad-41ca-a9f7-38989dc83a07\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"
Oct 30 04:14:42.342533 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.342451    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"
Oct 30 04:14:42.632956 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.632925    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"]
Oct 30 04:14:42.634904 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:14:42.634867    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf938c15c_51ad_41ca_a9f7_38989dc83a07.slice/crio-1d9f121b6b91a1c0248fc8ad84ccdf6424ce74689b5ff448a3cec54036b4a115 WatchSource:0}: Error finding container 1d9f121b6b91a1c0248fc8ad84ccdf6424ce74689b5ff448a3cec54036b4a115: Status 404 returned error can't find the container with id 1d9f121b6b91a1c0248fc8ad84ccdf6424ce74689b5ff448a3cec54036b4a115
Oct 30 04:14:42.987727 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.987694    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:14:42.991071 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:42.991046    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:43.003352 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.003326    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl" event={"ID":"f938c15c-51ad-41ca-a9f7-38989dc83a07","Type":"ContainerStarted","Data":"c5aa593e8246140a2b541fa294ed6ee6815135b879dff8192392e93508807a27"}
Oct 30 04:14:43.003453 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.003369    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl" event={"ID":"f938c15c-51ad-41ca-a9f7-38989dc83a07","Type":"ContainerStarted","Data":"1d9f121b6b91a1c0248fc8ad84ccdf6424ce74689b5ff448a3cec54036b4a115"}
Oct 30 04:14:43.010888 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.010864    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:14:43.040437 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.040399    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 04:14:43.043848 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.043824    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"]
Oct 30 04:14:43.047066 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.047046    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:43.064569 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.064545    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"]
Oct 30 04:14:43.074579 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.074534    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl" podStartSLOduration=2.074521775 podStartE2EDuration="2.074521775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:14:43.073250629 +0000 UTC m=+5522.915497056" watchObservedRunningTime="2026-10-30 04:14:43.074521775 +0000 UTC m=+5522.916768220"
Oct 30 04:14:43.079049 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.079023    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-plugins\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:43.079160 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.079070    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb9lb\" (UniqueName: \"kubernetes.io/projected/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-kube-api-access-wb9lb\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:43.079221 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.079166    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-config\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:43.124783 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.124751    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 04:14:43.124949 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.124738    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-svpqc\""
Oct 30 04:14:43.141502 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.141467    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 04:14:43.179953 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.179916    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/675617a6-7572-48af-838e-6c02cb19d4e7-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5c87f9b8d9-hb6r6\" (UID: \"675617a6-7572-48af-838e-6c02cb19d4e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:43.180115 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.180026    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/675617a6-7572-48af-838e-6c02cb19d4e7-ta-internal\") pod \"data-science-collector-targetallocator-5c87f9b8d9-hb6r6\" (UID: \"675617a6-7572-48af-838e-6c02cb19d4e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:43.180115 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.180082    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-plugins\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:43.180216 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.180139    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w4pm\" (UniqueName: \"kubernetes.io/projected/675617a6-7572-48af-838e-6c02cb19d4e7-kube-api-access-8w4pm\") pod \"data-science-collector-targetallocator-5c87f9b8d9-hb6r6\" (UID: \"675617a6-7572-48af-838e-6c02cb19d4e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:43.180216 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.180179    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb9lb\" (UniqueName: \"kubernetes.io/projected/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-kube-api-access-wb9lb\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:43.180347 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.180265    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-config\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:43.180428 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.180412    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-plugins\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:43.180781 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.180765    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-config\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:43.201277 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.201252    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb9lb\" (UniqueName: \"kubernetes.io/projected/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-kube-api-access-wb9lb\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:43.280933 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.280844    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/675617a6-7572-48af-838e-6c02cb19d4e7-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5c87f9b8d9-hb6r6\" (UID: \"675617a6-7572-48af-838e-6c02cb19d4e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:43.280933 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.280910    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/675617a6-7572-48af-838e-6c02cb19d4e7-ta-internal\") pod \"data-science-collector-targetallocator-5c87f9b8d9-hb6r6\" (UID: \"675617a6-7572-48af-838e-6c02cb19d4e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:43.281115 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.280950    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w4pm\" (UniqueName: \"kubernetes.io/projected/675617a6-7572-48af-838e-6c02cb19d4e7-kube-api-access-8w4pm\") pod \"data-science-collector-targetallocator-5c87f9b8d9-hb6r6\" (UID: \"675617a6-7572-48af-838e-6c02cb19d4e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:43.281618 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.281596    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/675617a6-7572-48af-838e-6c02cb19d4e7-ta-internal\") pod \"data-science-collector-targetallocator-5c87f9b8d9-hb6r6\" (UID: \"675617a6-7572-48af-838e-6c02cb19d4e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:43.283521 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.283500    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/675617a6-7572-48af-838e-6c02cb19d4e7-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5c87f9b8d9-hb6r6\" (UID: \"675617a6-7572-48af-838e-6c02cb19d4e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:43.305588 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.302161    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w4pm\" (UniqueName: \"kubernetes.io/projected/675617a6-7572-48af-838e-6c02cb19d4e7-kube-api-access-8w4pm\") pod \"data-science-collector-targetallocator-5c87f9b8d9-hb6r6\" (UID: \"675617a6-7572-48af-838e-6c02cb19d4e7\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:43.358737 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.358699    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:43.649005 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.648980    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"]
Oct 30 04:14:43.650888 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:14:43.650860    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod675617a6_7572_48af_838e_6c02cb19d4e7.slice/crio-3e79e66820e2885b5c34bb68f0d3ffc82c5a0c59e353c858950e1124063d87b0 WatchSource:0}: Error finding container 3e79e66820e2885b5c34bb68f0d3ffc82c5a0c59e353c858950e1124063d87b0: Status 404 returned error can't find the container with id 3e79e66820e2885b5c34bb68f0d3ffc82c5a0c59e353c858950e1124063d87b0
Oct 30 04:14:43.653112 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.653082    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:14:43.653177 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:43.653139    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:14:44.010578 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:44.010487    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6" event={"ID":"675617a6-7572-48af-838e-6c02cb19d4e7","Type":"ContainerStarted","Data":"cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b"}
Oct 30 04:14:44.010578 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:44.010529    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6" event={"ID":"675617a6-7572-48af-838e-6c02cb19d4e7","Type":"ContainerStarted","Data":"3e79e66820e2885b5c34bb68f0d3ffc82c5a0c59e353c858950e1124063d87b0"}
Oct 30 04:14:44.049790 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:44.049724    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6" podStartSLOduration=1.049706838 podStartE2EDuration="1.049706838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:14:44.049416808 +0000 UTC m=+5523.891663265" watchObservedRunningTime="2026-10-30 04:14:44.049706838 +0000 UTC m=+5523.891953287"
Oct 30 04:14:44.190106 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:44.190071    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:44.219683 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:44.219655    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:44.290587 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:44.290509    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:44.290759 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:44.290652    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:44.305335 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:44.305310    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:44.369799 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:14:44.369765    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:14:44.407458 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:44.407427    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:44.443270 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:44.443240    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:44.502771 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:44.502736    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:44.800160 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:44.800136    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:14:44.801828 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:14:44.801792    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b7ec710_6e40_4f9d_9c90_77c96c7e498b.slice/crio-04604d46050b1e7b2ffed988fe47f8b7f1da3e350df07a11904d38a64f2a48e0 WatchSource:0}: Error finding container 04604d46050b1e7b2ffed988fe47f8b7f1da3e350df07a11904d38a64f2a48e0: Status 404 returned error can't find the container with id 04604d46050b1e7b2ffed988fe47f8b7f1da3e350df07a11904d38a64f2a48e0
Oct 30 04:14:45.017405 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:45.017350    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"3b7ec710-6e40-4f9d-9c90-77c96c7e498b","Type":"ContainerStarted","Data":"54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d"}
Oct 30 04:14:45.017405 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:45.017408    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"3b7ec710-6e40-4f9d-9c90-77c96c7e498b","Type":"ContainerStarted","Data":"04604d46050b1e7b2ffed988fe47f8b7f1da3e350df07a11904d38a64f2a48e0"}
Oct 30 04:14:45.017719 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:45.017675    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:45.017719 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:45.017709    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:14:45.019417 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:45.019392    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:14:45.057701 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:45.057638    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=3.057619757 podStartE2EDuration="3.057619757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 04:14:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:14:45.056729491 +0000 UTC m=+5524.898975955" watchObservedRunningTime="2026-10-30 04:14:45.057619757 +0000 UTC m=+5524.899866200"
Oct 30 04:14:46.781845 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:46.781811    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"]
Oct 30 04:14:46.782387 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:46.781970    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl" podUID="f938c15c-51ad-41ca-a9f7-38989dc83a07" containerName="thanos-querier" containerID="cri-o://c5aa593e8246140a2b541fa294ed6ee6815135b879dff8192392e93508807a27" gracePeriod=30
Oct 30 04:14:47.027945 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:47.027916    5981 generic.go:356] "Generic (PLEG): container finished" podID="f938c15c-51ad-41ca-a9f7-38989dc83a07" containerID="c5aa593e8246140a2b541fa294ed6ee6815135b879dff8192392e93508807a27" exitCode=0
Oct 30 04:14:47.028149 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:47.027963    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl" event={"ID":"f938c15c-51ad-41ca-a9f7-38989dc83a07","Type":"ContainerDied","Data":"c5aa593e8246140a2b541fa294ed6ee6815135b879dff8192392e93508807a27"}
Oct 30 04:14:47.028149 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:47.028003    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl" event={"ID":"f938c15c-51ad-41ca-a9f7-38989dc83a07","Type":"ContainerDied","Data":"1d9f121b6b91a1c0248fc8ad84ccdf6424ce74689b5ff448a3cec54036b4a115"}
Oct 30 04:14:47.028149 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:47.028017    5981 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d9f121b6b91a1c0248fc8ad84ccdf6424ce74689b5ff448a3cec54036b4a115"
Oct 30 04:14:47.034375 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:47.034315    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"
Oct 30 04:14:47.119325 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:47.119296    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f938c15c-51ad-41ca-a9f7-38989dc83a07-kube-api-access-tvzqt\" (UniqueName: \"kubernetes.io/projected/f938c15c-51ad-41ca-a9f7-38989dc83a07-kube-api-access-tvzqt\") pod \"f938c15c-51ad-41ca-a9f7-38989dc83a07\" (UID: \"f938c15c-51ad-41ca-a9f7-38989dc83a07\") "
Oct 30 04:14:47.121498 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:47.121475    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f938c15c-51ad-41ca-a9f7-38989dc83a07-kube-api-access-tvzqt" pod "f938c15c-51ad-41ca-a9f7-38989dc83a07" (UID: "f938c15c-51ad-41ca-a9f7-38989dc83a07"). InnerVolumeSpecName "kube-api-access-tvzqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:14:47.220040 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:47.220009    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvzqt\" (UniqueName: \"kubernetes.io/projected/f938c15c-51ad-41ca-a9f7-38989dc83a07-kube-api-access-tvzqt\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:14:48.031846 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:48.031812    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"
Oct 30 04:14:48.081515 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:48.081485    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"]
Oct 30 04:14:48.094356 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:48.094332    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cmczl"]
Oct 30 04:14:48.274162 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:48.274130    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f938c15c-51ad-41ca-a9f7-38989dc83a07" path="/var/lib/kubelet/pods/f938c15c-51ad-41ca-a9f7-38989dc83a07/volumes"
Oct 30 04:14:56.023942 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:14:56.023912    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:03.224634 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.224597    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"]
Oct 30 04:15:03.225024 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.224933    5981 cpu_manager.go:414] "containerMap: removing container" podUID="f938c15c-51ad-41ca-a9f7-38989dc83a07" containerName="thanos-querier"
Oct 30 04:15:03.225024 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.224943    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f938c15c-51ad-41ca-a9f7-38989dc83a07" containerName="thanos-querier"
Oct 30 04:15:03.225024 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.224999    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="f938c15c-51ad-41ca-a9f7-38989dc83a07" containerName="thanos-querier"
Oct 30 04:15:03.228050 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.228034    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:03.259430 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.259401    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"]
Oct 30 04:15:03.359613 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.359581    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-ta-internal\") pod \"data-science-collector-targetallocator-787948fc56-6m7zk\" (UID: \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:03.359806 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.359727    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-787948fc56-6m7zk\" (UID: \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:03.359806 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.359793    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxwm4\" (UniqueName: \"kubernetes.io/projected/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-kube-api-access-hxwm4\") pod \"data-science-collector-targetallocator-787948fc56-6m7zk\" (UID: \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:03.460575 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.460543    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxwm4\" (UniqueName: \"kubernetes.io/projected/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-kube-api-access-hxwm4\") pod \"data-science-collector-targetallocator-787948fc56-6m7zk\" (UID: \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:03.460707 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.460607    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-ta-internal\") pod \"data-science-collector-targetallocator-787948fc56-6m7zk\" (UID: \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:03.460707 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.460630    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-787948fc56-6m7zk\" (UID: \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:03.461376 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.461267    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-ta-internal\") pod \"data-science-collector-targetallocator-787948fc56-6m7zk\" (UID: \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:03.463220 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.463200    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-787948fc56-6m7zk\" (UID: \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:03.480212 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.480158    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxwm4\" (UniqueName: \"kubernetes.io/projected/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-kube-api-access-hxwm4\") pod \"data-science-collector-targetallocator-787948fc56-6m7zk\" (UID: \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:03.538951 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.538921    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:03.828670 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.828641    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"]
Oct 30 04:15:03.830641 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:15:03.830609    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadc7fd9a_ec51_4cfb_a3db_6f04f76b3f8d.slice/crio-832c6c4551874ea0e6d0e005708bc6c040972f56bbb208878545d9290d633443 WatchSource:0}: Error finding container 832c6c4551874ea0e6d0e005708bc6c040972f56bbb208878545d9290d633443: Status 404 returned error can't find the container with id 832c6c4551874ea0e6d0e005708bc6c040972f56bbb208878545d9290d633443
Oct 30 04:15:03.833006 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.832977    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:03.833117 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:03.833039    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:04.099663 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.099583    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk" event={"ID":"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d","Type":"ContainerStarted","Data":"592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223"}
Oct 30 04:15:04.099663 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.099629    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk" event={"ID":"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d","Type":"ContainerStarted","Data":"832c6c4551874ea0e6d0e005708bc6c040972f56bbb208878545d9290d633443"}
Oct 30 04:15:04.099911 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.099798    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:04.100949 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.100921    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk" podUID="adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.152:8080/readyz\": dial tcp 10.134.0.152:8080: connect: connection refused"
Oct 30 04:15:04.139096 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.139049    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk" podStartSLOduration=1.139036166 podStartE2EDuration="1.139036166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:15:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:15:04.138009314 +0000 UTC m=+5543.980255760" watchObservedRunningTime="2026-10-30 04:15:04.139036166 +0000 UTC m=+5543.981282685"
Oct 30 04:15:04.150934 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.150904    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 04:15:04.154357 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.154337    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.178997 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.178970    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 04:15:04.178997 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.178974    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 04:15:04.179211 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.179038    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 04:15:04.180235 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.180208    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 04:15:04.183429 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.183410    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 04:15:04.183526 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.183466    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 04:15:04.183842 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.183829    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-dffss\""
Oct 30 04:15:04.267243 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.267187    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.267601 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.267247    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.267601 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.267268    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwfvc\" (UniqueName: \"kubernetes.io/projected/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-kube-api-access-qwfvc\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.267601 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.267386    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.267601 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.267410    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.267601 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.267537    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.368123 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.368060    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.368249 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.368140    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.368249 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.368204    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.368249 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.368233    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.368758 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.368260    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwfvc\" (UniqueName: \"kubernetes.io/projected/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-kube-api-access-qwfvc\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.368758 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.368357    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.369153 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.369130    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.370746 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.370722    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.370838 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.370763    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.371154 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.371132    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.371218 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.371137    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.387668 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.387646    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwfvc\" (UniqueName: \"kubernetes.io/projected/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-kube-api-access-qwfvc\") pod \"data-science-collector-collector-1\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.466657 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.466635    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:04.758264 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.758238    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 04:15:04.760063 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:15:04.760031    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c3ee0f_fa7e_4548_b37e_3b9b6dbb52c4.slice/crio-5970c8b86c556ded268016f30029a8f9c5572c082ac52ad94172100bf7b203d9 WatchSource:0}: Error finding container 5970c8b86c556ded268016f30029a8f9c5572c082ac52ad94172100bf7b203d9: Status 404 returned error can't find the container with id 5970c8b86c556ded268016f30029a8f9c5572c082ac52ad94172100bf7b203d9
Oct 30 04:15:04.762520 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.762484    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:04.762622 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:04.762557    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:05.106315 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.106216    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4","Type":"ContainerStarted","Data":"f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508"}
Oct 30 04:15:05.106315 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.106269    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4","Type":"ContainerStarted","Data":"5970c8b86c556ded268016f30029a8f9c5572c082ac52ad94172100bf7b203d9"}
Oct 30 04:15:05.107363 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.107341    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:05.148517 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.148475    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.148461439 podStartE2EDuration="1.148461439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:15:05.14727707 +0000 UTC m=+5544.989523518" watchObservedRunningTime="2026-10-30 04:15:05.148461439 +0000 UTC m=+5544.990707883"
Oct 30 04:15:05.223137 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.223104    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"]
Oct 30 04:15:05.223346 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.223276    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6" podUID="675617a6-7572-48af-838e-6c02cb19d4e7" containerName="ta-container" containerID="cri-o://cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b" gracePeriod=30
Oct 30 04:15:05.450778 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.450748    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:15:05.579528 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.579482    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/675617a6-7572-48af-838e-6c02cb19d4e7-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/675617a6-7572-48af-838e-6c02cb19d4e7-data-science-collector-ta-server-cert\") pod \"675617a6-7572-48af-838e-6c02cb19d4e7\" (UID: \"675617a6-7572-48af-838e-6c02cb19d4e7\") "
Oct 30 04:15:05.579657 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.579546    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/675617a6-7572-48af-838e-6c02cb19d4e7-kube-api-access-8w4pm\" (UniqueName: \"kubernetes.io/projected/675617a6-7572-48af-838e-6c02cb19d4e7-kube-api-access-8w4pm\") pod \"675617a6-7572-48af-838e-6c02cb19d4e7\" (UID: \"675617a6-7572-48af-838e-6c02cb19d4e7\") "
Oct 30 04:15:05.579657 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.579619    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/675617a6-7572-48af-838e-6c02cb19d4e7-ta-internal\" (UniqueName: \"kubernetes.io/configmap/675617a6-7572-48af-838e-6c02cb19d4e7-ta-internal\") pod \"675617a6-7572-48af-838e-6c02cb19d4e7\" (UID: \"675617a6-7572-48af-838e-6c02cb19d4e7\") "
Oct 30 04:15:05.579976 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.579952    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/675617a6-7572-48af-838e-6c02cb19d4e7-ta-internal" pod "675617a6-7572-48af-838e-6c02cb19d4e7" (UID: "675617a6-7572-48af-838e-6c02cb19d4e7"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:15:05.581658 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.581638    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/675617a6-7572-48af-838e-6c02cb19d4e7-data-science-collector-ta-server-cert" pod "675617a6-7572-48af-838e-6c02cb19d4e7" (UID: "675617a6-7572-48af-838e-6c02cb19d4e7"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:15:05.581776 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.581684    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/675617a6-7572-48af-838e-6c02cb19d4e7-kube-api-access-8w4pm" pod "675617a6-7572-48af-838e-6c02cb19d4e7" (UID: "675617a6-7572-48af-838e-6c02cb19d4e7"). InnerVolumeSpecName "kube-api-access-8w4pm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:15:05.680564 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.680537    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/675617a6-7572-48af-838e-6c02cb19d4e7-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:05.680564 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.680562    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w4pm\" (UniqueName: \"kubernetes.io/projected/675617a6-7572-48af-838e-6c02cb19d4e7-kube-api-access-8w4pm\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:05.680701 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:05.680573    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/675617a6-7572-48af-838e-6c02cb19d4e7-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:06.111959 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:06.111875    5981 generic.go:356] "Generic (PLEG): container finished" podID="675617a6-7572-48af-838e-6c02cb19d4e7" containerID="cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b" exitCode=0
Oct 30 04:15:06.111959 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:06.111914    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"
Oct 30 04:15:06.112190 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:06.111964    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6" event={"ID":"675617a6-7572-48af-838e-6c02cb19d4e7","Type":"ContainerDied","Data":"cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b"}
Oct 30 04:15:06.112190 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:06.112008    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6" event={"ID":"675617a6-7572-48af-838e-6c02cb19d4e7","Type":"ContainerDied","Data":"3e79e66820e2885b5c34bb68f0d3ffc82c5a0c59e353c858950e1124063d87b0"}
Oct 30 04:15:06.112190 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:06.112030    5981 scope.go:122] "RemoveContainer" containerID="cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b"
Oct 30 04:15:06.123051 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:06.122946    5981 scope.go:122] "RemoveContainer" containerID="cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b"
Oct 30 04:15:06.123309 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:15:06.123261    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b\": container with ID starting with cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b not found: ID does not exist" containerID="cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b"
Oct 30 04:15:06.123422 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:06.123316    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b"} err="failed to get container status \"cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b\": rpc error: code = NotFound desc = could not find container \"cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b\": container with ID starting with cd8718d38acbef9ecd84eefb9b7015ef4a9a3436c4a6d83d65b3b259290ba29b not found: ID does not exist"
Oct 30 04:15:06.163685 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:06.163660    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"]
Oct 30 04:15:06.166999 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:06.166980    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5c87f9b8d9-hb6r6"]
Oct 30 04:15:06.274872 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:06.274846    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="675617a6-7572-48af-838e-6c02cb19d4e7" path="/var/lib/kubelet/pods/675617a6-7572-48af-838e-6c02cb19d4e7/volumes"
Oct 30 04:15:14.287710 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.287675    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 04:15:14.288133 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.287858    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4" containerName="otc-container" containerID="cri-o://f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508" gracePeriod=30
Oct 30 04:15:14.369799 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:15:14.369767    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:15:14.488927 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.488896    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"]
Oct 30 04:15:14.489240 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.489226    5981 cpu_manager.go:414] "containerMap: removing container" podUID="675617a6-7572-48af-838e-6c02cb19d4e7" containerName="ta-container"
Oct 30 04:15:14.489352 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.489240    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="675617a6-7572-48af-838e-6c02cb19d4e7" containerName="ta-container"
Oct 30 04:15:14.489352 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.489341    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="675617a6-7572-48af-838e-6c02cb19d4e7" containerName="ta-container"
Oct 30 04:15:14.492460 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.492432    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:14.512322 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.512260    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"]
Oct 30 04:15:14.528725 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.528700    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:14.655289 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.655264    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-data-science-collector-ta-client-cert\") pod \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") "
Oct 30 04:15:14.655469 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.655322    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otc-internal\" (UniqueName: \"kubernetes.io/configmap/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otc-internal\") pod \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") "
Oct 30 04:15:14.655469 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.655364    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-tls-certs\") pod \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") "
Oct 30 04:15:14.655469 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.655413    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-kube-api-access-qwfvc\" (UniqueName: \"kubernetes.io/projected/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-kube-api-access-qwfvc\") pod \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") "
Oct 30 04:15:14.655469 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.655437    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-monitoring-tls-certs\") pod \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") "
Oct 30 04:15:14.655696 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.655472    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otlp-tls-certs\") pod \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\" (UID: \"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4\") "
Oct 30 04:15:14.655696 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.655576    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3978fda2-0437-4a5d-8963-f48a52b44e13-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8ffb65875-5758r\" (UID: \"3978fda2-0437-4a5d-8963-f48a52b44e13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:14.655696 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.655615    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q28j8\" (UniqueName: \"kubernetes.io/projected/3978fda2-0437-4a5d-8963-f48a52b44e13-kube-api-access-q28j8\") pod \"data-science-collector-targetallocator-8ffb65875-5758r\" (UID: \"3978fda2-0437-4a5d-8963-f48a52b44e13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:14.655852 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.655794    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3978fda2-0437-4a5d-8963-f48a52b44e13-ta-internal\") pod \"data-science-collector-targetallocator-8ffb65875-5758r\" (UID: \"3978fda2-0437-4a5d-8963-f48a52b44e13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:14.655852 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.655793    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otc-internal" pod "93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4" (UID: "93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:15:14.655944 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.655885    5981 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otc-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:14.657849 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.657814    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otlp-tls-certs" pod "93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4" (UID: "93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:15:14.658119 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.658092    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-tls-certs" pod "93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4" (UID: "93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:15:14.658230 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.658154    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-kube-api-access-qwfvc" pod "93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4" (UID: "93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4"). InnerVolumeSpecName "kube-api-access-qwfvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:15:14.658230 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.658187    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-monitoring-tls-certs" pod "93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4" (UID: "93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:15:14.658230 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.658209    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-data-science-collector-ta-client-cert" pod "93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4" (UID: "93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:15:14.756810 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.756778    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q28j8\" (UniqueName: \"kubernetes.io/projected/3978fda2-0437-4a5d-8963-f48a52b44e13-kube-api-access-q28j8\") pod \"data-science-collector-targetallocator-8ffb65875-5758r\" (UID: \"3978fda2-0437-4a5d-8963-f48a52b44e13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:14.756980 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.756849    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3978fda2-0437-4a5d-8963-f48a52b44e13-ta-internal\") pod \"data-science-collector-targetallocator-8ffb65875-5758r\" (UID: \"3978fda2-0437-4a5d-8963-f48a52b44e13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:14.756980 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.756883    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3978fda2-0437-4a5d-8963-f48a52b44e13-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8ffb65875-5758r\" (UID: \"3978fda2-0437-4a5d-8963-f48a52b44e13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:14.756980 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.756918    5981 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:14.756980 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.756928    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwfvc\" (UniqueName: \"kubernetes.io/projected/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-kube-api-access-qwfvc\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:14.756980 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.756938    5981 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-monitoring-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:14.756980 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.756951    5981 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-otlp-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:14.756980 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.756966    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4-data-science-collector-ta-client-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:14.757635 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.757604    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3978fda2-0437-4a5d-8963-f48a52b44e13-ta-internal\") pod \"data-science-collector-targetallocator-8ffb65875-5758r\" (UID: \"3978fda2-0437-4a5d-8963-f48a52b44e13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:14.759420 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.759401    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3978fda2-0437-4a5d-8963-f48a52b44e13-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8ffb65875-5758r\" (UID: \"3978fda2-0437-4a5d-8963-f48a52b44e13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:14.776666 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.776643    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q28j8\" (UniqueName: \"kubernetes.io/projected/3978fda2-0437-4a5d-8963-f48a52b44e13-kube-api-access-q28j8\") pod \"data-science-collector-targetallocator-8ffb65875-5758r\" (UID: \"3978fda2-0437-4a5d-8963-f48a52b44e13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:14.804638 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:14.804612    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:15.095393 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.095179    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"]
Oct 30 04:15:15.097574 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:15:15.097541    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3978fda2_0437_4a5d_8963_f48a52b44e13.slice/crio-b923eef8c5b39fd0bea5303dfb8130b8fa2cdaafd37bf506d6021ec0f629b98a WatchSource:0}: Error finding container b923eef8c5b39fd0bea5303dfb8130b8fa2cdaafd37bf506d6021ec0f629b98a: Status 404 returned error can't find the container with id b923eef8c5b39fd0bea5303dfb8130b8fa2cdaafd37bf506d6021ec0f629b98a
Oct 30 04:15:15.099655 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.099627    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:15.099708 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.099679    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:15.153732 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.153692    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r" event={"ID":"3978fda2-0437-4a5d-8963-f48a52b44e13","Type":"ContainerStarted","Data":"cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770"}
Oct 30 04:15:15.153891 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.153747    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:15.153891 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.153767    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r" event={"ID":"3978fda2-0437-4a5d-8963-f48a52b44e13","Type":"ContainerStarted","Data":"b923eef8c5b39fd0bea5303dfb8130b8fa2cdaafd37bf506d6021ec0f629b98a"}
Oct 30 04:15:15.155157 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.155129    5981 generic.go:356] "Generic (PLEG): container finished" podID="93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4" containerID="f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508" exitCode=0
Oct 30 04:15:15.155275 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.155159    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.155275 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.155205    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4","Type":"ContainerDied","Data":"f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508"}
Oct 30 04:15:15.155275 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.155254    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4","Type":"ContainerDied","Data":"5970c8b86c556ded268016f30029a8f9c5572c082ac52ad94172100bf7b203d9"}
Oct 30 04:15:15.155476 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.155312    5981 scope.go:122] "RemoveContainer" containerID="f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508"
Oct 30 04:15:15.155476 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.155433    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r" podUID="3978fda2-0437-4a5d-8963-f48a52b44e13" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.154:8080/readyz\": dial tcp 10.134.0.154:8080: connect: connection refused"
Oct 30 04:15:15.164433 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.164408    5981 scope.go:122] "RemoveContainer" containerID="f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508"
Oct 30 04:15:15.164743 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:15:15.164724    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508\": container with ID starting with f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508 not found: ID does not exist" containerID="f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508"
Oct 30 04:15:15.164810 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.164754    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508"} err="failed to get container status \"f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508\": rpc error: code = NotFound desc = could not find container \"f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508\": container with ID starting with f790f1503d78b6c7abcb16d04231268e9a275bb522615cb137a4fad4c0fdd508 not found: ID does not exist"
Oct 30 04:15:15.196300 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.196239    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r" podStartSLOduration=1.1962265300000001 podStartE2EDuration="1.19622653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:15:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:15:15.195268289 +0000 UTC m=+5555.037514733" watchObservedRunningTime="2026-10-30 04:15:15.19622653 +0000 UTC m=+5555.038472975"
Oct 30 04:15:15.233038 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.233007    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 04:15:15.237739 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.237712    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 04:15:15.274232 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.274204    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 04:15:15.274618 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.274604    5981 cpu_manager.go:414] "containerMap: removing container" podUID="93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4" containerName="otc-container"
Oct 30 04:15:15.274661 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.274620    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4" containerName="otc-container"
Oct 30 04:15:15.274721 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.274711    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4" containerName="otc-container"
Oct 30 04:15:15.278912 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.278893    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.295444 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.295414    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 04:15:15.297535 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.297511    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 04:15:15.297535 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.297530    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-dffss\""
Oct 30 04:15:15.297713 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.297585    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 04:15:15.297713 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.297650    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 04:15:15.297713 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.297659    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 04:15:15.297838 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.297760    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 04:15:15.361391 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.361317    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.361623 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.361434    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj6ll\" (UniqueName: \"kubernetes.io/projected/97209f14-1b6b-47f2-a0c0-f8071f288589-kube-api-access-gj6ll\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.361623 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.361504    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/97209f14-1b6b-47f2-a0c0-f8071f288589-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.361623 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.361556    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.361623 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.361582    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.361946 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.361649    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.463023 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.462989    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj6ll\" (UniqueName: \"kubernetes.io/projected/97209f14-1b6b-47f2-a0c0-f8071f288589-kube-api-access-gj6ll\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.463195 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.463031    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/97209f14-1b6b-47f2-a0c0-f8071f288589-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.463195 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.463063    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.463195 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.463095    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.463195 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.463132    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.463195 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.463165    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.463848 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.463822    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/97209f14-1b6b-47f2-a0c0-f8071f288589-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.465861 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.465836    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.465861 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.465855    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.466155 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.466139    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.466200 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.466183    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.482612 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.482591    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj6ll\" (UniqueName: \"kubernetes.io/projected/97209f14-1b6b-47f2-a0c0-f8071f288589-kube-api-access-gj6ll\") pod \"data-science-collector-collector-1\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.591697 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.591667    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:15.882542 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.882516    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 04:15:15.884894 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:15:15.884865    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97209f14_1b6b_47f2_a0c0_f8071f288589.slice/crio-5dce41a0d5d4e8a6df3529626e77ef6b64972fb4c2f3126851bff35bae68c9b7 WatchSource:0}: Error finding container 5dce41a0d5d4e8a6df3529626e77ef6b64972fb4c2f3126851bff35bae68c9b7: Status 404 returned error can't find the container with id 5dce41a0d5d4e8a6df3529626e77ef6b64972fb4c2f3126851bff35bae68c9b7
Oct 30 04:15:15.887076 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.887043    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:15.887164 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:15.887101    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:16.162430 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.162331    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"97209f14-1b6b-47f2-a0c0-f8071f288589","Type":"ContainerStarted","Data":"5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279"}
Oct 30 04:15:16.162430 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.162404    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"97209f14-1b6b-47f2-a0c0-f8071f288589","Type":"ContainerStarted","Data":"5dce41a0d5d4e8a6df3529626e77ef6b64972fb4c2f3126851bff35bae68c9b7"}
Oct 30 04:15:16.163480 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.163457    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:16.206311 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.206232    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.206214187 podStartE2EDuration="1.206214187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:15:16.205698431 +0000 UTC m=+5556.047944901" watchObservedRunningTime="2026-10-30 04:15:16.206214187 +0000 UTC m=+5556.048460627"
Oct 30 04:15:16.278078 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.278043    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4" path="/var/lib/kubelet/pods/93c3ee0f-fa7e-4548-b37e-3b9b6dbb52c4/volumes"
Oct 30 04:15:16.278379 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.278362    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"]
Oct 30 04:15:16.278555 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.278533    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk" podUID="adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d" containerName="ta-container" containerID="cri-o://592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223" gracePeriod=30
Oct 30 04:15:16.522789 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.522766    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:16.674895 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.674862    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-ta-internal\" (UniqueName: \"kubernetes.io/configmap/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-ta-internal\") pod \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\" (UID: \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\") "
Oct 30 04:15:16.675055 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.675000    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-data-science-collector-ta-server-cert\") pod \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\" (UID: \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\") "
Oct 30 04:15:16.675055 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.675033    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-kube-api-access-hxwm4\" (UniqueName: \"kubernetes.io/projected/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-kube-api-access-hxwm4\") pod \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\" (UID: \"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d\") "
Oct 30 04:15:16.675338 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.675305    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-ta-internal" pod "adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d" (UID: "adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:15:16.677242 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.677219    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-kube-api-access-hxwm4" pod "adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d" (UID: "adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d"). InnerVolumeSpecName "kube-api-access-hxwm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:15:16.677352 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.677246    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-data-science-collector-ta-server-cert" pod "adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d" (UID: "adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:15:16.776269 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.776199    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:16.776269 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.776226    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxwm4\" (UniqueName: \"kubernetes.io/projected/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-kube-api-access-hxwm4\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:16.776269 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:16.776235    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:17.168209 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:17.168170    5981 generic.go:356] "Generic (PLEG): container finished" podID="adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d" containerID="592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223" exitCode=0
Oct 30 04:15:17.168209 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:17.168210    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"
Oct 30 04:15:17.168490 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:17.168250    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk" event={"ID":"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d","Type":"ContainerDied","Data":"592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223"}
Oct 30 04:15:17.168490 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:17.168321    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk" event={"ID":"adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d","Type":"ContainerDied","Data":"832c6c4551874ea0e6d0e005708bc6c040972f56bbb208878545d9290d633443"}
Oct 30 04:15:17.168490 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:17.168347    5981 scope.go:122] "RemoveContainer" containerID="592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223"
Oct 30 04:15:17.178015 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:17.177991    5981 scope.go:122] "RemoveContainer" containerID="592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223"
Oct 30 04:15:17.178328 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:15:17.178305    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223\": container with ID starting with 592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223 not found: ID does not exist" containerID="592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223"
Oct 30 04:15:17.178419 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:17.178337    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223"} err="failed to get container status \"592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223\": rpc error: code = NotFound desc = could not find container \"592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223\": container with ID starting with 592a6fc95d3fe813b5bb677719feae0ca3c02880d6ecfdc5663f90bd9f984223 not found: ID does not exist"
Oct 30 04:15:17.233239 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:17.233207    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"]
Oct 30 04:15:17.251936 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:17.251912    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-787948fc56-6m7zk"]
Oct 30 04:15:18.274719 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:18.274686    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d" path="/var/lib/kubelet/pods/adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d/volumes"
Oct 30 04:15:19.657228 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:19.657199    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 04:15:19.657658 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:19.657401    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="97209f14-1b6b-47f2-a0c0-f8071f288589" containerName="otc-container" containerID="cri-o://5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279" gracePeriod=30
Oct 30 04:15:19.707502 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:19.707477    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"]
Oct 30 04:15:19.707652 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:19.707627    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r" podUID="3978fda2-0437-4a5d-8963-f48a52b44e13" containerName="ta-container" containerID="cri-o://cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770" gracePeriod=30
Oct 30 04:15:19.780275 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:19.780247    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:15:19.780474 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:19.780445    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="3b7ec710-6e40-4f9d-9c90-77c96c7e498b" containerName="perses" containerID="cri-o://54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d" gracePeriod=30
Oct 30 04:15:19.962325 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:19.962093    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:20.056222 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.056200    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:20.059393 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.059366    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:20.106809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.106789    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/97209f14-1b6b-47f2-a0c0-f8071f288589-otc-internal\" (UniqueName: \"kubernetes.io/configmap/97209f14-1b6b-47f2-a0c0-f8071f288589-otc-internal\") pod \"97209f14-1b6b-47f2-a0c0-f8071f288589\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") "
Oct 30 04:15:20.106919 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.106839    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-monitoring-tls-certs\") pod \"97209f14-1b6b-47f2-a0c0-f8071f288589\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") "
Oct 30 04:15:20.106919 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.106872    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-data-science-collector-ta-client-cert\") pod \"97209f14-1b6b-47f2-a0c0-f8071f288589\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") "
Oct 30 04:15:20.106919 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.106909    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-otlp-tls-certs\") pod \"97209f14-1b6b-47f2-a0c0-f8071f288589\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") "
Oct 30 04:15:20.107083 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.106931    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/97209f14-1b6b-47f2-a0c0-f8071f288589-kube-api-access-gj6ll\" (UniqueName: \"kubernetes.io/projected/97209f14-1b6b-47f2-a0c0-f8071f288589-kube-api-access-gj6ll\") pod \"97209f14-1b6b-47f2-a0c0-f8071f288589\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") "
Oct 30 04:15:20.107083 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.106971    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-tls-certs\") pod \"97209f14-1b6b-47f2-a0c0-f8071f288589\" (UID: \"97209f14-1b6b-47f2-a0c0-f8071f288589\") "
Oct 30 04:15:20.107430 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.107307    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97209f14-1b6b-47f2-a0c0-f8071f288589-otc-internal" pod "97209f14-1b6b-47f2-a0c0-f8071f288589" (UID: "97209f14-1b6b-47f2-a0c0-f8071f288589"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:15:20.109202 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.109173    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-monitoring-tls-certs" pod "97209f14-1b6b-47f2-a0c0-f8071f288589" (UID: "97209f14-1b6b-47f2-a0c0-f8071f288589"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:15:20.109320 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.109242    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-otlp-tls-certs" pod "97209f14-1b6b-47f2-a0c0-f8071f288589" (UID: "97209f14-1b6b-47f2-a0c0-f8071f288589"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:15:20.109486 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.109468    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-data-science-collector-ta-client-cert" pod "97209f14-1b6b-47f2-a0c0-f8071f288589" (UID: "97209f14-1b6b-47f2-a0c0-f8071f288589"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:15:20.109570 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.109554    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97209f14-1b6b-47f2-a0c0-f8071f288589-kube-api-access-gj6ll" pod "97209f14-1b6b-47f2-a0c0-f8071f288589" (UID: "97209f14-1b6b-47f2-a0c0-f8071f288589"). InnerVolumeSpecName "kube-api-access-gj6ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:15:20.109937 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.109916    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-tls-certs" pod "97209f14-1b6b-47f2-a0c0-f8071f288589" (UID: "97209f14-1b6b-47f2-a0c0-f8071f288589"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:15:20.183722 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.183656    5981 generic.go:356] "Generic (PLEG): container finished" podID="3978fda2-0437-4a5d-8963-f48a52b44e13" containerID="cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770" exitCode=0
Oct 30 04:15:20.183722 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.183704    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"
Oct 30 04:15:20.183898 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.183741    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r" event={"ID":"3978fda2-0437-4a5d-8963-f48a52b44e13","Type":"ContainerDied","Data":"cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770"}
Oct 30 04:15:20.183898 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.183789    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r" event={"ID":"3978fda2-0437-4a5d-8963-f48a52b44e13","Type":"ContainerDied","Data":"b923eef8c5b39fd0bea5303dfb8130b8fa2cdaafd37bf506d6021ec0f629b98a"}
Oct 30 04:15:20.183898 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.183812    5981 scope.go:122] "RemoveContainer" containerID="cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770"
Oct 30 04:15:20.185111 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.185092    5981 generic.go:356] "Generic (PLEG): container finished" podID="97209f14-1b6b-47f2-a0c0-f8071f288589" containerID="5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279" exitCode=0
Oct 30 04:15:20.185206 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.185116    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"97209f14-1b6b-47f2-a0c0-f8071f288589","Type":"ContainerDied","Data":"5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279"}
Oct 30 04:15:20.185206 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.185142    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 04:15:20.185206 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.185170    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"97209f14-1b6b-47f2-a0c0-f8071f288589","Type":"ContainerDied","Data":"5dce41a0d5d4e8a6df3529626e77ef6b64972fb4c2f3126851bff35bae68c9b7"}
Oct 30 04:15:20.186572 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.186554    5981 generic.go:356] "Generic (PLEG): container finished" podID="3b7ec710-6e40-4f9d-9c90-77c96c7e498b" containerID="54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d" exitCode=0
Oct 30 04:15:20.186660 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.186622    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"3b7ec710-6e40-4f9d-9c90-77c96c7e498b","Type":"ContainerDied","Data":"54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d"}
Oct 30 04:15:20.186660 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.186646    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"3b7ec710-6e40-4f9d-9c90-77c96c7e498b","Type":"ContainerDied","Data":"04604d46050b1e7b2ffed988fe47f8b7f1da3e350df07a11904d38a64f2a48e0"}
Oct 30 04:15:20.186730 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.186689    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:20.196251 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.196233    5981 scope.go:122] "RemoveContainer" containerID="cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770"
Oct 30 04:15:20.196517 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:15:20.196500    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770\": container with ID starting with cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770 not found: ID does not exist" containerID="cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770"
Oct 30 04:15:20.196587 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.196524    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770"} err="failed to get container status \"cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770\": rpc error: code = NotFound desc = could not find container \"cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770\": container with ID starting with cc16201fb110752ff08135361a1ea485d6411d6bb778060e70745ba99537a770 not found: ID does not exist"
Oct 30 04:15:20.196587 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.196540    5981 scope.go:122] "RemoveContainer" containerID="5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279"
Oct 30 04:15:20.204791 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.204775    5981 scope.go:122] "RemoveContainer" containerID="5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279"
Oct 30 04:15:20.205032 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:15:20.205015    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279\": container with ID starting with 5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279 not found: ID does not exist" containerID="5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279"
Oct 30 04:15:20.205096 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.205044    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279"} err="failed to get container status \"5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279\": rpc error: code = NotFound desc = could not find container \"5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279\": container with ID starting with 5bc404688962e566b1bc179a2c3b17971b66db18a6581db6db45c5fe89923279 not found: ID does not exist"
Oct 30 04:15:20.205096 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.205066    5981 scope.go:122] "RemoveContainer" containerID="54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d"
Oct 30 04:15:20.208365 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.208345    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-kube-api-access-wb9lb\" (UniqueName: \"kubernetes.io/projected/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-kube-api-access-wb9lb\") pod \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") "
Oct 30 04:15:20.208449 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.208372    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-config\" (UniqueName: \"kubernetes.io/configmap/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-config\") pod \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") "
Oct 30 04:15:20.208449 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.208425    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-plugins\" (UniqueName: \"kubernetes.io/empty-dir/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-plugins\") pod \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") "
Oct 30 04:15:20.208557 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.208531    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3978fda2-0437-4a5d-8963-f48a52b44e13-kube-api-access-q28j8\" (UniqueName: \"kubernetes.io/projected/3978fda2-0437-4a5d-8963-f48a52b44e13-kube-api-access-q28j8\") pod \"3978fda2-0437-4a5d-8963-f48a52b44e13\" (UID: \"3978fda2-0437-4a5d-8963-f48a52b44e13\") "
Oct 30 04:15:20.208621 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.208583    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3978fda2-0437-4a5d-8963-f48a52b44e13-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3978fda2-0437-4a5d-8963-f48a52b44e13-data-science-collector-ta-server-cert\") pod \"3978fda2-0437-4a5d-8963-f48a52b44e13\" (UID: \"3978fda2-0437-4a5d-8963-f48a52b44e13\") "
Oct 30 04:15:20.208680 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.208624    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3978fda2-0437-4a5d-8963-f48a52b44e13-ta-internal\" (UniqueName: \"kubernetes.io/configmap/3978fda2-0437-4a5d-8963-f48a52b44e13-ta-internal\") pod \"3978fda2-0437-4a5d-8963-f48a52b44e13\" (UID: \"3978fda2-0437-4a5d-8963-f48a52b44e13\") "
Oct 30 04:15:20.208798 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.208780    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\" (UID: \"3b7ec710-6e40-4f9d-9c90-77c96c7e498b\") "
Oct 30 04:15:20.209271 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.209249    5981 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/97209f14-1b6b-47f2-a0c0-f8071f288589-otc-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:20.209563 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.209276    5981 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-monitoring-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:20.209563 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.209353    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-data-science-collector-ta-client-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:20.209563 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.209369    5981 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-otlp-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:20.209563 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.209384    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj6ll\" (UniqueName: \"kubernetes.io/projected/97209f14-1b6b-47f2-a0c0-f8071f288589-kube-api-access-gj6ll\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:20.209563 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.209422    5981 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97209f14-1b6b-47f2-a0c0-f8071f288589-tls-certs\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:20.209563 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.208782    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-config" pod "3b7ec710-6e40-4f9d-9c90-77c96c7e498b" (UID: "3b7ec710-6e40-4f9d-9c90-77c96c7e498b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:15:20.209563 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.209191    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3978fda2-0437-4a5d-8963-f48a52b44e13-ta-internal" pod "3978fda2-0437-4a5d-8963-f48a52b44e13" (UID: "3978fda2-0437-4a5d-8963-f48a52b44e13"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:15:20.210989 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.210953    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-kube-api-access-wb9lb" pod "3b7ec710-6e40-4f9d-9c90-77c96c7e498b" (UID: "3b7ec710-6e40-4f9d-9c90-77c96c7e498b"). InnerVolumeSpecName "kube-api-access-wb9lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:15:20.211169 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.211147    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3978fda2-0437-4a5d-8963-f48a52b44e13-kube-api-access-q28j8" pod "3978fda2-0437-4a5d-8963-f48a52b44e13" (UID: "3978fda2-0437-4a5d-8963-f48a52b44e13"). InnerVolumeSpecName "kube-api-access-q28j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:15:20.211308 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.211266    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3978fda2-0437-4a5d-8963-f48a52b44e13-data-science-collector-ta-server-cert" pod "3978fda2-0437-4a5d-8963-f48a52b44e13" (UID: "3978fda2-0437-4a5d-8963-f48a52b44e13"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:15:20.212064 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.212042    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "3b7ec710-6e40-4f9d-9c90-77c96c7e498b" (UID: "3b7ec710-6e40-4f9d-9c90-77c96c7e498b"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 04:15:20.214655 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.214636    5981 scope.go:122] "RemoveContainer" containerID="54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d"
Oct 30 04:15:20.214938 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:15:20.214919    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d\": container with ID starting with 54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d not found: ID does not exist" containerID="54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d"
Oct 30 04:15:20.215016 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.214947    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d"} err="failed to get container status \"54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d\": rpc error: code = NotFound desc = could not find container \"54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d\": container with ID starting with 54852115e55f6ff0ea4735f13fb8119bc6fdab8bc8f225c1c777976aee8cbb1d not found: ID does not exist"
Oct 30 04:15:20.237035 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.237017    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 04:15:20.240732 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.240709    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 04:15:20.276681 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.276650    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="97209f14-1b6b-47f2-a0c0-f8071f288589" path="/var/lib/kubelet/pods/97209f14-1b6b-47f2-a0c0-f8071f288589/volumes"
Oct 30 04:15:20.310116 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.310097    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 04:15:20.310217 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.310134    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb9lb\" (UniqueName: \"kubernetes.io/projected/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-kube-api-access-wb9lb\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:20.310217 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.310144    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:20.310217 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.310154    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q28j8\" (UniqueName: \"kubernetes.io/projected/3978fda2-0437-4a5d-8963-f48a52b44e13-kube-api-access-q28j8\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:20.310217 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.310163    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3978fda2-0437-4a5d-8963-f48a52b44e13-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:20.310217 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.310173    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3978fda2-0437-4a5d-8963-f48a52b44e13-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:20.324535 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.324519    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 04:15:20.362727 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.362700    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-plugins" pod "3b7ec710-6e40-4f9d-9c90-77c96c7e498b" (UID: "3b7ec710-6e40-4f9d-9c90-77c96c7e498b"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:15:20.410572 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.410543    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/3b7ec710-6e40-4f9d-9c90-77c96c7e498b-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:20.410572 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.410570    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 04:15:20.521162 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.521137    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"]
Oct 30 04:15:20.525383 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.525361    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8ffb65875-5758r"]
Oct 30 04:15:20.560920 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.560897    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:15:20.564270 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:20.564250    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:15:22.274807 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:22.274771    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3978fda2-0437-4a5d-8963-f48a52b44e13" path="/var/lib/kubelet/pods/3978fda2-0437-4a5d-8963-f48a52b44e13/volumes"
Oct 30 04:15:22.275240 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:22.275210    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b7ec710-6e40-4f9d-9c90-77c96c7e498b" path="/var/lib/kubelet/pods/3b7ec710-6e40-4f9d-9c90-77c96c7e498b/volumes"
Oct 30 04:15:26.187143 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187109    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"]
Oct 30 04:15:26.187619 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187599    5981 cpu_manager.go:414] "containerMap: removing container" podUID="adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d" containerName="ta-container"
Oct 30 04:15:26.187751 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187621    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d" containerName="ta-container"
Oct 30 04:15:26.187751 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187638    5981 cpu_manager.go:414] "containerMap: removing container" podUID="97209f14-1b6b-47f2-a0c0-f8071f288589" containerName="otc-container"
Oct 30 04:15:26.187751 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187646    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="97209f14-1b6b-47f2-a0c0-f8071f288589" containerName="otc-container"
Oct 30 04:15:26.187751 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187663    5981 cpu_manager.go:414] "containerMap: removing container" podUID="3b7ec710-6e40-4f9d-9c90-77c96c7e498b" containerName="perses"
Oct 30 04:15:26.187751 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187671    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b7ec710-6e40-4f9d-9c90-77c96c7e498b" containerName="perses"
Oct 30 04:15:26.187751 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187681    5981 cpu_manager.go:414] "containerMap: removing container" podUID="3978fda2-0437-4a5d-8963-f48a52b44e13" containerName="ta-container"
Oct 30 04:15:26.187751 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187688    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3978fda2-0437-4a5d-8963-f48a52b44e13" containerName="ta-container"
Oct 30 04:15:26.188031 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187782    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b7ec710-6e40-4f9d-9c90-77c96c7e498b" containerName="perses"
Oct 30 04:15:26.188031 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187794    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="3978fda2-0437-4a5d-8963-f48a52b44e13" containerName="ta-container"
Oct 30 04:15:26.188031 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187812    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="adc7fd9a-ec51-4cfb-a3db-6f04f76b3f8d" containerName="ta-container"
Oct 30 04:15:26.188031 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.187820    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="97209f14-1b6b-47f2-a0c0-f8071f288589" containerName="otc-container"
Oct 30 04:15:26.210450 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.210414    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"]
Oct 30 04:15:26.210618 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.210516    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"
Oct 30 04:15:26.227654 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.227627    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 04:15:26.227768 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.227658    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 04:15:26.227768 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.227705    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 04:15:26.362945 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.362904    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqbz4\" (UniqueName: \"kubernetes.io/projected/8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f-kube-api-access-jqbz4\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75\" (UID: \"8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"
Oct 30 04:15:26.464172 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.464100    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqbz4\" (UniqueName: \"kubernetes.io/projected/8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f-kube-api-access-jqbz4\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75\" (UID: \"8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"
Oct 30 04:15:26.488143 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.488112    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqbz4\" (UniqueName: \"kubernetes.io/projected/8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f-kube-api-access-jqbz4\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75\" (UID: \"8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"
Oct 30 04:15:26.524793 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.524760    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"
Oct 30 04:15:26.814349 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:26.814324    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"]
Oct 30 04:15:26.816510 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:15:26.816483    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f6224ec_ce4c_4459_8ffb_42b01c0c8f2f.slice/crio-ec5114134daf783883f226ae2e04bacc27ecb73fdf911502aa7d7fe5db576ed6 WatchSource:0}: Error finding container ec5114134daf783883f226ae2e04bacc27ecb73fdf911502aa7d7fe5db576ed6: Status 404 returned error can't find the container with id ec5114134daf783883f226ae2e04bacc27ecb73fdf911502aa7d7fe5db576ed6
Oct 30 04:15:27.189080 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.189047    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:15:27.192240 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.192224    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:27.209708 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.209684    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:15:27.221782 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.221756    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75" event={"ID":"8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f","Type":"ContainerStarted","Data":"ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2"}
Oct 30 04:15:27.221908 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.221789    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75" event={"ID":"8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f","Type":"ContainerStarted","Data":"ec5114134daf783883f226ae2e04bacc27ecb73fdf911502aa7d7fe5db576ed6"}
Oct 30 04:15:27.229570 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.229551    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 04:15:27.288932 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.288902    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"]
Oct 30 04:15:27.292047 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.292027    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:27.317002 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.316978    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-rq9df\""
Oct 30 04:15:27.317002 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.316982    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 04:15:27.318126 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.318103    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"]
Oct 30 04:15:27.328957 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.328936    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 04:15:27.338270 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.338214    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75" podStartSLOduration=1.3382002069999999 podStartE2EDuration="1.338200207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:15:27.337846268 +0000 UTC m=+5567.180092713" watchObservedRunningTime="2026-10-30 04:15:27.338200207 +0000 UTC m=+5567.180446653"
Oct 30 04:15:27.372978 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.372950    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/ff2d13fe-7474-4168-a683-749b3d3c4e04-plugins\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:27.373110 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.373000    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgftt\" (UniqueName: \"kubernetes.io/projected/ff2d13fe-7474-4168-a683-749b3d3c4e04-kube-api-access-sgftt\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:27.373171 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.373114    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff2d13fe-7474-4168-a683-749b3d3c4e04-config\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:27.473868 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.473778    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c067bab6-bb52-4174-87a0-3fc928682624-ta-internal\") pod \"data-science-collector-targetallocator-7d5c5dd4d5-8r6n9\" (UID: \"c067bab6-bb52-4174-87a0-3fc928682624\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:27.473868 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.473829    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/ff2d13fe-7474-4168-a683-749b3d3c4e04-plugins\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:27.474074 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.473941    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c067bab6-bb52-4174-87a0-3fc928682624-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7d5c5dd4d5-8r6n9\" (UID: \"c067bab6-bb52-4174-87a0-3fc928682624\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:27.474074 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.473992    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlvb4\" (UniqueName: \"kubernetes.io/projected/c067bab6-bb52-4174-87a0-3fc928682624-kube-api-access-nlvb4\") pod \"data-science-collector-targetallocator-7d5c5dd4d5-8r6n9\" (UID: \"c067bab6-bb52-4174-87a0-3fc928682624\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:27.474185 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.474095    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgftt\" (UniqueName: \"kubernetes.io/projected/ff2d13fe-7474-4168-a683-749b3d3c4e04-kube-api-access-sgftt\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:27.474185 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.474143    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff2d13fe-7474-4168-a683-749b3d3c4e04-config\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:27.474309 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.474192    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/ff2d13fe-7474-4168-a683-749b3d3c4e04-plugins\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:27.474701 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.474683    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff2d13fe-7474-4168-a683-749b3d3c4e04-config\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:27.496124 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.496090    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgftt\" (UniqueName: \"kubernetes.io/projected/ff2d13fe-7474-4168-a683-749b3d3c4e04-kube-api-access-sgftt\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:27.575561 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.575529    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c067bab6-bb52-4174-87a0-3fc928682624-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7d5c5dd4d5-8r6n9\" (UID: \"c067bab6-bb52-4174-87a0-3fc928682624\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:27.575696 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.575569    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlvb4\" (UniqueName: \"kubernetes.io/projected/c067bab6-bb52-4174-87a0-3fc928682624-kube-api-access-nlvb4\") pod \"data-science-collector-targetallocator-7d5c5dd4d5-8r6n9\" (UID: \"c067bab6-bb52-4174-87a0-3fc928682624\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:27.575696 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.575641    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c067bab6-bb52-4174-87a0-3fc928682624-ta-internal\") pod \"data-science-collector-targetallocator-7d5c5dd4d5-8r6n9\" (UID: \"c067bab6-bb52-4174-87a0-3fc928682624\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:27.576304 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.576265    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c067bab6-bb52-4174-87a0-3fc928682624-ta-internal\") pod \"data-science-collector-targetallocator-7d5c5dd4d5-8r6n9\" (UID: \"c067bab6-bb52-4174-87a0-3fc928682624\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:27.578068 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.578043    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c067bab6-bb52-4174-87a0-3fc928682624-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7d5c5dd4d5-8r6n9\" (UID: \"c067bab6-bb52-4174-87a0-3fc928682624\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:27.595320 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.595272    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlvb4\" (UniqueName: \"kubernetes.io/projected/c067bab6-bb52-4174-87a0-3fc928682624-kube-api-access-nlvb4\") pod \"data-science-collector-targetallocator-7d5c5dd4d5-8r6n9\" (UID: \"c067bab6-bb52-4174-87a0-3fc928682624\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:27.603781 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.603760    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:27.896137 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.896110    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"]
Oct 30 04:15:27.897717 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:15:27.897679    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc067bab6_bb52_4174_87a0_3fc928682624.slice/crio-1545683864fd3e835129610683a1fd217996e616691acd78c5967cfd466216f7 WatchSource:0}: Error finding container 1545683864fd3e835129610683a1fd217996e616691acd78c5967cfd466216f7: Status 404 returned error can't find the container with id 1545683864fd3e835129610683a1fd217996e616691acd78c5967cfd466216f7
Oct 30 04:15:27.899797 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.899769    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:27.899859 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:27.899824    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:28.228164 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:28.228128    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9" event={"ID":"c067bab6-bb52-4174-87a0-3fc928682624","Type":"ContainerStarted","Data":"fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca"}
Oct 30 04:15:28.228164 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:28.228169    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9" event={"ID":"c067bab6-bb52-4174-87a0-3fc928682624","Type":"ContainerStarted","Data":"1545683864fd3e835129610683a1fd217996e616691acd78c5967cfd466216f7"}
Oct 30 04:15:28.271063 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:28.270990    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9" podStartSLOduration=1.270963581 podStartE2EDuration="1.270963581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:15:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:15:28.270414326 +0000 UTC m=+5568.112660788" watchObservedRunningTime="2026-10-30 04:15:28.270963581 +0000 UTC m=+5568.113210026"
Oct 30 04:15:29.232142 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:29.232104    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:29.233946 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:29.233924    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:29.962146 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:29.962113    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"]
Oct 30 04:15:29.965431 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:29.965407    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"
Oct 30 04:15:29.982692 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:29.982662    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"]
Oct 30 04:15:30.099088 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:30.099047    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r46pg\" (UniqueName: \"kubernetes.io/projected/4cb19fd1-b679-47d2-9902-ea2f85c8f1ea-kube-api-access-r46pg\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk\" (UID: \"4cb19fd1-b679-47d2-9902-ea2f85c8f1ea\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"
Oct 30 04:15:30.200015 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:30.199975    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46pg\" (UniqueName: \"kubernetes.io/projected/4cb19fd1-b679-47d2-9902-ea2f85c8f1ea-kube-api-access-r46pg\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk\" (UID: \"4cb19fd1-b679-47d2-9902-ea2f85c8f1ea\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"
Oct 30 04:15:30.220602 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:30.220528    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r46pg\" (UniqueName: \"kubernetes.io/projected/4cb19fd1-b679-47d2-9902-ea2f85c8f1ea-kube-api-access-r46pg\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk\" (UID: \"4cb19fd1-b679-47d2-9902-ea2f85c8f1ea\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"
Oct 30 04:15:30.277399 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:30.277372    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"
Oct 30 04:15:30.568631 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:30.568566    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"]
Oct 30 04:15:31.241257 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:31.241218    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk" event={"ID":"4cb19fd1-b679-47d2-9902-ea2f85c8f1ea","Type":"ContainerStarted","Data":"a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58"}
Oct 30 04:15:31.241458 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:31.241269    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk" event={"ID":"4cb19fd1-b679-47d2-9902-ea2f85c8f1ea","Type":"ContainerStarted","Data":"245b79e6ec63b7b116f66042b2113cc173b6342c50f2c22a38cf381455ef901e"}
Oct 30 04:15:31.305276 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:31.305224    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk" podStartSLOduration=2.305209682 podStartE2EDuration="2.305209682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:15:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:15:31.279243092 +0000 UTC m=+5571.121489552" watchObservedRunningTime="2026-10-30 04:15:31.305209682 +0000 UTC m=+5571.147456144"
Oct 30 04:15:31.305772 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:31.305681    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"]
Oct 30 04:15:31.305835 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:31.305796    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75" podUID="8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f" containerName="thanos-querier" containerID="cri-o://ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2" gracePeriod=30
Oct 30 04:15:31.552454 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:31.552421    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"
Oct 30 04:15:31.612779 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:31.612741    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f-kube-api-access-jqbz4\" (UniqueName: \"kubernetes.io/projected/8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f-kube-api-access-jqbz4\") pod \"8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f\" (UID: \"8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f\") "
Oct 30 04:15:31.614952 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:31.614925    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f-kube-api-access-jqbz4" pod "8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f" (UID: "8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f"). InnerVolumeSpecName "kube-api-access-jqbz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:15:31.714250 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:31.714213    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqbz4\" (UniqueName: \"kubernetes.io/projected/8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f-kube-api-access-jqbz4\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:32.247361 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:32.247327    5981 generic.go:356] "Generic (PLEG): container finished" podID="8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f" containerID="ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2" exitCode=0
Oct 30 04:15:32.247512 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:32.247379    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"
Oct 30 04:15:32.247512 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:32.247420    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75" event={"ID":"8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f","Type":"ContainerDied","Data":"ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2"}
Oct 30 04:15:32.247512 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:32.247465    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75" event={"ID":"8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f","Type":"ContainerDied","Data":"ec5114134daf783883f226ae2e04bacc27ecb73fdf911502aa7d7fe5db576ed6"}
Oct 30 04:15:32.247512 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:32.247486    5981 scope.go:122] "RemoveContainer" containerID="ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2"
Oct 30 04:15:32.256491 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:32.256475    5981 scope.go:122] "RemoveContainer" containerID="ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2"
Oct 30 04:15:32.256722 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:15:32.256705    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2\": container with ID starting with ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2 not found: ID does not exist" containerID="ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2"
Oct 30 04:15:32.256760 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:32.256731    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2"} err="failed to get container status \"ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2\": rpc error: code = NotFound desc = could not find container \"ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2\": container with ID starting with ed44040c70505e792ec660693d8c3a04522b205e816091c047518f71f5b939c2 not found: ID does not exist"
Oct 30 04:15:32.300769 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:32.300740    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"]
Oct 30 04:15:32.313649 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:32.313624    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-2dr75"]
Oct 30 04:15:34.274818 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:34.274789    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f" path="/var/lib/kubelet/pods/8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f/volumes"
Oct 30 04:15:35.144397 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:35.144364    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:35.174128 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:35.174099    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:35.245304 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:35.245248    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:35.245428 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:35.245369    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:35.259913 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:35.259891    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:35.362670 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:35.362645    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:35.393466 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:35.393433    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:35.603924 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:35.603888    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:35.897012 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:35.896982    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:15:35.899161 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:15:35.899132    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff2d13fe_7474_4168_a683_749b3d3c4e04.slice/crio-24930f4afce11fae65c6c43f2896dde7a36da8b6955ae4c0196d75572a507c56 WatchSource:0}: Error finding container 24930f4afce11fae65c6c43f2896dde7a36da8b6955ae4c0196d75572a507c56: Status 404 returned error can't find the container with id 24930f4afce11fae65c6c43f2896dde7a36da8b6955ae4c0196d75572a507c56
Oct 30 04:15:36.267468 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:36.267427    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"ff2d13fe-7474-4168-a683-749b3d3c4e04","Type":"ContainerStarted","Data":"1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359"}
Oct 30 04:15:36.267468 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:36.267468    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"ff2d13fe-7474-4168-a683-749b3d3c4e04","Type":"ContainerStarted","Data":"24930f4afce11fae65c6c43f2896dde7a36da8b6955ae4c0196d75572a507c56"}
Oct 30 04:15:36.267690 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:36.267558    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:36.319385 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:36.319327    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=9.319313952 podStartE2EDuration="9.319313952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 04:15:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:15:36.306542568 +0000 UTC m=+5576.148789012" watchObservedRunningTime="2026-10-30 04:15:36.319313952 +0000 UTC m=+5576.161560390"
Oct 30 04:15:44.368250 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:15:44.368214    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:15:47.275346 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:47.275313    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:15:47.984690 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:47.984655    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"]
Oct 30 04:15:47.985027 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:47.985014    5981 cpu_manager.go:414] "containerMap: removing container" podUID="8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f" containerName="thanos-querier"
Oct 30 04:15:47.985078 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:47.985029    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f" containerName="thanos-querier"
Oct 30 04:15:47.985110 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:47.985097    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f6224ec-ce4c-4459-8ffb-42b01c0c8f2f" containerName="thanos-querier"
Oct 30 04:15:48.008300 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.008261    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"]
Oct 30 04:15:48.008431 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.008381    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:48.056508 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.056473    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/838343e4-3eba-437f-8d8f-a0436b036e39-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-867cfdfdbd-x5f9b\" (UID: \"838343e4-3eba-437f-8d8f-a0436b036e39\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:48.056655 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.056515    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v252j\" (UniqueName: \"kubernetes.io/projected/838343e4-3eba-437f-8d8f-a0436b036e39-kube-api-access-v252j\") pod \"data-science-collector-targetallocator-867cfdfdbd-x5f9b\" (UID: \"838343e4-3eba-437f-8d8f-a0436b036e39\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:48.056655 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.056546    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/838343e4-3eba-437f-8d8f-a0436b036e39-ta-internal\") pod \"data-science-collector-targetallocator-867cfdfdbd-x5f9b\" (UID: \"838343e4-3eba-437f-8d8f-a0436b036e39\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:48.157771 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.157740    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/838343e4-3eba-437f-8d8f-a0436b036e39-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-867cfdfdbd-x5f9b\" (UID: \"838343e4-3eba-437f-8d8f-a0436b036e39\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:48.157945 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.157777    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v252j\" (UniqueName: \"kubernetes.io/projected/838343e4-3eba-437f-8d8f-a0436b036e39-kube-api-access-v252j\") pod \"data-science-collector-targetallocator-867cfdfdbd-x5f9b\" (UID: \"838343e4-3eba-437f-8d8f-a0436b036e39\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:48.157945 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.157810    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/838343e4-3eba-437f-8d8f-a0436b036e39-ta-internal\") pod \"data-science-collector-targetallocator-867cfdfdbd-x5f9b\" (UID: \"838343e4-3eba-437f-8d8f-a0436b036e39\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:48.158511 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.158492    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/838343e4-3eba-437f-8d8f-a0436b036e39-ta-internal\") pod \"data-science-collector-targetallocator-867cfdfdbd-x5f9b\" (UID: \"838343e4-3eba-437f-8d8f-a0436b036e39\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:48.160484 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.160463    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/838343e4-3eba-437f-8d8f-a0436b036e39-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-867cfdfdbd-x5f9b\" (UID: \"838343e4-3eba-437f-8d8f-a0436b036e39\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:48.185383 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.185360    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v252j\" (UniqueName: \"kubernetes.io/projected/838343e4-3eba-437f-8d8f-a0436b036e39-kube-api-access-v252j\") pod \"data-science-collector-targetallocator-867cfdfdbd-x5f9b\" (UID: \"838343e4-3eba-437f-8d8f-a0436b036e39\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:48.321763 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.321679    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:48.611359 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.611213    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"]
Oct 30 04:15:48.613960 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:15:48.613930    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod838343e4_3eba_437f_8d8f_a0436b036e39.slice/crio-3c97e714e463b8ea16d1dfa60da71f84622fc13b0f03d6da4c691c3cf3b6b17c WatchSource:0}: Error finding container 3c97e714e463b8ea16d1dfa60da71f84622fc13b0f03d6da4c691c3cf3b6b17c: Status 404 returned error can't find the container with id 3c97e714e463b8ea16d1dfa60da71f84622fc13b0f03d6da4c691c3cf3b6b17c
Oct 30 04:15:48.616461 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.616424    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:48.616528 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:48.616494    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:49.324680 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.324647    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b" event={"ID":"838343e4-3eba-437f-8d8f-a0436b036e39","Type":"ContainerStarted","Data":"b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e"}
Oct 30 04:15:49.325186 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.324692    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b" event={"ID":"838343e4-3eba-437f-8d8f-a0436b036e39","Type":"ContainerStarted","Data":"3c97e714e463b8ea16d1dfa60da71f84622fc13b0f03d6da4c691c3cf3b6b17c"}
Oct 30 04:15:49.325186 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.324852    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:49.326460 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.326438    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:15:49.364423 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.364377    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b" podStartSLOduration=2.364365639 podStartE2EDuration="2.364365639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:15:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:15:49.364087911 +0000 UTC m=+5589.206334411" watchObservedRunningTime="2026-10-30 04:15:49.364365639 +0000 UTC m=+5589.206612078"
Oct 30 04:15:49.437560 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.437531    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"]
Oct 30 04:15:49.437731 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.437707    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9" podUID="c067bab6-bb52-4174-87a0-3fc928682624" containerName="ta-container" containerID="cri-o://fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca" gracePeriod=30
Oct 30 04:15:49.684450 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.684422    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:49.772494 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.772466    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c067bab6-bb52-4174-87a0-3fc928682624-ta-internal\" (UniqueName: \"kubernetes.io/configmap/c067bab6-bb52-4174-87a0-3fc928682624-ta-internal\") pod \"c067bab6-bb52-4174-87a0-3fc928682624\" (UID: \"c067bab6-bb52-4174-87a0-3fc928682624\") "
Oct 30 04:15:49.772494 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.772496    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c067bab6-bb52-4174-87a0-3fc928682624-kube-api-access-nlvb4\" (UniqueName: \"kubernetes.io/projected/c067bab6-bb52-4174-87a0-3fc928682624-kube-api-access-nlvb4\") pod \"c067bab6-bb52-4174-87a0-3fc928682624\" (UID: \"c067bab6-bb52-4174-87a0-3fc928682624\") "
Oct 30 04:15:49.772721 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.772553    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c067bab6-bb52-4174-87a0-3fc928682624-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c067bab6-bb52-4174-87a0-3fc928682624-data-science-collector-ta-server-cert\") pod \"c067bab6-bb52-4174-87a0-3fc928682624\" (UID: \"c067bab6-bb52-4174-87a0-3fc928682624\") "
Oct 30 04:15:49.772875 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.772853    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c067bab6-bb52-4174-87a0-3fc928682624-ta-internal" pod "c067bab6-bb52-4174-87a0-3fc928682624" (UID: "c067bab6-bb52-4174-87a0-3fc928682624"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:15:49.774759 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.774733    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c067bab6-bb52-4174-87a0-3fc928682624-data-science-collector-ta-server-cert" pod "c067bab6-bb52-4174-87a0-3fc928682624" (UID: "c067bab6-bb52-4174-87a0-3fc928682624"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:15:49.774851 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.774788    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c067bab6-bb52-4174-87a0-3fc928682624-kube-api-access-nlvb4" pod "c067bab6-bb52-4174-87a0-3fc928682624" (UID: "c067bab6-bb52-4174-87a0-3fc928682624"). InnerVolumeSpecName "kube-api-access-nlvb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:15:49.873865 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.873803    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c067bab6-bb52-4174-87a0-3fc928682624-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:49.873865 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.873827    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlvb4\" (UniqueName: \"kubernetes.io/projected/c067bab6-bb52-4174-87a0-3fc928682624-kube-api-access-nlvb4\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:49.873865 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:49.873841    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c067bab6-bb52-4174-87a0-3fc928682624-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:15:50.329600 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:50.329571    5981 generic.go:356] "Generic (PLEG): container finished" podID="c067bab6-bb52-4174-87a0-3fc928682624" containerID="fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca" exitCode=0
Oct 30 04:15:50.329961 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:50.329614    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"
Oct 30 04:15:50.329961 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:50.329646    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9" event={"ID":"c067bab6-bb52-4174-87a0-3fc928682624","Type":"ContainerDied","Data":"fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca"}
Oct 30 04:15:50.329961 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:50.329686    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9" event={"ID":"c067bab6-bb52-4174-87a0-3fc928682624","Type":"ContainerDied","Data":"1545683864fd3e835129610683a1fd217996e616691acd78c5967cfd466216f7"}
Oct 30 04:15:50.329961 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:50.329703    5981 scope.go:122] "RemoveContainer" containerID="fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca"
Oct 30 04:15:50.338011 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:50.337989    5981 scope.go:122] "RemoveContainer" containerID="fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca"
Oct 30 04:15:50.338303 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:15:50.338262    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca\": container with ID starting with fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca not found: ID does not exist" containerID="fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca"
Oct 30 04:15:50.338365 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:50.338311    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca"} err="failed to get container status \"fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca\": rpc error: code = NotFound desc = could not find container \"fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca\": container with ID starting with fc83cd2d929060cc3ae81b28a9a3b9121153c55d666816591369812347d933ca not found: ID does not exist"
Oct 30 04:15:50.381034 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:50.380986    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"]
Oct 30 04:15:50.394014 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:50.393992    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d5c5dd4d5-8r6n9"]
Oct 30 04:15:52.274755 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:52.274721    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c067bab6-bb52-4174-87a0-3fc928682624" path="/var/lib/kubelet/pods/c067bab6-bb52-4174-87a0-3fc928682624/volumes"
Oct 30 04:15:59.193403 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.193370    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"]
Oct 30 04:15:59.193775 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.193732    5981 cpu_manager.go:414] "containerMap: removing container" podUID="c067bab6-bb52-4174-87a0-3fc928682624" containerName="ta-container"
Oct 30 04:15:59.193775 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.193742    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c067bab6-bb52-4174-87a0-3fc928682624" containerName="ta-container"
Oct 30 04:15:59.193846 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.193798    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="c067bab6-bb52-4174-87a0-3fc928682624" containerName="ta-container"
Oct 30 04:15:59.196620 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.196600    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:15:59.214122 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.214096    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"]
Oct 30 04:15:59.251200 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.251168    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fd76aa03-d659-401d-b0f3-524206362c4f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8566cc56d7-drdmg\" (UID: \"fd76aa03-d659-401d-b0f3-524206362c4f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:15:59.251401 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.251218    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fd76aa03-d659-401d-b0f3-524206362c4f-ta-internal\") pod \"data-science-collector-targetallocator-8566cc56d7-drdmg\" (UID: \"fd76aa03-d659-401d-b0f3-524206362c4f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:15:59.251401 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.251377    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz67q\" (UniqueName: \"kubernetes.io/projected/fd76aa03-d659-401d-b0f3-524206362c4f-kube-api-access-mz67q\") pod \"data-science-collector-targetallocator-8566cc56d7-drdmg\" (UID: \"fd76aa03-d659-401d-b0f3-524206362c4f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:15:59.352211 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.352177    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fd76aa03-d659-401d-b0f3-524206362c4f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8566cc56d7-drdmg\" (UID: \"fd76aa03-d659-401d-b0f3-524206362c4f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:15:59.352211 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.352209    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fd76aa03-d659-401d-b0f3-524206362c4f-ta-internal\") pod \"data-science-collector-targetallocator-8566cc56d7-drdmg\" (UID: \"fd76aa03-d659-401d-b0f3-524206362c4f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:15:59.352412 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.352334    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz67q\" (UniqueName: \"kubernetes.io/projected/fd76aa03-d659-401d-b0f3-524206362c4f-kube-api-access-mz67q\") pod \"data-science-collector-targetallocator-8566cc56d7-drdmg\" (UID: \"fd76aa03-d659-401d-b0f3-524206362c4f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:15:59.352854 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.352837    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fd76aa03-d659-401d-b0f3-524206362c4f-ta-internal\") pod \"data-science-collector-targetallocator-8566cc56d7-drdmg\" (UID: \"fd76aa03-d659-401d-b0f3-524206362c4f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:15:59.354838 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.354819    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fd76aa03-d659-401d-b0f3-524206362c4f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8566cc56d7-drdmg\" (UID: \"fd76aa03-d659-401d-b0f3-524206362c4f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:15:59.372880 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.372854    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz67q\" (UniqueName: \"kubernetes.io/projected/fd76aa03-d659-401d-b0f3-524206362c4f-kube-api-access-mz67q\") pod \"data-science-collector-targetallocator-8566cc56d7-drdmg\" (UID: \"fd76aa03-d659-401d-b0f3-524206362c4f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:15:59.508124 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.508042    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:15:59.798628 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.798606    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"]
Oct 30 04:15:59.800631 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:15:59.800598    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd76aa03_d659_401d_b0f3_524206362c4f.slice/crio-993b55144c30512bf794bbdcaf99310e3c616b2a7f27460af3743fc6571e8af8 WatchSource:0}: Error finding container 993b55144c30512bf794bbdcaf99310e3c616b2a7f27460af3743fc6571e8af8: Status 404 returned error can't find the container with id 993b55144c30512bf794bbdcaf99310e3c616b2a7f27460af3743fc6571e8af8
Oct 30 04:15:59.802769 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.802737    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:15:59.802844 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:15:59.802797    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:16:00.371415 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.371377    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg" event={"ID":"fd76aa03-d659-401d-b0f3-524206362c4f","Type":"ContainerStarted","Data":"8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2"}
Oct 30 04:16:00.371415 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.371418    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg" event={"ID":"fd76aa03-d659-401d-b0f3-524206362c4f","Type":"ContainerStarted","Data":"993b55144c30512bf794bbdcaf99310e3c616b2a7f27460af3743fc6571e8af8"}
Oct 30 04:16:00.371863 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.371436    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:16:00.372896 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.372873    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:16:00.411440 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.411390    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg" podStartSLOduration=1.411376062 podStartE2EDuration="1.411376062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:15:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:16:00.411033011 +0000 UTC m=+5600.253279444" watchObservedRunningTime="2026-10-30 04:16:00.411376062 +0000 UTC m=+5600.253622506"
Oct 30 04:16:00.477838 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.477810    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"]
Oct 30 04:16:00.477994 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.477971    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b" podUID="838343e4-3eba-437f-8d8f-a0436b036e39" containerName="ta-container" containerID="cri-o://b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e" gracePeriod=30
Oct 30 04:16:00.714093 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.714069    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:16:00.764816 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.764788    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/838343e4-3eba-437f-8d8f-a0436b036e39-kube-api-access-v252j\" (UniqueName: \"kubernetes.io/projected/838343e4-3eba-437f-8d8f-a0436b036e39-kube-api-access-v252j\") pod \"838343e4-3eba-437f-8d8f-a0436b036e39\" (UID: \"838343e4-3eba-437f-8d8f-a0436b036e39\") "
Oct 30 04:16:00.764973 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.764841    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/838343e4-3eba-437f-8d8f-a0436b036e39-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/838343e4-3eba-437f-8d8f-a0436b036e39-data-science-collector-ta-server-cert\") pod \"838343e4-3eba-437f-8d8f-a0436b036e39\" (UID: \"838343e4-3eba-437f-8d8f-a0436b036e39\") "
Oct 30 04:16:00.764973 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.764904    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/838343e4-3eba-437f-8d8f-a0436b036e39-ta-internal\" (UniqueName: \"kubernetes.io/configmap/838343e4-3eba-437f-8d8f-a0436b036e39-ta-internal\") pod \"838343e4-3eba-437f-8d8f-a0436b036e39\" (UID: \"838343e4-3eba-437f-8d8f-a0436b036e39\") "
Oct 30 04:16:00.765312 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.765272    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/838343e4-3eba-437f-8d8f-a0436b036e39-ta-internal" pod "838343e4-3eba-437f-8d8f-a0436b036e39" (UID: "838343e4-3eba-437f-8d8f-a0436b036e39"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:16:00.766996 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.766966    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/838343e4-3eba-437f-8d8f-a0436b036e39-data-science-collector-ta-server-cert" pod "838343e4-3eba-437f-8d8f-a0436b036e39" (UID: "838343e4-3eba-437f-8d8f-a0436b036e39"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:16:00.767108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.767079    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/838343e4-3eba-437f-8d8f-a0436b036e39-kube-api-access-v252j" pod "838343e4-3eba-437f-8d8f-a0436b036e39" (UID: "838343e4-3eba-437f-8d8f-a0436b036e39"). InnerVolumeSpecName "kube-api-access-v252j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:16:00.865685 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.865655    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v252j\" (UniqueName: \"kubernetes.io/projected/838343e4-3eba-437f-8d8f-a0436b036e39-kube-api-access-v252j\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:00.865685 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.865681    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/838343e4-3eba-437f-8d8f-a0436b036e39-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:00.865857 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:00.865692    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/838343e4-3eba-437f-8d8f-a0436b036e39-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:01.376635 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:01.376599    5981 generic.go:356] "Generic (PLEG): container finished" podID="838343e4-3eba-437f-8d8f-a0436b036e39" containerID="b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e" exitCode=0
Oct 30 04:16:01.377032 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:01.376646    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"
Oct 30 04:16:01.377032 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:01.376684    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b" event={"ID":"838343e4-3eba-437f-8d8f-a0436b036e39","Type":"ContainerDied","Data":"b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e"}
Oct 30 04:16:01.377032 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:01.376722    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b" event={"ID":"838343e4-3eba-437f-8d8f-a0436b036e39","Type":"ContainerDied","Data":"3c97e714e463b8ea16d1dfa60da71f84622fc13b0f03d6da4c691c3cf3b6b17c"}
Oct 30 04:16:01.377032 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:01.376738    5981 scope.go:122] "RemoveContainer" containerID="b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e"
Oct 30 04:16:01.387941 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:01.387904    5981 scope.go:122] "RemoveContainer" containerID="b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e"
Oct 30 04:16:01.388391 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:01.388369    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e\": container with ID starting with b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e not found: ID does not exist" containerID="b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e"
Oct 30 04:16:01.388490 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:01.388403    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e"} err="failed to get container status \"b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e\": rpc error: code = NotFound desc = could not find container \"b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e\": container with ID starting with b4c8836ae488bd54e0c4ec72365153e44eca27f169cb395f81ec321ca71c900e not found: ID does not exist"
Oct 30 04:16:01.428019 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:01.427976    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"]
Oct 30 04:16:01.441130 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:01.441103    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-867cfdfdbd-x5f9b"]
Oct 30 04:16:02.274558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:02.274529    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="838343e4-3eba-437f-8d8f-a0436b036e39" path="/var/lib/kubelet/pods/838343e4-3eba-437f-8d8f-a0436b036e39/volumes"
Oct 30 04:16:03.556129 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:03.556094    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"]
Oct 30 04:16:03.556616 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:03.556341    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk" podUID="4cb19fd1-b679-47d2-9902-ea2f85c8f1ea" containerName="thanos-querier" containerID="cri-o://a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58" gracePeriod=30
Oct 30 04:16:03.808904 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:03.808853    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"
Oct 30 04:16:03.892059 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:03.892032    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4cb19fd1-b679-47d2-9902-ea2f85c8f1ea-kube-api-access-r46pg\" (UniqueName: \"kubernetes.io/projected/4cb19fd1-b679-47d2-9902-ea2f85c8f1ea-kube-api-access-r46pg\") pod \"4cb19fd1-b679-47d2-9902-ea2f85c8f1ea\" (UID: \"4cb19fd1-b679-47d2-9902-ea2f85c8f1ea\") "
Oct 30 04:16:03.894236 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:03.894209    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cb19fd1-b679-47d2-9902-ea2f85c8f1ea-kube-api-access-r46pg" pod "4cb19fd1-b679-47d2-9902-ea2f85c8f1ea" (UID: "4cb19fd1-b679-47d2-9902-ea2f85c8f1ea"). InnerVolumeSpecName "kube-api-access-r46pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:16:03.993393 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:03.993360    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r46pg\" (UniqueName: \"kubernetes.io/projected/4cb19fd1-b679-47d2-9902-ea2f85c8f1ea-kube-api-access-r46pg\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:04.385728 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.385686    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"]
Oct 30 04:16:04.385900 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.385869    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg" podUID="fd76aa03-d659-401d-b0f3-524206362c4f" containerName="ta-container" containerID="cri-o://8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2" gracePeriod=30
Oct 30 04:16:04.404484 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.404150    5981 generic.go:356] "Generic (PLEG): container finished" podID="4cb19fd1-b679-47d2-9902-ea2f85c8f1ea" containerID="a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58" exitCode=0
Oct 30 04:16:04.404484 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.404179    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk" event={"ID":"4cb19fd1-b679-47d2-9902-ea2f85c8f1ea","Type":"ContainerDied","Data":"a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58"}
Oct 30 04:16:04.404484 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.404246    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk" event={"ID":"4cb19fd1-b679-47d2-9902-ea2f85c8f1ea","Type":"ContainerDied","Data":"245b79e6ec63b7b116f66042b2113cc173b6342c50f2c22a38cf381455ef901e"}
Oct 30 04:16:04.404484 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.404261    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"
Oct 30 04:16:04.404484 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.404271    5981 scope.go:122] "RemoveContainer" containerID="a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58"
Oct 30 04:16:04.481728 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.481693    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:16:04.481906 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.481881    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="ff2d13fe-7474-4168-a683-749b3d3c4e04" containerName="perses" containerID="cri-o://1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359" gracePeriod=30
Oct 30 04:16:04.496453 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.496416    5981 scope.go:122] "RemoveContainer" containerID="a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58"
Oct 30 04:16:04.496893 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:04.496858    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58\": container with ID starting with a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58 not found: ID does not exist" containerID="a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58"
Oct 30 04:16:04.497048 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.496909    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58"} err="failed to get container status \"a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58\": rpc error: code = NotFound desc = could not find container \"a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58\": container with ID starting with a7774791adf4228b905baa46d2fa65b54c184fb6c6fa1a618142c0194eb08c58 not found: ID does not exist"
Oct 30 04:16:04.528032 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:04.528007    5981 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff2d13fe_7474_4168_a683_749b3d3c4e04.slice/crio-conmon-1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 04:16:04.556918 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.556863    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"]
Oct 30 04:16:04.558443 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.558420    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hvksk"]
Oct 30 04:16:04.744641 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.744378    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:16:04.748367 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.748346    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:04.804671 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.804646    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd76aa03-d659-401d-b0f3-524206362c4f-kube-api-access-mz67q\" (UniqueName: \"kubernetes.io/projected/fd76aa03-d659-401d-b0f3-524206362c4f-kube-api-access-mz67q\") pod \"fd76aa03-d659-401d-b0f3-524206362c4f\" (UID: \"fd76aa03-d659-401d-b0f3-524206362c4f\") "
Oct 30 04:16:04.804820 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.804689    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fd76aa03-d659-401d-b0f3-524206362c4f-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fd76aa03-d659-401d-b0f3-524206362c4f-data-science-collector-ta-server-cert\") pod \"fd76aa03-d659-401d-b0f3-524206362c4f\" (UID: \"fd76aa03-d659-401d-b0f3-524206362c4f\") "
Oct 30 04:16:04.804820 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.804760    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fd76aa03-d659-401d-b0f3-524206362c4f-ta-internal\" (UniqueName: \"kubernetes.io/configmap/fd76aa03-d659-401d-b0f3-524206362c4f-ta-internal\") pod \"fd76aa03-d659-401d-b0f3-524206362c4f\" (UID: \"fd76aa03-d659-401d-b0f3-524206362c4f\") "
Oct 30 04:16:04.804931 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.804846    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"ff2d13fe-7474-4168-a683-749b3d3c4e04\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") "
Oct 30 04:16:04.804931 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.804872    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff2d13fe-7474-4168-a683-749b3d3c4e04-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ff2d13fe-7474-4168-a683-749b3d3c4e04-plugins\") pod \"ff2d13fe-7474-4168-a683-749b3d3c4e04\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") "
Oct 30 04:16:04.804931 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.804909    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff2d13fe-7474-4168-a683-749b3d3c4e04-kube-api-access-sgftt\" (UniqueName: \"kubernetes.io/projected/ff2d13fe-7474-4168-a683-749b3d3c4e04-kube-api-access-sgftt\") pod \"ff2d13fe-7474-4168-a683-749b3d3c4e04\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") "
Oct 30 04:16:04.805093 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.804937    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ff2d13fe-7474-4168-a683-749b3d3c4e04-config\" (UniqueName: \"kubernetes.io/configmap/ff2d13fe-7474-4168-a683-749b3d3c4e04-config\") pod \"ff2d13fe-7474-4168-a683-749b3d3c4e04\" (UID: \"ff2d13fe-7474-4168-a683-749b3d3c4e04\") "
Oct 30 04:16:04.805178 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.805141    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd76aa03-d659-401d-b0f3-524206362c4f-ta-internal" pod "fd76aa03-d659-401d-b0f3-524206362c4f" (UID: "fd76aa03-d659-401d-b0f3-524206362c4f"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:16:04.805645 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.805607    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff2d13fe-7474-4168-a683-749b3d3c4e04-config" pod "ff2d13fe-7474-4168-a683-749b3d3c4e04" (UID: "ff2d13fe-7474-4168-a683-749b3d3c4e04"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:16:04.807300 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.807221    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd76aa03-d659-401d-b0f3-524206362c4f-data-science-collector-ta-server-cert" pod "fd76aa03-d659-401d-b0f3-524206362c4f" (UID: "fd76aa03-d659-401d-b0f3-524206362c4f"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:16:04.807300 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.807244    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd76aa03-d659-401d-b0f3-524206362c4f-kube-api-access-mz67q" pod "fd76aa03-d659-401d-b0f3-524206362c4f" (UID: "fd76aa03-d659-401d-b0f3-524206362c4f"). InnerVolumeSpecName "kube-api-access-mz67q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:16:04.807710 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.807692    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff2d13fe-7474-4168-a683-749b3d3c4e04-kube-api-access-sgftt" pod "ff2d13fe-7474-4168-a683-749b3d3c4e04" (UID: "ff2d13fe-7474-4168-a683-749b3d3c4e04"). InnerVolumeSpecName "kube-api-access-sgftt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:16:04.808355 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.808337    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "ff2d13fe-7474-4168-a683-749b3d3c4e04" (UID: "ff2d13fe-7474-4168-a683-749b3d3c4e04"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 04:16:04.906198 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.906167    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/fd76aa03-d659-401d-b0f3-524206362c4f-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:04.906373 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.906212    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 04:16:04.906373 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.906225    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgftt\" (UniqueName: \"kubernetes.io/projected/ff2d13fe-7474-4168-a683-749b3d3c4e04-kube-api-access-sgftt\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:04.906373 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.906235    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff2d13fe-7474-4168-a683-749b3d3c4e04-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:04.906373 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.906244    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz67q\" (UniqueName: \"kubernetes.io/projected/fd76aa03-d659-401d-b0f3-524206362c4f-kube-api-access-mz67q\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:04.906373 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.906254    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/fd76aa03-d659-401d-b0f3-524206362c4f-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:04.919059 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.919039    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 04:16:04.950623 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:04.950590    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff2d13fe-7474-4168-a683-749b3d3c4e04-plugins" pod "ff2d13fe-7474-4168-a683-749b3d3c4e04" (UID: "ff2d13fe-7474-4168-a683-749b3d3c4e04"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:16:05.006855 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.006827    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 04:16:05.006855 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.006854    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/ff2d13fe-7474-4168-a683-749b3d3c4e04-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:05.410709 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.410671    5981 generic.go:356] "Generic (PLEG): container finished" podID="fd76aa03-d659-401d-b0f3-524206362c4f" containerID="8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2" exitCode=0
Oct 30 04:16:05.410906 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.410730    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"
Oct 30 04:16:05.410906 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.410757    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg" event={"ID":"fd76aa03-d659-401d-b0f3-524206362c4f","Type":"ContainerDied","Data":"8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2"}
Oct 30 04:16:05.410906 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.410808    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg" event={"ID":"fd76aa03-d659-401d-b0f3-524206362c4f","Type":"ContainerDied","Data":"993b55144c30512bf794bbdcaf99310e3c616b2a7f27460af3743fc6571e8af8"}
Oct 30 04:16:05.410906 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.410831    5981 scope.go:122] "RemoveContainer" containerID="8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2"
Oct 30 04:16:05.417592 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.417563    5981 generic.go:356] "Generic (PLEG): container finished" podID="ff2d13fe-7474-4168-a683-749b3d3c4e04" containerID="1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359" exitCode=0
Oct 30 04:16:05.417740 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.417615    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"ff2d13fe-7474-4168-a683-749b3d3c4e04","Type":"ContainerDied","Data":"1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359"}
Oct 30 04:16:05.417740 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.417648    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"ff2d13fe-7474-4168-a683-749b3d3c4e04","Type":"ContainerDied","Data":"24930f4afce11fae65c6c43f2896dde7a36da8b6955ae4c0196d75572a507c56"}
Oct 30 04:16:05.417740 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.417717    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:05.428606 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.424817    5981 scope.go:122] "RemoveContainer" containerID="8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2"
Oct 30 04:16:05.428606 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:05.425155    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2\": container with ID starting with 8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2 not found: ID does not exist" containerID="8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2"
Oct 30 04:16:05.428606 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.425188    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2"} err="failed to get container status \"8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2\": rpc error: code = NotFound desc = could not find container \"8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2\": container with ID starting with 8544165b3e345caec451df0750f44f786e2492e8b165a84fa7fc2482469328d2 not found: ID does not exist"
Oct 30 04:16:05.428606 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.425213    5981 scope.go:122] "RemoveContainer" containerID="1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359"
Oct 30 04:16:05.435558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.435536    5981 scope.go:122] "RemoveContainer" containerID="1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359"
Oct 30 04:16:05.435884 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:05.435854    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359\": container with ID starting with 1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359 not found: ID does not exist" containerID="1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359"
Oct 30 04:16:05.435992 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.435893    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359"} err="failed to get container status \"1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359\": rpc error: code = NotFound desc = could not find container \"1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359\": container with ID starting with 1eff00ffb6d49449917becb38f9fce412e64dadc11ba79bb793dab4d38d87359 not found: ID does not exist"
Oct 30 04:16:05.465033 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.465003    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"]
Oct 30 04:16:05.468003 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.467981    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8566cc56d7-drdmg"]
Oct 30 04:16:05.518673 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.518650    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:16:05.522198 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:05.522178    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:16:06.274756 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:06.274724    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4cb19fd1-b679-47d2-9902-ea2f85c8f1ea" path="/var/lib/kubelet/pods/4cb19fd1-b679-47d2-9902-ea2f85c8f1ea/volumes"
Oct 30 04:16:06.275126 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:06.275110    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fd76aa03-d659-401d-b0f3-524206362c4f" path="/var/lib/kubelet/pods/fd76aa03-d659-401d-b0f3-524206362c4f/volumes"
Oct 30 04:16:06.275482 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:06.275469    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ff2d13fe-7474-4168-a683-749b3d3c4e04" path="/var/lib/kubelet/pods/ff2d13fe-7474-4168-a683-749b3d3c4e04/volumes"
Oct 30 04:16:10.619855 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.619822    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"]
Oct 30 04:16:10.620317 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.620299    5981 cpu_manager.go:414] "containerMap: removing container" podUID="ff2d13fe-7474-4168-a683-749b3d3c4e04" containerName="perses"
Oct 30 04:16:10.620372 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.620320    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ff2d13fe-7474-4168-a683-749b3d3c4e04" containerName="perses"
Oct 30 04:16:10.620372 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.620349    5981 cpu_manager.go:414] "containerMap: removing container" podUID="838343e4-3eba-437f-8d8f-a0436b036e39" containerName="ta-container"
Oct 30 04:16:10.620372 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.620357    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="838343e4-3eba-437f-8d8f-a0436b036e39" containerName="ta-container"
Oct 30 04:16:10.620463 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.620380    5981 cpu_manager.go:414] "containerMap: removing container" podUID="4cb19fd1-b679-47d2-9902-ea2f85c8f1ea" containerName="thanos-querier"
Oct 30 04:16:10.620463 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.620389    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4cb19fd1-b679-47d2-9902-ea2f85c8f1ea" containerName="thanos-querier"
Oct 30 04:16:10.620463 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.620409    5981 cpu_manager.go:414] "containerMap: removing container" podUID="fd76aa03-d659-401d-b0f3-524206362c4f" containerName="ta-container"
Oct 30 04:16:10.620463 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.620417    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fd76aa03-d659-401d-b0f3-524206362c4f" containerName="ta-container"
Oct 30 04:16:10.620575 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.620501    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="ff2d13fe-7474-4168-a683-749b3d3c4e04" containerName="perses"
Oct 30 04:16:10.620575 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.620516    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="838343e4-3eba-437f-8d8f-a0436b036e39" containerName="ta-container"
Oct 30 04:16:10.620575 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.620527    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="4cb19fd1-b679-47d2-9902-ea2f85c8f1ea" containerName="thanos-querier"
Oct 30 04:16:10.620575 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.620538    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="fd76aa03-d659-401d-b0f3-524206362c4f" containerName="ta-container"
Oct 30 04:16:10.623722 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.623702    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"
Oct 30 04:16:10.638140 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.638112    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"]
Oct 30 04:16:10.640087 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.640066    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 04:16:10.650387 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.650364    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 04:16:10.653055 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.653035    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 04:16:10.751727 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.751689    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5jsz\" (UniqueName: \"kubernetes.io/projected/13b05332-1825-44e3-af44-bb9c47ec5ae0-kube-api-access-f5jsz\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl\" (UID: \"13b05332-1825-44e3-af44-bb9c47ec5ae0\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"
Oct 30 04:16:10.852757 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.852717    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jsz\" (UniqueName: \"kubernetes.io/projected/13b05332-1825-44e3-af44-bb9c47ec5ae0-kube-api-access-f5jsz\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl\" (UID: \"13b05332-1825-44e3-af44-bb9c47ec5ae0\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"
Oct 30 04:16:10.872720 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.872652    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5jsz\" (UniqueName: \"kubernetes.io/projected/13b05332-1825-44e3-af44-bb9c47ec5ae0-kube-api-access-f5jsz\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl\" (UID: \"13b05332-1825-44e3-af44-bb9c47ec5ae0\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"
Oct 30 04:16:10.935904 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:10.935871    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"
Oct 30 04:16:11.230878 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.230847    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"]
Oct 30 04:16:11.234695 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:16:11.234660    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13b05332_1825_44e3_af44_bb9c47ec5ae0.slice/crio-c8b75963b8eb4140a253c5d5e6431bf6d018c173af8b3310bcf8387e0233950b WatchSource:0}: Error finding container c8b75963b8eb4140a253c5d5e6431bf6d018c173af8b3310bcf8387e0233950b: Status 404 returned error can't find the container with id c8b75963b8eb4140a253c5d5e6431bf6d018c173af8b3310bcf8387e0233950b
Oct 30 04:16:11.448164 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.448124    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl" event={"ID":"13b05332-1825-44e3-af44-bb9c47ec5ae0","Type":"ContainerStarted","Data":"2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327"}
Oct 30 04:16:11.448365 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.448171    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl" event={"ID":"13b05332-1825-44e3-af44-bb9c47ec5ae0","Type":"ContainerStarted","Data":"c8b75963b8eb4140a253c5d5e6431bf6d018c173af8b3310bcf8387e0233950b"}
Oct 30 04:16:11.485901 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.485783    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl" podStartSLOduration=1.485764471 podStartE2EDuration="1.485764471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:16:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:16:11.485409038 +0000 UTC m=+5611.327655496" watchObservedRunningTime="2026-10-30 04:16:11.485764471 +0000 UTC m=+5611.328010917"
Oct 30 04:16:11.588620 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.588589    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:16:11.591936 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.591913    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:11.609227 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.609198    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:16:11.651101 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.651072    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 04:16:11.662636 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.662595    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81c90aa8-a06e-40f9-b4e8-dea765e75a49-config\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:11.662801 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.662654    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/81c90aa8-a06e-40f9-b4e8-dea765e75a49-plugins\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:11.663134 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.662689    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sgcq\" (UniqueName: \"kubernetes.io/projected/81c90aa8-a06e-40f9-b4e8-dea765e75a49-kube-api-access-8sgcq\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:11.670109 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.670081    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"]
Oct 30 04:16:11.673356 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.673339    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:11.691181 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.690918    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 04:16:11.691181 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.691054    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-xkcfh\""
Oct 30 04:16:11.691975 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.691952    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"]
Oct 30 04:16:11.750404 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.750327    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 04:16:11.763679 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.763650    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk6gd\" (UniqueName: \"kubernetes.io/projected/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-kube-api-access-qk6gd\") pod \"data-science-collector-targetallocator-8476d4b6bf-d2z6g\" (UID: \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:11.763777 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.763697    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8476d4b6bf-d2z6g\" (UID: \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:11.763777 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.763763    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81c90aa8-a06e-40f9-b4e8-dea765e75a49-config\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:11.763859 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.763802    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-ta-internal\") pod \"data-science-collector-targetallocator-8476d4b6bf-d2z6g\" (UID: \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:11.763903 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.763863    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/81c90aa8-a06e-40f9-b4e8-dea765e75a49-plugins\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:11.763903 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.763885    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sgcq\" (UniqueName: \"kubernetes.io/projected/81c90aa8-a06e-40f9-b4e8-dea765e75a49-kube-api-access-8sgcq\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:11.764190 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.764172    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/81c90aa8-a06e-40f9-b4e8-dea765e75a49-plugins\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:11.764387 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.764370    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81c90aa8-a06e-40f9-b4e8-dea765e75a49-config\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:11.783762 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.783739    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sgcq\" (UniqueName: \"kubernetes.io/projected/81c90aa8-a06e-40f9-b4e8-dea765e75a49-kube-api-access-8sgcq\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:11.864633 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.864596    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8476d4b6bf-d2z6g\" (UID: \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:11.864807 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.864658    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-ta-internal\") pod \"data-science-collector-targetallocator-8476d4b6bf-d2z6g\" (UID: \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:11.864807 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.864751    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk6gd\" (UniqueName: \"kubernetes.io/projected/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-kube-api-access-qk6gd\") pod \"data-science-collector-targetallocator-8476d4b6bf-d2z6g\" (UID: \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:11.865329 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.865247    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-ta-internal\") pod \"data-science-collector-targetallocator-8476d4b6bf-d2z6g\" (UID: \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:11.867194 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.867170    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-8476d4b6bf-d2z6g\" (UID: \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:11.885193 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.885166    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk6gd\" (UniqueName: \"kubernetes.io/projected/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-kube-api-access-qk6gd\") pod \"data-science-collector-targetallocator-8476d4b6bf-d2z6g\" (UID: \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:11.985063 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:11.985025    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:12.277936 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:12.277456    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"]
Oct 30 04:16:12.279550 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:16:12.279522    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9aafc0dc_cb5c_4bd1_b816_d2bac9808d29.slice/crio-68b8dae6c0631bab9016a8a3c440b58d5237c31b578616b30bab737af4093ee5 WatchSource:0}: Error finding container 68b8dae6c0631bab9016a8a3c440b58d5237c31b578616b30bab737af4093ee5: Status 404 returned error can't find the container with id 68b8dae6c0631bab9016a8a3c440b58d5237c31b578616b30bab737af4093ee5
Oct 30 04:16:12.281623 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:12.281595    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:16:12.281711 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:12.281661    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:16:12.454560 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:12.454527    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g" event={"ID":"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29","Type":"ContainerStarted","Data":"1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2"}
Oct 30 04:16:12.454720 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:12.454569    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g" event={"ID":"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29","Type":"ContainerStarted","Data":"68b8dae6c0631bab9016a8a3c440b58d5237c31b578616b30bab737af4093ee5"}
Oct 30 04:16:12.496781 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:12.496714    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g" podStartSLOduration=1.496695708 podStartE2EDuration="1.496695708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:16:12.496123889 +0000 UTC m=+5612.338370344" watchObservedRunningTime="2026-10-30 04:16:12.496695708 +0000 UTC m=+5612.338942154"
Oct 30 04:16:13.459493 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:13.459464    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:13.461200 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:13.461177    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:14.226757 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:14.226725    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"]
Oct 30 04:16:14.230083 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:14.230067    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"
Oct 30 04:16:14.245620 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:14.245598    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"]
Oct 30 04:16:14.283325 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:14.283295    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bglpm\" (UniqueName: \"kubernetes.io/projected/98884a85-8fd1-477b-97d5-561275bc0c84-kube-api-access-bglpm\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q\" (UID: \"98884a85-8fd1-477b-97d5-561275bc0c84\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"
Oct 30 04:16:14.369346 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:14.369311    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:16:14.384798 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:14.384779    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bglpm\" (UniqueName: \"kubernetes.io/projected/98884a85-8fd1-477b-97d5-561275bc0c84-kube-api-access-bglpm\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q\" (UID: \"98884a85-8fd1-477b-97d5-561275bc0c84\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"
Oct 30 04:16:14.406887 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:14.406859    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bglpm\" (UniqueName: \"kubernetes.io/projected/98884a85-8fd1-477b-97d5-561275bc0c84-kube-api-access-bglpm\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q\" (UID: \"98884a85-8fd1-477b-97d5-561275bc0c84\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"
Oct 30 04:16:14.541753 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:14.541672    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"
Oct 30 04:16:14.832150 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:14.832126    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"]
Oct 30 04:16:14.834032 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:16:14.833998    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98884a85_8fd1_477b_97d5_561275bc0c84.slice/crio-ff400fda5c613d414e753d7fc76f8b87224e7f2245c3045d7f1c9b4d34aa0500 WatchSource:0}: Error finding container ff400fda5c613d414e753d7fc76f8b87224e7f2245c3045d7f1c9b4d34aa0500: Status 404 returned error can't find the container with id ff400fda5c613d414e753d7fc76f8b87224e7f2245c3045d7f1c9b4d34aa0500
Oct 30 04:16:15.469485 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:15.469449    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q" event={"ID":"98884a85-8fd1-477b-97d5-561275bc0c84","Type":"ContainerStarted","Data":"af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b"}
Oct 30 04:16:15.469638 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:15.469494    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q" event={"ID":"98884a85-8fd1-477b-97d5-561275bc0c84","Type":"ContainerStarted","Data":"ff400fda5c613d414e753d7fc76f8b87224e7f2245c3045d7f1c9b4d34aa0500"}
Oct 30 04:16:15.508926 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:15.508873    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q" podStartSLOduration=1.508856605 podStartE2EDuration="1.508856605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:16:15.508237022 +0000 UTC m=+5615.350483467" watchObservedRunningTime="2026-10-30 04:16:15.508856605 +0000 UTC m=+5615.351103049"
Oct 30 04:16:15.530831 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:15.530802    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"]
Oct 30 04:16:15.531019 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:15.530993    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl" podUID="13b05332-1825-44e3-af44-bb9c47ec5ae0" containerName="thanos-querier" containerID="cri-o://2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327" gracePeriod=30
Oct 30 04:16:15.768919 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:15.768896    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"
Oct 30 04:16:15.802112 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:15.802084    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13b05332-1825-44e3-af44-bb9c47ec5ae0-kube-api-access-f5jsz\" (UniqueName: \"kubernetes.io/projected/13b05332-1825-44e3-af44-bb9c47ec5ae0-kube-api-access-f5jsz\") pod \"13b05332-1825-44e3-af44-bb9c47ec5ae0\" (UID: \"13b05332-1825-44e3-af44-bb9c47ec5ae0\") "
Oct 30 04:16:15.804173 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:15.804152    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13b05332-1825-44e3-af44-bb9c47ec5ae0-kube-api-access-f5jsz" pod "13b05332-1825-44e3-af44-bb9c47ec5ae0" (UID: "13b05332-1825-44e3-af44-bb9c47ec5ae0"). InnerVolumeSpecName "kube-api-access-f5jsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:16:15.902776 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:15.902736    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5jsz\" (UniqueName: \"kubernetes.io/projected/13b05332-1825-44e3-af44-bb9c47ec5ae0-kube-api-access-f5jsz\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:16.104386 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.104278    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:16.133991 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.133960    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:16.205432 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.205392    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:16.205578 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.205534    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:16.220183 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.220156    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:16.322826 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.322793    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:16.353487 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.353463    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:16.403337 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.403312    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:16.474546 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.474517    5981 generic.go:356] "Generic (PLEG): container finished" podID="13b05332-1825-44e3-af44-bb9c47ec5ae0" containerID="2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327" exitCode=0
Oct 30 04:16:16.474675 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.474563    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"
Oct 30 04:16:16.474675 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.474600    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl" event={"ID":"13b05332-1825-44e3-af44-bb9c47ec5ae0","Type":"ContainerDied","Data":"2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327"}
Oct 30 04:16:16.474675 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.474647    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl" event={"ID":"13b05332-1825-44e3-af44-bb9c47ec5ae0","Type":"ContainerDied","Data":"c8b75963b8eb4140a253c5d5e6431bf6d018c173af8b3310bcf8387e0233950b"}
Oct 30 04:16:16.474675 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.474666    5981 scope.go:122] "RemoveContainer" containerID="2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327"
Oct 30 04:16:16.484246 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.484228    5981 scope.go:122] "RemoveContainer" containerID="2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327"
Oct 30 04:16:16.484563 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:16.484541    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327\": container with ID starting with 2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327 not found: ID does not exist" containerID="2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327"
Oct 30 04:16:16.484621 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.484571    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327"} err="failed to get container status \"2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327\": rpc error: code = NotFound desc = could not find container \"2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327\": container with ID starting with 2ae7d9bba5e2791c32ab85aef21d370b1ef12b9f0dda22adc1b4ca3da75b6327 not found: ID does not exist"
Oct 30 04:16:16.524751 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.524720    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"]
Oct 30 04:16:16.556150 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.556122    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-p7zbl"]
Oct 30 04:16:16.691467 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:16.691440    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:16:16.693239 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:16:16.693206    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81c90aa8_a06e_40f9_b4e8_dea765e75a49.slice/crio-5f84b546cb74643f60c75c0f037f42f6b6003783ce5ba66e47c981fca8c91033 WatchSource:0}: Error finding container 5f84b546cb74643f60c75c0f037f42f6b6003783ce5ba66e47c981fca8c91033: Status 404 returned error can't find the container with id 5f84b546cb74643f60c75c0f037f42f6b6003783ce5ba66e47c981fca8c91033
Oct 30 04:16:17.481851 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:17.481801    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"81c90aa8-a06e-40f9-b4e8-dea765e75a49","Type":"ContainerStarted","Data":"c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5"}
Oct 30 04:16:17.482359 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:17.481865    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:17.482359 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:17.481884    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"81c90aa8-a06e-40f9-b4e8-dea765e75a49","Type":"ContainerStarted","Data":"5f84b546cb74643f60c75c0f037f42f6b6003783ce5ba66e47c981fca8c91033"}
Oct 30 04:16:17.521543 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:17.521477    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=6.521460537 podStartE2EDuration="6.521460537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 04:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:16:17.520933002 +0000 UTC m=+5617.363179485" watchObservedRunningTime="2026-10-30 04:16:17.521460537 +0000 UTC m=+5617.363706983"
Oct 30 04:16:18.275466 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:18.275434    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="13b05332-1825-44e3-af44-bb9c47ec5ae0" path="/var/lib/kubelet/pods/13b05332-1825-44e3-af44-bb9c47ec5ae0/volumes"
Oct 30 04:16:28.492805 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:28.492769    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:31.258464 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.258429    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"]
Oct 30 04:16:31.258853 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.258771    5981 cpu_manager.go:414] "containerMap: removing container" podUID="13b05332-1825-44e3-af44-bb9c47ec5ae0" containerName="thanos-querier"
Oct 30 04:16:31.258853 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.258783    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13b05332-1825-44e3-af44-bb9c47ec5ae0" containerName="thanos-querier"
Oct 30 04:16:31.258924 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.258866    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="13b05332-1825-44e3-af44-bb9c47ec5ae0" containerName="thanos-querier"
Oct 30 04:16:31.267006 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.266985    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:31.279675 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.279649    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"]
Oct 30 04:16:31.338020 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.337994    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2md64\" (UniqueName: \"kubernetes.io/projected/77ccb126-3a91-4a8a-8134-36cec3869b16-kube-api-access-2md64\") pod \"data-science-collector-targetallocator-7d7c89d788-cwkmm\" (UID: \"77ccb126-3a91-4a8a-8134-36cec3869b16\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:31.338130 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.338023    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/77ccb126-3a91-4a8a-8134-36cec3869b16-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7d7c89d788-cwkmm\" (UID: \"77ccb126-3a91-4a8a-8134-36cec3869b16\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:31.338130 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.338070    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/77ccb126-3a91-4a8a-8134-36cec3869b16-ta-internal\") pod \"data-science-collector-targetallocator-7d7c89d788-cwkmm\" (UID: \"77ccb126-3a91-4a8a-8134-36cec3869b16\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:31.439186 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.439159    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/77ccb126-3a91-4a8a-8134-36cec3869b16-ta-internal\") pod \"data-science-collector-targetallocator-7d7c89d788-cwkmm\" (UID: \"77ccb126-3a91-4a8a-8134-36cec3869b16\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:31.439337 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.439210    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2md64\" (UniqueName: \"kubernetes.io/projected/77ccb126-3a91-4a8a-8134-36cec3869b16-kube-api-access-2md64\") pod \"data-science-collector-targetallocator-7d7c89d788-cwkmm\" (UID: \"77ccb126-3a91-4a8a-8134-36cec3869b16\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:31.439337 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.439232    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/77ccb126-3a91-4a8a-8134-36cec3869b16-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7d7c89d788-cwkmm\" (UID: \"77ccb126-3a91-4a8a-8134-36cec3869b16\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:31.439797 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.439777    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/77ccb126-3a91-4a8a-8134-36cec3869b16-ta-internal\") pod \"data-science-collector-targetallocator-7d7c89d788-cwkmm\" (UID: \"77ccb126-3a91-4a8a-8134-36cec3869b16\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:31.441830 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.441808    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/77ccb126-3a91-4a8a-8134-36cec3869b16-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7d7c89d788-cwkmm\" (UID: \"77ccb126-3a91-4a8a-8134-36cec3869b16\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:31.458489 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.458469    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2md64\" (UniqueName: \"kubernetes.io/projected/77ccb126-3a91-4a8a-8134-36cec3869b16-kube-api-access-2md64\") pod \"data-science-collector-targetallocator-7d7c89d788-cwkmm\" (UID: \"77ccb126-3a91-4a8a-8134-36cec3869b16\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:31.577426 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.577353    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:31.865902 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.865877    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"]
Oct 30 04:16:31.867975 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:16:31.867948    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77ccb126_3a91_4a8a_8134_36cec3869b16.slice/crio-67ae54daff28340b2f131e35721b8ae61dbc0c5b5321891decfec854888e8322 WatchSource:0}: Error finding container 67ae54daff28340b2f131e35721b8ae61dbc0c5b5321891decfec854888e8322: Status 404 returned error can't find the container with id 67ae54daff28340b2f131e35721b8ae61dbc0c5b5321891decfec854888e8322
Oct 30 04:16:31.870033 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.869998    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:16:31.870157 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:31.870067    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:16:32.552298 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:32.552243    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm" event={"ID":"77ccb126-3a91-4a8a-8134-36cec3869b16","Type":"ContainerStarted","Data":"26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f"}
Oct 30 04:16:32.552738 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:32.552316    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm" event={"ID":"77ccb126-3a91-4a8a-8134-36cec3869b16","Type":"ContainerStarted","Data":"67ae54daff28340b2f131e35721b8ae61dbc0c5b5321891decfec854888e8322"}
Oct 30 04:16:32.552738 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:32.552411    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:32.553914 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:32.553890    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:32.591785 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:32.591738    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm" podStartSLOduration=1.5917262399999998 podStartE2EDuration="1.59172624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:16:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:16:32.590550892 +0000 UTC m=+5632.432797342" watchObservedRunningTime="2026-10-30 04:16:32.59172624 +0000 UTC m=+5632.433972684"
Oct 30 04:16:32.663890 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:32.663857    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"]
Oct 30 04:16:32.664085 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:32.664060    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g" podUID="9aafc0dc-cb5c-4bd1-b816-d2bac9808d29" containerName="ta-container" containerID="cri-o://1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2" gracePeriod=30
Oct 30 04:16:32.910442 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:32.910417    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:33.052588 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.052559    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-ta-internal\" (UniqueName: \"kubernetes.io/configmap/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-ta-internal\") pod \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\" (UID: \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\") "
Oct 30 04:16:33.052769 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.052650    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-kube-api-access-qk6gd\" (UniqueName: \"kubernetes.io/projected/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-kube-api-access-qk6gd\") pod \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\" (UID: \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\") "
Oct 30 04:16:33.052769 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.052678    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-data-science-collector-ta-server-cert\") pod \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\" (UID: \"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29\") "
Oct 30 04:16:33.052991 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.052970    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-ta-internal" pod "9aafc0dc-cb5c-4bd1-b816-d2bac9808d29" (UID: "9aafc0dc-cb5c-4bd1-b816-d2bac9808d29"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:16:33.054930 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.054905    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-data-science-collector-ta-server-cert" pod "9aafc0dc-cb5c-4bd1-b816-d2bac9808d29" (UID: "9aafc0dc-cb5c-4bd1-b816-d2bac9808d29"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:16:33.055031 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.055012    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-kube-api-access-qk6gd" pod "9aafc0dc-cb5c-4bd1-b816-d2bac9808d29" (UID: "9aafc0dc-cb5c-4bd1-b816-d2bac9808d29"). InnerVolumeSpecName "kube-api-access-qk6gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:16:33.154046 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.154020    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:33.154046 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.154045    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk6gd\" (UniqueName: \"kubernetes.io/projected/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-kube-api-access-qk6gd\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:33.154202 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.154056    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:33.557993 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.557910    5981 generic.go:356] "Generic (PLEG): container finished" podID="9aafc0dc-cb5c-4bd1-b816-d2bac9808d29" containerID="1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2" exitCode=0
Oct 30 04:16:33.557993 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.557953    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"
Oct 30 04:16:33.558482 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.557997    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g" event={"ID":"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29","Type":"ContainerDied","Data":"1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2"}
Oct 30 04:16:33.558482 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.558043    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g" event={"ID":"9aafc0dc-cb5c-4bd1-b816-d2bac9808d29","Type":"ContainerDied","Data":"68b8dae6c0631bab9016a8a3c440b58d5237c31b578616b30bab737af4093ee5"}
Oct 30 04:16:33.558482 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.558063    5981 scope.go:122] "RemoveContainer" containerID="1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2"
Oct 30 04:16:33.567564 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.567547    5981 scope.go:122] "RemoveContainer" containerID="1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2"
Oct 30 04:16:33.567824 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:33.567803    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2\": container with ID starting with 1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2 not found: ID does not exist" containerID="1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2"
Oct 30 04:16:33.567871 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.567834    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2"} err="failed to get container status \"1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2\": rpc error: code = NotFound desc = could not find container \"1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2\": container with ID starting with 1064253489f767ac215a9149ad3834d81f713214223795de17adfc76288c1af2 not found: ID does not exist"
Oct 30 04:16:33.608906 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.608877    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"]
Oct 30 04:16:33.621957 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:33.621932    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-8476d4b6bf-d2z6g"]
Oct 30 04:16:34.274767 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:34.274724    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9aafc0dc-cb5c-4bd1-b816-d2bac9808d29" path="/var/lib/kubelet/pods/9aafc0dc-cb5c-4bd1-b816-d2bac9808d29/volumes"
Oct 30 04:16:44.368732 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:44.368693    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:16:48.079849 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.079816    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"]
Oct 30 04:16:48.080272 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.080137    5981 cpu_manager.go:414] "containerMap: removing container" podUID="9aafc0dc-cb5c-4bd1-b816-d2bac9808d29" containerName="ta-container"
Oct 30 04:16:48.080272 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.080148    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9aafc0dc-cb5c-4bd1-b816-d2bac9808d29" containerName="ta-container"
Oct 30 04:16:48.080272 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.080217    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="9aafc0dc-cb5c-4bd1-b816-d2bac9808d29" containerName="ta-container"
Oct 30 04:16:48.087077 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.087056    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:48.103333 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.103309    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"]
Oct 30 04:16:48.179530 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.179500    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27qdn\" (UniqueName: \"kubernetes.io/projected/1754413c-c2f2-4841-b1d9-f6a16299f04c-kube-api-access-27qdn\") pod \"data-science-collector-targetallocator-66db9c8d9d-9svxr\" (UID: \"1754413c-c2f2-4841-b1d9-f6a16299f04c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:48.179692 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.179561    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1754413c-c2f2-4841-b1d9-f6a16299f04c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-66db9c8d9d-9svxr\" (UID: \"1754413c-c2f2-4841-b1d9-f6a16299f04c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:48.179692 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.179676    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1754413c-c2f2-4841-b1d9-f6a16299f04c-ta-internal\") pod \"data-science-collector-targetallocator-66db9c8d9d-9svxr\" (UID: \"1754413c-c2f2-4841-b1d9-f6a16299f04c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:48.280215 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.280183    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qdn\" (UniqueName: \"kubernetes.io/projected/1754413c-c2f2-4841-b1d9-f6a16299f04c-kube-api-access-27qdn\") pod \"data-science-collector-targetallocator-66db9c8d9d-9svxr\" (UID: \"1754413c-c2f2-4841-b1d9-f6a16299f04c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:48.280362 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.280229    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1754413c-c2f2-4841-b1d9-f6a16299f04c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-66db9c8d9d-9svxr\" (UID: \"1754413c-c2f2-4841-b1d9-f6a16299f04c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:48.280362 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.280265    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1754413c-c2f2-4841-b1d9-f6a16299f04c-ta-internal\") pod \"data-science-collector-targetallocator-66db9c8d9d-9svxr\" (UID: \"1754413c-c2f2-4841-b1d9-f6a16299f04c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:48.280852 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.280830    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1754413c-c2f2-4841-b1d9-f6a16299f04c-ta-internal\") pod \"data-science-collector-targetallocator-66db9c8d9d-9svxr\" (UID: \"1754413c-c2f2-4841-b1d9-f6a16299f04c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:48.282855 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.282833    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1754413c-c2f2-4841-b1d9-f6a16299f04c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-66db9c8d9d-9svxr\" (UID: \"1754413c-c2f2-4841-b1d9-f6a16299f04c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:48.299677 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.299653    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27qdn\" (UniqueName: \"kubernetes.io/projected/1754413c-c2f2-4841-b1d9-f6a16299f04c-kube-api-access-27qdn\") pod \"data-science-collector-targetallocator-66db9c8d9d-9svxr\" (UID: \"1754413c-c2f2-4841-b1d9-f6a16299f04c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:48.398098 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.398069    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:48.688674 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.688652    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"]
Oct 30 04:16:48.690740 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:16:48.690709    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1754413c_c2f2_4841_b1d9_f6a16299f04c.slice/crio-fcadfd27e7ccc175901fa93da68d158e3707bc93eb60e0f63f866d9467f2874f WatchSource:0}: Error finding container fcadfd27e7ccc175901fa93da68d158e3707bc93eb60e0f63f866d9467f2874f: Status 404 returned error can't find the container with id fcadfd27e7ccc175901fa93da68d158e3707bc93eb60e0f63f866d9467f2874f
Oct 30 04:16:48.693023 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.692985    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:16:48.693105 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:48.693058    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:16:49.625799 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.625767    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr" event={"ID":"1754413c-c2f2-4841-b1d9-f6a16299f04c","Type":"ContainerStarted","Data":"0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c"}
Oct 30 04:16:49.626213 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.625818    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:49.626213 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.625836    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr" event={"ID":"1754413c-c2f2-4841-b1d9-f6a16299f04c","Type":"ContainerStarted","Data":"fcadfd27e7ccc175901fa93da68d158e3707bc93eb60e0f63f866d9467f2874f"}
Oct 30 04:16:49.627509 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.627488    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:49.664901 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.664829    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr" podStartSLOduration=1.664811498 podStartE2EDuration="1.664811498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:16:49.664321516 +0000 UTC m=+5649.506567962" watchObservedRunningTime="2026-10-30 04:16:49.664811498 +0000 UTC m=+5649.507057942"
Oct 30 04:16:49.731297 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.731246    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"]
Oct 30 04:16:49.731479 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.731456    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm" podUID="77ccb126-3a91-4a8a-8134-36cec3869b16" containerName="ta-container" containerID="cri-o://26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f" gracePeriod=30
Oct 30 04:16:49.973408 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.973385    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:49.994878 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.994849    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77ccb126-3a91-4a8a-8134-36cec3869b16-kube-api-access-2md64\" (UniqueName: \"kubernetes.io/projected/77ccb126-3a91-4a8a-8134-36cec3869b16-kube-api-access-2md64\") pod \"77ccb126-3a91-4a8a-8134-36cec3869b16\" (UID: \"77ccb126-3a91-4a8a-8134-36cec3869b16\") "
Oct 30 04:16:49.995013 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.994903    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/77ccb126-3a91-4a8a-8134-36cec3869b16-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/77ccb126-3a91-4a8a-8134-36cec3869b16-data-science-collector-ta-server-cert\") pod \"77ccb126-3a91-4a8a-8134-36cec3869b16\" (UID: \"77ccb126-3a91-4a8a-8134-36cec3869b16\") "
Oct 30 04:16:49.995013 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.994994    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/77ccb126-3a91-4a8a-8134-36cec3869b16-ta-internal\" (UniqueName: \"kubernetes.io/configmap/77ccb126-3a91-4a8a-8134-36cec3869b16-ta-internal\") pod \"77ccb126-3a91-4a8a-8134-36cec3869b16\" (UID: \"77ccb126-3a91-4a8a-8134-36cec3869b16\") "
Oct 30 04:16:49.995381 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.995359    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77ccb126-3a91-4a8a-8134-36cec3869b16-ta-internal" pod "77ccb126-3a91-4a8a-8134-36cec3869b16" (UID: "77ccb126-3a91-4a8a-8134-36cec3869b16"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:16:49.997028 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.997006    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77ccb126-3a91-4a8a-8134-36cec3869b16-data-science-collector-ta-server-cert" pod "77ccb126-3a91-4a8a-8134-36cec3869b16" (UID: "77ccb126-3a91-4a8a-8134-36cec3869b16"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:16:49.997101 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:49.997041    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77ccb126-3a91-4a8a-8134-36cec3869b16-kube-api-access-2md64" pod "77ccb126-3a91-4a8a-8134-36cec3869b16" (UID: "77ccb126-3a91-4a8a-8134-36cec3869b16"). InnerVolumeSpecName "kube-api-access-2md64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:16:50.095777 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:50.095753    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/77ccb126-3a91-4a8a-8134-36cec3869b16-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:50.095902 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:50.095777    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2md64\" (UniqueName: \"kubernetes.io/projected/77ccb126-3a91-4a8a-8134-36cec3869b16-kube-api-access-2md64\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:50.095902 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:50.095797    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/77ccb126-3a91-4a8a-8134-36cec3869b16-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:50.631327 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:50.631229    5981 generic.go:356] "Generic (PLEG): container finished" podID="77ccb126-3a91-4a8a-8134-36cec3869b16" containerID="26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f" exitCode=0
Oct 30 04:16:50.631327 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:50.631312    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"
Oct 30 04:16:50.631799 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:50.631316    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm" event={"ID":"77ccb126-3a91-4a8a-8134-36cec3869b16","Type":"ContainerDied","Data":"26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f"}
Oct 30 04:16:50.631799 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:50.631364    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm" event={"ID":"77ccb126-3a91-4a8a-8134-36cec3869b16","Type":"ContainerDied","Data":"67ae54daff28340b2f131e35721b8ae61dbc0c5b5321891decfec854888e8322"}
Oct 30 04:16:50.631799 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:50.631382    5981 scope.go:122] "RemoveContainer" containerID="26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f"
Oct 30 04:16:50.639739 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:50.639718    5981 scope.go:122] "RemoveContainer" containerID="26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f"
Oct 30 04:16:50.639992 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:50.639972    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f\": container with ID starting with 26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f not found: ID does not exist" containerID="26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f"
Oct 30 04:16:50.640041 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:50.640001    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f"} err="failed to get container status \"26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f\": rpc error: code = NotFound desc = could not find container \"26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f\": container with ID starting with 26cbf4388c792cdc75a995fc7b9456e636efb5870fd791ae0e8aeff950eac03f not found: ID does not exist"
Oct 30 04:16:50.681779 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:50.681757    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"]
Oct 30 04:16:50.685218 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:50.685199    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7d7c89d788-cwkmm"]
Oct 30 04:16:52.276265 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.276235    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="77ccb126-3a91-4a8a-8134-36cec3869b16" path="/var/lib/kubelet/pods/77ccb126-3a91-4a8a-8134-36cec3869b16/volumes"
Oct 30 04:16:52.315891 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.315861    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"]
Oct 30 04:16:52.316068 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.316041    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q" podUID="98884a85-8fd1-477b-97d5-561275bc0c84" containerName="thanos-querier" containerID="cri-o://af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b" gracePeriod=30
Oct 30 04:16:52.572879 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.572852    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"
Oct 30 04:16:52.616669 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.616643    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98884a85-8fd1-477b-97d5-561275bc0c84-kube-api-access-bglpm\" (UniqueName: \"kubernetes.io/projected/98884a85-8fd1-477b-97d5-561275bc0c84-kube-api-access-bglpm\") pod \"98884a85-8fd1-477b-97d5-561275bc0c84\" (UID: \"98884a85-8fd1-477b-97d5-561275bc0c84\") "
Oct 30 04:16:52.618765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.618739    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98884a85-8fd1-477b-97d5-561275bc0c84-kube-api-access-bglpm" pod "98884a85-8fd1-477b-97d5-561275bc0c84" (UID: "98884a85-8fd1-477b-97d5-561275bc0c84"). InnerVolumeSpecName "kube-api-access-bglpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:16:52.641444 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.641418    5981 generic.go:356] "Generic (PLEG): container finished" podID="98884a85-8fd1-477b-97d5-561275bc0c84" containerID="af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b" exitCode=0
Oct 30 04:16:52.641558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.641463    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"
Oct 30 04:16:52.641558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.641482    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q" event={"ID":"98884a85-8fd1-477b-97d5-561275bc0c84","Type":"ContainerDied","Data":"af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b"}
Oct 30 04:16:52.641558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.641523    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q" event={"ID":"98884a85-8fd1-477b-97d5-561275bc0c84","Type":"ContainerDied","Data":"ff400fda5c613d414e753d7fc76f8b87224e7f2245c3045d7f1c9b4d34aa0500"}
Oct 30 04:16:52.641558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.641545    5981 scope.go:122] "RemoveContainer" containerID="af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b"
Oct 30 04:16:52.650040 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.650022    5981 scope.go:122] "RemoveContainer" containerID="af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b"
Oct 30 04:16:52.650350 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:52.650333    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b\": container with ID starting with af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b not found: ID does not exist" containerID="af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b"
Oct 30 04:16:52.650413 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.650364    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b"} err="failed to get container status \"af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b\": rpc error: code = NotFound desc = could not find container \"af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b\": container with ID starting with af95c6aa3d7dea81c4e758f8a71fd2740e5bfacd7a9714507097d4aeabeca99b not found: ID does not exist"
Oct 30 04:16:52.693092 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.693069    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"]
Oct 30 04:16:52.695993 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.695973    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-tdh5q"]
Oct 30 04:16:52.717637 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:52.717615    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bglpm\" (UniqueName: \"kubernetes.io/projected/98884a85-8fd1-477b-97d5-561275bc0c84-kube-api-access-bglpm\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:53.109599 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.109567    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"]
Oct 30 04:16:53.109783 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.109758    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr" podUID="1754413c-c2f2-4841-b1d9-f6a16299f04c" containerName="ta-container" containerID="cri-o://0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c" gracePeriod=30
Oct 30 04:16:53.198574 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.198542    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:16:53.198766 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.198727    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="81c90aa8-a06e-40f9-b4e8-dea765e75a49" containerName="perses" containerID="cri-o://c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5" gracePeriod=30
Oct 30 04:16:53.435775 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.435750    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:53.465769 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.465749    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:53.525378 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.525350    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81c90aa8-a06e-40f9-b4e8-dea765e75a49-kube-api-access-8sgcq\" (UniqueName: \"kubernetes.io/projected/81c90aa8-a06e-40f9-b4e8-dea765e75a49-kube-api-access-8sgcq\") pod \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") "
Oct 30 04:16:53.525527 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.525386    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81c90aa8-a06e-40f9-b4e8-dea765e75a49-plugins\" (UniqueName: \"kubernetes.io/empty-dir/81c90aa8-a06e-40f9-b4e8-dea765e75a49-plugins\") pod \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") "
Oct 30 04:16:53.525527 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.525431    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1754413c-c2f2-4841-b1d9-f6a16299f04c-kube-api-access-27qdn\" (UniqueName: \"kubernetes.io/projected/1754413c-c2f2-4841-b1d9-f6a16299f04c-kube-api-access-27qdn\") pod \"1754413c-c2f2-4841-b1d9-f6a16299f04c\" (UID: \"1754413c-c2f2-4841-b1d9-f6a16299f04c\") "
Oct 30 04:16:53.525527 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.525511    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") "
Oct 30 04:16:53.525665 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.525558    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1754413c-c2f2-4841-b1d9-f6a16299f04c-ta-internal\" (UniqueName: \"kubernetes.io/configmap/1754413c-c2f2-4841-b1d9-f6a16299f04c-ta-internal\") pod \"1754413c-c2f2-4841-b1d9-f6a16299f04c\" (UID: \"1754413c-c2f2-4841-b1d9-f6a16299f04c\") "
Oct 30 04:16:53.525665 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.525633    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1754413c-c2f2-4841-b1d9-f6a16299f04c-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1754413c-c2f2-4841-b1d9-f6a16299f04c-data-science-collector-ta-server-cert\") pod \"1754413c-c2f2-4841-b1d9-f6a16299f04c\" (UID: \"1754413c-c2f2-4841-b1d9-f6a16299f04c\") "
Oct 30 04:16:53.525773 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.525665    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81c90aa8-a06e-40f9-b4e8-dea765e75a49-config\" (UniqueName: \"kubernetes.io/configmap/81c90aa8-a06e-40f9-b4e8-dea765e75a49-config\") pod \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\" (UID: \"81c90aa8-a06e-40f9-b4e8-dea765e75a49\") "
Oct 30 04:16:53.526322 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.526105    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1754413c-c2f2-4841-b1d9-f6a16299f04c-ta-internal" pod "1754413c-c2f2-4841-b1d9-f6a16299f04c" (UID: "1754413c-c2f2-4841-b1d9-f6a16299f04c"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:16:53.526439 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.526339    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81c90aa8-a06e-40f9-b4e8-dea765e75a49-config" pod "81c90aa8-a06e-40f9-b4e8-dea765e75a49" (UID: "81c90aa8-a06e-40f9-b4e8-dea765e75a49"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:16:53.528217 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.528192    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1754413c-c2f2-4841-b1d9-f6a16299f04c-kube-api-access-27qdn" pod "1754413c-c2f2-4841-b1d9-f6a16299f04c" (UID: "1754413c-c2f2-4841-b1d9-f6a16299f04c"). InnerVolumeSpecName "kube-api-access-27qdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:16:53.528490 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.528383    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1754413c-c2f2-4841-b1d9-f6a16299f04c-data-science-collector-ta-server-cert" pod "1754413c-c2f2-4841-b1d9-f6a16299f04c" (UID: "1754413c-c2f2-4841-b1d9-f6a16299f04c"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:16:53.528490 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.528396    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81c90aa8-a06e-40f9-b4e8-dea765e75a49-kube-api-access-8sgcq" pod "81c90aa8-a06e-40f9-b4e8-dea765e75a49" (UID: "81c90aa8-a06e-40f9-b4e8-dea765e75a49"). InnerVolumeSpecName "kube-api-access-8sgcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:16:53.529005 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.528988    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "81c90aa8-a06e-40f9-b4e8-dea765e75a49" (UID: "81c90aa8-a06e-40f9-b4e8-dea765e75a49"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 04:16:53.626794 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.626733    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1754413c-c2f2-4841-b1d9-f6a16299f04c-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:53.626794 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.626758    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81c90aa8-a06e-40f9-b4e8-dea765e75a49-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:53.626794 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.626769    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sgcq\" (UniqueName: \"kubernetes.io/projected/81c90aa8-a06e-40f9-b4e8-dea765e75a49-kube-api-access-8sgcq\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:53.626794 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.626779    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27qdn\" (UniqueName: \"kubernetes.io/projected/1754413c-c2f2-4841-b1d9-f6a16299f04c-kube-api-access-27qdn\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:53.627114 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.626804    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 04:16:53.627114 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.626814    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1754413c-c2f2-4841-b1d9-f6a16299f04c-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:53.639659 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.639640    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 04:16:53.647472 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.647448    5981 generic.go:356] "Generic (PLEG): container finished" podID="81c90aa8-a06e-40f9-b4e8-dea765e75a49" containerID="c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5" exitCode=0
Oct 30 04:16:53.647575 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.647506    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:16:53.647575 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.647527    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"81c90aa8-a06e-40f9-b4e8-dea765e75a49","Type":"ContainerDied","Data":"c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5"}
Oct 30 04:16:53.647575 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.647568    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"81c90aa8-a06e-40f9-b4e8-dea765e75a49","Type":"ContainerDied","Data":"5f84b546cb74643f60c75c0f037f42f6b6003783ce5ba66e47c981fca8c91033"}
Oct 30 04:16:53.647740 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.647587    5981 scope.go:122] "RemoveContainer" containerID="c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5"
Oct 30 04:16:53.648854 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.648836    5981 generic.go:356] "Generic (PLEG): container finished" podID="1754413c-c2f2-4841-b1d9-f6a16299f04c" containerID="0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c" exitCode=0
Oct 30 04:16:53.648951 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.648881    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"
Oct 30 04:16:53.648951 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.648887    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr" event={"ID":"1754413c-c2f2-4841-b1d9-f6a16299f04c","Type":"ContainerDied","Data":"0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c"}
Oct 30 04:16:53.648951 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.648918    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr" event={"ID":"1754413c-c2f2-4841-b1d9-f6a16299f04c","Type":"ContainerDied","Data":"fcadfd27e7ccc175901fa93da68d158e3707bc93eb60e0f63f866d9467f2874f"}
Oct 30 04:16:53.656156 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.656138    5981 scope.go:122] "RemoveContainer" containerID="c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5"
Oct 30 04:16:53.656450 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:53.656430    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5\": container with ID starting with c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5 not found: ID does not exist" containerID="c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5"
Oct 30 04:16:53.656503 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.656458    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5"} err="failed to get container status \"c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5\": rpc error: code = NotFound desc = could not find container \"c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5\": container with ID starting with c25699ddfe62d47c4e22dfec49628f1210be3fe8d615bef4e9fa8d940526e3a5 not found: ID does not exist"
Oct 30 04:16:53.656503 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.656475    5981 scope.go:122] "RemoveContainer" containerID="0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c"
Oct 30 04:16:53.664099 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.664081    5981 scope.go:122] "RemoveContainer" containerID="0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c"
Oct 30 04:16:53.664379 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:16:53.664358    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c\": container with ID starting with 0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c not found: ID does not exist" containerID="0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c"
Oct 30 04:16:53.664452 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.664387    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c"} err="failed to get container status \"0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c\": rpc error: code = NotFound desc = could not find container \"0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c\": container with ID starting with 0925c272a04d808b5ac21663715c235abe3de1776d814a52fde2d084fcb4f83c not found: ID does not exist"
Oct 30 04:16:53.681095 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.681070    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81c90aa8-a06e-40f9-b4e8-dea765e75a49-plugins" pod "81c90aa8-a06e-40f9-b4e8-dea765e75a49" (UID: "81c90aa8-a06e-40f9-b4e8-dea765e75a49"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:16:53.698269 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.698245    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"]
Oct 30 04:16:53.702451 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.702432    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66db9c8d9d-9svxr"]
Oct 30 04:16:53.727383 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.727360    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/81c90aa8-a06e-40f9-b4e8-dea765e75a49-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:16:53.727383 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.727380    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 04:16:53.991881 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:53.991849    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:16:54.003993 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:54.003969    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:16:54.276176 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:54.276103    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1754413c-c2f2-4841-b1d9-f6a16299f04c" path="/var/lib/kubelet/pods/1754413c-c2f2-4841-b1d9-f6a16299f04c/volumes"
Oct 30 04:16:54.276620 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:54.276603    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81c90aa8-a06e-40f9-b4e8-dea765e75a49" path="/var/lib/kubelet/pods/81c90aa8-a06e-40f9-b4e8-dea765e75a49/volumes"
Oct 30 04:16:54.276938 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:16:54.276925    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="98884a85-8fd1-477b-97d5-561275bc0c84" path="/var/lib/kubelet/pods/98884a85-8fd1-477b-97d5-561275bc0c84/volumes"
Oct 30 04:17:01.634256 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634218    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"]
Oct 30 04:17:01.634765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634540    5981 cpu_manager.go:414] "containerMap: removing container" podUID="81c90aa8-a06e-40f9-b4e8-dea765e75a49" containerName="perses"
Oct 30 04:17:01.634765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634552    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81c90aa8-a06e-40f9-b4e8-dea765e75a49" containerName="perses"
Oct 30 04:17:01.634765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634572    5981 cpu_manager.go:414] "containerMap: removing container" podUID="98884a85-8fd1-477b-97d5-561275bc0c84" containerName="thanos-querier"
Oct 30 04:17:01.634765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634577    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98884a85-8fd1-477b-97d5-561275bc0c84" containerName="thanos-querier"
Oct 30 04:17:01.634765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634585    5981 cpu_manager.go:414] "containerMap: removing container" podUID="1754413c-c2f2-4841-b1d9-f6a16299f04c" containerName="ta-container"
Oct 30 04:17:01.634765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634590    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1754413c-c2f2-4841-b1d9-f6a16299f04c" containerName="ta-container"
Oct 30 04:17:01.634765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634604    5981 cpu_manager.go:414] "containerMap: removing container" podUID="77ccb126-3a91-4a8a-8134-36cec3869b16" containerName="ta-container"
Oct 30 04:17:01.634765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634609    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77ccb126-3a91-4a8a-8134-36cec3869b16" containerName="ta-container"
Oct 30 04:17:01.634765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634666    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="77ccb126-3a91-4a8a-8134-36cec3869b16" containerName="ta-container"
Oct 30 04:17:01.634765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634675    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="81c90aa8-a06e-40f9-b4e8-dea765e75a49" containerName="perses"
Oct 30 04:17:01.634765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634684    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="98884a85-8fd1-477b-97d5-561275bc0c84" containerName="thanos-querier"
Oct 30 04:17:01.634765 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.634690    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="1754413c-c2f2-4841-b1d9-f6a16299f04c" containerName="ta-container"
Oct 30 04:17:01.637851 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.637831    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"
Oct 30 04:17:01.655419 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.655396    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 04:17:01.668317 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.668262    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-fhc4j\""
Oct 30 04:17:01.668317 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.668264    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 04:17:01.669038 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.669015    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"]
Oct 30 04:17:01.689190 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.689160    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpt85\" (UniqueName: \"kubernetes.io/projected/d14d931a-fa1f-4d01-bc5e-cde044650d3f-kube-api-access-jpt85\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5\" (UID: \"d14d931a-fa1f-4d01-bc5e-cde044650d3f\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"
Oct 30 04:17:01.789937 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.789901    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpt85\" (UniqueName: \"kubernetes.io/projected/d14d931a-fa1f-4d01-bc5e-cde044650d3f-kube-api-access-jpt85\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5\" (UID: \"d14d931a-fa1f-4d01-bc5e-cde044650d3f\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"
Oct 30 04:17:01.810055 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.810028    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpt85\" (UniqueName: \"kubernetes.io/projected/d14d931a-fa1f-4d01-bc5e-cde044650d3f-kube-api-access-jpt85\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5\" (UID: \"d14d931a-fa1f-4d01-bc5e-cde044650d3f\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"
Oct 30 04:17:01.949556 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:01.949518    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"
Oct 30 04:17:02.237872 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.237784    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"]
Oct 30 04:17:02.241090 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:17:02.241060    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd14d931a_fa1f_4d01_bc5e_cde044650d3f.slice/crio-3e290992dcd3ee1451f8e7cc7a429595665b4739bd5c5d46eb052f112973688a WatchSource:0}: Error finding container 3e290992dcd3ee1451f8e7cc7a429595665b4739bd5c5d46eb052f112973688a: Status 404 returned error can't find the container with id 3e290992dcd3ee1451f8e7cc7a429595665b4739bd5c5d46eb052f112973688a
Oct 30 04:17:02.618820 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.618742    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:17:02.621885 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.621861    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:02.641099 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.641071    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 04:17:02.642720 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.642696    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:17:02.688008 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.687969    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5" event={"ID":"d14d931a-fa1f-4d01-bc5e-cde044650d3f","Type":"ContainerStarted","Data":"afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6"}
Oct 30 04:17:02.688008 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.688013    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5" event={"ID":"d14d931a-fa1f-4d01-bc5e-cde044650d3f","Type":"ContainerStarted","Data":"3e290992dcd3ee1451f8e7cc7a429595665b4739bd5c5d46eb052f112973688a"}
Oct 30 04:17:02.710078 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.710047    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"]
Oct 30 04:17:02.713536 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.713515    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:02.728826 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.728787    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5" podStartSLOduration=1.728772851 podStartE2EDuration="1.728772851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:17:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:17:02.727689864 +0000 UTC m=+5662.569936328" watchObservedRunningTime="2026-10-30 04:17:02.728772851 +0000 UTC m=+5662.571019296"
Oct 30 04:17:02.732026 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.732004    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"]
Oct 30 04:17:02.799197 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.799154    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10fc1997-0558-430f-948e-67329f7a0b7e-config\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:02.799391 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.799258    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/10fc1997-0558-430f-948e-67329f7a0b7e-plugins\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:02.799391 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.799301    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hphdz\" (UniqueName: \"kubernetes.io/projected/10fc1997-0558-430f-948e-67329f7a0b7e-kube-api-access-hphdz\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:02.819328 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.819270    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 04:17:02.819483 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.819382    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 04:17:02.819483 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.819440    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-9z954\""
Oct 30 04:17:02.900723 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.900691    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hphdz\" (UniqueName: \"kubernetes.io/projected/10fc1997-0558-430f-948e-67329f7a0b7e-kube-api-access-hphdz\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:02.900891 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.900754    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttxhv\" (UniqueName: \"kubernetes.io/projected/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-kube-api-access-ttxhv\") pod \"data-science-collector-targetallocator-57bbbb6545-lf6lk\" (UID: \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:02.900891 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.900785    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57bbbb6545-lf6lk\" (UID: \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:02.900891 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.900817    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10fc1997-0558-430f-948e-67329f7a0b7e-config\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:02.901075 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.900905    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-ta-internal\") pod \"data-science-collector-targetallocator-57bbbb6545-lf6lk\" (UID: \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:02.901075 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.901032    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/10fc1997-0558-430f-948e-67329f7a0b7e-plugins\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:02.901367 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.901351    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/10fc1997-0558-430f-948e-67329f7a0b7e-plugins\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:02.901514 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.901499    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10fc1997-0558-430f-948e-67329f7a0b7e-config\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:02.920715 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:02.920683    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hphdz\" (UniqueName: \"kubernetes.io/projected/10fc1997-0558-430f-948e-67329f7a0b7e-kube-api-access-hphdz\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:03.002028 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.001993    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-ta-internal\") pod \"data-science-collector-targetallocator-57bbbb6545-lf6lk\" (UID: \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:03.002215 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.002065    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttxhv\" (UniqueName: \"kubernetes.io/projected/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-kube-api-access-ttxhv\") pod \"data-science-collector-targetallocator-57bbbb6545-lf6lk\" (UID: \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:03.002215 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.002098    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57bbbb6545-lf6lk\" (UID: \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:03.002716 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.002691    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-ta-internal\") pod \"data-science-collector-targetallocator-57bbbb6545-lf6lk\" (UID: \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:03.004667 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.004645    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57bbbb6545-lf6lk\" (UID: \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:03.021568 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.021549    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttxhv\" (UniqueName: \"kubernetes.io/projected/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-kube-api-access-ttxhv\") pod \"data-science-collector-targetallocator-57bbbb6545-lf6lk\" (UID: \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:03.026353 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.026337    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:03.319045 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.319020    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"]
Oct 30 04:17:03.321012 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:17:03.320986    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e852ffe_9fb8_4804_9ba9_6751d6e33e72.slice/crio-6d37831b61ff48f2548ff3d8c9bfb3ec96da314abe05cb1aa1a9b477c6b0283e WatchSource:0}: Error finding container 6d37831b61ff48f2548ff3d8c9bfb3ec96da314abe05cb1aa1a9b477c6b0283e: Status 404 returned error can't find the container with id 6d37831b61ff48f2548ff3d8c9bfb3ec96da314abe05cb1aa1a9b477c6b0283e
Oct 30 04:17:03.323083 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.323055    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:17:03.323141 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.323108    5981 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892004Ki","pods":"250"}
Oct 30 04:17:03.693898 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.693862    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk" event={"ID":"3e852ffe-9fb8-4804-9ba9-6751d6e33e72","Type":"ContainerStarted","Data":"1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20"}
Oct 30 04:17:03.694402 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.693905    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk" event={"ID":"3e852ffe-9fb8-4804-9ba9-6751d6e33e72","Type":"ContainerStarted","Data":"6d37831b61ff48f2548ff3d8c9bfb3ec96da314abe05cb1aa1a9b477c6b0283e"}
Oct 30 04:17:03.694402 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.694186    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:03.694959 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.694929    5981 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk" podUID="3e852ffe-9fb8-4804-9ba9-6751d6e33e72" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.170:8080/readyz\": dial tcp 10.134.0.170:8080: connect: connection refused"
Oct 30 04:17:03.735815 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:03.735769    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk" podStartSLOduration=1.7357578070000002 podStartE2EDuration="1.735757807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:17:03.734972271 +0000 UTC m=+5663.577218911" watchObservedRunningTime="2026-10-30 04:17:03.735757807 +0000 UTC m=+5663.578004248"
Oct 30 04:17:04.700675 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:04.700645    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:05.309183 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:05.309149    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"]
Oct 30 04:17:05.312525 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:05.312502    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"
Oct 30 04:17:05.332367 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:05.332333    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"]
Oct 30 04:17:05.420604 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:05.420567    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl4w4\" (UniqueName: \"kubernetes.io/projected/9ee59571-0352-464e-a396-60925fffd73d-kube-api-access-sl4w4\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x\" (UID: \"9ee59571-0352-464e-a396-60925fffd73d\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"
Oct 30 04:17:05.521220 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:05.521180    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl4w4\" (UniqueName: \"kubernetes.io/projected/9ee59571-0352-464e-a396-60925fffd73d-kube-api-access-sl4w4\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x\" (UID: \"9ee59571-0352-464e-a396-60925fffd73d\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"
Oct 30 04:17:05.541576 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:05.541547    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl4w4\" (UniqueName: \"kubernetes.io/projected/9ee59571-0352-464e-a396-60925fffd73d-kube-api-access-sl4w4\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x\" (UID: \"9ee59571-0352-464e-a396-60925fffd73d\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"
Oct 30 04:17:05.624851 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:05.624763    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"
Oct 30 04:17:05.925257 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:05.925231    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"]
Oct 30 04:17:05.926682 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:17:05.926651    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ee59571_0352_464e_a396_60925fffd73d.slice/crio-6fa808beeca6d8380b664298ea937240925298ae1e436b989b976e6587533dc0 WatchSource:0}: Error finding container 6fa808beeca6d8380b664298ea937240925298ae1e436b989b976e6587533dc0: Status 404 returned error can't find the container with id 6fa808beeca6d8380b664298ea937240925298ae1e436b989b976e6587533dc0
Oct 30 04:17:06.710904 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:06.710863    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x" event={"ID":"9ee59571-0352-464e-a396-60925fffd73d","Type":"ContainerStarted","Data":"e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa"}
Oct 30 04:17:06.711099 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:06.710917    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x" event={"ID":"9ee59571-0352-464e-a396-60925fffd73d","Type":"ContainerStarted","Data":"6fa808beeca6d8380b664298ea937240925298ae1e436b989b976e6587533dc0"}
Oct 30 04:17:06.751198 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:06.751141    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x" podStartSLOduration=1.7511265580000002 podStartE2EDuration="1.751126558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:17:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:17:06.750198572 +0000 UTC m=+5666.592445019" watchObservedRunningTime="2026-10-30 04:17:06.751126558 +0000 UTC m=+5666.593372981"
Oct 30 04:17:06.777952 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:06.777921    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"]
Oct 30 04:17:06.778108 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:06.778090    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5" podUID="d14d931a-fa1f-4d01-bc5e-cde044650d3f" containerName="thanos-querier" containerID="cri-o://afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6" gracePeriod=30
Oct 30 04:17:06.933984 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:06.933951    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:06.966190 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:06.966127    5981 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:07.013549 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.013526    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"
Oct 30 04:17:07.035381 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.035356    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:07.035503 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.035479    5981 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:07.053747 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.053718    5981 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:07.136501 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.136476    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d14d931a-fa1f-4d01-bc5e-cde044650d3f-kube-api-access-jpt85\" (UniqueName: \"kubernetes.io/projected/d14d931a-fa1f-4d01-bc5e-cde044650d3f-kube-api-access-jpt85\") pod \"d14d931a-fa1f-4d01-bc5e-cde044650d3f\" (UID: \"d14d931a-fa1f-4d01-bc5e-cde044650d3f\") "
Oct 30 04:17:07.138607 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.138579    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d14d931a-fa1f-4d01-bc5e-cde044650d3f-kube-api-access-jpt85" pod "d14d931a-fa1f-4d01-bc5e-cde044650d3f" (UID: "d14d931a-fa1f-4d01-bc5e-cde044650d3f"). InnerVolumeSpecName "kube-api-access-jpt85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:17:07.159953 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.159932    5981 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/da7e9f7b360230c0efbde74df922f655495c18b0964142d601c318c9aff9e947/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:07.189991 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.189971    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"data-science-perses-0\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:07.237914 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.237863    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpt85\" (UniqueName: \"kubernetes.io/projected/d14d931a-fa1f-4d01-bc5e-cde044650d3f-kube-api-access-jpt85\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:07.434384 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.434348    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:07.716232 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.716197    5981 generic.go:356] "Generic (PLEG): container finished" podID="d14d931a-fa1f-4d01-bc5e-cde044650d3f" containerID="afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6" exitCode=0
Oct 30 04:17:07.716413 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.716241    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"
Oct 30 04:17:07.716413 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.716275    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5" event={"ID":"d14d931a-fa1f-4d01-bc5e-cde044650d3f","Type":"ContainerDied","Data":"afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6"}
Oct 30 04:17:07.716413 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.716329    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5" event={"ID":"d14d931a-fa1f-4d01-bc5e-cde044650d3f","Type":"ContainerDied","Data":"3e290992dcd3ee1451f8e7cc7a429595665b4739bd5c5d46eb052f112973688a"}
Oct 30 04:17:07.716413 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.716347    5981 scope.go:122] "RemoveContainer" containerID="afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6"
Oct 30 04:17:07.725054 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.725033    5981 scope.go:122] "RemoveContainer" containerID="afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6"
Oct 30 04:17:07.725498 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:17:07.725464    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6\": container with ID starting with afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6 not found: ID does not exist" containerID="afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6"
Oct 30 04:17:07.725648 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.725512    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6"} err="failed to get container status \"afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6\": rpc error: code = NotFound desc = could not find container \"afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6\": container with ID starting with afa141cbc7d4cbe77fec2c196c041a1bcb08160753838ff52476482e9e6fecd6 not found: ID does not exist"
Oct 30 04:17:07.727424 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.727405    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:17:07.730350 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:17:07.730328    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10fc1997_0558_430f_948e_67329f7a0b7e.slice/crio-b35e85e86b0394a6ddf1d6b4cfc05110c7b80f963e103516a7f66738ba46719b WatchSource:0}: Error finding container b35e85e86b0394a6ddf1d6b4cfc05110c7b80f963e103516a7f66738ba46719b: Status 404 returned error can't find the container with id b35e85e86b0394a6ddf1d6b4cfc05110c7b80f963e103516a7f66738ba46719b
Oct 30 04:17:07.775140 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.775114    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"]
Oct 30 04:17:07.782631 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:07.782607    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-8s7g5"]
Oct 30 04:17:08.275935 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:08.275900    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d14d931a-fa1f-4d01-bc5e-cde044650d3f" path="/var/lib/kubelet/pods/d14d931a-fa1f-4d01-bc5e-cde044650d3f/volumes"
Oct 30 04:17:08.723166 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:08.723130    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"10fc1997-0558-430f-948e-67329f7a0b7e","Type":"ContainerStarted","Data":"ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10"}
Oct 30 04:17:08.723399 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:08.723178    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"10fc1997-0558-430f-948e-67329f7a0b7e","Type":"ContainerStarted","Data":"b35e85e86b0394a6ddf1d6b4cfc05110c7b80f963e103516a7f66738ba46719b"}
Oct 30 04:17:08.723399 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:08.723301    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:08.767713 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:08.767662    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=6.767650905 podStartE2EDuration="6.767650905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 04:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:17:08.766017002 +0000 UTC m=+5668.608263472" watchObservedRunningTime="2026-10-30 04:17:08.767650905 +0000 UTC m=+5668.609897373"
Oct 30 04:17:14.367951 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:17:14.367914    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:17:19.731351 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:19.731314    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:34.571424 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.571331    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"]
Oct 30 04:17:34.571974 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.571580    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x" podUID="9ee59571-0352-464e-a396-60925fffd73d" containerName="thanos-querier" containerID="cri-o://e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa" gracePeriod=30
Oct 30 04:17:34.823498 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.823430    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"
Oct 30 04:17:34.842961 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.842920    5981 generic.go:356] "Generic (PLEG): container finished" podID="9ee59571-0352-464e-a396-60925fffd73d" containerID="e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa" exitCode=0
Oct 30 04:17:34.843182 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.842974    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"
Oct 30 04:17:34.843182 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.843017    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x" event={"ID":"9ee59571-0352-464e-a396-60925fffd73d","Type":"ContainerDied","Data":"e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa"}
Oct 30 04:17:34.843182 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.843071    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x" event={"ID":"9ee59571-0352-464e-a396-60925fffd73d","Type":"ContainerDied","Data":"6fa808beeca6d8380b664298ea937240925298ae1e436b989b976e6587533dc0"}
Oct 30 04:17:34.843182 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.843093    5981 scope.go:122] "RemoveContainer" containerID="e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa"
Oct 30 04:17:34.854444 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.854416    5981 scope.go:122] "RemoveContainer" containerID="e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa"
Oct 30 04:17:34.854810 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:17:34.854786    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa\": container with ID starting with e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa not found: ID does not exist" containerID="e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa"
Oct 30 04:17:34.854889 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.854823    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa"} err="failed to get container status \"e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa\": rpc error: code = NotFound desc = could not find container \"e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa\": container with ID starting with e80752ef36daf1d6614ffa7f70e687364b6aaa829e7dcc029567f3d9fdcf85aa not found: ID does not exist"
Oct 30 04:17:34.893620 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.893587    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ee59571-0352-464e-a396-60925fffd73d-kube-api-access-sl4w4\" (UniqueName: \"kubernetes.io/projected/9ee59571-0352-464e-a396-60925fffd73d-kube-api-access-sl4w4\") pod \"9ee59571-0352-464e-a396-60925fffd73d\" (UID: \"9ee59571-0352-464e-a396-60925fffd73d\") "
Oct 30 04:17:34.895782 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.895760    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ee59571-0352-464e-a396-60925fffd73d-kube-api-access-sl4w4" pod "9ee59571-0352-464e-a396-60925fffd73d" (UID: "9ee59571-0352-464e-a396-60925fffd73d"). InnerVolumeSpecName "kube-api-access-sl4w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:17:34.995018 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:34.994987    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl4w4\" (UniqueName: \"kubernetes.io/projected/9ee59571-0352-464e-a396-60925fffd73d-kube-api-access-sl4w4\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:35.191175 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.191138    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"]
Oct 30 04:17:35.193610 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.193589    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-mfs2x"]
Oct 30 04:17:35.399344 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.399308    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"]
Oct 30 04:17:35.399934 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.399900    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk" podUID="3e852ffe-9fb8-4804-9ba9-6751d6e33e72" containerName="ta-container" containerID="cri-o://1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20" gracePeriod=30
Oct 30 04:17:35.504826 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.504797    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:17:35.505009 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.504976    5981 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="10fc1997-0558-430f-948e-67329f7a0b7e" containerName="perses" containerID="cri-o://ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10" gracePeriod=30
Oct 30 04:17:35.658256 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.658224    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:35.771798 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.771778    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:35.804003 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.803978    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-kube-api-access-ttxhv\" (UniqueName: \"kubernetes.io/projected/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-kube-api-access-ttxhv\") pod \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\" (UID: \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\") "
Oct 30 04:17:35.804151 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.804055    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-ta-internal\" (UniqueName: \"kubernetes.io/configmap/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-ta-internal\") pod \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\" (UID: \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\") "
Oct 30 04:17:35.804151 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.804137    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-data-science-collector-ta-server-cert\") pod \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\" (UID: \"3e852ffe-9fb8-4804-9ba9-6751d6e33e72\") "
Oct 30 04:17:35.804456 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.804435    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-ta-internal" pod "3e852ffe-9fb8-4804-9ba9-6751d6e33e72" (UID: "3e852ffe-9fb8-4804-9ba9-6751d6e33e72"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:17:35.806312 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.806267    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-data-science-collector-ta-server-cert" pod "3e852ffe-9fb8-4804-9ba9-6751d6e33e72" (UID: "3e852ffe-9fb8-4804-9ba9-6751d6e33e72"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 04:17:35.806433 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.806331    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-kube-api-access-ttxhv" pod "3e852ffe-9fb8-4804-9ba9-6751d6e33e72" (UID: "3e852ffe-9fb8-4804-9ba9-6751d6e33e72"). InnerVolumeSpecName "kube-api-access-ttxhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:17:35.849143 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.849117    5981 generic.go:356] "Generic (PLEG): container finished" podID="10fc1997-0558-430f-948e-67329f7a0b7e" containerID="ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10" exitCode=0
Oct 30 04:17:35.849327 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.849175    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 04:17:35.849327 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.849205    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"10fc1997-0558-430f-948e-67329f7a0b7e","Type":"ContainerDied","Data":"ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10"}
Oct 30 04:17:35.849327 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.849250    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"10fc1997-0558-430f-948e-67329f7a0b7e","Type":"ContainerDied","Data":"b35e85e86b0394a6ddf1d6b4cfc05110c7b80f963e103516a7f66738ba46719b"}
Oct 30 04:17:35.849327 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.849271    5981 scope.go:122] "RemoveContainer" containerID="ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10"
Oct 30 04:17:35.851852 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.851829    5981 generic.go:356] "Generic (PLEG): container finished" podID="3e852ffe-9fb8-4804-9ba9-6751d6e33e72" containerID="1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20" exitCode=0
Oct 30 04:17:35.851970 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.851889    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk" event={"ID":"3e852ffe-9fb8-4804-9ba9-6751d6e33e72","Type":"ContainerDied","Data":"1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20"}
Oct 30 04:17:35.851970 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.851916    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk" event={"ID":"3e852ffe-9fb8-4804-9ba9-6751d6e33e72","Type":"ContainerDied","Data":"6d37831b61ff48f2548ff3d8c9bfb3ec96da314abe05cb1aa1a9b477c6b0283e"}
Oct 30 04:17:35.851970 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.851924    5981 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"
Oct 30 04:17:35.859887 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.859869    5981 scope.go:122] "RemoveContainer" containerID="ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10"
Oct 30 04:17:35.860180 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:17:35.860163    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10\": container with ID starting with ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10 not found: ID does not exist" containerID="ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10"
Oct 30 04:17:35.860269 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.860189    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10"} err="failed to get container status \"ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10\": rpc error: code = NotFound desc = could not find container \"ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10\": container with ID starting with ab0d75fecc5ad6c69d62a25167336e3cc0450d68e0a5f765319578a0e6f7da10 not found: ID does not exist"
Oct 30 04:17:35.860269 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.860205    5981 scope.go:122] "RemoveContainer" containerID="1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20"
Oct 30 04:17:35.867594 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.867578    5981 scope.go:122] "RemoveContainer" containerID="1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20"
Oct 30 04:17:35.867814 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:17:35.867797    5981 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20\": container with ID starting with 1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20 not found: ID does not exist" containerID="1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20"
Oct 30 04:17:35.867860 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.867822    5981 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20"} err="failed to get container status \"1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20\": rpc error: code = NotFound desc = could not find container \"1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20\": container with ID starting with 1316a81b041aed21bb9e8c1223fc225dde38be99fbc4620c7e0168fd41666d20 not found: ID does not exist"
Oct 30 04:17:35.905544 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.905516    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") pod \"10fc1997-0558-430f-948e-67329f7a0b7e\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") "
Oct 30 04:17:35.905636 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.905622    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/10fc1997-0558-430f-948e-67329f7a0b7e-config\" (UniqueName: \"kubernetes.io/configmap/10fc1997-0558-430f-948e-67329f7a0b7e-config\") pod \"10fc1997-0558-430f-948e-67329f7a0b7e\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") "
Oct 30 04:17:35.905689 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.905648    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10fc1997-0558-430f-948e-67329f7a0b7e-plugins\" (UniqueName: \"kubernetes.io/empty-dir/10fc1997-0558-430f-948e-67329f7a0b7e-plugins\") pod \"10fc1997-0558-430f-948e-67329f7a0b7e\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") "
Oct 30 04:17:35.905689 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.905676    5981 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10fc1997-0558-430f-948e-67329f7a0b7e-kube-api-access-hphdz\" (UniqueName: \"kubernetes.io/projected/10fc1997-0558-430f-948e-67329f7a0b7e-kube-api-access-hphdz\") pod \"10fc1997-0558-430f-948e-67329f7a0b7e\" (UID: \"10fc1997-0558-430f-948e-67329f7a0b7e\") "
Oct 30 04:17:35.905957 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.905889    5981 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-data-science-collector-ta-server-cert\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:35.905957 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.905913    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttxhv\" (UniqueName: \"kubernetes.io/projected/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-kube-api-access-ttxhv\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:35.905957 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.905928    5981 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3e852ffe-9fb8-4804-9ba9-6751d6e33e72-ta-internal\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:35.906170 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.906028    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10fc1997-0558-430f-948e-67329f7a0b7e-config" pod "10fc1997-0558-430f-948e-67329f7a0b7e" (UID: "10fc1997-0558-430f-948e-67329f7a0b7e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 04:17:35.908164 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.908139    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10fc1997-0558-430f-948e-67329f7a0b7e-kube-api-access-hphdz" pod "10fc1997-0558-430f-948e-67329f7a0b7e" (UID: "10fc1997-0558-430f-948e-67329f7a0b7e"). InnerVolumeSpecName "kube-api-access-hphdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 04:17:35.908558 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.908540    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6" pod "10fc1997-0558-430f-948e-67329f7a0b7e" (UID: "10fc1997-0558-430f-948e-67329f7a0b7e"). InnerVolumeSpecName "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 04:17:35.921854 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.921832    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"]
Oct 30 04:17:35.942035 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:35.941984    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57bbbb6545-lf6lk"]
Oct 30 04:17:36.006742 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:36.006715    5981 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" "
Oct 30 04:17:36.006742 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:36.006741    5981 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10fc1997-0558-430f-948e-67329f7a0b7e-config\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:36.006920 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:36.006753    5981 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hphdz\" (UniqueName: \"kubernetes.io/projected/10fc1997-0558-430f-948e-67329f7a0b7e-kube-api-access-hphdz\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:36.019548 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:36.019528    5981 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6") on node "ip-10-0-128-202.ec2.internal"
Oct 30 04:17:36.052518 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:36.052489    5981 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10fc1997-0558-430f-948e-67329f7a0b7e-plugins" pod "10fc1997-0558-430f-948e-67329f7a0b7e" (UID: "10fc1997-0558-430f-948e-67329f7a0b7e"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 04:17:36.108047 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:36.108013    5981 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/10fc1997-0558-430f-948e-67329f7a0b7e-plugins\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"\""
Oct 30 04:17:36.108047 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:36.108040    5981 reconciler_common.go:299] "Volume detached for volume \"pvc-85f99a51-bc51-44d2-b35e-b47bcca37d9e\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ff65d73b71ac4ab6\") on node \"ip-10-0-128-202.ec2.internal\" DevicePath \"csi-382083b8d9b88ed1d08d070a95128f3684f833e8a476d721d79fd136daa5da16\""
Oct 30 04:17:36.194225 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:36.194151    5981 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:17:36.207378 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:36.207352    5981 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 04:17:36.275347 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:36.275310    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="10fc1997-0558-430f-948e-67329f7a0b7e" path="/var/lib/kubelet/pods/10fc1997-0558-430f-948e-67329f7a0b7e/volumes"
Oct 30 04:17:36.275788 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:36.275768    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e852ffe-9fb8-4804-9ba9-6751d6e33e72" path="/var/lib/kubelet/pods/3e852ffe-9fb8-4804-9ba9-6751d6e33e72/volumes"
Oct 30 04:17:36.276135 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:17:36.276117    5981 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ee59571-0352-464e-a396-60925fffd73d" path="/var/lib/kubelet/pods/9ee59571-0352-464e-a396-60925fffd73d/volumes"
Oct 30 04:17:44.368632 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:17:44.368596    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:18:10.227339 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227302    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6xn7p/must-gather-t8nfv"]
Oct 30 04:18:10.227809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227638    5981 cpu_manager.go:414] "containerMap: removing container" podUID="9ee59571-0352-464e-a396-60925fffd73d" containerName="thanos-querier"
Oct 30 04:18:10.227809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227649    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ee59571-0352-464e-a396-60925fffd73d" containerName="thanos-querier"
Oct 30 04:18:10.227809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227676    5981 cpu_manager.go:414] "containerMap: removing container" podUID="10fc1997-0558-430f-948e-67329f7a0b7e" containerName="perses"
Oct 30 04:18:10.227809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227681    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10fc1997-0558-430f-948e-67329f7a0b7e" containerName="perses"
Oct 30 04:18:10.227809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227696    5981 cpu_manager.go:414] "containerMap: removing container" podUID="d14d931a-fa1f-4d01-bc5e-cde044650d3f" containerName="thanos-querier"
Oct 30 04:18:10.227809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227701    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d14d931a-fa1f-4d01-bc5e-cde044650d3f" containerName="thanos-querier"
Oct 30 04:18:10.227809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227710    5981 cpu_manager.go:414] "containerMap: removing container" podUID="3e852ffe-9fb8-4804-9ba9-6751d6e33e72" containerName="ta-container"
Oct 30 04:18:10.227809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227715    5981 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e852ffe-9fb8-4804-9ba9-6751d6e33e72" containerName="ta-container"
Oct 30 04:18:10.227809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227769    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="10fc1997-0558-430f-948e-67329f7a0b7e" containerName="perses"
Oct 30 04:18:10.227809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227777    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="d14d931a-fa1f-4d01-bc5e-cde044650d3f" containerName="thanos-querier"
Oct 30 04:18:10.227809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227786    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e852ffe-9fb8-4804-9ba9-6751d6e33e72" containerName="ta-container"
Oct 30 04:18:10.227809 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.227792    5981 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ee59571-0352-464e-a396-60925fffd73d" containerName="thanos-querier"
Oct 30 04:18:10.230792 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.230773    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6xn7p/must-gather-t8nfv"
Oct 30 04:18:10.261427 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.261405    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6xn7p\"/\"openshift-service-ca.crt\""
Oct 30 04:18:10.261427 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.261418    5981 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6xn7p\"/\"kube-root-ca.crt\""
Oct 30 04:18:10.261427 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.261408    5981 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6xn7p\"/\"default-dockercfg-4j88g\""
Oct 30 04:18:10.262102 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.262083    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6xn7p/must-gather-t8nfv"]
Oct 30 04:18:10.282740 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.282713    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/068493a1-13af-4830-ad6a-29ec1a0fccc6-must-gather-output\") pod \"must-gather-t8nfv\" (UID: \"068493a1-13af-4830-ad6a-29ec1a0fccc6\") " pod="openshift-must-gather-6xn7p/must-gather-t8nfv"
Oct 30 04:18:10.282839 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.282749    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkh8z\" (UniqueName: \"kubernetes.io/projected/068493a1-13af-4830-ad6a-29ec1a0fccc6-kube-api-access-kkh8z\") pod \"must-gather-t8nfv\" (UID: \"068493a1-13af-4830-ad6a-29ec1a0fccc6\") " pod="openshift-must-gather-6xn7p/must-gather-t8nfv"
Oct 30 04:18:10.383887 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.383859    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/068493a1-13af-4830-ad6a-29ec1a0fccc6-must-gather-output\") pod \"must-gather-t8nfv\" (UID: \"068493a1-13af-4830-ad6a-29ec1a0fccc6\") " pod="openshift-must-gather-6xn7p/must-gather-t8nfv"
Oct 30 04:18:10.383999 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.383903    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkh8z\" (UniqueName: \"kubernetes.io/projected/068493a1-13af-4830-ad6a-29ec1a0fccc6-kube-api-access-kkh8z\") pod \"must-gather-t8nfv\" (UID: \"068493a1-13af-4830-ad6a-29ec1a0fccc6\") " pod="openshift-must-gather-6xn7p/must-gather-t8nfv"
Oct 30 04:18:10.384251 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.384229    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/068493a1-13af-4830-ad6a-29ec1a0fccc6-must-gather-output\") pod \"must-gather-t8nfv\" (UID: \"068493a1-13af-4830-ad6a-29ec1a0fccc6\") " pod="openshift-must-gather-6xn7p/must-gather-t8nfv"
Oct 30 04:18:10.403611 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.403589    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkh8z\" (UniqueName: \"kubernetes.io/projected/068493a1-13af-4830-ad6a-29ec1a0fccc6-kube-api-access-kkh8z\") pod \"must-gather-t8nfv\" (UID: \"068493a1-13af-4830-ad6a-29ec1a0fccc6\") " pod="openshift-must-gather-6xn7p/must-gather-t8nfv"
Oct 30 04:18:10.543386 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.543338    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6xn7p/must-gather-t8nfv"
Oct 30 04:18:10.832151 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.832123    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6xn7p/must-gather-t8nfv"]
Oct 30 04:18:10.833808 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:18:10.833773    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod068493a1_13af_4830_ad6a_29ec1a0fccc6.slice/crio-b8a91eb503eb4b41fb2c80af5c250d2dbaf8c6afb92fea4a505bb0fbefa8eefc WatchSource:0}: Error finding container b8a91eb503eb4b41fb2c80af5c250d2dbaf8c6afb92fea4a505bb0fbefa8eefc: Status 404 returned error can't find the container with id b8a91eb503eb4b41fb2c80af5c250d2dbaf8c6afb92fea4a505bb0fbefa8eefc
Oct 30 04:18:10.835848 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.835831    5981 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 04:18:10.989744 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:10.989711    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xn7p/must-gather-t8nfv" event={"ID":"068493a1-13af-4830-ad6a-29ec1a0fccc6","Type":"ContainerStarted","Data":"b8a91eb503eb4b41fb2c80af5c250d2dbaf8c6afb92fea4a505bb0fbefa8eefc"}
Oct 30 04:18:11.996616 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:11.996536    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xn7p/must-gather-t8nfv" event={"ID":"068493a1-13af-4830-ad6a-29ec1a0fccc6","Type":"ContainerStarted","Data":"3fbbbe3a4bff596bcd95f89bdd3509f649eebe425b9ae9aea67961a59cc5a153"}
Oct 30 04:18:11.996616 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:11.996581    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xn7p/must-gather-t8nfv" event={"ID":"068493a1-13af-4830-ad6a-29ec1a0fccc6","Type":"ContainerStarted","Data":"a24d04ab850cb42cbc8c89320b2036ef5183492250d23d38666bcf8afe7004b8"}
Oct 30 04:18:14.370642 ip-10-0-128-202 kubenswrapper[5981]: E1030 04:18:14.370603    5981 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xgrln" containerName="extractor"
Oct 30 04:18:14.571946 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:14.571902    5981 ???:1] "http: TLS handshake error from 10.0.128.202:52792: EOF"
Oct 30 04:18:14.599162 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:14.599130    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pb6zp_f8cf619f-9892-48d5-911e-5f7432d945ec/global-pull-secret-syncer/0.log"
Oct 30 04:18:15.421305 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:15.419447    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h6mqn_48a605d4-42c2-4362-b230-08a10ab9dec6/konnectivity-agent/0.log"
Oct 30 04:18:15.715360 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:15.713727    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-202.ec2.internal_3ce1fe095f8980ce35b373b8b077959e/haproxy/0.log"
Oct 30 04:18:20.674833 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:20.674796    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df01f296-d148-442f-a228-22862bb3c543/alertmanager/0.log"
Oct 30 04:18:20.800539 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:20.800462    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df01f296-d148-442f-a228-22862bb3c543/config-reloader/0.log"
Oct 30 04:18:20.922841 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:20.922813    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df01f296-d148-442f-a228-22862bb3c543/kube-rbac-proxy-web/0.log"
Oct 30 04:18:21.047772 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:21.047681    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df01f296-d148-442f-a228-22862bb3c543/kube-rbac-proxy/0.log"
Oct 30 04:18:21.178149 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:21.178119    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df01f296-d148-442f-a228-22862bb3c543/kube-rbac-proxy-metric/0.log"
Oct 30 04:18:21.297882 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:21.297803    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df01f296-d148-442f-a228-22862bb3c543/prom-label-proxy/0.log"
Oct 30 04:18:21.418308 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:21.418105    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df01f296-d148-442f-a228-22862bb3c543/init-config-reloader/0.log"
Oct 30 04:18:21.704880 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:21.704849    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-58tds_36d0c7ea-c907-4088-aacd-dd7224bd896c/kube-state-metrics/0.log"
Oct 30 04:18:21.813950 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:21.813919    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-58tds_36d0c7ea-c907-4088-aacd-dd7224bd896c/kube-rbac-proxy-main/0.log"
Oct 30 04:18:21.973351 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:21.972903    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-58tds_36d0c7ea-c907-4088-aacd-dd7224bd896c/kube-rbac-proxy-self/0.log"
Oct 30 04:18:22.110037 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:22.109997    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-75b5f57486-2nn2p_c1239074-11cc-456f-8ff1-242cb437f9a8/metrics-server/0.log"
Oct 30 04:18:22.238858 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:22.238782    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-28zrt_b3b1c5be-f236-44d8-9168-1bdf3dd9dce6/monitoring-plugin/0.log"
Oct 30 04:18:23.079086 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.078546    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zk2zh_3237b03d-9c16-410e-b61e-7c5884f42e65/node-exporter/0.log"
Oct 30 04:18:23.193688 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.193655    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zk2zh_3237b03d-9c16-410e-b61e-7c5884f42e65/kube-rbac-proxy/0.log"
Oct 30 04:18:23.316395 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.316366    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zk2zh_3237b03d-9c16-410e-b61e-7c5884f42e65/init-textfile/0.log"
Oct 30 04:18:23.408238 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.408187    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-6xn7p/must-gather-t8nfv" podStartSLOduration=12.57620528 podStartE2EDuration="13.408169789s" totalImagesPullingTime="831.964509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 04:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:18:12.035966386 +0000 UTC m=+5731.878212833" watchObservedRunningTime="2026-10-30 04:18:23.408169789 +0000 UTC m=+5743.250416224"
Oct 30 04:18:23.409168 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.409140    5981 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"]
Oct 30 04:18:23.413882 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.413859    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.429771 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.429740    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"]
Oct 30 04:18:23.436033 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.436007    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-z7zz8_a72ad10b-db47-41f9-bacf-ab880f332a7a/kube-rbac-proxy-main/0.log"
Oct 30 04:18:23.499125 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.499089    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqgld\" (UniqueName: \"kubernetes.io/projected/f683b9af-94e1-4866-82ad-255f510b2273-kube-api-access-jqgld\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.499334 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.499232    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f683b9af-94e1-4866-82ad-255f510b2273-lib-modules\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.499413 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.499331    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f683b9af-94e1-4866-82ad-255f510b2273-sys\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.499413 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.499372    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f683b9af-94e1-4866-82ad-255f510b2273-podres\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.499526 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.499476    5981 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f683b9af-94e1-4866-82ad-255f510b2273-proc\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.555419 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.555379    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-z7zz8_a72ad10b-db47-41f9-bacf-ab880f332a7a/kube-rbac-proxy-self/0.log"
Oct 30 04:18:23.602717 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.602678    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f683b9af-94e1-4866-82ad-255f510b2273-lib-modules\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.602907 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.602724    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f683b9af-94e1-4866-82ad-255f510b2273-sys\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.602907 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.602773    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f683b9af-94e1-4866-82ad-255f510b2273-podres\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.602907 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.602829    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f683b9af-94e1-4866-82ad-255f510b2273-proc\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.602907 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.602880    5981 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqgld\" (UniqueName: \"kubernetes.io/projected/f683b9af-94e1-4866-82ad-255f510b2273-kube-api-access-jqgld\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.603318 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.603273    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f683b9af-94e1-4866-82ad-255f510b2273-lib-modules\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.603393 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.603364    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f683b9af-94e1-4866-82ad-255f510b2273-sys\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.603457 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.603416    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f683b9af-94e1-4866-82ad-255f510b2273-podres\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.603515 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.603458    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f683b9af-94e1-4866-82ad-255f510b2273-proc\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.622965 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.622928    5981 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqgld\" (UniqueName: \"kubernetes.io/projected/f683b9af-94e1-4866-82ad-255f510b2273-kube-api-access-jqgld\") pod \"perf-node-gather-daemonset-6x8n2\" (UID: \"f683b9af-94e1-4866-82ad-255f510b2273\") " pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.675550 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.675481    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-z7zz8_a72ad10b-db47-41f9-bacf-ab880f332a7a/openshift-state-metrics/0.log"
Oct 30 04:18:23.735546 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.734349    5981 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:23.820398 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.818311    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb9f8167-1a90-4e53-a0d6-a50097c2facc/prometheus/0.log"
Oct 30 04:18:23.932549 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:23.932476    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb9f8167-1a90-4e53-a0d6-a50097c2facc/config-reloader/0.log"
Oct 30 04:18:24.050155 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:24.050132    5981 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"]
Oct 30 04:18:24.051991 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:24.051966    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb9f8167-1a90-4e53-a0d6-a50097c2facc/thanos-sidecar/0.log"
Oct 30 04:18:24.055214 ip-10-0-128-202 kubenswrapper[5981]: W1030 04:18:24.052851    5981 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf683b9af_94e1_4866_82ad_255f510b2273.slice/crio-c2ec05629e2f3ae014d7f1722feaa9c5c5d5e8d0d1a49c25f27c7fb66eb929d9 WatchSource:0}: Error finding container c2ec05629e2f3ae014d7f1722feaa9c5c5d5e8d0d1a49c25f27c7fb66eb929d9: Status 404 returned error can't find the container with id c2ec05629e2f3ae014d7f1722feaa9c5c5d5e8d0d1a49c25f27c7fb66eb929d9
Oct 30 04:18:24.091787 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:24.091749    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2" event={"ID":"f683b9af-94e1-4866-82ad-255f510b2273","Type":"ContainerStarted","Data":"c2ec05629e2f3ae014d7f1722feaa9c5c5d5e8d0d1a49c25f27c7fb66eb929d9"}
Oct 30 04:18:24.174526 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:24.174482    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb9f8167-1a90-4e53-a0d6-a50097c2facc/kube-rbac-proxy-web/0.log"
Oct 30 04:18:24.295597 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:24.295565    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb9f8167-1a90-4e53-a0d6-a50097c2facc/kube-rbac-proxy/0.log"
Oct 30 04:18:24.415038 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:24.411910    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb9f8167-1a90-4e53-a0d6-a50097c2facc/kube-rbac-proxy-thanos/0.log"
Oct 30 04:18:24.528521 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:24.528440    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb9f8167-1a90-4e53-a0d6-a50097c2facc/init-config-reloader/0.log"
Oct 30 04:18:24.656380 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:24.656350    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-c7f7j_53793bc8-ff97-4faa-aaf8-3d101fb8d646/prometheus-operator/0.log"
Oct 30 04:18:24.769254 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:24.769202    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-c7f7j_53793bc8-ff97-4faa-aaf8-3d101fb8d646/kube-rbac-proxy/0.log"
Oct 30 04:18:25.097331 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:25.097277    5981 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2" event={"ID":"f683b9af-94e1-4866-82ad-255f510b2273","Type":"ContainerStarted","Data":"4786c9a828419306a4ba34f3a70ec49b472deec1ef45faa1ee9e4363eef69108"}
Oct 30 04:18:25.097796 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:25.097415    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:25.137089 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:25.137043    5981 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2" podStartSLOduration=2.13702626 podStartE2EDuration="2.13702626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 04:18:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 04:18:25.136030974 +0000 UTC m=+5744.978277418" watchObservedRunningTime="2026-10-30 04:18:25.13702626 +0000 UTC m=+5744.979272705"
Oct 30 04:18:25.385472 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:25.385395    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bc4965dc5-zgf5h_fc15187f-0896-4775-a227-4633a4dc3734/thanos-query/0.log"
Oct 30 04:18:25.497218 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:25.497189    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bc4965dc5-zgf5h_fc15187f-0896-4775-a227-4633a4dc3734/kube-rbac-proxy-web/0.log"
Oct 30 04:18:25.610399 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:25.610371    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bc4965dc5-zgf5h_fc15187f-0896-4775-a227-4633a4dc3734/kube-rbac-proxy/0.log"
Oct 30 04:18:25.724004 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:25.723978    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bc4965dc5-zgf5h_fc15187f-0896-4775-a227-4633a4dc3734/prom-label-proxy/0.log"
Oct 30 04:18:25.840325 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:25.840296    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bc4965dc5-zgf5h_fc15187f-0896-4775-a227-4633a4dc3734/kube-rbac-proxy-rules/0.log"
Oct 30 04:18:25.954567 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:25.954541    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bc4965dc5-zgf5h_fc15187f-0896-4775-a227-4633a4dc3734/kube-rbac-proxy-metrics/0.log"
Oct 30 04:18:31.116572 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:31.116541    5981 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6xn7p/perf-node-gather-daemonset-6x8n2"
Oct 30 04:18:32.705511 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:32.705483    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nmmgn_f92b4266-f045-41d5-8694-ddec1b9fcdf5/dns/0.log"
Oct 30 04:18:32.819508 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:32.819479    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nmmgn_f92b4266-f045-41d5-8694-ddec1b9fcdf5/kube-rbac-proxy/0.log"
Oct 30 04:18:33.173504 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:33.173472    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sm872_bec335ab-48e3-4940-aeea-f8f46a184eed/dns-node-resolver/0.log"
Oct 30 04:18:34.374234 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:34.374200    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cz9ks_87cca6f3-8578-41cd-ba4a-da8798608de9/node-ca/0.log"
Oct 30 04:18:37.436653 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:37.436621    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wjp42_0dbab0f3-4bbd-4889-ae78-ddff0b995e72/serve-healthcheck-canary/0.log"
Oct 30 04:18:39.102095 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:39.102066    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xgrln_f13d6d8d-e290-450f-b648-1869845dd5a7/kube-rbac-proxy/0.log"
Oct 30 04:18:39.247002 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:39.246972    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xgrln_f13d6d8d-e290-450f-b648-1869845dd5a7/exporter/0.log"
Oct 30 04:18:39.371832 ip-10-0-128-202 kubenswrapper[5981]: I1030 04:18:39.371752    5981 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xgrln_f13d6d8d-e290-450f-b648-1869845dd5a7/extractor/0.log"