Jul 24 21:13:09.256064 ip-10-0-138-234 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 21:13:09.256166 ip-10-0-138-234 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 21:13:09.256225 ip-10-0-138-234 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 21:13:09.256538 ip-10-0-138-234 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 21:13:19.440938 ip-10-0-138-234 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 21:13:19.440954 ip-10-0-138-234 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c7b506c7494749a89e848fa60163b870 --
Jul 24 21:14:56.653650 ip-10-0-138-234 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 21:14:57.097403 ip-10-0-138-234 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 21:14:57.097403 ip-10-0-138-234 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 21:14:57.097403 ip-10-0-138-234 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 21:14:57.097403 ip-10-0-138-234 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 21:14:57.097403 ip-10-0-138-234 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 21:14:57.099471 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.099387    2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 21:14:57.105275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105261    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 21:14:57.105275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105274    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105278    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105281    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105285    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105288    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105291    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105293    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105296    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105299    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105302    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105305    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105308    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105311    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105313    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105316    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105319    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105321    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105325    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105329    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105331    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 21:14:57.105335 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105334    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105336    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105339    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105343    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105346    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105349    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105351    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105354    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105368    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105371    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105373    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105376    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105378    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105381    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105384    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105386    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105389    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105391    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105394    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105396    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 21:14:57.105858 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105399    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105402    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105404    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105407    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105409    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105414    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105417    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105420    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105422    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105425    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105428    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105431    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105434    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105437    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105441    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105443    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105446    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105448    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105451    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 21:14:57.106351 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105453    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105455    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105458    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105460    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105464    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105467    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105471    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105474    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105476    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105479    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105481    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105483    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105486    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105489    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105491    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105494    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105496    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105499    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105503    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 21:14:57.106865 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105506    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105509    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105511    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105514    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105516    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105519    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105522    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105524    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105527    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105530    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105532    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105535    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105537    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105539    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105542    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105544    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105547    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105549    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105551    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.105554    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 21:14:57.107324 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106247    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106254    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106257    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106260    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106262    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106265    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106268    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106271    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106273    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106276    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106278    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106283    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106286    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106290    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106292    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106295    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106298    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106300    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106303    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 21:14:57.107886 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106306    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106308    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106311    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106314    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106317    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106319    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106322    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106324    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106327    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106329    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106332    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106334    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106337    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106339    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106342    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106344    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106347    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106349    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106352    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106355    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 21:14:57.108352 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106371    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106375    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106378    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106382    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106385    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106387    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106390    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106392    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106395    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106397    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106400    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106403    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106408    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106410    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106413    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106415    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106418    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106421    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106423    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106426    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 21:14:57.108854 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106431    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106433    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106436    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106438    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106441    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106443    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106447    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106449    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106452    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106455    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106458    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106460    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106463    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106466    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106468    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106471    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106474    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106476    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106478    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 21:14:57.109390 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106481    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106484    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106487    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106489    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106492    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106494    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106497    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106499    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106502    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106505    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106509    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106512    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106515    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106520    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106522    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106525    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106528    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106531    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106533    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106536    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 21:14:57.109852 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106539    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106903    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106908    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106910    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106913    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106916    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106918    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106921    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106923    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106926    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106928    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106931    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106933    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106936    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106938    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106940    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106943    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106945    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106948    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 21:14:57.110350 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106950    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106954    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106958    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106961    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106963    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106966    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106971    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106974    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106977    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106980    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106982    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106985    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106987    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106990    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106992    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106995    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106997    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.106999    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107002    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 21:14:57.110819 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107005    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107007    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107010    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107012    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107015    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107018    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107020    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107023    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107025    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107028    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107030    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107033    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107035    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107037    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107040    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107042    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107045    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107047    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107049    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107053    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 21:14:57.111275 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107055    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107058    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107060    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107064    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107066    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107069    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107071    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107074    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107076    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107079    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107081    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107084    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107086    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107089    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107091    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107094    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107096    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107098    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107101    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107103    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 21:14:57.111864 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107106    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107108    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107110    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107113    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107115    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107117    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107120    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107122    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107125    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107127    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107130    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107134    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107137    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107140    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107143    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107145    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107148    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107150    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107152    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 21:14:57.112466 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107155    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107159    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107162    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107240    2549 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107251    2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107259    2549 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107266    2549 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107273    2549 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107278    2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107284    2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107289    2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107291    2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107294    2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107297    2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107300    2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107303    2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107306    2549 flags.go:64] FLAG: --cgroup-root=""
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107309    2549 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107312    2549 flags.go:64] FLAG: --client-ca-file=""
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107314    2549 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107317    2549 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107322    2549 flags.go:64] FLAG: --cluster-domain=""
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107325    2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 21:14:57.112936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107328    2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107332    2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107338    2549 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107342    2549 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107345    2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107348    2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107351    2549 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107354    2549 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107369    2549 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107373    2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107375    2549 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107378    2549 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107382    2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107385    2549 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107388    2549 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107391    2549 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107394    2549 flags.go:64] FLAG: --enable-server="true"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107397    2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107402    2549 flags.go:64] FLAG: --event-burst="100"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107405    2549 flags.go:64] FLAG: --event-qps="50"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107407    2549 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107410    2549 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107413    2549 flags.go:64] FLAG: --eviction-hard=""
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107416    2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 21:14:57.113515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107419    2549 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107422    2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107425    2549 flags.go:64] FLAG: --eviction-soft=""
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107428    2549 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107431    2549 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107433    2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107436    2549 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107439    2549 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107442    2549 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107445    2549 flags.go:64] FLAG: --feature-gates=""
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107450    2549 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107453    2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107456    2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107459    2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107461    2549 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107464    2549 flags.go:64] FLAG: --help="false"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107467    2549 flags.go:64] FLAG: --hostname-override="ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107470    2549 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107473    2549 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107476    2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107479    2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107482    2549 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107485    2549 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 21:14:57.114087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107488    2549 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107491    2549 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107493    2549 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107497    2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107500    2549 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107502    2549 flags.go:64] FLAG: --kube-reserved=""
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107505    2549 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107507    2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107510    2549 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107513    2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107516    2549 flags.go:64] FLAG: --lock-file=""
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107518    2549 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107521    2549 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107523    2549 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107529    2549 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107531    2549 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107534    2549 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107537    2549 flags.go:64] FLAG: --logging-format="text"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107540    2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107544    2549 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107547    2549 flags.go:64] FLAG: --manifest-url=""
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107549    2549 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107554    2549 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107557    2549 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107561    2549 flags.go:64] FLAG: --max-pods="110"
Jul 24 21:14:57.114734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107563    2549 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107567    2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107569    2549 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107572    2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107575    2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107578    2549 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107580    2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107587    2549 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107590    2549 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107593    2549 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107596    2549 flags.go:64] FLAG: --pod-cidr=""
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107599    2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107604    2549 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107607    2549 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107610    2549 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107613    2549 flags.go:64] FLAG: --port="10250"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107616    2549 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107619    2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ab2332c67590c180"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107622    2549 flags.go:64] FLAG: --qos-reserved=""
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107625    2549 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107627    2549 flags.go:64] FLAG: --register-node="true"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107630    2549 flags.go:64] FLAG: --register-with-taints=""
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107634    2549 flags.go:64] FLAG: --registry-burst="10"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107637    2549 flags.go:64] FLAG: --registry-qps="5"
Jul 24 21:14:57.115476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107639    2549 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107642    2549 flags.go:64] FLAG: --reserved-memory=""
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107645    2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107649    2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107653    2549 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107656    2549 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107659    2549 flags.go:64] FLAG: --runonce="false"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107661    2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107664    2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107667    2549 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107670    2549 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107673    2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107675    2549 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107678    2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107681    2549 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107684    2549 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107687    2549 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107689    2549 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107692    2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107695    2549 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107698    2549 flags.go:64] FLAG: --system-cgroups=""
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107701    2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107706    2549 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107709    2549 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107712    2549 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 21:14:57.116523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107716    2549 flags.go:64] FLAG: --tls-min-version=""
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107718    2549 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107721    2549 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107724    2549 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107726    2549 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107729    2549 flags.go:64] FLAG: --v="2"
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107734    2549 flags.go:64] FLAG: --version="false"
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107738    2549 flags.go:64] FLAG: --vmodule=""
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107742    2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.107745    2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107862    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107865    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107868    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107871    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107874    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107877    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107879    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107882    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107884    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107887    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107890    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107893    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 21:14:57.117603 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107895    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107898    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107900    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107903    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107906    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107908    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107911    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107914    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107916    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107919    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107922    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107924    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107927    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107929    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107932    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107934    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107938    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107940    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107943    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107945    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 21:14:57.118575 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107949    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107951    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107954    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107956    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107959    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107961    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107964    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107966    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107969    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107972    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107974    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107978    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107981    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107984    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107987    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107989    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107992    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107994    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.107997    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 21:14:57.119463 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108000    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108003    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108005    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108008    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108010    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108013    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108015    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108018    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108020    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108024    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108026    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108029    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108032    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108035    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108038    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108040    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108043    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108045    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108048    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 21:14:57.120032 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108052    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108055    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108059    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108061    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108064    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108067    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108069    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108072    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108074    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108077    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108079    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108082    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108084    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108087    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108090    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108092    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108096    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108099    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108102    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108105    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 21:14:57.120738 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108107    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108110    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108114    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108117    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108120    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108122    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108127    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108129    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.108132    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.109155    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.117994    2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.118016    2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.118037    2549 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.118050    2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118139    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 21:14:57.121596 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118146    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118151    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118156    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118160    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118165    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118169    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118174    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118178    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118183    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118187    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118191    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118195    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118200    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118204    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118208    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118213    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118217    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118221    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118225    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118229    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 21:14:57.122130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118233    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118237    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118242    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118248    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118255    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118260    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118264    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118269    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118282    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118287    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118291    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118295    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118299    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118304    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118308    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118312    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118316    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118320    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118325    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 21:14:57.122702 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118330    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118334    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118337    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118342    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118346    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118350    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118354    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118376    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118381    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118386    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118390    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118394    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118398    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118402    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118406    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118410    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118414    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118418    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118422    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 21:14:57.123503 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118435    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118439    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118444    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118456    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118461    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118465    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118469    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118474    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118478    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118482    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118486    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118490    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118494    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118498    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118503    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118507    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118511    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118515    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118519    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118523    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 21:14:57.124130 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118527    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118533    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118539    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118544    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118548    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118552    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118556    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118561    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118565    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118569    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118573    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118577    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118582    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118587    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118593    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118598    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118612    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118619    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118623    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 21:14:57.124716 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118628    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.118637    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118888    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118897    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118902    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118907    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118911    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118916    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118920    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118925    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118929    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118934    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118938    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118942    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118946    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 21:14:57.125179 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118951    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118955    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118959    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118963    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118967    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118972    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118976    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118980    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118984    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118988    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.118995    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119001    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119005    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119010    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119013    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119026    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119032    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119036    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119040    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 21:14:57.125601 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119044    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119048    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119052    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119056    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119060    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119065    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119069    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119073    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119077    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119081    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119085    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119089    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119093    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119097    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119100    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119105    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119109    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119114    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119118    2549 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119122    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 21:14:57.126077 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119128    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119133    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119138    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119142    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119146    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119150    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119154    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119158    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119162    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119174    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119178    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119182    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119186    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119190    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119195    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119199    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119203    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119207    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119211    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119215    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 21:14:57.126589 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119219    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119224    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119228    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119231    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119236    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119240    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119244    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119248    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119252    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119256    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119260    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119264    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119268    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119274    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119280    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119284    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119289    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119293    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119297    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 21:14:57.127069 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119302    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119306    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119309    2549 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119321    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119326    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119330    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119335    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:57.119339    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.119347    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.119544    2549 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.122701    2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.126065    2549 server.go:1019] "Starting client certificate rotation"
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.126168    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 21:14:57.127699 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.126200    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 21:14:57.128898 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.128883    2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 21:14:57.130082 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.130064    2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 21:14:57.138280 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.138264    2549 log.go:25] "Validated CRI v1 runtime API"
Jul 24 21:14:57.141190 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.141177    2549 log.go:25] "Validated CRI v1 image API"
Jul 24 21:14:57.142002 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.141986    2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 21:14:57.145663 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.145644    2549 fs.go:135] Filesystem UUIDs: map[21c4e862-97b7-41f3-8c66-e392037f05da:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ed921657-fb4c-4679-8762-7bd421f21f1f:/dev/nvme0n1p4]
Jul 24 21:14:57.145728 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.145662    2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 21:14:57.151646 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.151541    2549 manager.go:216] Machine: {Timestamp:2026-07-24 21:14:57.149207756 +0000 UTC m=+0.369788240 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107990 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ab79d31ae4b6c4457d9764e8a9cb5 SystemUUID:ec2ab79d-31ae-4b6c-4457-d9764e8a9cb5 BootID:c7b506c7-4947-49a8-9e84-8fa60163b870 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:35:8c:b7:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:35:8c:b7:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:05:c0:1a:3e:f3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 21:14:57.151646 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.151644    2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 21:14:57.151765 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.151718    2549 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 21:14:57.155443 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.155416    2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 21:14:57.155578 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.155446    2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 21:14:57.156270 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.156259    2549 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 21:14:57.156311 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.156272    2549 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 21:14:57.156311 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.156279    2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 21:14:57.156311 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.156292    2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 21:14:57.158272 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.158260    2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 21:14:57.158543 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.158527    2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 21:14:57.163114 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.163102    2549 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 21:14:57.163227 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.163217    2549 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 21:14:57.163263 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.163248    2549 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 21:14:57.163295 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.163267    2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 21:14:57.163295 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.163285    2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 21:14:57.163345 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.163337    2549 kubelet.go:398] "Adding apiserver pod source"
Jul 24 21:14:57.163383 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.163345    2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 21:14:57.163797 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.163782    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 21:14:57.163850 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.163804    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 21:14:57.168812 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.168786    2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 21:14:57.170613 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.170599    2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 21:14:57.170658 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.170629    2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 21:14:57.171409 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.171399    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 21:14:57.171443 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.171415    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 21:14:57.171443 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.171421    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 21:14:57.171443 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.171426    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 21:14:57.171443 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.171434    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 21:14:57.171443 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.171439    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 21:14:57.171586 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.171457    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 21:14:57.171586 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.171463    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 21:14:57.171586 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.171470    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 21:14:57.171586 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.171475    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 21:14:57.171586 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.171483    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 21:14:57.171586 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.171490    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 21:14:57.172409 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.172397    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 21:14:57.172449 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.172411    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 21:14:57.174716 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.174697    2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 21:14:57.174927 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.174906    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 21:14:57.174962 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.174915    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 21:14:57.176115 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.176102    2549 server.go:1268] "Started kubelet"
Jul 24 21:14:57.176200 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.176168    2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 21:14:57.176252 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.176195    2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 21:14:57.176293 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.176275    2549 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 21:14:57.177071 ip-10-0-138-234 systemd[1]: Started Kubernetes Kubelet.
Jul 24 21:14:57.178567 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.178551    2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 21:14:57.178567 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.178565    2549 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 21:14:57.183430 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.183411    2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 21:14:57.185074 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.183939    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-234.ec2.internal.18c556489bef88d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-234.ec2.internal,UID:ip-10-0-138-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-234.ec2.internal,},FirstTimestamp:2026-07-24 21:14:57.176070355 +0000 UTC m=+0.396650839,LastTimestamp:2026-07-24 21:14:57.176070355 +0000 UTC m=+0.396650839,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-234.ec2.internal,}"
Jul 24 21:14:57.188869 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.188850    2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 21:14:57.188869 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.188859    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 21:14:57.189047 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.189028    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-234.ec2.internal\" not found"
Jul 24 21:14:57.189762 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.189747    2549 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 21:14:57.189841 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.189783    2549 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 21:14:57.189907 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.189745    2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 21:14:57.189974 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.189948    2549 factory.go:55] Registering systemd factory
Jul 24 21:14:57.190026 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.189976    2549 factory.go:223] Registration of the systemd container factory successfully
Jul 24 21:14:57.190026 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.189995    2549 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 21:14:57.190026 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.190005    2549 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 21:14:57.190317 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.190303    2549 factory.go:153] Registering CRI-O factory
Jul 24 21:14:57.190408 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.190333    2549 factory.go:223] Registration of the crio container factory successfully
Jul 24 21:14:57.190408 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.190404    2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 21:14:57.190506 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.190429    2549 factory.go:103] Registering Raw factory
Jul 24 21:14:57.190506 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.190444    2549 manager.go:1196] Started watching for new ooms in manager
Jul 24 21:14:57.191037 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.191022    2549 manager.go:349] Starting recovery of all containers
Jul 24 21:14:57.191492 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.191463    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 21:14:57.191592 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.191573    2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 21:14:57.205001 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.204982    2549 manager.go:354] Recovery completed
Jul 24 21:14:57.209072 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.209060    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:57.212059 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.212041    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rk2hr"
Jul 24 21:14:57.212446 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.212428    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:57.212501 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.212461    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:57.212501 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.212476    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:57.213000 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.212984    2549 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 21:14:57.213000 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.212997    2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 21:14:57.213000 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.212999    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:57.213182 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.213012    2549 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 21:14:57.214063 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.214047    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:57.214133 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.214076    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:57.214133 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.214090    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:57.215252 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.215239    2549 policy_none.go:49] "None policy: Start"
Jul 24 21:14:57.215300 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.215255    2549 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 21:14:57.215300 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.215266    2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 21:14:57.217376 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.217340    2549 policy_none.go:47] "Start"
Jul 24 21:14:57.220768 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.220752    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rk2hr"
Jul 24 21:14:57.222570 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.222492    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-234.ec2.internal.18c556489e1a9994  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-234.ec2.internal,UID:ip-10-0-138-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-234.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-234.ec2.internal,},FirstTimestamp:2026-07-24 21:14:57.212447124 +0000 UTC m=+0.433027605,LastTimestamp:2026-07-24 21:14:57.212447124 +0000 UTC m=+0.433027605,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-234.ec2.internal,}"
Jul 24 21:14:57.225081 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.225009    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-234.ec2.internal.18c556489e1aeb8d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-234.ec2.internal,UID:ip-10-0-138-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-234.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-234.ec2.internal,},FirstTimestamp:2026-07-24 21:14:57.212468109 +0000 UTC m=+0.433048593,LastTimestamp:2026-07-24 21:14:57.212468109 +0000 UTC m=+0.433048593,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-234.ec2.internal,}"
Jul 24 21:14:57.257071 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.257059    2549 manager.go:337] "Starting Device Plugin manager"
Jul 24 21:14:57.257144 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.257088    2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 21:14:57.257144 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.257101    2549 server.go:87] "Starting device plugin registration server"
Jul 24 21:14:57.257410 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.257396    2549 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 21:14:57.257501 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.257410    2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 21:14:57.257560 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.257547    2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 21:14:57.257627 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.257614    2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 21:14:57.257680 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.257628    2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 21:14:57.258061 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.258044    2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 21:14:57.258152 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.258087    2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-234.ec2.internal\" not found"
Jul 24 21:14:57.357880 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.357811    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:57.360143 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.358786    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:57.360143 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.358812    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:57.360143 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.358822    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:57.360143 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.358847    2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.364318 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.364292    2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 21:14:57.365639 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.365626    2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 21:14:57.365694 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.365659    2549 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 21:14:57.365694 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.365677    2549 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 21:14:57.365767 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.365706    2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 21:14:57.367945 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.367929    2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.368029 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.367949    2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-234.ec2.internal\": node \"ip-10-0-138-234.ec2.internal\" not found"
Jul 24 21:14:57.368107 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.368091    2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 21:14:57.417694 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.417670    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-234.ec2.internal\" not found"
Jul 24 21:14:57.466746 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.466716    2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-234.ec2.internal"]
Jul 24 21:14:57.466823 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.466801    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:57.468560 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.468545    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:57.468633 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.468573    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:57.468633 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.468583    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:57.470971 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.470959    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:57.471076 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.471061    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.471125 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.471104    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:57.472377 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.472341    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:57.472449 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.472389    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:57.472449 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.472405    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:57.472796 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.472783    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:57.472837 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.472810    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:57.472837 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.472822    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:57.475080 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.475066    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.475148 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.475097    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 21:14:57.475913 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.475895    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 21:14:57.476031 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.475925    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 21:14:57.476031 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.475941    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 21:14:57.491549 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.491526    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d733089b62827c8f273fb62b77f8b43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal\" (UID: \"3d733089b62827c8f273fb62b77f8b43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.491621 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.491550    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d733089b62827c8f273fb62b77f8b43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal\" (UID: \"3d733089b62827c8f273fb62b77f8b43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.491621 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.491567    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58841f079534c869b41ffecd7da2f5d6-config\") pod \"kube-apiserver-proxy-ip-10-0-138-234.ec2.internal\" (UID: \"58841f079534c869b41ffecd7da2f5d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.496988 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.496966    2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-234.ec2.internal\" not found" node="ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.501246 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.501231    2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-234.ec2.internal\" not found" node="ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.518596 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.518576    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-234.ec2.internal\" not found"
Jul 24 21:14:57.592139 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.592101    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d733089b62827c8f273fb62b77f8b43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal\" (UID: \"3d733089b62827c8f273fb62b77f8b43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.592139 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.592138    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d733089b62827c8f273fb62b77f8b43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal\" (UID: \"3d733089b62827c8f273fb62b77f8b43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.592282 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.592156    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58841f079534c869b41ffecd7da2f5d6-config\") pod \"kube-apiserver-proxy-ip-10-0-138-234.ec2.internal\" (UID: \"58841f079534c869b41ffecd7da2f5d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.592282 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.592203    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58841f079534c869b41ffecd7da2f5d6-config\") pod \"kube-apiserver-proxy-ip-10-0-138-234.ec2.internal\" (UID: \"58841f079534c869b41ffecd7da2f5d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.592282 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.592206    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d733089b62827c8f273fb62b77f8b43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal\" (UID: \"3d733089b62827c8f273fb62b77f8b43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.592282 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.592204    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3d733089b62827c8f273fb62b77f8b43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal\" (UID: \"3d733089b62827c8f273fb62b77f8b43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.619271 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.619210    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-234.ec2.internal\" not found"
Jul 24 21:14:57.720021 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.719985    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-234.ec2.internal\" not found"
Jul 24 21:14:57.799583 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.799550    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.803938 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:57.803918    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:57.820948 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.820924    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-234.ec2.internal\" not found"
Jul 24 21:14:57.921503 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:57.921419    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-234.ec2.internal\" not found"
Jul 24 21:14:58.022061 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.022022    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-234.ec2.internal\" not found"
Jul 24 21:14:58.122657 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.122623    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-234.ec2.internal\" not found"
Jul 24 21:14:58.124782 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.124763    2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 21:14:58.124937 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.124918    2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 21:14:58.154728 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.154706    2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 21:14:58.154918 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.154901    2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 21:14:58.164274 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.164259    2549 apiserver.go:52] "Watching apiserver"
Jul 24 21:14:58.173525 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.173470    2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 21:14:58.174424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.174404    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-z75rk","kube-system/konnectivity-agent-45wph","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4","openshift-cluster-node-tuning-operator/tuned-znr2r","openshift-dns/node-resolver-8n4t9","openshift-multus/multus-additional-cni-plugins-f66pj","openshift-multus/network-metrics-daemon-swh5h","kube-system/global-pull-secret-syncer-z9mv2","openshift-image-registry/node-ca-2jdzt","openshift-multus/multus-ml8jl","openshift-network-diagnostics/network-check-target-cp457","openshift-network-operator/iptables-alerter-5bnrr"]
Jul 24 21:14:58.176828 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.176810    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.179430 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.179405    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 21:14:58.179430 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.179425    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 21:14:58.179590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.179472    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 21:14:58.179590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.179415    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 21:14:58.179590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.179412    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 21:14:58.179729 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.179705    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-45wph"
Jul 24 21:14:58.179850 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.179833    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g7v74\""
Jul 24 21:14:58.179914 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.179835    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 21:14:58.181998 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.181975    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.182077 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.182034    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pb5mq\""
Jul 24 21:14:58.182796 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.182037    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 21:14:58.182796 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.182413    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 21:14:58.184084 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.184063    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 21:14:58.184304 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.184285    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 21:14:58.184433 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.184340    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 21:14:58.184433 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.184351    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6s9bf\""
Jul 24 21:14:58.184512 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.184445    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.188107 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.186976    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 21:14:58.188107 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.187106    2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 21:14:58.188107 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.187227    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 21:14:58.188107 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.187473    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rxsn4\""
Jul 24 21:14:58.189196 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.189180    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 21:14:58.189279 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.189267    2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:58.189315 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.189282    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8n4t9"
Jul 24 21:14:58.191534 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.191515    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.191763 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.191642    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 21:14:58.191763 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.191642    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 21:14:58.191882 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.191762    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rh97l\""
Jul 24 21:14:58.193321 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.193306    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-spm82\""
Jul 24 21:14:58.193607 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.193592    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 21:14:58.193695 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.193594    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 21:14:58.193874 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.193850    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:14:58.193971 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.193890    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 21:14:58.193971 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.193901    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 21:14:58.193971 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.193859    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 21:14:58.193971 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.193941    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:14:58.196261 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196239    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:14:58.196344 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196266    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-lib-modules\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.196344 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196285    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-tuned\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.196344 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196302    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxr75\" (UniqueName: \"kubernetes.io/projected/52a8bba3-fd08-4389-b149-fb57d0def826-kube-api-access-pxr75\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.196344 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196317    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-sysconfig\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.196344 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.196316    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:14:58.196590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196383    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84ea809a-0e0a-43ae-9887-511531a13985-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.196590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196426    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-slash\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.196590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196458    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52a8bba3-fd08-4389-b149-fb57d0def826-env-overrides\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.196590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196485    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-kubernetes\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.196590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196505    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-sys\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.196590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196520    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/676e80dd-860d-4732-af8a-fc0c9bbdb457-tmp\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.196590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196535    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84ea809a-0e0a-43ae-9887-511531a13985-system-cni-dir\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.196590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196564    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-var-lib-openvswitch\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.196590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196587    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-log-socket\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196601    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84ea809a-0e0a-43ae-9887-511531a13985-cnibin\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196615    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-systemd-units\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196638    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-run-netns\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196661    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-systemd\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196684    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-run-ovn\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196720    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52a8bba3-fd08-4389-b149-fb57d0def826-ovnkube-script-lib\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196767    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b98f23e3-646c-4930-a5c6-e4296ea2ca8d-hosts-file\") pod \"node-resolver-8n4t9\" (UID: \"b98f23e3-646c-4930-a5c6-e4296ea2ca8d\") " pod="openshift-dns/node-resolver-8n4t9"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196789    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-run\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196809    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-var-lib-kubelet\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196836    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196859    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2ffn\" (UniqueName: \"kubernetes.io/projected/b98f23e3-646c-4930-a5c6-e4296ea2ca8d-kube-api-access-g2ffn\") pod \"node-resolver-8n4t9\" (UID: \"b98f23e3-646c-4930-a5c6-e4296ea2ca8d\") " pod="openshift-dns/node-resolver-8n4t9"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196880    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84ea809a-0e0a-43ae-9887-511531a13985-os-release\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196898    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-run-systemd\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196912    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-cni-netd\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196926    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-host\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.196955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196942    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqbgk\" (UniqueName: \"kubernetes.io/projected/676e80dd-860d-4732-af8a-fc0c9bbdb457-kube-api-access-jqbgk\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196960    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98f23e3-646c-4930-a5c6-e4296ea2ca8d-tmp-dir\") pod \"node-resolver-8n4t9\" (UID: \"b98f23e3-646c-4930-a5c6-e4296ea2ca8d\") " pod="openshift-dns/node-resolver-8n4t9"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196974    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddnfc\" (UniqueName: \"kubernetes.io/projected/84ea809a-0e0a-43ae-9887-511531a13985-kube-api-access-ddnfc\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.196990    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84ea809a-0e0a-43ae-9887-511531a13985-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197004    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-node-log\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197023    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4c98a31-a4ff-4948-b133-4d5d1bb852d1-agent-certs\") pod \"konnectivity-agent-45wph\" (UID: \"f4c98a31-a4ff-4948-b133-4d5d1bb852d1\") " pod="kube-system/konnectivity-agent-45wph"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197039    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5xqz\" (UniqueName: \"kubernetes.io/projected/3e996386-b010-4c1c-920a-a1c0f613b7a6-kube-api-access-v5xqz\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197065    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-sysctl-conf\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197103    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-kubelet\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197132    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-run-openvswitch\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197158    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-sys-fs\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197182    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-run-ovn-kubernetes\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197205    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-device-dir\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197246    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-registration-dir\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197267    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-sysctl-d\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197288    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.197548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197309    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-socket-dir\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.198192 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197331    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84ea809a-0e0a-43ae-9887-511531a13985-cni-binary-copy\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.198192 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197353    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84ea809a-0e0a-43ae-9887-511531a13985-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.198192 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197439    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52a8bba3-fd08-4389-b149-fb57d0def826-ovn-node-metrics-cert\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.198192 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197462    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-modprobe-d\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.198192 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197486    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-cni-bin\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.198192 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197551    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.198192 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197574    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52a8bba3-fd08-4389-b149-fb57d0def826-ovnkube-config\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.198192 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197590    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-etc-openvswitch\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.198192 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.197620    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4c98a31-a4ff-4948-b133-4d5d1bb852d1-konnectivity-ca\") pod \"konnectivity-agent-45wph\" (UID: \"f4c98a31-a4ff-4948-b133-4d5d1bb852d1\") " pod="kube-system/konnectivity-agent-45wph"
Jul 24 21:14:58.198808 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.198616    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2jdzt"
Jul 24 21:14:58.199574 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.199559    2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 21:14:58.200800 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.200780    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 21:14:58.200889 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.200825    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 21:14:58.200889 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.200844    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 21:14:58.200994 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.200889    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7nhnc\""
Jul 24 21:14:58.201036 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.201011    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.201470 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.201455    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 21:14:58.201529 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.201514    2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal"
Jul 24 21:14:58.203222 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.203209    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nts2h\""
Jul 24 21:14:58.203308 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.203295    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 21:14:58.204132 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.204119    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:14:58.204183 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.204172    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:14:58.206623 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.206607    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-234.ec2.internal"]
Jul 24 21:14:58.206688 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.206678    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5bnrr"
Jul 24 21:14:58.209305 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.209193    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r6gkj\""
Jul 24 21:14:58.209305 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.209237    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 21:14:58.209305 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.209253    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 21:14:58.209305 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.209221    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 21:14:58.213695 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.213678    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 21:14:58.213858 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.213843    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal"]
Jul 24 21:14:58.226615 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.226576    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 21:09:58 +0000 UTC" deadline="2028-03-18 20:02:25.90141279 +0000 UTC"
Jul 24 21:14:58.226615 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.226609    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14470h47m27.674805652s"
Jul 24 21:14:58.227033 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.226994    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7l8kx"
Jul 24 21:14:58.236863 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.236842    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7l8kx"
Jul 24 21:14:58.291708 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.291687    2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 21:14:58.297813 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.297792    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84ea809a-0e0a-43ae-9887-511531a13985-cni-binary-copy\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.297938 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.297819    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84ea809a-0e0a-43ae-9887-511531a13985-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.297938 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.297839    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4114fa7c-7465-42c3-b98b-2464c726d3b6-serviceca\") pod \"node-ca-2jdzt\" (UID: \"4114fa7c-7465-42c3-b98b-2464c726d3b6\") " pod="openshift-image-registry/node-ca-2jdzt"
Jul 24 21:14:58.297938 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.297856    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-cni-binary-copy\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.297938 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.297873    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-multus-socket-dir-parent\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.297938 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.297892    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-run-multus-certs\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.297938 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.297916    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52a8bba3-fd08-4389-b149-fb57d0def826-ovn-node-metrics-cert\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.297938 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.297939    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-modprobe-d\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.297970    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-etc-kubernetes\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.297994    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-cni-bin\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298021    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298046    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52a8bba3-fd08-4389-b149-fb57d0def826-ovnkube-config\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298068    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfjv2\" (UniqueName: \"kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2\") pod \"network-check-target-cp457\" (UID: \"73bd674d-7f25-417d-b153-d8d1351c991b\") " pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298088    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-cnibin\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298109    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-multus-conf-dir\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298121    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-modprobe-d\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298149    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-etc-openvswitch\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298175    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4c98a31-a4ff-4948-b133-4d5d1bb852d1-konnectivity-ca\") pod \"konnectivity-agent-45wph\" (UID: \"f4c98a31-a4ff-4948-b133-4d5d1bb852d1\") " pod="kube-system/konnectivity-agent-45wph"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298200    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-lib-modules\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298204    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-cni-bin\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298224    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-tuned\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298245    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298249    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8lk7\" (UniqueName: \"kubernetes.io/projected/48c96e78-0f96-4d03-8b10-97adb041a4b5-kube-api-access-j8lk7\") pod \"iptables-alerter-5bnrr\" (UID: \"48c96e78-0f96-4d03-8b10-97adb041a4b5\") " pod="openshift-network-operator/iptables-alerter-5bnrr"
Jul 24 21:14:58.298281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298282    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxr75\" (UniqueName: \"kubernetes.io/projected/52a8bba3-fd08-4389-b149-fb57d0def826-kube-api-access-pxr75\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298308    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-sysconfig\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298284    2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298326    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-etc-openvswitch\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298333    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84ea809a-0e0a-43ae-9887-511531a13985-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298373    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4114fa7c-7465-42c3-b98b-2464c726d3b6-host\") pod \"node-ca-2jdzt\" (UID: \"4114fa7c-7465-42c3-b98b-2464c726d3b6\") " pod="openshift-image-registry/node-ca-2jdzt"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298399    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-slash\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298421    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52a8bba3-fd08-4389-b149-fb57d0def826-env-overrides\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298444    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-kubernetes\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298448    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84ea809a-0e0a-43ae-9887-511531a13985-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298466    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-sys\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298482    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84ea809a-0e0a-43ae-9887-511531a13985-cni-binary-copy\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298510    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-sys\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298510    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/676e80dd-860d-4732-af8a-fc0c9bbdb457-tmp\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298549    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84ea809a-0e0a-43ae-9887-511531a13985-system-cni-dir\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298574    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8284212-d460-42a6-89de-5dde8f3ebb2e-dbus\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298604    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-var-lib-openvswitch\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298629    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-log-socket\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.299073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298644    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-lib-modules\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298652    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84ea809a-0e0a-43ae-9887-511531a13985-cnibin\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298668    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84ea809a-0e0a-43ae-9887-511531a13985-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298675    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-run-netns\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298716    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84ea809a-0e0a-43ae-9887-511531a13985-system-cni-dir\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298720    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-var-lib-cni-bin\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298738    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-slash\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298747    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48c96e78-0f96-4d03-8b10-97adb041a4b5-iptables-alerter-script\") pod \"iptables-alerter-5bnrr\" (UID: \"48c96e78-0f96-4d03-8b10-97adb041a4b5\") " pod="openshift-network-operator/iptables-alerter-5bnrr"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298773    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48c96e78-0f96-4d03-8b10-97adb041a4b5-host-slash\") pod \"iptables-alerter-5bnrr\" (UID: \"48c96e78-0f96-4d03-8b10-97adb041a4b5\") " pod="openshift-network-operator/iptables-alerter-5bnrr"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298797    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-systemd-units\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298823    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-run-netns\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298846    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-systemd\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298856    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52a8bba3-fd08-4389-b149-fb57d0def826-ovnkube-config\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298870    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-hostroot\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298978    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-kubernetes\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299033    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-log-socket\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299050    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84ea809a-0e0a-43ae-9887-511531a13985-cnibin\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.299815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299078    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-var-lib-openvswitch\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299116    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52a8bba3-fd08-4389-b149-fb57d0def826-env-overrides\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299142    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-systemd-units\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299123    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-run-netns\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299120    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4c98a31-a4ff-4948-b133-4d5d1bb852d1-konnectivity-ca\") pod \"konnectivity-agent-45wph\" (UID: \"f4c98a31-a4ff-4948-b133-4d5d1bb852d1\") " pod="kube-system/konnectivity-agent-45wph"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299168    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-systemd\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299163    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-sysconfig\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.298901    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-run-ovn\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299254    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-run-ovn\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299237    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52a8bba3-fd08-4389-b149-fb57d0def826-ovnkube-script-lib\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299406    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b98f23e3-646c-4930-a5c6-e4296ea2ca8d-hosts-file\") pod \"node-resolver-8n4t9\" (UID: \"b98f23e3-646c-4930-a5c6-e4296ea2ca8d\") " pod="openshift-dns/node-resolver-8n4t9"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299502    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b98f23e3-646c-4930-a5c6-e4296ea2ca8d-hosts-file\") pod \"node-resolver-8n4t9\" (UID: \"b98f23e3-646c-4930-a5c6-e4296ea2ca8d\") " pod="openshift-dns/node-resolver-8n4t9"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299433    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn7pt\" (UniqueName: \"kubernetes.io/projected/4114fa7c-7465-42c3-b98b-2464c726d3b6-kube-api-access-sn7pt\") pod \"node-ca-2jdzt\" (UID: \"4114fa7c-7465-42c3-b98b-2464c726d3b6\") " pod="openshift-image-registry/node-ca-2jdzt"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299655    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-system-cni-dir\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299804    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-os-release\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299827    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-run-k8s-cni-cncf-io\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299850    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-run\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299876    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-var-lib-kubelet\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.300563 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299898    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8284212-d460-42a6-89de-5dde8f3ebb2e-kubelet-config\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299921    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299964    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299982    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-var-lib-kubelet\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299990    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2ffn\" (UniqueName: \"kubernetes.io/projected/b98f23e3-646c-4930-a5c6-e4296ea2ca8d-kube-api-access-g2ffn\") pod \"node-resolver-8n4t9\" (UID: \"b98f23e3-646c-4930-a5c6-e4296ea2ca8d\") " pod="openshift-dns/node-resolver-8n4t9"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.299966    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52a8bba3-fd08-4389-b149-fb57d0def826-ovnkube-script-lib\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300017    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-run\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300026    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84ea809a-0e0a-43ae-9887-511531a13985-os-release\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300049    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxqkd\" (UniqueName: \"kubernetes.io/projected/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-kube-api-access-nxqkd\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300072    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-run-systemd\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300080    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84ea809a-0e0a-43ae-9887-511531a13985-os-release\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300117    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-cni-netd\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300120    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300124    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-run-systemd\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300219    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-cni-netd\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300244    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-host\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300271    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqbgk\" (UniqueName: \"kubernetes.io/projected/676e80dd-860d-4732-af8a-fc0c9bbdb457-kube-api-access-jqbgk\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.301424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300304    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-host\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300311    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98f23e3-646c-4930-a5c6-e4296ea2ca8d-tmp-dir\") pod \"node-resolver-8n4t9\" (UID: \"b98f23e3-646c-4930-a5c6-e4296ea2ca8d\") " pod="openshift-dns/node-resolver-8n4t9"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300337    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddnfc\" (UniqueName: \"kubernetes.io/projected/84ea809a-0e0a-43ae-9887-511531a13985-kube-api-access-ddnfc\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300386    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300435    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tcd2\" (UniqueName: \"kubernetes.io/projected/09a761ee-8038-4b88-ab1d-c6b7462a7f13-kube-api-access-5tcd2\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300535    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84ea809a-0e0a-43ae-9887-511531a13985-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300578    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-node-log\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300601    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4c98a31-a4ff-4948-b133-4d5d1bb852d1-agent-certs\") pod \"konnectivity-agent-45wph\" (UID: \"f4c98a31-a4ff-4948-b133-4d5d1bb852d1\") " pod="kube-system/konnectivity-agent-45wph"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300648    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-node-log\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300668    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98f23e3-646c-4930-a5c6-e4296ea2ca8d-tmp-dir\") pod \"node-resolver-8n4t9\" (UID: \"b98f23e3-646c-4930-a5c6-e4296ea2ca8d\") " pod="openshift-dns/node-resolver-8n4t9"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300726    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5xqz\" (UniqueName: \"kubernetes.io/projected/3e996386-b010-4c1c-920a-a1c0f613b7a6-kube-api-access-v5xqz\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300754    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-sysctl-conf\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300780    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-var-lib-kubelet\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300804    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-multus-daemon-config\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300832    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-kubelet\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300860    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-run-openvswitch\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300885    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-sys-fs\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.302213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300907    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-run-ovn-kubernetes\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300950    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-device-dir\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.300985    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-multus-cni-dir\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301013    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-var-lib-cni-multus\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301041    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-registration-dir\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301049    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-kubelet\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301066    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-sysctl-d\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301082    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84ea809a-0e0a-43ae-9887-511531a13985-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301161    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-sysctl-d\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301177    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-sysctl-conf\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301207    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301233    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-socket-dir\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301238    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-run-openvswitch\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301161    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-device-dir\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301265    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52a8bba3-fd08-4389-b149-fb57d0def826-host-run-ovn-kubernetes\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301210    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-sys-fs\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301321    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.302779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301324    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-registration-dir\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.303277 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.301444    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e996386-b010-4c1c-920a-a1c0f613b7a6-socket-dir\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.303277 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.302330    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/676e80dd-860d-4732-af8a-fc0c9bbdb457-etc-tuned\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.303277 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.302411    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52a8bba3-fd08-4389-b149-fb57d0def826-ovn-node-metrics-cert\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.303527 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.303511    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/676e80dd-860d-4732-af8a-fc0c9bbdb457-tmp\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.303573 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.303512    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4c98a31-a4ff-4948-b133-4d5d1bb852d1-agent-certs\") pod \"konnectivity-agent-45wph\" (UID: \"f4c98a31-a4ff-4948-b133-4d5d1bb852d1\") " pod="kube-system/konnectivity-agent-45wph"
Jul 24 21:14:58.307644 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.307622    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqbgk\" (UniqueName: \"kubernetes.io/projected/676e80dd-860d-4732-af8a-fc0c9bbdb457-kube-api-access-jqbgk\") pod \"tuned-znr2r\" (UID: \"676e80dd-860d-4732-af8a-fc0c9bbdb457\") " pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.307863 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.307825    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxr75\" (UniqueName: \"kubernetes.io/projected/52a8bba3-fd08-4389-b149-fb57d0def826-kube-api-access-pxr75\") pod \"ovnkube-node-z75rk\" (UID: \"52a8bba3-fd08-4389-b149-fb57d0def826\") " pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.307939 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.307907    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2ffn\" (UniqueName: \"kubernetes.io/projected/b98f23e3-646c-4930-a5c6-e4296ea2ca8d-kube-api-access-g2ffn\") pod \"node-resolver-8n4t9\" (UID: \"b98f23e3-646c-4930-a5c6-e4296ea2ca8d\") " pod="openshift-dns/node-resolver-8n4t9"
Jul 24 21:14:58.308525 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.308507    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddnfc\" (UniqueName: \"kubernetes.io/projected/84ea809a-0e0a-43ae-9887-511531a13985-kube-api-access-ddnfc\") pod \"multus-additional-cni-plugins-f66pj\" (UID: \"84ea809a-0e0a-43ae-9887-511531a13985\") " pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.308638 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.308624    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5xqz\" (UniqueName: \"kubernetes.io/projected/3e996386-b010-4c1c-920a-a1c0f613b7a6-kube-api-access-v5xqz\") pod \"aws-ebs-csi-driver-node-2frg4\" (UID: \"3e996386-b010-4c1c-920a-a1c0f613b7a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.350410 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:58.350377    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d733089b62827c8f273fb62b77f8b43.slice/crio-7f279fd7cf92e1f46c265ccbf092ff4d8b488d1b9453d6fe9bc958b16fad3f7e WatchSource:0}: Error finding container 7f279fd7cf92e1f46c265ccbf092ff4d8b488d1b9453d6fe9bc958b16fad3f7e: Status 404 returned error can't find the container with id 7f279fd7cf92e1f46c265ccbf092ff4d8b488d1b9453d6fe9bc958b16fad3f7e
Jul 24 21:14:58.350758 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:58.350740    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58841f079534c869b41ffecd7da2f5d6.slice/crio-66bee5256877fe559ba9155e8e51051d42a7549ae73bd4ae5be32b3b6baefd52 WatchSource:0}: Error finding container 66bee5256877fe559ba9155e8e51051d42a7549ae73bd4ae5be32b3b6baefd52: Status 404 returned error can't find the container with id 66bee5256877fe559ba9155e8e51051d42a7549ae73bd4ae5be32b3b6baefd52
Jul 24 21:14:58.356327 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.356309    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 21:14:58.368606 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.368562    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal" event={"ID":"3d733089b62827c8f273fb62b77f8b43","Type":"ContainerStarted","Data":"7f279fd7cf92e1f46c265ccbf092ff4d8b488d1b9453d6fe9bc958b16fad3f7e"}
Jul 24 21:14:58.369633 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.369612    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-234.ec2.internal" event={"ID":"58841f079534c869b41ffecd7da2f5d6","Type":"ContainerStarted","Data":"66bee5256877fe559ba9155e8e51051d42a7549ae73bd4ae5be32b3b6baefd52"}
Jul 24 21:14:58.402099 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402075    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8lk7\" (UniqueName: \"kubernetes.io/projected/48c96e78-0f96-4d03-8b10-97adb041a4b5-kube-api-access-j8lk7\") pod \"iptables-alerter-5bnrr\" (UID: \"48c96e78-0f96-4d03-8b10-97adb041a4b5\") " pod="openshift-network-operator/iptables-alerter-5bnrr"
Jul 24 21:14:58.402242 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402110    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4114fa7c-7465-42c3-b98b-2464c726d3b6-host\") pod \"node-ca-2jdzt\" (UID: \"4114fa7c-7465-42c3-b98b-2464c726d3b6\") " pod="openshift-image-registry/node-ca-2jdzt"
Jul 24 21:14:58.402242 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402127    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8284212-d460-42a6-89de-5dde8f3ebb2e-dbus\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:14:58.402242 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402194    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4114fa7c-7465-42c3-b98b-2464c726d3b6-host\") pod \"node-ca-2jdzt\" (UID: \"4114fa7c-7465-42c3-b98b-2464c726d3b6\") " pod="openshift-image-registry/node-ca-2jdzt"
Jul 24 21:14:58.402337 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402251    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-run-netns\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.402337 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402285    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-var-lib-cni-bin\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.402337 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402302    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48c96e78-0f96-4d03-8b10-97adb041a4b5-iptables-alerter-script\") pod \"iptables-alerter-5bnrr\" (UID: \"48c96e78-0f96-4d03-8b10-97adb041a4b5\") " pod="openshift-network-operator/iptables-alerter-5bnrr"
Jul 24 21:14:58.402337 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402310    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-run-netns\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.402337 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402316    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48c96e78-0f96-4d03-8b10-97adb041a4b5-host-slash\") pod \"iptables-alerter-5bnrr\" (UID: \"48c96e78-0f96-4d03-8b10-97adb041a4b5\") " pod="openshift-network-operator/iptables-alerter-5bnrr"
Jul 24 21:14:58.402337 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402335    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-hostroot\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402330    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8284212-d460-42a6-89de-5dde8f3ebb2e-dbus\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402379    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7pt\" (UniqueName: \"kubernetes.io/projected/4114fa7c-7465-42c3-b98b-2464c726d3b6-kube-api-access-sn7pt\") pod \"node-ca-2jdzt\" (UID: \"4114fa7c-7465-42c3-b98b-2464c726d3b6\") " pod="openshift-image-registry/node-ca-2jdzt"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402376    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48c96e78-0f96-4d03-8b10-97adb041a4b5-host-slash\") pod \"iptables-alerter-5bnrr\" (UID: \"48c96e78-0f96-4d03-8b10-97adb041a4b5\") " pod="openshift-network-operator/iptables-alerter-5bnrr"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402335    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-var-lib-cni-bin\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402408    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-hostroot\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402413    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-system-cni-dir\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402451    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-system-cni-dir\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402453    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-os-release\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402477    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-run-k8s-cni-cncf-io\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402495    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8284212-d460-42a6-89de-5dde8f3ebb2e-kubelet-config\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402504    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-os-release\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402517    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402548    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-run-k8s-cni-cncf-io\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.402576 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402546    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxqkd\" (UniqueName: \"kubernetes.io/projected/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-kube-api-access-nxqkd\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403101 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402593    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:14:58.403101 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402552    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8284212-d460-42a6-89de-5dde8f3ebb2e-kubelet-config\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:14:58.403101 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.402626    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tcd2\" (UniqueName: \"kubernetes.io/projected/09a761ee-8038-4b88-ab1d-c6b7462a7f13-kube-api-access-5tcd2\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:14:58.403101 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.402790    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:58.403101 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403013    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-var-lib-kubelet\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403101 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.403071    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret podName:a8284212-d460-42a6-89de-5dde8f3ebb2e nodeName:}" failed. No retries permitted until 2026-07-24 21:14:58.90302897 +0000 UTC m=+2.123609461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret") pod "global-pull-secret-syncer-z9mv2" (UID: "a8284212-d460-42a6-89de-5dde8f3ebb2e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:58.403101 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403092    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-multus-daemon-config\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403070    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-var-lib-kubelet\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403139    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-multus-cni-dir\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403172    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-var-lib-cni-multus\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403203    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4114fa7c-7465-42c3-b98b-2464c726d3b6-serviceca\") pod \"node-ca-2jdzt\" (UID: \"4114fa7c-7465-42c3-b98b-2464c726d3b6\") " pod="openshift-image-registry/node-ca-2jdzt"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403235    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-cni-binary-copy\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403261    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-multus-cni-dir\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403287    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-multus-socket-dir-parent\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403319    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-run-multus-certs\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403342    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48c96e78-0f96-4d03-8b10-97adb041a4b5-iptables-alerter-script\") pod \"iptables-alerter-5bnrr\" (UID: \"48c96e78-0f96-4d03-8b10-97adb041a4b5\") " pod="openshift-network-operator/iptables-alerter-5bnrr"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403348    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-etc-kubernetes\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403464    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-run-multus-certs\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403468    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-host-var-lib-cni-multus\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.403519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403466    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjv2\" (UniqueName: \"kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2\") pod \"network-check-target-cp457\" (UID: \"73bd674d-7f25-417d-b153-d8d1351c991b\") " pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:14:58.404079 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403530    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-etc-kubernetes\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.404079 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403563    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-multus-socket-dir-parent\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.404079 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.403615    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:58.404079 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.403686    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs podName:09a761ee-8038-4b88-ab1d-c6b7462a7f13 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:58.903661788 +0000 UTC m=+2.124242259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs") pod "network-metrics-daemon-swh5h" (UID: "09a761ee-8038-4b88-ab1d-c6b7462a7f13") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:58.404079 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403732    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-cnibin\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.404079 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403762    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-multus-daemon-config\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.404079 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403780    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-multus-conf-dir\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.404079 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403880    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-cni-binary-copy\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.404079 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403899    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-cnibin\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.404079 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403919    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-multus-conf-dir\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.404079 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.403953    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4114fa7c-7465-42c3-b98b-2464c726d3b6-serviceca\") pod \"node-ca-2jdzt\" (UID: \"4114fa7c-7465-42c3-b98b-2464c726d3b6\") " pod="openshift-image-registry/node-ca-2jdzt"
Jul 24 21:14:58.410224 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.410201    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8lk7\" (UniqueName: \"kubernetes.io/projected/48c96e78-0f96-4d03-8b10-97adb041a4b5-kube-api-access-j8lk7\") pod \"iptables-alerter-5bnrr\" (UID: \"48c96e78-0f96-4d03-8b10-97adb041a4b5\") " pod="openshift-network-operator/iptables-alerter-5bnrr"
Jul 24 21:14:58.410323 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.410262    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxqkd\" (UniqueName: \"kubernetes.io/projected/4de9c6b6-0e66-4773-b4d4-6b395f1f6cef-kube-api-access-nxqkd\") pod \"multus-ml8jl\" (UID: \"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef\") " pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.410460 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.410441    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn7pt\" (UniqueName: \"kubernetes.io/projected/4114fa7c-7465-42c3-b98b-2464c726d3b6-kube-api-access-sn7pt\") pod \"node-ca-2jdzt\" (UID: \"4114fa7c-7465-42c3-b98b-2464c726d3b6\") " pod="openshift-image-registry/node-ca-2jdzt"
Jul 24 21:14:58.410743 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.410728    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tcd2\" (UniqueName: \"kubernetes.io/projected/09a761ee-8038-4b88-ab1d-c6b7462a7f13-kube-api-access-5tcd2\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:14:58.411889 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.411872    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:14:58.411889 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.411889    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:14:58.411989 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.411899    2549 projected.go:196] Error preparing data for projected volume kube-api-access-rfjv2 for pod openshift-network-diagnostics/network-check-target-cp457: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:58.411989 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.411941    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2 podName:73bd674d-7f25-417d-b153-d8d1351c991b nodeName:}" failed. No retries permitted until 2026-07-24 21:14:58.911929503 +0000 UTC m=+2.132509974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rfjv2" (UniqueName: "kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2") pod "network-check-target-cp457" (UID: "73bd674d-7f25-417d-b153-d8d1351c991b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:58.511814 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.511770    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:14:58.521436 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:58.521412    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a8bba3_fd08_4389_b149_fb57d0def826.slice/crio-b1abc29875ce0b45d8ae02463e5a6f4d1a0338c04c50a1208f7cc78cb2b4f2ff WatchSource:0}: Error finding container b1abc29875ce0b45d8ae02463e5a6f4d1a0338c04c50a1208f7cc78cb2b4f2ff: Status 404 returned error can't find the container with id b1abc29875ce0b45d8ae02463e5a6f4d1a0338c04c50a1208f7cc78cb2b4f2ff
Jul 24 21:14:58.530866 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.530847    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-45wph"
Jul 24 21:14:58.538861 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:58.538836    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c98a31_a4ff_4948_b133_4d5d1bb852d1.slice/crio-06704bcb536218152431917c95308965eddf0e3ad4832d317adeecc475d34ed4 WatchSource:0}: Error finding container 06704bcb536218152431917c95308965eddf0e3ad4832d317adeecc475d34ed4: Status 404 returned error can't find the container with id 06704bcb536218152431917c95308965eddf0e3ad4832d317adeecc475d34ed4
Jul 24 21:14:58.538935 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.538906    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4"
Jul 24 21:14:58.547148 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:58.547128    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e996386_b010_4c1c_920a_a1c0f613b7a6.slice/crio-535ea3c20d014e2f8d2a58dbf924dcaf01a6b4e0c68707c605d1889abce698c9 WatchSource:0}: Error finding container 535ea3c20d014e2f8d2a58dbf924dcaf01a6b4e0c68707c605d1889abce698c9: Status 404 returned error can't find the container with id 535ea3c20d014e2f8d2a58dbf924dcaf01a6b4e0c68707c605d1889abce698c9
Jul 24 21:14:58.550073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.550057    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-znr2r"
Jul 24 21:14:58.557925 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:58.557906    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676e80dd_860d_4732_af8a_fc0c9bbdb457.slice/crio-4dff960d2789aa3e51357deec6b5912c2a20b61eb9f99332ba15e71612b25bb8 WatchSource:0}: Error finding container 4dff960d2789aa3e51357deec6b5912c2a20b61eb9f99332ba15e71612b25bb8: Status 404 returned error can't find the container with id 4dff960d2789aa3e51357deec6b5912c2a20b61eb9f99332ba15e71612b25bb8
Jul 24 21:14:58.566961 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.566941    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8n4t9"
Jul 24 21:14:58.574907 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:58.574882    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98f23e3_646c_4930_a5c6_e4296ea2ca8d.slice/crio-5a2fbdf5159064c6a7b273b39482d6db1336cafabe0b14853b4b86faea1c8d5c WatchSource:0}: Error finding container 5a2fbdf5159064c6a7b273b39482d6db1336cafabe0b14853b4b86faea1c8d5c: Status 404 returned error can't find the container with id 5a2fbdf5159064c6a7b273b39482d6db1336cafabe0b14853b4b86faea1c8d5c
Jul 24 21:14:58.581991 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.581973    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f66pj"
Jul 24 21:14:58.589648 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:58.589626    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ea809a_0e0a_43ae_9887_511531a13985.slice/crio-fc6061368a4e4a06f87000f2bdcd487f3989e4097d24142455bb3025ea0277a6 WatchSource:0}: Error finding container fc6061368a4e4a06f87000f2bdcd487f3989e4097d24142455bb3025ea0277a6: Status 404 returned error can't find the container with id fc6061368a4e4a06f87000f2bdcd487f3989e4097d24142455bb3025ea0277a6
Jul 24 21:14:58.597470 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.597442    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2jdzt"
Jul 24 21:14:58.605293 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:58.605273    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4114fa7c_7465_42c3_b98b_2464c726d3b6.slice/crio-ffb0c1f39ff96b8a73ce5b07b87b055ae10839b8b470789590bfc523fefce05f WatchSource:0}: Error finding container ffb0c1f39ff96b8a73ce5b07b87b055ae10839b8b470789590bfc523fefce05f: Status 404 returned error can't find the container with id ffb0c1f39ff96b8a73ce5b07b87b055ae10839b8b470789590bfc523fefce05f
Jul 24 21:14:58.619372 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.619335    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ml8jl"
Jul 24 21:14:58.624130 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.624116    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5bnrr"
Jul 24 21:14:58.627068 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:58.627047    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de9c6b6_0e66_4773_b4d4_6b395f1f6cef.slice/crio-64c5a0b1a7d7c767e832233aec1ea44c3c74b236fe6ec2b50fa47c1b50318394 WatchSource:0}: Error finding container 64c5a0b1a7d7c767e832233aec1ea44c3c74b236fe6ec2b50fa47c1b50318394: Status 404 returned error can't find the container with id 64c5a0b1a7d7c767e832233aec1ea44c3c74b236fe6ec2b50fa47c1b50318394
Jul 24 21:14:58.632465 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:14:58.632447    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c96e78_0f96_4d03_8b10_97adb041a4b5.slice/crio-bca09ced49a8b4314358095922287a31f7b2fde30d3ed3f9c4421e84bb00d783 WatchSource:0}: Error finding container bca09ced49a8b4314358095922287a31f7b2fde30d3ed3f9c4421e84bb00d783: Status 404 returned error can't find the container with id bca09ced49a8b4314358095922287a31f7b2fde30d3ed3f9c4421e84bb00d783
Jul 24 21:14:58.907134 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.907060    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:14:58.907134 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:58.907112    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:14:58.907429 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.907231    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:58.907429 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.907236    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:58.907429 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.907278    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs podName:09a761ee-8038-4b88-ab1d-c6b7462a7f13 nodeName:}" failed. No retries permitted until 2026-07-24 21:14:59.907266017 +0000 UTC m=+3.127846487 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs") pod "network-metrics-daemon-swh5h" (UID: "09a761ee-8038-4b88-ab1d-c6b7462a7f13") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:14:58.907429 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:58.907310    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret podName:a8284212-d460-42a6-89de-5dde8f3ebb2e nodeName:}" failed. No retries permitted until 2026-07-24 21:14:59.907292075 +0000 UTC m=+3.127872549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret") pod "global-pull-secret-syncer-z9mv2" (UID: "a8284212-d460-42a6-89de-5dde8f3ebb2e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:14:59.008378 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:14:59.008323    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjv2\" (UniqueName: \"kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2\") pod \"network-check-target-cp457\" (UID: \"73bd674d-7f25-417d-b153-d8d1351c991b\") " pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:14:59.010658 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:59.008600    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:14:59.010658 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:59.008624    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:14:59.010658 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:59.008637    2549 projected.go:196] Error preparing data for projected volume kube-api-access-rfjv2 for pod openshift-network-diagnostics/network-check-target-cp457: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:14:59.010658 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:14:59.008699    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2 podName:73bd674d-7f25-417d-b153-d8d1351c991b nodeName:}" failed. No retries permitted until 2026-07-24 21:15:00.008678176 +0000 UTC m=+3.229258666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfjv2" (UniqueName: "kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2") pod "network-check-target-cp457" (UID: "73bd674d-7f25-417d-b153-d8d1351c991b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:00.276505 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.276428    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 21:09:59 +0000 UTC" deadline="2027-12-18 09:55:53.850660231 +0000 UTC"
Jul 24 21:15:00.276505 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.276494    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12276h40m53.574170716s"
Jul 24 21:15:00.405691 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.405660    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:00.405852 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:00.405798    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:00.423655 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.423620    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ml8jl" event={"ID":"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef","Type":"ContainerStarted","Data":"64c5a0b1a7d7c767e832233aec1ea44c3c74b236fe6ec2b50fa47c1b50318394"}
Jul 24 21:15:00.429423 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.429391    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2jdzt" event={"ID":"4114fa7c-7465-42c3-b98b-2464c726d3b6","Type":"ContainerStarted","Data":"ffb0c1f39ff96b8a73ce5b07b87b055ae10839b8b470789590bfc523fefce05f"}
Jul 24 21:15:00.439133 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.439099    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f66pj" event={"ID":"84ea809a-0e0a-43ae-9887-511531a13985","Type":"ContainerStarted","Data":"fc6061368a4e4a06f87000f2bdcd487f3989e4097d24142455bb3025ea0277a6"}
Jul 24 21:15:00.459859 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.459828    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4" event={"ID":"3e996386-b010-4c1c-920a-a1c0f613b7a6","Type":"ContainerStarted","Data":"535ea3c20d014e2f8d2a58dbf924dcaf01a6b4e0c68707c605d1889abce698c9"}
Jul 24 21:15:00.473188 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.473155    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk" event={"ID":"52a8bba3-fd08-4389-b149-fb57d0def826","Type":"ContainerStarted","Data":"b1abc29875ce0b45d8ae02463e5a6f4d1a0338c04c50a1208f7cc78cb2b4f2ff"}
Jul 24 21:15:00.493976 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.493944    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5bnrr" event={"ID":"48c96e78-0f96-4d03-8b10-97adb041a4b5","Type":"ContainerStarted","Data":"bca09ced49a8b4314358095922287a31f7b2fde30d3ed3f9c4421e84bb00d783"}
Jul 24 21:15:00.503218 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.503190    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8n4t9" event={"ID":"b98f23e3-646c-4930-a5c6-e4296ea2ca8d","Type":"ContainerStarted","Data":"5a2fbdf5159064c6a7b273b39482d6db1336cafabe0b14853b4b86faea1c8d5c"}
Jul 24 21:15:00.524345 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.524313    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-znr2r" event={"ID":"676e80dd-860d-4732-af8a-fc0c9bbdb457","Type":"ContainerStarted","Data":"4dff960d2789aa3e51357deec6b5912c2a20b61eb9f99332ba15e71612b25bb8"}
Jul 24 21:15:00.535898 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.535829    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-45wph" event={"ID":"f4c98a31-a4ff-4948-b133-4d5d1bb852d1","Type":"ContainerStarted","Data":"06704bcb536218152431917c95308965eddf0e3ad4832d317adeecc475d34ed4"}
Jul 24 21:15:00.761108 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.761078    2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 21:15:00.953243 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.952457    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:00.953243 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:00.952506    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:00.953243 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:00.952623    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:00.953243 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:00.952682    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs podName:09a761ee-8038-4b88-ab1d-c6b7462a7f13 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:02.952663004 +0000 UTC m=+5.136336383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs") pod "network-metrics-daemon-swh5h" (UID: "09a761ee-8038-4b88-ab1d-c6b7462a7f13") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:00.953243 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:00.953056    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:00.953243 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:00.953118    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret podName:a8284212-d460-42a6-89de-5dde8f3ebb2e nodeName:}" failed. No retries permitted until 2026-07-24 21:15:02.953088933 +0000 UTC m=+5.136762308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret") pod "global-pull-secret-syncer-z9mv2" (UID: "a8284212-d460-42a6-89de-5dde8f3ebb2e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:01.053676 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:01.053571    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjv2\" (UniqueName: \"kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2\") pod \"network-check-target-cp457\" (UID: \"73bd674d-7f25-417d-b153-d8d1351c991b\") " pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:01.053834 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:01.053758    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:15:01.053834 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:01.053788    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:15:01.053834 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:01.053801    2549 projected.go:196] Error preparing data for projected volume kube-api-access-rfjv2 for pod openshift-network-diagnostics/network-check-target-cp457: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:01.053998 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:01.053857    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2 podName:73bd674d-7f25-417d-b153-d8d1351c991b nodeName:}" failed. No retries permitted until 2026-07-24 21:15:03.053836963 +0000 UTC m=+5.237510339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfjv2" (UniqueName: "kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2") pod "network-check-target-cp457" (UID: "73bd674d-7f25-417d-b153-d8d1351c991b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:01.277523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:01.277483    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 21:09:59 +0000 UTC" deadline="2028-03-31 15:33:49.869765882 +0000 UTC"
Jul 24 21:15:01.277523 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:01.277520    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14778h18m48.59225019s"
Jul 24 21:15:01.403160 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:01.403124    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:01.403380 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:01.403309    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:01.403441 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:01.403390    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:01.403441 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:01.403253    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:02.408479 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:02.408444    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:02.408915 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:02.408635    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:02.969462 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:02.969427    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:02.969631 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:02.969477    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:02.969631 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:02.969599    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:02.969744 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:02.969655    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs podName:09a761ee-8038-4b88-ab1d-c6b7462a7f13 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:06.96963587 +0000 UTC m=+9.153309248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs") pod "network-metrics-daemon-swh5h" (UID: "09a761ee-8038-4b88-ab1d-c6b7462a7f13") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:02.970044 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:02.970025    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:02.970134 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:02.970077    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret podName:a8284212-d460-42a6-89de-5dde8f3ebb2e nodeName:}" failed. No retries permitted until 2026-07-24 21:15:06.970063806 +0000 UTC m=+9.153737179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret") pod "global-pull-secret-syncer-z9mv2" (UID: "a8284212-d460-42a6-89de-5dde8f3ebb2e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:03.070740 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:03.070705    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjv2\" (UniqueName: \"kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2\") pod \"network-check-target-cp457\" (UID: \"73bd674d-7f25-417d-b153-d8d1351c991b\") " pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:03.070951 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:03.070921    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:15:03.070951 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:03.070945    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:15:03.071081 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:03.070958    2549 projected.go:196] Error preparing data for projected volume kube-api-access-rfjv2 for pod openshift-network-diagnostics/network-check-target-cp457: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:03.071081 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:03.071016    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2 podName:73bd674d-7f25-417d-b153-d8d1351c991b nodeName:}" failed. No retries permitted until 2026-07-24 21:15:07.070996876 +0000 UTC m=+9.254670251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfjv2" (UniqueName: "kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2") pod "network-check-target-cp457" (UID: "73bd674d-7f25-417d-b153-d8d1351c991b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:03.404424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:03.404390    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:03.404588 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:03.404561    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:03.404877 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:03.404856    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:03.405028 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:03.404993    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:04.404972 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:04.404938    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:04.405467 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:04.405051    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:05.403158 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:05.403119    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:05.403158 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:05.403161    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:05.403450 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:05.403246    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:05.403450 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:05.403383    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:06.403386 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:06.403347    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:06.403816 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:06.403545    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:07.005630 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:07.005301    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:07.005630 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:07.005410    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:07.005630 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:07.005488    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:07.005630 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:07.005514    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:07.005630 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:07.005548    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs podName:09a761ee-8038-4b88-ab1d-c6b7462a7f13 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:15.005533603 +0000 UTC m=+17.189206975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs") pod "network-metrics-daemon-swh5h" (UID: "09a761ee-8038-4b88-ab1d-c6b7462a7f13") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:07.005630 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:07.005571    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret podName:a8284212-d460-42a6-89de-5dde8f3ebb2e nodeName:}" failed. No retries permitted until 2026-07-24 21:15:15.005555259 +0000 UTC m=+17.189228657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret") pod "global-pull-secret-syncer-z9mv2" (UID: "a8284212-d460-42a6-89de-5dde8f3ebb2e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:07.106705 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:07.106657    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjv2\" (UniqueName: \"kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2\") pod \"network-check-target-cp457\" (UID: \"73bd674d-7f25-417d-b153-d8d1351c991b\") " pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:07.106875 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:07.106837    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:15:07.106875 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:07.106869    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:15:07.106983 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:07.106883    2549 projected.go:196] Error preparing data for projected volume kube-api-access-rfjv2 for pod openshift-network-diagnostics/network-check-target-cp457: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:07.106983 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:07.106943    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2 podName:73bd674d-7f25-417d-b153-d8d1351c991b nodeName:}" failed. No retries permitted until 2026-07-24 21:15:15.106922186 +0000 UTC m=+17.290595574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfjv2" (UniqueName: "kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2") pod "network-check-target-cp457" (UID: "73bd674d-7f25-417d-b153-d8d1351c991b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:07.402829 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:07.402792    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:07.402990 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:07.402932    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:07.403295 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:07.403259    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:07.403391 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:07.403367    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:08.404151 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:08.404109    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:08.404651 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:08.404238    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:09.403484 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:09.403454    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:09.403689 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:09.403454    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:09.403689 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:09.403594    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:09.403689 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:09.403644    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:10.403082 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:10.403043    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:10.403496 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:10.403168    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:11.403077 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:11.403030    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:11.403598 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:11.403040    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:11.403598 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:11.403169    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:11.403598 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:11.403215    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:12.403339 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:12.403296    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:12.403752 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:12.403442    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:13.403701 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:13.403668    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:13.404162 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:13.403810    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:13.404162 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:13.403864    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:13.404162 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:13.403974    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:14.403147 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:14.403110    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:14.403342 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:14.403299    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:15.068649 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:15.068609    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:15.069151 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:15.068664    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:15.069151 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:15.068779    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:15.069151 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:15.068810    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:15.069151 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:15.068855    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret podName:a8284212-d460-42a6-89de-5dde8f3ebb2e nodeName:}" failed. No retries permitted until 2026-07-24 21:15:31.06883873 +0000 UTC m=+33.252512102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret") pod "global-pull-secret-syncer-z9mv2" (UID: "a8284212-d460-42a6-89de-5dde8f3ebb2e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:15.069151 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:15.068877    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs podName:09a761ee-8038-4b88-ab1d-c6b7462a7f13 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:31.068865894 +0000 UTC m=+33.252539267 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs") pod "network-metrics-daemon-swh5h" (UID: "09a761ee-8038-4b88-ab1d-c6b7462a7f13") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:15.169547 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:15.169508    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjv2\" (UniqueName: \"kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2\") pod \"network-check-target-cp457\" (UID: \"73bd674d-7f25-417d-b153-d8d1351c991b\") " pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:15.169700 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:15.169683    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:15:15.169758 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:15.169705    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:15:15.169758 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:15.169716    2549 projected.go:196] Error preparing data for projected volume kube-api-access-rfjv2 for pod openshift-network-diagnostics/network-check-target-cp457: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:15.169840 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:15.169768    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2 podName:73bd674d-7f25-417d-b153-d8d1351c991b nodeName:}" failed. No retries permitted until 2026-07-24 21:15:31.169754448 +0000 UTC m=+33.353427821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfjv2" (UniqueName: "kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2") pod "network-check-target-cp457" (UID: "73bd674d-7f25-417d-b153-d8d1351c991b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:15.403068 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:15.402996    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:15.403283 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:15.403002    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:15.403283 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:15.403117    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:15.403283 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:15.403177    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:16.403773 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:16.403740    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:16.404224 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:16.403853    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:17.403093 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:17.403057    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:17.403307 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:17.403180    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:17.403307 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:17.403244    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:17.403443 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:17.403383    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:18.404684 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:18.404646    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:18.405158 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:18.404781    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:19.403571 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:19.403534    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:19.403754 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:19.403543    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:19.403754 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:19.403632    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:19.403754 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:19.403735    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:20.406520 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.406090    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:20.406985 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:20.406652    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:20.578595 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.578565    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-234.ec2.internal" event={"ID":"58841f079534c869b41ffecd7da2f5d6","Type":"ContainerStarted","Data":"8a0c6b94ddc33b7075f6223a06eedb2b3407f89bbd5f46f86641269b4db5fbb8"}
Jul 24 21:15:20.585122 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.585099    2549 generic.go:356] "Generic (PLEG): container finished" podID="3d733089b62827c8f273fb62b77f8b43" containerID="f0e3bf56e44412c19936637f10875f6e7f4ab7aae16eb0bc7e1a839792561969" exitCode=0
Jul 24 21:15:20.585213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.585177    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal" event={"ID":"3d733089b62827c8f273fb62b77f8b43","Type":"ContainerDied","Data":"f0e3bf56e44412c19936637f10875f6e7f4ab7aae16eb0bc7e1a839792561969"}
Jul 24 21:15:20.586598 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.586579    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ml8jl" event={"ID":"4de9c6b6-0e66-4773-b4d4-6b395f1f6cef","Type":"ContainerStarted","Data":"3d4f36a310097025bf996bc361cfd1584bf2adc07ed2037d29af184ce1ef6398"}
Jul 24 21:15:20.588095 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.588068    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2jdzt" event={"ID":"4114fa7c-7465-42c3-b98b-2464c726d3b6","Type":"ContainerStarted","Data":"c3f45532929389eb2f3780ccfca417839470cbb9b832db37a7d3baa69886678f"}
Jul 24 21:15:20.589452 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.589431    2549 generic.go:356] "Generic (PLEG): container finished" podID="84ea809a-0e0a-43ae-9887-511531a13985" containerID="f0c6f2b20b60e0a6a109483fcc11dcb280c76556e1aadd6ce3a52dd175854c95" exitCode=0
Jul 24 21:15:20.589532 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.589492    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f66pj" event={"ID":"84ea809a-0e0a-43ae-9887-511531a13985","Type":"ContainerDied","Data":"f0c6f2b20b60e0a6a109483fcc11dcb280c76556e1aadd6ce3a52dd175854c95"}
Jul 24 21:15:20.591095 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.591070    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4" event={"ID":"3e996386-b010-4c1c-920a-a1c0f613b7a6","Type":"ContainerStarted","Data":"35cdb4a832f17bcfed7fde6d1b7ca9c486f491e019f53a9dbbb9e9e317fb2ceb"}
Jul 24 21:15:20.592586 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.592547    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-234.ec2.internal" podStartSLOduration=21.592510051 podStartE2EDuration="21.592510051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:20.591720886 +0000 UTC m=+22.775394282" watchObservedRunningTime="2026-07-24 21:15:20.592510051 +0000 UTC m=+22.776183447"
Jul 24 21:15:20.594621 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.594599    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk" event={"ID":"52a8bba3-fd08-4389-b149-fb57d0def826","Type":"ContainerStarted","Data":"2ef1de978fcc91d2c3c78be55226cd73366f7d29d60d566b22cb8cc1ebb3823e"}
Jul 24 21:15:20.594732 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.594655    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk" event={"ID":"52a8bba3-fd08-4389-b149-fb57d0def826","Type":"ContainerStarted","Data":"320cde8811f91fed79d3a6c82e04f6e9a6a5b00ac323c23a0d6fda572234e449"}
Jul 24 21:15:20.594732 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.594687    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk" event={"ID":"52a8bba3-fd08-4389-b149-fb57d0def826","Type":"ContainerStarted","Data":"ab4d736a7272f25c33d9a0d8d65120ea0ec5530af93dd0f05673e8e62912395e"}
Jul 24 21:15:20.594732 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.594716    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk" event={"ID":"52a8bba3-fd08-4389-b149-fb57d0def826","Type":"ContainerStarted","Data":"c35f47f1e542a84cb198ad0c048967e9f260027d819130d79423b1ed5b037af3"}
Jul 24 21:15:20.594902 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.594742    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk" event={"ID":"52a8bba3-fd08-4389-b149-fb57d0def826","Type":"ContainerStarted","Data":"f4fa6d17bb01c0abe894d2ea927cdf849d0099c663211141b6552583a9802e03"}
Jul 24 21:15:20.596711 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.596691    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8n4t9" event={"ID":"b98f23e3-646c-4930-a5c6-e4296ea2ca8d","Type":"ContainerStarted","Data":"2ce8e9a7526031c9ebf8c8c9b8a9e8969b372fdb199e0bf647f7e09d12aafe7d"}
Jul 24 21:15:20.598227 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.598200    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-znr2r" event={"ID":"676e80dd-860d-4732-af8a-fc0c9bbdb457","Type":"ContainerStarted","Data":"5b2c171cf622c1053ce745d9ffcbfdab85c59d8e419645fb299f3e3836d156d4"}
Jul 24 21:15:20.599899 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.599881    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-45wph" event={"ID":"f4c98a31-a4ff-4948-b133-4d5d1bb852d1","Type":"ContainerStarted","Data":"c63830a57e312e61422ed4239977558f4e857a79f0817189968c246716ea3434"}
Jul 24 21:15:20.634238 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.634197    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ml8jl" podStartSLOduration=2.405482985 podStartE2EDuration="22.634184305s" totalImagesPullingTime="20.22870132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:20.634105757 +0000 UTC m=+22.817779151" watchObservedRunningTime="2026-07-24 21:15:20.634184305 +0000 UTC m=+22.817857701"
Jul 24 21:15:20.657992 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.657918    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2jdzt" podStartSLOduration=2.460830507 podStartE2EDuration="22.657897785s" totalImagesPullingTime="20.197067278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:20.657584152 +0000 UTC m=+22.841257546" watchObservedRunningTime="2026-07-24 21:15:20.657897785 +0000 UTC m=+22.841571181"
Jul 24 21:15:20.677767 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.677723    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-45wph" podStartSLOduration=2.443399385 podStartE2EDuration="22.677705901s" totalImagesPullingTime="20.234306516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:20.676509659 +0000 UTC m=+22.860183051" watchObservedRunningTime="2026-07-24 21:15:20.677705901 +0000 UTC m=+22.861379297"
Jul 24 21:15:20.695706 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.695646    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-znr2r" podStartSLOduration=2.451118412 podStartE2EDuration="22.695625901s" totalImagesPullingTime="20.244507489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:20.69507307 +0000 UTC m=+22.878746466" watchObservedRunningTime="2026-07-24 21:15:20.695625901 +0000 UTC m=+22.879299297"
Jul 24 21:15:20.710949 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:20.710904    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8n4t9" podStartSLOduration=2.482951074 podStartE2EDuration="22.710890904s" totalImagesPullingTime="20.22793983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:20.710240027 +0000 UTC m=+22.893913423" watchObservedRunningTime="2026-07-24 21:15:20.710890904 +0000 UTC m=+22.894564298"
Jul 24 21:15:21.403573 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:21.403544    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:21.403804 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:21.403649    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:21.403804 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:21.403716    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:21.403938 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:21.403823    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:21.605456 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:21.605423    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk" event={"ID":"52a8bba3-fd08-4389-b149-fb57d0def826","Type":"ContainerStarted","Data":"84953999b2a5284ac4243843cdf278227291c9492c7ef10144793510d5c7f2a9"}
Jul 24 21:15:21.607302 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:21.607247    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5bnrr" event={"ID":"48c96e78-0f96-4d03-8b10-97adb041a4b5","Type":"ContainerStarted","Data":"d5e781ea042b907045a652d4c11d719d7a36d29a806adbb2f94de7ed4893ce2d"}
Jul 24 21:15:21.621693 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:21.621649    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5bnrr" podStartSLOduration=3.5051729959999998 podStartE2EDuration="23.621635061s" totalImagesPullingTime="20.116462065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:21.621522543 +0000 UTC m=+23.805195965" watchObservedRunningTime="2026-07-24 21:15:21.621635061 +0000 UTC m=+23.805308456"
Jul 24 21:15:21.628839 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:21.628818    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-45wph"
Jul 24 21:15:21.629392 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:21.629368    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-45wph"
Jul 24 21:15:21.732330 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:21.732292    2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 21:15:22.305338 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:22.305082    2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T21:15:21.732317116Z","UUID":"a9520add-2df3-40c1-97d1-d9a3dfb32924","Handler":null,"Name":"","Endpoint":""}
Jul 24 21:15:22.306900 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:22.306877    2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 21:15:22.307033 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:22.306919    2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 21:15:22.403443 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:22.403411    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:22.403632 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:22.403562    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:22.611602 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:22.611527    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal" event={"ID":"3d733089b62827c8f273fb62b77f8b43","Type":"ContainerStarted","Data":"ab1dc4b06c906fe82c5b4912222e4c2f225ee64ab557c818dc03ff988d610481"}
Jul 24 21:15:22.613458 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:22.613414    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4" event={"ID":"3e996386-b010-4c1c-920a-a1c0f613b7a6","Type":"ContainerStarted","Data":"32ed5eca73248830711ede5aaee05d3c139975cbc465ec83c90823d94db80479"}
Jul 24 21:15:22.613712 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:22.613698    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-45wph"
Jul 24 21:15:22.614092 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:22.614073    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-45wph"
Jul 24 21:15:22.630703 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:22.630653    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-234.ec2.internal" podStartSLOduration=23.630640867 podStartE2EDuration="23.630640867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:22.630402969 +0000 UTC m=+24.814076364" watchObservedRunningTime="2026-07-24 21:15:22.630640867 +0000 UTC m=+24.814314261"
Jul 24 21:15:23.402931 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:23.402899    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:23.403090 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:23.402899    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:23.403090 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:23.403000    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:23.403166 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:23.403080    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:23.619908 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:23.619863    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk" event={"ID":"52a8bba3-fd08-4389-b149-fb57d0def826","Type":"ContainerStarted","Data":"819878e902d90abe50957aa539979a0c9b3086cc589e34106ef08fedc1dda2fb"}
Jul 24 21:15:23.622126 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:23.622086    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4" event={"ID":"3e996386-b010-4c1c-920a-a1c0f613b7a6","Type":"ContainerStarted","Data":"9dcbfcc52ec92cc89afbdc88f4363f622fa239ec585320474858bd26a8ec858f"}
Jul 24 21:15:23.641487 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:23.641440    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2frg4" podStartSLOduration=3.224455815 podStartE2EDuration="25.641421724s" totalImagesPullingTime="22.416965909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:23.641006167 +0000 UTC m=+25.824679561" watchObservedRunningTime="2026-07-24 21:15:23.641421724 +0000 UTC m=+25.825095118"
Jul 24 21:15:24.403193 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:24.403151    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:24.403405 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:24.403307    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:25.403580 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:25.403367    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:25.404220 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:25.403424    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:25.404220 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:25.403607    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:25.404220 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:25.403703    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:25.628815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:25.628785    2549 generic.go:356] "Generic (PLEG): container finished" podID="84ea809a-0e0a-43ae-9887-511531a13985" containerID="a18efe127373c67860979359a5d80d1bb7e6d0ae04402d71cf2ed02a07b292f7" exitCode=0
Jul 24 21:15:25.629001 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:25.628875    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f66pj" event={"ID":"84ea809a-0e0a-43ae-9887-511531a13985","Type":"ContainerDied","Data":"a18efe127373c67860979359a5d80d1bb7e6d0ae04402d71cf2ed02a07b292f7"}
Jul 24 21:15:25.632589 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:25.632564    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk" event={"ID":"52a8bba3-fd08-4389-b149-fb57d0def826","Type":"ContainerStarted","Data":"38c4d17acc819fa877afd843dfaf8e7b8718e9d8d1e4a010b4a6ee7cdc703264"}
Jul 24 21:15:25.632904 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:25.632880    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:15:25.633022 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:25.632982    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:15:25.633110 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:25.633054    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:15:25.648323 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:25.648297    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:15:25.648466 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:25.648419    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:15:25.673469 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:25.673380    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk" podStartSLOduration=7.352310231 podStartE2EDuration="27.673368517s" totalImagesPullingTime="20.321058286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:25.672634318 +0000 UTC m=+27.856307724" watchObservedRunningTime="2026-07-24 21:15:25.673368517 +0000 UTC m=+27.857041912"
Jul 24 21:15:26.404059 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:26.403881    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:26.404574 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:26.404177    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:27.403448 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:27.403414    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:27.403658 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:27.403419    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:27.403658 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:27.403515    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:27.403658 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:27.403581    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:27.410533 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:27.410505    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z9mv2"]
Jul 24 21:15:27.413503 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:27.413478    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-swh5h"]
Jul 24 21:15:27.413622 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:27.413583    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:27.413721 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:27.413700    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:27.423248 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:27.423221    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cp457"]
Jul 24 21:15:27.638786 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:27.638758    2549 generic.go:356] "Generic (PLEG): container finished" podID="84ea809a-0e0a-43ae-9887-511531a13985" containerID="9a578dea3ed0e9dc362a730cf45cd5b1c7263a85fd09a6acd910b983987da1ee" exitCode=0
Jul 24 21:15:27.638982 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:27.638835    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:27.638982 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:27.638863    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f66pj" event={"ID":"84ea809a-0e0a-43ae-9887-511531a13985","Type":"ContainerDied","Data":"9a578dea3ed0e9dc362a730cf45cd5b1c7263a85fd09a6acd910b983987da1ee"}
Jul 24 21:15:27.638982 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:27.638911    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:27.639143 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:27.639005    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:27.639143 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:27.639068    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:29.403790 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:29.403760    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:29.404132 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:29.403858    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:29.404132 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:29.403866    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:29.404132 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:29.403886    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:29.404132 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:29.403961    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:29.404132 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:29.404026    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:29.645444 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:29.645359    2549 generic.go:356] "Generic (PLEG): container finished" podID="84ea809a-0e0a-43ae-9887-511531a13985" containerID="a529f038bf04843d997862e9b08244f99a40d86dfb2fac1bc70515e10d1ce63b" exitCode=0
Jul 24 21:15:29.645573 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:29.645433    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f66pj" event={"ID":"84ea809a-0e0a-43ae-9887-511531a13985","Type":"ContainerDied","Data":"a529f038bf04843d997862e9b08244f99a40d86dfb2fac1bc70515e10d1ce63b"}
Jul 24 21:15:31.088618 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:31.088584    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:31.088618 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:31.088629    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:31.089178 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:31.088751    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:31.089178 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:31.088753    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:31.089178 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:31.088808    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs podName:09a761ee-8038-4b88-ab1d-c6b7462a7f13 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:03.088791295 +0000 UTC m=+65.272464668 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs") pod "network-metrics-daemon-swh5h" (UID: "09a761ee-8038-4b88-ab1d-c6b7462a7f13") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 21:15:31.089178 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:31.088826    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret podName:a8284212-d460-42a6-89de-5dde8f3ebb2e nodeName:}" failed. No retries permitted until 2026-07-24 21:16:03.088817438 +0000 UTC m=+65.272490813 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret") pod "global-pull-secret-syncer-z9mv2" (UID: "a8284212-d460-42a6-89de-5dde8f3ebb2e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 21:15:31.189357 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:31.189319    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjv2\" (UniqueName: \"kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2\") pod \"network-check-target-cp457\" (UID: \"73bd674d-7f25-417d-b153-d8d1351c991b\") " pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:31.189515 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:31.189494    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 21:15:31.189577 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:31.189522    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 21:15:31.189577 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:31.189534    2549 projected.go:196] Error preparing data for projected volume kube-api-access-rfjv2 for pod openshift-network-diagnostics/network-check-target-cp457: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:31.189666 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:31.189584    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2 podName:73bd674d-7f25-417d-b153-d8d1351c991b nodeName:}" failed. No retries permitted until 2026-07-24 21:16:03.189569856 +0000 UTC m=+65.373243230 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfjv2" (UniqueName: "kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2") pod "network-check-target-cp457" (UID: "73bd674d-7f25-417d-b153-d8d1351c991b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 21:15:31.403194 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:31.402964    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:31.403355 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:31.402968    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:31.403355 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:31.403331    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z9mv2" podUID="a8284212-d460-42a6-89de-5dde8f3ebb2e"
Jul 24 21:15:31.403481 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:31.402998    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:31.403481 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:31.403431    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swh5h" podUID="09a761ee-8038-4b88-ab1d-c6b7462a7f13"
Jul 24 21:15:31.403575 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:31.403484    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cp457" podUID="73bd674d-7f25-417d-b153-d8d1351c991b"
Jul 24 21:15:32.664423 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.664393    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-234.ec2.internal" event="NodeReady"
Jul 24 21:15:32.664828 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.664555    2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 21:15:32.703021 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.702978    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cb779c6bb-cr2px"]
Jul 24 21:15:32.735933 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.735800    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lvgr5"]
Jul 24 21:15:32.736342 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.736321    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.738728 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.738703    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 21:15:32.738997 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.738978    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 21:15:32.739296 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.739258    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ms492\""
Jul 24 21:15:32.739505 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.739491    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 21:15:32.746363 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.746341    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 21:15:32.751780 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.751761    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fxhh6"]
Jul 24 21:15:32.751900 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.751886    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:32.756111 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.756089    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-thbdw\""
Jul 24 21:15:32.756211 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.756164    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 21:15:32.756306 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.756221    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 21:15:32.773810 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.773786    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb779c6bb-cr2px"]
Jul 24 21:15:32.773919 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.773824    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fxhh6"]
Jul 24 21:15:32.773919 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.773845    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lvgr5"]
Jul 24 21:15:32.773919 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.773895    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxhh6"
Jul 24 21:15:32.778279 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.778234    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 21:15:32.778668 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.778524    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 21:15:32.779465 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.779445    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 21:15:32.779694 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.779466    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vk68f\""
Jul 24 21:15:32.802356 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.802330    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48ca2954-8014-4947-b7d7-f2863879ced7-image-registry-private-configuration\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.802484 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.802366    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.802484 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.802390    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjv85\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-kube-api-access-mjv85\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.802484 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.802433    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48ca2954-8014-4947-b7d7-f2863879ced7-installation-pull-secrets\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.802484 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.802465    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48ca2954-8014-4947-b7d7-f2863879ced7-registry-certificates\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.802719 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.802488    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48ca2954-8014-4947-b7d7-f2863879ced7-ca-trust-extracted\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.802719 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.802551    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-bound-sa-token\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.802719 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.802576    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48ca2954-8014-4947-b7d7-f2863879ced7-trusted-ca\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.876558 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.876444    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log" limit=1024
Jul 24 21:15:32.903231 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903205    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:32.903428 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903252    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48ca2954-8014-4947-b7d7-f2863879ced7-image-registry-private-configuration\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.903428 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903293    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.903428 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903314    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjv85\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-kube-api-access-mjv85\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.903428 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903341    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841-cert\") pod \"ingress-canary-fxhh6\" (UID: \"4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841\") " pod="openshift-ingress-canary/ingress-canary-fxhh6"
Jul 24 21:15:32.903428 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903368    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48ca2954-8014-4947-b7d7-f2863879ced7-installation-pull-secrets\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.903659 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903444    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48ca2954-8014-4947-b7d7-f2863879ced7-registry-certificates\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.903659 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:32.903467    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:15:32.903659 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:32.903481    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb779c6bb-cr2px: secret "image-registry-tls" not found
Jul 24 21:15:32.903659 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903489    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48ca2954-8014-4947-b7d7-f2863879ced7-ca-trust-extracted\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.903659 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903519    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-tmp-dir\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:32.903659 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:32.903546    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls podName:48ca2954-8014-4947-b7d7-f2863879ced7 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:33.403529431 +0000 UTC m=+35.587202806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls") pod "image-registry-5cb779c6bb-cr2px" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7") : secret "image-registry-tls" not found
Jul 24 21:15:32.903936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903795    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-config-volume\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:32.903936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903832    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-bound-sa-token\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.903936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903852    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76fcd\" (UniqueName: \"kubernetes.io/projected/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-kube-api-access-76fcd\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:32.903936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903887    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48ca2954-8014-4947-b7d7-f2863879ced7-trusted-ca\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.903936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.903908    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kh4j\" (UniqueName: \"kubernetes.io/projected/4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841-kube-api-access-4kh4j\") pod \"ingress-canary-fxhh6\" (UID: \"4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841\") " pod="openshift-ingress-canary/ingress-canary-fxhh6"
Jul 24 21:15:32.904164 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.904049    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48ca2954-8014-4947-b7d7-f2863879ced7-ca-trust-extracted\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.904466 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.904446    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48ca2954-8014-4947-b7d7-f2863879ced7-registry-certificates\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.904759 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.904734    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48ca2954-8014-4947-b7d7-f2863879ced7-trusted-ca\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.908023 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.908005    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48ca2954-8014-4947-b7d7-f2863879ced7-image-registry-private-configuration\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.908100 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.908022    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48ca2954-8014-4947-b7d7-f2863879ced7-installation-pull-secrets\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.914054 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.914031    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-bound-sa-token\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.914569 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.914545    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjv85\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-kube-api-access-mjv85\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:32.965583 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:32.965547    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log" limit=1024
Jul 24 21:15:33.004508 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.004474    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-tmp-dir\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:33.004666 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.004514    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-config-volume\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:33.004666 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.004542    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76fcd\" (UniqueName: \"kubernetes.io/projected/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-kube-api-access-76fcd\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:33.004666 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.004580    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kh4j\" (UniqueName: \"kubernetes.io/projected/4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841-kube-api-access-4kh4j\") pod \"ingress-canary-fxhh6\" (UID: \"4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841\") " pod="openshift-ingress-canary/ingress-canary-fxhh6"
Jul 24 21:15:33.004666 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.004606    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:33.004666 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.004667    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841-cert\") pod \"ingress-canary-fxhh6\" (UID: \"4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841\") " pod="openshift-ingress-canary/ingress-canary-fxhh6"
Jul 24 21:15:33.004916 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.004848    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-tmp-dir\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:33.004995 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:33.004967    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:33.005120 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:33.005042    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls podName:0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb nodeName:}" failed. No retries permitted until 2026-07-24 21:15:33.505022184 +0000 UTC m=+35.688695564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls") pod "dns-default-lvgr5" (UID: "0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:33.005396 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.005356    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-config-volume\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:33.007283 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.007251    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841-cert\") pod \"ingress-canary-fxhh6\" (UID: \"4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841\") " pod="openshift-ingress-canary/ingress-canary-fxhh6"
Jul 24 21:15:33.015064 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.015041    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76fcd\" (UniqueName: \"kubernetes.io/projected/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-kube-api-access-76fcd\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:33.015300 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.015257    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kh4j\" (UniqueName: \"kubernetes.io/projected/4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841-kube-api-access-4kh4j\") pod \"ingress-canary-fxhh6\" (UID: \"4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841\") " pod="openshift-ingress-canary/ingress-canary-fxhh6"
Jul 24 21:15:33.083472 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.083432    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxhh6"
Jul 24 21:15:33.402970 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.402883    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:15:33.403134 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.402893    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:15:33.403134 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.403049    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:15:33.405611 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.405585    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 21:15:33.405611 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.405607    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n9q4d\""
Jul 24 21:15:33.405883 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.405870    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 21:15:33.406014 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.406000    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 21:15:33.406077 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.406010    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 21:15:33.406126 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.406104    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qdtkv\""
Jul 24 21:15:33.407716 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.407692    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:33.407879 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:33.407860    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:15:33.407947 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:33.407883    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb779c6bb-cr2px: secret "image-registry-tls" not found
Jul 24 21:15:33.407947 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:33.407927    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls podName:48ca2954-8014-4947-b7d7-f2863879ced7 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:34.407911525 +0000 UTC m=+36.591584898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls") pod "image-registry-5cb779c6bb-cr2px" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7") : secret "image-registry-tls" not found
Jul 24 21:15:33.508426 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.508384    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:33.508616 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:33.508509    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:33.508616 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:33.508611    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls podName:0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb nodeName:}" failed. No retries permitted until 2026-07-24 21:15:34.508596913 +0000 UTC m=+36.692270286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls") pod "dns-default-lvgr5" (UID: "0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:33.878805 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:33.878767    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fxhh6"]
Jul 24 21:15:33.974296 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:15:33.974247    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9cd2ce_4f5b_4cbb_9dfa_e8b8a4a21841.slice/crio-df65d0896486e1722f12b34b1e22ffdeab93db6cafe66632694883f6b9f93d4b WatchSource:0}: Error finding container df65d0896486e1722f12b34b1e22ffdeab93db6cafe66632694883f6b9f93d4b: Status 404 returned error can't find the container with id df65d0896486e1722f12b34b1e22ffdeab93db6cafe66632694883f6b9f93d4b
Jul 24 21:15:34.416102 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:34.415891    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:34.416258 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:34.416067    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:15:34.416258 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:34.416205    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb779c6bb-cr2px: secret "image-registry-tls" not found
Jul 24 21:15:34.416385 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:34.416301    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls podName:48ca2954-8014-4947-b7d7-f2863879ced7 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:36.41625948 +0000 UTC m=+38.599932890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls") pod "image-registry-5cb779c6bb-cr2px" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7") : secret "image-registry-tls" not found
Jul 24 21:15:34.520131 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:34.518565    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:34.520131 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:34.518766    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:34.520131 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:34.518866    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls podName:0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb nodeName:}" failed. No retries permitted until 2026-07-24 21:15:36.51883946 +0000 UTC m=+38.702512837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls") pod "dns-default-lvgr5" (UID: "0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:34.660980 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:34.660942    2549 generic.go:356] "Generic (PLEG): container finished" podID="84ea809a-0e0a-43ae-9887-511531a13985" containerID="b34cceb5fe1f477e3c0f40aeb6d9f45efce583035400498f809602b85fcdbd0c" exitCode=0
Jul 24 21:15:34.661150 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:34.661076    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f66pj" event={"ID":"84ea809a-0e0a-43ae-9887-511531a13985","Type":"ContainerDied","Data":"b34cceb5fe1f477e3c0f40aeb6d9f45efce583035400498f809602b85fcdbd0c"}
Jul 24 21:15:34.662472 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:34.662451    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fxhh6" event={"ID":"4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841","Type":"ContainerStarted","Data":"df65d0896486e1722f12b34b1e22ffdeab93db6cafe66632694883f6b9f93d4b"}
Jul 24 21:15:35.668754 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:35.668718    2549 generic.go:356] "Generic (PLEG): container finished" podID="84ea809a-0e0a-43ae-9887-511531a13985" containerID="5e0d3e035f7bf3fdd5032c394b9cef03462fc83f668ebb86a1e9730ae962a560" exitCode=0
Jul 24 21:15:35.669132 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:35.668787    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f66pj" event={"ID":"84ea809a-0e0a-43ae-9887-511531a13985","Type":"ContainerDied","Data":"5e0d3e035f7bf3fdd5032c394b9cef03462fc83f668ebb86a1e9730ae962a560"}
Jul 24 21:15:36.434859 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:36.434822    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:36.435011 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:36.434958    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:15:36.435011 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:36.434973    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb779c6bb-cr2px: secret "image-registry-tls" not found
Jul 24 21:15:36.435174 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:36.435035    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls podName:48ca2954-8014-4947-b7d7-f2863879ced7 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:40.435016402 +0000 UTC m=+42.618689791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls") pod "image-registry-5cb779c6bb-cr2px" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7") : secret "image-registry-tls" not found
Jul 24 21:15:36.535936 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:36.535902    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:36.536108 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:36.536077    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:36.536156 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:36.536140    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls podName:0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb nodeName:}" failed. No retries permitted until 2026-07-24 21:15:40.536125113 +0000 UTC m=+42.719798488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls") pod "dns-default-lvgr5" (UID: "0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:36.674449 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:36.674368    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f66pj" event={"ID":"84ea809a-0e0a-43ae-9887-511531a13985","Type":"ContainerStarted","Data":"4095861e92819b146b5a74ed6325a7f24dc89da92fad4e6d9425e5dc05a5db89"}
Jul 24 21:15:36.675826 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:36.675797    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fxhh6" event={"ID":"4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841","Type":"ContainerStarted","Data":"b8051f99bedb030c9e213b4dae9c6a7137ee8258b4beaa150100e10031d7818a"}
Jul 24 21:15:36.697841 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:36.697790    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f66pj" podStartSLOduration=7.791284588 podStartE2EDuration="38.697775296s" totalImagesPullingTime="30.906490708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:36.69592617 +0000 UTC m=+38.879599564" watchObservedRunningTime="2026-07-24 21:15:36.697775296 +0000 UTC m=+38.881448691"
Jul 24 21:15:36.711664 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:36.711622    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fxhh6" podStartSLOduration=2.435641639 podStartE2EDuration="4.71160778s" totalImagesPullingTime="2.275966141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:15:36.710763456 +0000 UTC m=+38.894436853" watchObservedRunningTime="2026-07-24 21:15:36.71160778 +0000 UTC m=+38.895281172"
Jul 24 21:15:36.824184 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:36.824149    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log" limit=1024
Jul 24 21:15:36.925601 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:36.925518    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log" limit=1024
Jul 24 21:15:37.416745 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:37.416711    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log" limit=1024
Jul 24 21:15:37.471281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:37.471243    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log" limit=1024
Jul 24 21:15:38.103945 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:38.103906    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log" limit=1024
Jul 24 21:15:38.163365 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:38.163336    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log" limit=1024
Jul 24 21:15:39.814957 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:39.814923    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log" limit=1024
Jul 24 21:15:39.871998 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:39.871962    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log" limit=1024
Jul 24 21:15:40.467188 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:40.467154    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:40.467378 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:40.467263    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:15:40.467378 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:40.467293    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb779c6bb-cr2px: secret "image-registry-tls" not found
Jul 24 21:15:40.467378 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:40.467349    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls podName:48ca2954-8014-4947-b7d7-f2863879ced7 nodeName:}" failed. No retries permitted until 2026-07-24 21:15:48.467326461 +0000 UTC m=+50.650999834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls") pod "image-registry-5cb779c6bb-cr2px" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7") : secret "image-registry-tls" not found
Jul 24 21:15:40.567937 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:40.567903    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:40.568041 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:40.568026    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:40.568096 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:40.568086    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls podName:0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb nodeName:}" failed. No retries permitted until 2026-07-24 21:15:48.568068035 +0000 UTC m=+50.751741428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls") pod "dns-default-lvgr5" (UID: "0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:41.285482 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:41.285447    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log" limit=1024
Jul 24 21:15:41.386818 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:41.386773    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log" limit=1024
Jul 24 21:15:48.525918 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:48.525876    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:15:48.526398 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:48.526016    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:15:48.526398 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:48.526030    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb779c6bb-cr2px: secret "image-registry-tls" not found
Jul 24 21:15:48.526398 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:48.526085    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls podName:48ca2954-8014-4947-b7d7-f2863879ced7 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:04.526067423 +0000 UTC m=+66.709740800 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls") pod "image-registry-5cb779c6bb-cr2px" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7") : secret "image-registry-tls" not found
Jul 24 21:15:48.626464 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:48.626420    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:15:48.626604 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:48.626577    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:15:48.626659 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:15:48.626649    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls podName:0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb nodeName:}" failed. No retries permitted until 2026-07-24 21:16:04.626633343 +0000 UTC m=+66.810306716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls") pod "dns-default-lvgr5" (UID: "0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb") : secret "dns-default-metrics-tls" not found
Jul 24 21:15:57.649565 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:15:57.649532    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z75rk"
Jul 24 21:16:03.131463 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.131422    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:16:03.131463 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.131465    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:16:03.135425 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.135405    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 21:16:03.135538 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.135408    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 21:16:03.142308 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:03.142289    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 21:16:03.142373 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:03.142358    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs podName:09a761ee-8038-4b88-ab1d-c6b7462a7f13 nodeName:}" failed. No retries permitted until 2026-07-24 21:17:07.142338823 +0000 UTC m=+129.326012198 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs") pod "network-metrics-daemon-swh5h" (UID: "09a761ee-8038-4b88-ab1d-c6b7462a7f13") : secret "metrics-daemon-secret" not found
Jul 24 21:16:03.145874 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.145856    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8284212-d460-42a6-89de-5dde8f3ebb2e-original-pull-secret\") pod \"global-pull-secret-syncer-z9mv2\" (UID: \"a8284212-d460-42a6-89de-5dde8f3ebb2e\") " pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:16:03.232233 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.232205    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjv2\" (UniqueName: \"kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2\") pod \"network-check-target-cp457\" (UID: \"73bd674d-7f25-417d-b153-d8d1351c991b\") " pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:16:03.234718 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.234702    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 21:16:03.245545 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.245528    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 21:16:03.256077 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.256050    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfjv2\" (UniqueName: \"kubernetes.io/projected/73bd674d-7f25-417d-b153-d8d1351c991b-kube-api-access-rfjv2\") pod \"network-check-target-cp457\" (UID: \"73bd674d-7f25-417d-b153-d8d1351c991b\") " pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:16:03.428176 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.428094    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z9mv2"
Jul 24 21:16:03.428423 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.428406    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n9q4d\""
Jul 24 21:16:03.433605 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.433590    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:16:03.566018 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.565982    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z9mv2"]
Jul 24 21:16:03.569529 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:03.569503    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8284212_d460_42a6_89de_5dde8f3ebb2e.slice/crio-3fde6d7509c46324b30571003df0846b5f05cf9ed50f4e1bb1410d8e3318e2bb WatchSource:0}: Error finding container 3fde6d7509c46324b30571003df0846b5f05cf9ed50f4e1bb1410d8e3318e2bb: Status 404 returned error can't find the container with id 3fde6d7509c46324b30571003df0846b5f05cf9ed50f4e1bb1410d8e3318e2bb
Jul 24 21:16:03.580644 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.580622    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cp457"]
Jul 24 21:16:03.583228 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:03.583210    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73bd674d_7f25_417d_b153_d8d1351c991b.slice/crio-b010c4268cf6668df3a931963db1b35ee44d908b9b06487294680f85a53b8aa2 WatchSource:0}: Error finding container b010c4268cf6668df3a931963db1b35ee44d908b9b06487294680f85a53b8aa2: Status 404 returned error can't find the container with id b010c4268cf6668df3a931963db1b35ee44d908b9b06487294680f85a53b8aa2
Jul 24 21:16:03.739417 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.739318    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z9mv2" event={"ID":"a8284212-d460-42a6-89de-5dde8f3ebb2e","Type":"ContainerStarted","Data":"3fde6d7509c46324b30571003df0846b5f05cf9ed50f4e1bb1410d8e3318e2bb"}
Jul 24 21:16:03.740313 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:03.740264    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cp457" event={"ID":"73bd674d-7f25-417d-b153-d8d1351c991b","Type":"ContainerStarted","Data":"b010c4268cf6668df3a931963db1b35ee44d908b9b06487294680f85a53b8aa2"}
Jul 24 21:16:04.544878 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:04.544843    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:16:04.545347 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:04.544974    2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 21:16:04.545347 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:04.544991    2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb779c6bb-cr2px: secret "image-registry-tls" not found
Jul 24 21:16:04.545347 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:04.545058    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls podName:48ca2954-8014-4947-b7d7-f2863879ced7 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:36.545038045 +0000 UTC m=+98.728711421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls") pod "image-registry-5cb779c6bb-cr2px" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7") : secret "image-registry-tls" not found
Jul 24 21:16:04.645865 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:04.645827    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:16:04.646022 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:04.645971    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 21:16:04.646067 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:04.646034    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls podName:0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb nodeName:}" failed. No retries permitted until 2026-07-24 21:16:36.646018256 +0000 UTC m=+98.829691631 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls") pod "dns-default-lvgr5" (UID: "0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb") : secret "dns-default-metrics-tls" not found
Jul 24 21:16:05.676548 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.676245    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bxmn8"]
Jul 24 21:16:05.681067 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.681048    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.685430 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.685405    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 21:16:05.686201 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.686179    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 21:16:05.686387 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.686364    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4d5n4\""
Jul 24 21:16:05.686472 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.686432    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 21:16:05.686472 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.686449    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 21:16:05.700249 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.700211    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bxmn8"]
Jul 24 21:16:05.754795 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.754762    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/42ad4077-85e7-4098-9a9b-36ca924f16ad-crio-socket\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.754980 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.754825    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/42ad4077-85e7-4098-9a9b-36ca924f16ad-data-volume\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.754980 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.754881    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.754980 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.754908    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.754980 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.754933    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr6ct\" (UniqueName: \"kubernetes.io/projected/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-api-access-lr6ct\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.856136 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.855291    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/42ad4077-85e7-4098-9a9b-36ca924f16ad-data-volume\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.856136 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.855342    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.856136 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.855377    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.856136 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.855406    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr6ct\" (UniqueName: \"kubernetes.io/projected/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-api-access-lr6ct\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.856136 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.855492    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/42ad4077-85e7-4098-9a9b-36ca924f16ad-crio-socket\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.856136 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.855621    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/42ad4077-85e7-4098-9a9b-36ca924f16ad-crio-socket\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.856136 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.855720    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/42ad4077-85e7-4098-9a9b-36ca924f16ad-data-volume\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:05.856136 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:05.855731    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 21:16:05.856136 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:05.855932    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm podName:42ad4077-85e7-4098-9a9b-36ca924f16ad nodeName:}" failed. No retries permitted until 2026-07-24 21:16:06.355912524 +0000 UTC m=+68.539585910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxmn8" (UID: "42ad4077-85e7-4098-9a9b-36ca924f16ad") : configmap "kube-rbac-proxy" not found
Jul 24 21:16:05.856136 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:05.856097    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:05.856136 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:05.856151    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls podName:42ad4077-85e7-4098-9a9b-36ca924f16ad nodeName:}" failed. No retries permitted until 2026-07-24 21:16:06.356133636 +0000 UTC m=+68.539807023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxmn8" (UID: "42ad4077-85e7-4098-9a9b-36ca924f16ad") : secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:05.864628 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:05.864602    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr6ct\" (UniqueName: \"kubernetes.io/projected/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-api-access-lr6ct\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:06.359096 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:06.359063    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:06.359096 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:06.359099    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:06.359363 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:06.359196    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 21:16:06.359363 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:06.359235    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:06.359363 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:06.359294    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm podName:42ad4077-85e7-4098-9a9b-36ca924f16ad nodeName:}" failed. No retries permitted until 2026-07-24 21:16:07.359255169 +0000 UTC m=+69.542928554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxmn8" (UID: "42ad4077-85e7-4098-9a9b-36ca924f16ad") : configmap "kube-rbac-proxy" not found
Jul 24 21:16:06.359363 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:06.359315    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls podName:42ad4077-85e7-4098-9a9b-36ca924f16ad nodeName:}" failed. No retries permitted until 2026-07-24 21:16:07.359304309 +0000 UTC m=+69.542977681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxmn8" (UID: "42ad4077-85e7-4098-9a9b-36ca924f16ad") : secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:07.368503 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:07.368461    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:07.368503 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:07.368506    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:07.368982 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:07.368592    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 21:16:07.368982 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:07.368648    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:07.368982 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:07.368678    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm podName:42ad4077-85e7-4098-9a9b-36ca924f16ad nodeName:}" failed. No retries permitted until 2026-07-24 21:16:09.368656599 +0000 UTC m=+71.552329990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxmn8" (UID: "42ad4077-85e7-4098-9a9b-36ca924f16ad") : configmap "kube-rbac-proxy" not found
Jul 24 21:16:07.368982 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:07.368705    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls podName:42ad4077-85e7-4098-9a9b-36ca924f16ad nodeName:}" failed. No retries permitted until 2026-07-24 21:16:09.368686911 +0000 UTC m=+71.552360284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxmn8" (UID: "42ad4077-85e7-4098-9a9b-36ca924f16ad") : secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:07.436313 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:07.436280    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8n4t9_b98f23e3-646c-4930-a5c6-e4296ea2ca8d/dns-node-resolver/0.log"
Jul 24 21:16:08.236792 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:08.236764    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2jdzt_4114fa7c-7465-42c3-b98b-2464c726d3b6/node-ca/0.log"
Jul 24 21:16:08.755914 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:08.755809    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z9mv2" event={"ID":"a8284212-d460-42a6-89de-5dde8f3ebb2e","Type":"ContainerStarted","Data":"fe5eda9a102fb609c04b9de925a1c234cb84c0a2abab6c11ef23f880975904cc"}
Jul 24 21:16:08.757429 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:08.757399    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cp457" event={"ID":"73bd674d-7f25-417d-b153-d8d1351c991b","Type":"ContainerStarted","Data":"32a2f7c3d34cbf9094367460656c7f47bd0b1a8e8a452a0ef85a6401d152b594"}
Jul 24 21:16:08.757567 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:08.757540    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:16:08.771801 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:08.771751    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z9mv2" podStartSLOduration=65.831912943 podStartE2EDuration="1m10.771738405s" totalImagesPullingTime="4.939825462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:08.770950351 +0000 UTC m=+70.954623747" watchObservedRunningTime="2026-07-24 21:16:08.771738405 +0000 UTC m=+70.955411815"
Jul 24 21:16:08.791651 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:08.791609    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cp457" podStartSLOduration=65.879014716 podStartE2EDuration="1m10.791599158s" totalImagesPullingTime="4.912584442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:08.791053914 +0000 UTC m=+70.974727308" watchObservedRunningTime="2026-07-24 21:16:08.791599158 +0000 UTC m=+70.975272553"
Jul 24 21:16:09.036562 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:09.036474    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fxhh6_4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841/serve-healthcheck-canary/0.log"
Jul 24 21:16:09.385581 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:09.385487    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:09.385581 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:09.385535    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:09.385831 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:09.385609    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 21:16:09.385831 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:09.385657    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:09.385831 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:09.385677    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm podName:42ad4077-85e7-4098-9a9b-36ca924f16ad nodeName:}" failed. No retries permitted until 2026-07-24 21:16:13.38566113 +0000 UTC m=+75.569334529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxmn8" (UID: "42ad4077-85e7-4098-9a9b-36ca924f16ad") : configmap "kube-rbac-proxy" not found
Jul 24 21:16:09.385831 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:09.385695    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls podName:42ad4077-85e7-4098-9a9b-36ca924f16ad nodeName:}" failed. No retries permitted until 2026-07-24 21:16:13.385684308 +0000 UTC m=+75.569357682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxmn8" (UID: "42ad4077-85e7-4098-9a9b-36ca924f16ad") : secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:13.412526 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:13.412494    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:13.412526 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:13.412529    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:13.412939 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:13.412617    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 21:16:13.412939 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:13.412661    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:13.412939 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:13.412681    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm podName:42ad4077-85e7-4098-9a9b-36ca924f16ad nodeName:}" failed. No retries permitted until 2026-07-24 21:16:21.412664355 +0000 UTC m=+83.596337728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxmn8" (UID: "42ad4077-85e7-4098-9a9b-36ca924f16ad") : configmap "kube-rbac-proxy" not found
Jul 24 21:16:13.412939 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:13.412698    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls podName:42ad4077-85e7-4098-9a9b-36ca924f16ad nodeName:}" failed. No retries permitted until 2026-07-24 21:16:21.412687534 +0000 UTC m=+83.596360907 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxmn8" (UID: "42ad4077-85e7-4098-9a9b-36ca924f16ad") : secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:17.125814 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:17.125781    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-tpmr4"]
Jul 24 21:16:17.128814 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:17.128798    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-tpmr4"
Jul 24 21:16:17.131996 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:17.131977    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 24 21:16:17.132112 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:17.132086    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 24 21:16:17.132173 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:17.132153    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fng7s\""
Jul 24 21:16:17.138073 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:17.138052    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-tpmr4"]
Jul 24 21:16:17.238678 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:17.238642    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpd2t\" (UniqueName: \"kubernetes.io/projected/c37eb170-2b48-4f09-a240-05dc74b643f8-kube-api-access-fpd2t\") pod \"migrator-6865c9967-tpmr4\" (UID: \"c37eb170-2b48-4f09-a240-05dc74b643f8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-tpmr4"
Jul 24 21:16:17.339226 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:17.339184    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpd2t\" (UniqueName: \"kubernetes.io/projected/c37eb170-2b48-4f09-a240-05dc74b643f8-kube-api-access-fpd2t\") pod \"migrator-6865c9967-tpmr4\" (UID: \"c37eb170-2b48-4f09-a240-05dc74b643f8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-tpmr4"
Jul 24 21:16:17.347503 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:17.347476    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpd2t\" (UniqueName: \"kubernetes.io/projected/c37eb170-2b48-4f09-a240-05dc74b643f8-kube-api-access-fpd2t\") pod \"migrator-6865c9967-tpmr4\" (UID: \"c37eb170-2b48-4f09-a240-05dc74b643f8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-tpmr4"
Jul 24 21:16:17.436835 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:17.436738    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-tpmr4"
Jul 24 21:16:17.560398 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:17.560371    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-tpmr4"]
Jul 24 21:16:17.563522 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:17.563494    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc37eb170_2b48_4f09_a240_05dc74b643f8.slice/crio-99928acaf7023e295af43a39bd06fd6502fc5ac682c57c561a8fca69dab5a83c WatchSource:0}: Error finding container 99928acaf7023e295af43a39bd06fd6502fc5ac682c57c561a8fca69dab5a83c: Status 404 returned error can't find the container with id 99928acaf7023e295af43a39bd06fd6502fc5ac682c57c561a8fca69dab5a83c
Jul 24 21:16:17.780241 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:17.780205    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-tpmr4" event={"ID":"c37eb170-2b48-4f09-a240-05dc74b643f8","Type":"ContainerStarted","Data":"99928acaf7023e295af43a39bd06fd6502fc5ac682c57c561a8fca69dab5a83c"}
Jul 24 21:16:18.327799 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.327766    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-nqfzz"]
Jul 24 21:16:18.330710 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.330691    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz"
Jul 24 21:16:18.333948 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.333916    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 24 21:16:18.334166 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.334147    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-g7j6r\""
Jul 24 21:16:18.334280 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.334175    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 24 21:16:18.334721 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.334695    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 24 21:16:18.335412 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.335392    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 24 21:16:18.344623 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.344604    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-nqfzz"]
Jul 24 21:16:18.447518 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.447487    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5b796100-5603-4ea4-84f8-8b290c0ea318-signing-cabundle\") pod \"service-ca-658d7b7c78-nqfzz\" (UID: \"5b796100-5603-4ea4-84f8-8b290c0ea318\") " pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz"
Jul 24 21:16:18.447690 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.447637    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5b796100-5603-4ea4-84f8-8b290c0ea318-signing-key\") pod \"service-ca-658d7b7c78-nqfzz\" (UID: \"5b796100-5603-4ea4-84f8-8b290c0ea318\") " pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz"
Jul 24 21:16:18.447751 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.447697    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9g4q\" (UniqueName: \"kubernetes.io/projected/5b796100-5603-4ea4-84f8-8b290c0ea318-kube-api-access-v9g4q\") pod \"service-ca-658d7b7c78-nqfzz\" (UID: \"5b796100-5603-4ea4-84f8-8b290c0ea318\") " pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz"
Jul 24 21:16:18.549064 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.549015    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5b796100-5603-4ea4-84f8-8b290c0ea318-signing-cabundle\") pod \"service-ca-658d7b7c78-nqfzz\" (UID: \"5b796100-5603-4ea4-84f8-8b290c0ea318\") " pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz"
Jul 24 21:16:18.549287 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.549160    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5b796100-5603-4ea4-84f8-8b290c0ea318-signing-key\") pod \"service-ca-658d7b7c78-nqfzz\" (UID: \"5b796100-5603-4ea4-84f8-8b290c0ea318\") " pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz"
Jul 24 21:16:18.549287 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.549216    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9g4q\" (UniqueName: \"kubernetes.io/projected/5b796100-5603-4ea4-84f8-8b290c0ea318-kube-api-access-v9g4q\") pod \"service-ca-658d7b7c78-nqfzz\" (UID: \"5b796100-5603-4ea4-84f8-8b290c0ea318\") " pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz"
Jul 24 21:16:18.549835 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.549810    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5b796100-5603-4ea4-84f8-8b290c0ea318-signing-cabundle\") pod \"service-ca-658d7b7c78-nqfzz\" (UID: \"5b796100-5603-4ea4-84f8-8b290c0ea318\") " pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz"
Jul 24 21:16:18.552224 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.552201    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5b796100-5603-4ea4-84f8-8b290c0ea318-signing-key\") pod \"service-ca-658d7b7c78-nqfzz\" (UID: \"5b796100-5603-4ea4-84f8-8b290c0ea318\") " pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz"
Jul 24 21:16:18.558192 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.558173    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9g4q\" (UniqueName: \"kubernetes.io/projected/5b796100-5603-4ea4-84f8-8b290c0ea318-kube-api-access-v9g4q\") pod \"service-ca-658d7b7c78-nqfzz\" (UID: \"5b796100-5603-4ea4-84f8-8b290c0ea318\") " pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz"
Jul 24 21:16:18.641367 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.641345    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz"
Jul 24 21:16:18.769737 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.769713    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-nqfzz"]
Jul 24 21:16:18.774506 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:18.774480    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b796100_5603_4ea4_84f8_8b290c0ea318.slice/crio-954823a088efad2fcb3b11ed393948aa63aab796c3b07458cc6dadd9f4f63910 WatchSource:0}: Error finding container 954823a088efad2fcb3b11ed393948aa63aab796c3b07458cc6dadd9f4f63910: Status 404 returned error can't find the container with id 954823a088efad2fcb3b11ed393948aa63aab796c3b07458cc6dadd9f4f63910
Jul 24 21:16:18.783690 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.783631    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz" event={"ID":"5b796100-5603-4ea4-84f8-8b290c0ea318","Type":"ContainerStarted","Data":"954823a088efad2fcb3b11ed393948aa63aab796c3b07458cc6dadd9f4f63910"}
Jul 24 21:16:18.785329 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.785301    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-tpmr4" event={"ID":"c37eb170-2b48-4f09-a240-05dc74b643f8","Type":"ContainerStarted","Data":"83ed1b5947f90ce7819b1ff20ecd8b957f6efbcc10887b816506645a49d6939b"}
Jul 24 21:16:18.785412 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.785350    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-tpmr4" event={"ID":"c37eb170-2b48-4f09-a240-05dc74b643f8","Type":"ContainerStarted","Data":"86fe5f8cdf784e671f1aeadc6126e6a3626e8fb78232f884552cdb23b89e7cc1"}
Jul 24 21:16:18.801578 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:18.801541    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-tpmr4" podStartSLOduration=0.741774487 podStartE2EDuration="1.801526408s" totalImagesPullingTime="1.059751921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:18.800505395 +0000 UTC m=+80.984178791" watchObservedRunningTime="2026-07-24 21:16:18.801526408 +0000 UTC m=+80.985199802"
Jul 24 21:16:20.794638 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:20.794602    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz" event={"ID":"5b796100-5603-4ea4-84f8-8b290c0ea318","Type":"ContainerStarted","Data":"4ae516a9b18d4204e003ce3cb21125e0881c89560cb2892b2f927d549acaa439"}
Jul 24 21:16:20.814223 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:20.814176    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-nqfzz" podStartSLOduration=1.1153411069999999 podStartE2EDuration="2.81415573s" totalImagesPullingTime="1.698814623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:20.813572704 +0000 UTC m=+82.997246092" watchObservedRunningTime="2026-07-24 21:16:20.81415573 +0000 UTC m=+82.997829128"
Jul 24 21:16:21.473622 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:21.473586    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:21.473862 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:21.473843    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:21.474153 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:21.474139    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:21.474323 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:21.474310    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls podName:42ad4077-85e7-4098-9a9b-36ca924f16ad nodeName:}" failed. No retries permitted until 2026-07-24 21:16:37.474290035 +0000 UTC m=+99.657963423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxmn8" (UID: "42ad4077-85e7-4098-9a9b-36ca924f16ad") : secret "insights-runtime-extractor-tls" not found
Jul 24 21:16:21.474419 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:21.474210    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42ad4077-85e7-4098-9a9b-36ca924f16ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:36.592462 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:36.592394    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:16:36.594951 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:36.594907    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls\") pod \"image-registry-5cb779c6bb-cr2px\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") " pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:16:36.655144 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:36.655114    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ms492\""
Jul 24 21:16:36.663127 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:36.663105    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:16:36.693714 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:36.693686    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:16:36.696077 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:36.696053    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb-metrics-tls\") pod \"dns-default-lvgr5\" (UID: \"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb\") " pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:16:36.794870 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:36.794833    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb779c6bb-cr2px"]
Jul 24 21:16:36.797614 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:36.797584    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ca2954_8014_4947_b7d7_f2863879ced7.slice/crio-2c97d52e274ba30715ddd78e2b7442aa1ef7b411880efac54e8228408e34f282 WatchSource:0}: Error finding container 2c97d52e274ba30715ddd78e2b7442aa1ef7b411880efac54e8228408e34f282: Status 404 returned error can't find the container with id 2c97d52e274ba30715ddd78e2b7442aa1ef7b411880efac54e8228408e34f282
Jul 24 21:16:36.851059 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:36.849353    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px" event={"ID":"48ca2954-8014-4947-b7d7-f2863879ced7","Type":"ContainerStarted","Data":"2c97d52e274ba30715ddd78e2b7442aa1ef7b411880efac54e8228408e34f282"}
Jul 24 21:16:36.965303 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:36.965257    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-thbdw\""
Jul 24 21:16:36.973503 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:36.973480    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:16:37.100657 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:37.100585    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lvgr5"]
Jul 24 21:16:37.104157 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:37.104126    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc92fe0_bd51_4a01_92b1_27a6bf0c40bb.slice/crio-4c7cf4b5379029cb338784b3cf41a25bcaadbdc8f9ed48aa096c5f882187c27e WatchSource:0}: Error finding container 4c7cf4b5379029cb338784b3cf41a25bcaadbdc8f9ed48aa096c5f882187c27e: Status 404 returned error can't find the container with id 4c7cf4b5379029cb338784b3cf41a25bcaadbdc8f9ed48aa096c5f882187c27e
Jul 24 21:16:37.500166 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:37.500120    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:37.502557 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:37.502530    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42ad4077-85e7-4098-9a9b-36ca924f16ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxmn8\" (UID: \"42ad4077-85e7-4098-9a9b-36ca924f16ad\") " pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:37.792782 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:37.792697    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bxmn8"
Jul 24 21:16:37.857347 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:37.857308    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lvgr5" event={"ID":"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb","Type":"ContainerStarted","Data":"4c7cf4b5379029cb338784b3cf41a25bcaadbdc8f9ed48aa096c5f882187c27e"}
Jul 24 21:16:37.859838 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:37.859381    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px" event={"ID":"48ca2954-8014-4947-b7d7-f2863879ced7","Type":"ContainerStarted","Data":"38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d"}
Jul 24 21:16:37.859838 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:37.859511    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:16:37.886340 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:37.885822    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px" podStartSLOduration=77.885800376 podStartE2EDuration="1m17.885800376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:37.884094785 +0000 UTC m=+100.067768182" watchObservedRunningTime="2026-07-24 21:16:37.885800376 +0000 UTC m=+100.069473771"
Jul 24 21:16:37.939920 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:37.939887    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bxmn8"]
Jul 24 21:16:37.945149 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:37.945118    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ad4077_85e7_4098_9a9b_36ca924f16ad.slice/crio-82598dfad4dafcae5cab750a45194ee7f343594682dc399e4d764aba9da35f02 WatchSource:0}: Error finding container 82598dfad4dafcae5cab750a45194ee7f343594682dc399e4d764aba9da35f02: Status 404 returned error can't find the container with id 82598dfad4dafcae5cab750a45194ee7f343594682dc399e4d764aba9da35f02
Jul 24 21:16:38.865301 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:38.865201    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxmn8" event={"ID":"42ad4077-85e7-4098-9a9b-36ca924f16ad","Type":"ContainerStarted","Data":"82598dfad4dafcae5cab750a45194ee7f343594682dc399e4d764aba9da35f02"}
Jul 24 21:16:38.868246 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:38.868123    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lvgr5" event={"ID":"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb","Type":"ContainerStarted","Data":"9291bf65b3c5ef8f5c18ef1b121e5a5332bfb0d6dd0d4fdeeac4e3819bedf890"}
Jul 24 21:16:38.868246 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:38.868174    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lvgr5" event={"ID":"0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb","Type":"ContainerStarted","Data":"e9ed8db55d34208c3274f5c419069fe26d4778338723b15e4818ed08ca9c3829"}
Jul 24 21:16:38.889961 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:38.888983    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lvgr5" podStartSLOduration=65.375971028 podStartE2EDuration="1m6.888963072s" totalImagesPullingTime="1.512992044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:38.888088627 +0000 UTC m=+101.071762019" watchObservedRunningTime="2026-07-24 21:16:38.888963072 +0000 UTC m=+101.072636468"
Jul 24 21:16:39.762681 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:39.762650    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cp457"
Jul 24 21:16:39.872007 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:39.871977    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:16:40.351206 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.351159    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-48z8b"]
Jul 24 21:16:40.356016 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.355993    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-48z8b"
Jul 24 21:16:40.359011 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.358821    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 24 21:16:40.362839 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.362615    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rvkrm\""
Jul 24 21:16:40.362839 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.362647    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 24 21:16:40.366827 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.366803    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-48z8b"]
Jul 24 21:16:40.425000 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.424916    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/69462d3d-76a5-4c50-bff1-acc487aaa2ed-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-48z8b\" (UID: \"69462d3d-76a5-4c50-bff1-acc487aaa2ed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-48z8b"
Jul 24 21:16:40.425183 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.425043    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69462d3d-76a5-4c50-bff1-acc487aaa2ed-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-48z8b\" (UID: \"69462d3d-76a5-4c50-bff1-acc487aaa2ed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-48z8b"
Jul 24 21:16:40.470160 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.470128    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-mq8gd"]
Jul 24 21:16:40.472729 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.472707    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mq8gd"
Jul 24 21:16:40.481803 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.481780    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8kr4w\""
Jul 24 21:16:40.508468 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.508430    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-mq8gd"]
Jul 24 21:16:40.526097 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.526069    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/69462d3d-76a5-4c50-bff1-acc487aaa2ed-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-48z8b\" (UID: \"69462d3d-76a5-4c50-bff1-acc487aaa2ed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-48z8b"
Jul 24 21:16:40.526260 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.526133    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69462d3d-76a5-4c50-bff1-acc487aaa2ed-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-48z8b\" (UID: \"69462d3d-76a5-4c50-bff1-acc487aaa2ed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-48z8b"
Jul 24 21:16:40.526834 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.526783    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/69462d3d-76a5-4c50-bff1-acc487aaa2ed-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-48z8b\" (UID: \"69462d3d-76a5-4c50-bff1-acc487aaa2ed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-48z8b"
Jul 24 21:16:40.528895 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.528871    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69462d3d-76a5-4c50-bff1-acc487aaa2ed-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-48z8b\" (UID: \"69462d3d-76a5-4c50-bff1-acc487aaa2ed\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-48z8b"
Jul 24 21:16:40.626953 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.626861    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th9w4\" (UniqueName: \"kubernetes.io/projected/6419d2df-c692-4ca0-85af-316a83c3b6b3-kube-api-access-th9w4\") pod \"network-check-source-7d88cb55d8-mq8gd\" (UID: \"6419d2df-c692-4ca0-85af-316a83c3b6b3\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mq8gd"
Jul 24 21:16:40.668622 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.668582    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-48z8b"
Jul 24 21:16:40.727385 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.727337    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th9w4\" (UniqueName: \"kubernetes.io/projected/6419d2df-c692-4ca0-85af-316a83c3b6b3-kube-api-access-th9w4\") pod \"network-check-source-7d88cb55d8-mq8gd\" (UID: \"6419d2df-c692-4ca0-85af-316a83c3b6b3\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mq8gd"
Jul 24 21:16:40.740233 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.740184    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th9w4\" (UniqueName: \"kubernetes.io/projected/6419d2df-c692-4ca0-85af-316a83c3b6b3-kube-api-access-th9w4\") pod \"network-check-source-7d88cb55d8-mq8gd\" (UID: \"6419d2df-c692-4ca0-85af-316a83c3b6b3\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mq8gd"
Jul 24 21:16:40.781374 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:40.781340    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mq8gd"
Jul 24 21:16:43.805307 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:43.805259    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-mq8gd"]
Jul 24 21:16:43.806565 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:43.806539    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6419d2df_c692_4ca0_85af_316a83c3b6b3.slice/crio-2389e417b70e72ecbd0de7d5b1c29aafd40ab17a0039feb9cffd16f5402881e2 WatchSource:0}: Error finding container 2389e417b70e72ecbd0de7d5b1c29aafd40ab17a0039feb9cffd16f5402881e2: Status 404 returned error can't find the container with id 2389e417b70e72ecbd0de7d5b1c29aafd40ab17a0039feb9cffd16f5402881e2
Jul 24 21:16:43.823219 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:43.823194    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-48z8b"]
Jul 24 21:16:43.825607 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:43.825584    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69462d3d_76a5_4c50_bff1_acc487aaa2ed.slice/crio-cd91d059912746b2e9a326783d256bb41ed2e891bf53366bfab2cce6b1b162f7 WatchSource:0}: Error finding container cd91d059912746b2e9a326783d256bb41ed2e891bf53366bfab2cce6b1b162f7: Status 404 returned error can't find the container with id cd91d059912746b2e9a326783d256bb41ed2e891bf53366bfab2cce6b1b162f7
Jul 24 21:16:43.885752 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:43.885719    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mq8gd" event={"ID":"6419d2df-c692-4ca0-85af-316a83c3b6b3","Type":"ContainerStarted","Data":"2389e417b70e72ecbd0de7d5b1c29aafd40ab17a0039feb9cffd16f5402881e2"}
Jul 24 21:16:43.886959 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:43.886854    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-48z8b" event={"ID":"69462d3d-76a5-4c50-bff1-acc487aaa2ed","Type":"ContainerStarted","Data":"cd91d059912746b2e9a326783d256bb41ed2e891bf53366bfab2cce6b1b162f7"}
Jul 24 21:16:44.891439 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:44.891402    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxmn8" event={"ID":"42ad4077-85e7-4098-9a9b-36ca924f16ad","Type":"ContainerStarted","Data":"57ac6f226e1c0f137c2da587c87cc8bd27197092b0f5968169f202d32c21f9c0"}
Jul 24 21:16:44.892771 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:44.892747    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mq8gd" event={"ID":"6419d2df-c692-4ca0-85af-316a83c3b6b3","Type":"ContainerStarted","Data":"ca6b7d3204bf69d9dfacf14a68a9610f2f44ee65fde67090d9ee6902210927c6"}
Jul 24 21:16:44.913508 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:44.909601    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mq8gd" podStartSLOduration=4.9095828489999995 podStartE2EDuration="4.909582849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:44.908404601 +0000 UTC m=+107.092077997" watchObservedRunningTime="2026-07-24 21:16:44.909582849 +0000 UTC m=+107.093256245"
Jul 24 21:16:45.898937 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:45.898898    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-48z8b" event={"ID":"69462d3d-76a5-4c50-bff1-acc487aaa2ed","Type":"ContainerStarted","Data":"3a6f0797e41d05eb6d0bcac13500a5a7e016eddca3f6da1b03a883a7343ef349"}
Jul 24 21:16:45.916196 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:45.916137    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-48z8b" podStartSLOduration=4.808965959 podStartE2EDuration="5.916119291s" totalImagesPullingTime="1.107153332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:45.91516719 +0000 UTC m=+108.098840586" watchObservedRunningTime="2026-07-24 21:16:45.916119291 +0000 UTC m=+108.099792727"
Jul 24 21:16:48.912974 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:48.912927    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxmn8" event={"ID":"42ad4077-85e7-4098-9a9b-36ca924f16ad","Type":"ContainerStarted","Data":"34f986e6ff1bf4958808ad024aea1835788c1550e8ce2c602bbb1a5334a0aef4"}
Jul 24 21:16:49.877619 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:49.877593    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lvgr5"
Jul 24 21:16:50.115866 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.115831    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wc7pw"]
Jul 24 21:16:50.124484 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.124422    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.130751 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.130212    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 21:16:50.130751 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.130407    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 21:16:50.130751 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.130544    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ngxl2\""
Jul 24 21:16:50.130751 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.130573    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 21:16:50.130751 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.130590    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 21:16:50.130751 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.130592    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 21:16:50.130751 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.130677    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 21:16:50.207616 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.207580    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.207797 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.207629    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-root\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.207797 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.207705    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-metrics-client-ca\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.207797 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.207763    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-textfile\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.207797 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.207793    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-sys\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.208005 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.207816    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-wtmp\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.208005 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.207850    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx5md\" (UniqueName: \"kubernetes.io/projected/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-kube-api-access-wx5md\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.208005 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.207955    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-tls\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.208005 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.207996    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-accelerators-collector-config\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.308672 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.308633    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx5md\" (UniqueName: \"kubernetes.io/projected/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-kube-api-access-wx5md\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.308855 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.308702    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-tls\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.308855 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.308729    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-accelerators-collector-config\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.308855 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.308772    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.308855 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.308799    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-root\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.308855 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.308817    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-metrics-client-ca\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.308855 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.308840    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-textfile\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.309191 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.308861    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-sys\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.309191 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.308883    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-wtmp\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.309191 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.309019    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-wtmp\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.309191 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:50.309098    2549 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 21:16:50.309191 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.309114    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-root\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.309191 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:16:50.309147    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-tls podName:d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8 nodeName:}" failed. No retries permitted until 2026-07-24 21:16:50.80913241 +0000 UTC m=+112.992805782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-tls") pod "node-exporter-wc7pw" (UID: "d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8") : secret "node-exporter-tls" not found
Jul 24 21:16:50.309580 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.309555    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-metrics-client-ca\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.309921 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.309655    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-accelerators-collector-config\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.309921 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.309705    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-sys\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.309921 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.309757    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-textfile\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.312457 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.312432    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.324443 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.324396    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx5md\" (UniqueName: \"kubernetes.io/projected/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-kube-api-access-wx5md\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.811417 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.811365    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-tls\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:50.814113 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:50.814085    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8-node-exporter-tls\") pod \"node-exporter-wc7pw\" (UID: \"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8\") " pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:51.037420 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:51.037373    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wc7pw"
Jul 24 21:16:51.431924 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:51.431890    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69c6959_a5fe_41b5_a638_6d9c5c7b2fe8.slice/crio-9adbbc60146e61f6acba8d6ce9075341833fc2bdae0a9cd00da6d39f9ac5f254 WatchSource:0}: Error finding container 9adbbc60146e61f6acba8d6ce9075341833fc2bdae0a9cd00da6d39f9ac5f254: Status 404 returned error can't find the container with id 9adbbc60146e61f6acba8d6ce9075341833fc2bdae0a9cd00da6d39f9ac5f254
Jul 24 21:16:51.927253 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:51.927205    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxmn8" event={"ID":"42ad4077-85e7-4098-9a9b-36ca924f16ad","Type":"ContainerStarted","Data":"bdb8783fa4039b2aac08efe3a5882c72410a789a6d0f953888a67e8976308727"}
Jul 24 21:16:51.928500 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:51.928475    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wc7pw" event={"ID":"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8","Type":"ContainerStarted","Data":"9adbbc60146e61f6acba8d6ce9075341833fc2bdae0a9cd00da6d39f9ac5f254"}
Jul 24 21:16:51.954330 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:51.954246    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bxmn8" podStartSLOduration=33.535654612 podStartE2EDuration="46.954231432s" totalImagesPullingTime="13.41857682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:16:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:51.95276757 +0000 UTC m=+114.136440977" watchObservedRunningTime="2026-07-24 21:16:51.954231432 +0000 UTC m=+114.137904826"
Jul 24 21:16:52.110363 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.110327    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b8998f574-7qw9l"]
Jul 24 21:16:52.114478 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.114452    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.117401 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.117375    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 24 21:16:52.117621 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.117553    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 24 21:16:52.117621 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.117575    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3an0vkpca29e2\""
Jul 24 21:16:52.117621 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.117594    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-c4rn8\""
Jul 24 21:16:52.117787 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.117580    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 24 21:16:52.117787 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.117669    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 24 21:16:52.117787 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.117765    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 24 21:16:52.127926 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.127903    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b8998f574-7qw9l"]
Jul 24 21:16:52.223975 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.223908    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-tls\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.223975 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.223952    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.224138 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.224016    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15f7819d-7e38-4a9e-9f65-2b79a6437c55-metrics-client-ca\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.224138 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.224035    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2xzs\" (UniqueName: \"kubernetes.io/projected/15f7819d-7e38-4a9e-9f65-2b79a6437c55-kube-api-access-z2xzs\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.224138 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.224092    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.224138 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.224115    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.224262 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.224180    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-grpc-tls\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.224262 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.224219    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.324615 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.324589    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.324693 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.324628    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.324693 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.324673    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-grpc-tls\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.324780 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.324705    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.324831 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.324796    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-tls\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.324878 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.324859    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.324922 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.324902    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15f7819d-7e38-4a9e-9f65-2b79a6437c55-metrics-client-ca\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.324982 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.324922    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2xzs\" (UniqueName: \"kubernetes.io/projected/15f7819d-7e38-4a9e-9f65-2b79a6437c55-kube-api-access-z2xzs\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.326029 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.325943    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15f7819d-7e38-4a9e-9f65-2b79a6437c55-metrics-client-ca\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.327586 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.327561    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-grpc-tls\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.327944 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.327920    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.328397 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.328371    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.328530 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.328513    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.328586 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.328536    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-tls\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.329430 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.329399    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15f7819d-7e38-4a9e-9f65-2b79a6437c55-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.335640 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.335617    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2xzs\" (UniqueName: \"kubernetes.io/projected/15f7819d-7e38-4a9e-9f65-2b79a6437c55-kube-api-access-z2xzs\") pod \"thanos-querier-7b8998f574-7qw9l\" (UID: \"15f7819d-7e38-4a9e-9f65-2b79a6437c55\") " pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.424291 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.424242    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:52.555760 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.555736    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b8998f574-7qw9l"]
Jul 24 21:16:52.558035 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:52.558008    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f7819d_7e38_4a9e_9f65_2b79a6437c55.slice/crio-dd5991950f2f892103e07d49410fb569e0455ae5ce73dd39f6656395c97e4638 WatchSource:0}: Error finding container dd5991950f2f892103e07d49410fb569e0455ae5ce73dd39f6656395c97e4638: Status 404 returned error can't find the container with id dd5991950f2f892103e07d49410fb569e0455ae5ce73dd39f6656395c97e4638
Jul 24 21:16:52.937285 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.937198    2549 generic.go:356] "Generic (PLEG): container finished" podID="d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8" containerID="2531a8580cbf3bfb587541f3b838e4a46e34609bdb9927b4e369cd582df3f25e" exitCode=0
Jul 24 21:16:52.937465 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.937285    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wc7pw" event={"ID":"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8","Type":"ContainerDied","Data":"2531a8580cbf3bfb587541f3b838e4a46e34609bdb9927b4e369cd582df3f25e"}
Jul 24 21:16:52.938377 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:52.938353    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l" event={"ID":"15f7819d-7e38-4a9e-9f65-2b79a6437c55","Type":"ContainerStarted","Data":"dd5991950f2f892103e07d49410fb569e0455ae5ce73dd39f6656395c97e4638"}
Jul 24 21:16:53.944989 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:53.944948    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wc7pw" event={"ID":"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8","Type":"ContainerStarted","Data":"1689ebb896ff1ff6846b0a69ed0b4dfc17520e094a72692ce3283a11be9a550a"}
Jul 24 21:16:53.945418 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:53.945015    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wc7pw" event={"ID":"d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8","Type":"ContainerStarted","Data":"d92c319b684d8e4f289540232a3461324783956f21ffdcb29935bda4ce7c2ddd"}
Jul 24 21:16:53.967882 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:53.967825    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wc7pw" podStartSLOduration=3.072102137 podStartE2EDuration="3.967804244s" totalImagesPullingTime="833.8726ms" totalInitContainerRuntime="61.829507ms" isStatefulPod=true podCreationTimestamp="2026-07-24 21:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:53.966195444 +0000 UTC m=+116.149868853" watchObservedRunningTime="2026-07-24 21:16:53.967804244 +0000 UTC m=+116.151477642"
Jul 24 21:16:54.915371 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:54.915333    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"]
Jul 24 21:16:54.919703 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:54.919678    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"
Jul 24 21:16:54.922198 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:54.922170    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 24 21:16:54.922321 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:54.922214    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hf574\""
Jul 24 21:16:54.937235 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:54.937215    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"]
Jul 24 21:16:54.952029 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:54.952006    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l" event={"ID":"15f7819d-7e38-4a9e-9f65-2b79a6437c55","Type":"ContainerStarted","Data":"dac4f99398aeeb482683d53868220c853d23d0cd402ef5a9258c66989debeea2"}
Jul 24 21:16:54.952386 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:54.952066    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l" event={"ID":"15f7819d-7e38-4a9e-9f65-2b79a6437c55","Type":"ContainerStarted","Data":"7e4d8154622d079aac41401d4fdbd1e9bf6a15e7b8ef50946af8c8c04b887ae1"}
Jul 24 21:16:54.952386 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:54.952092    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l" event={"ID":"15f7819d-7e38-4a9e-9f65-2b79a6437c55","Type":"ContainerStarted","Data":"66fb6166ec8fd82a2e3a2e3eed175b37972a7cdc7a2fe45ec36d9d9969e31a98"}
Jul 24 21:16:55.046912 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.046877    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv42j\" (UniqueName: \"kubernetes.io/projected/2527c8dd-74fe-4165-afb7-ebab68962c58-kube-api-access-fv42j\") pod \"monitoring-plugin-68b7fc9574-2pprd\" (UID: \"2527c8dd-74fe-4165-afb7-ebab68962c58\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"
Jul 24 21:16:55.047125 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.047077    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2527c8dd-74fe-4165-afb7-ebab68962c58-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-2pprd\" (UID: \"2527c8dd-74fe-4165-afb7-ebab68962c58\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"
Jul 24 21:16:55.147896 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.147843    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2527c8dd-74fe-4165-afb7-ebab68962c58-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-2pprd\" (UID: \"2527c8dd-74fe-4165-afb7-ebab68962c58\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"
Jul 24 21:16:55.148063 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.147947    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv42j\" (UniqueName: \"kubernetes.io/projected/2527c8dd-74fe-4165-afb7-ebab68962c58-kube-api-access-fv42j\") pod \"monitoring-plugin-68b7fc9574-2pprd\" (UID: \"2527c8dd-74fe-4165-afb7-ebab68962c58\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"
Jul 24 21:16:55.150583 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.150553    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2527c8dd-74fe-4165-afb7-ebab68962c58-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-2pprd\" (UID: \"2527c8dd-74fe-4165-afb7-ebab68962c58\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"
Jul 24 21:16:55.157799 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.157717    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv42j\" (UniqueName: \"kubernetes.io/projected/2527c8dd-74fe-4165-afb7-ebab68962c58-kube-api-access-fv42j\") pod \"monitoring-plugin-68b7fc9574-2pprd\" (UID: \"2527c8dd-74fe-4165-afb7-ebab68962c58\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"
Jul 24 21:16:55.230806 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.230787    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"
Jul 24 21:16:55.373004 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.372967    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"]
Jul 24 21:16:55.376310 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:55.376260    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2527c8dd_74fe_4165_afb7_ebab68962c58.slice/crio-8c1c359155747f26f4212e41091b82e339651dfaed0048240b62c6b3a86275fd WatchSource:0}: Error finding container 8c1c359155747f26f4212e41091b82e339651dfaed0048240b62c6b3a86275fd: Status 404 returned error can't find the container with id 8c1c359155747f26f4212e41091b82e339651dfaed0048240b62c6b3a86275fd
Jul 24 21:16:55.741507 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.741475    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-ppdzp"]
Jul 24 21:16:55.744684 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.744669    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-ppdzp"
Jul 24 21:16:55.752847 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.752815    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 21:16:55.752847 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.752821    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zbbqj\""
Jul 24 21:16:55.752997 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.752833    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 21:16:55.781771 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.781744    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-ppdzp"]
Jul 24 21:16:55.854542 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.854503    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb25j\" (UniqueName: \"kubernetes.io/projected/ed649641-c902-48c0-bb64-6adc98969cff-kube-api-access-pb25j\") pod \"downloads-7c97dc4555-ppdzp\" (UID: \"ed649641-c902-48c0-bb64-6adc98969cff\") " pod="openshift-console/downloads-7c97dc4555-ppdzp"
Jul 24 21:16:55.955170 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.955138    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb25j\" (UniqueName: \"kubernetes.io/projected/ed649641-c902-48c0-bb64-6adc98969cff-kube-api-access-pb25j\") pod \"downloads-7c97dc4555-ppdzp\" (UID: \"ed649641-c902-48c0-bb64-6adc98969cff\") " pod="openshift-console/downloads-7c97dc4555-ppdzp"
Jul 24 21:16:55.957245 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.957213    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd" event={"ID":"2527c8dd-74fe-4165-afb7-ebab68962c58","Type":"ContainerStarted","Data":"8c1c359155747f26f4212e41091b82e339651dfaed0048240b62c6b3a86275fd"}
Jul 24 21:16:55.961219 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.961195    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l" event={"ID":"15f7819d-7e38-4a9e-9f65-2b79a6437c55","Type":"ContainerStarted","Data":"7fc3f2b74a4271b2e09f37234bed46bc89d8fa53829063e42f9dbd5f5a72b4e4"}
Jul 24 21:16:55.961342 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.961286    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l" event={"ID":"15f7819d-7e38-4a9e-9f65-2b79a6437c55","Type":"ContainerStarted","Data":"1d08395193e22e7616b5873141419021f6a44ac7ef99f68e331a9842337218b1"}
Jul 24 21:16:55.961342 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.961317    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l" event={"ID":"15f7819d-7e38-4a9e-9f65-2b79a6437c55","Type":"ContainerStarted","Data":"547be7988d515195e933e897a0d9b7d436d860d1d58bbd43695fa4f412cc7983"}
Jul 24 21:16:55.961627 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.961439    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:16:55.963705 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.963682    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb25j\" (UniqueName: \"kubernetes.io/projected/ed649641-c902-48c0-bb64-6adc98969cff-kube-api-access-pb25j\") pod \"downloads-7c97dc4555-ppdzp\" (UID: \"ed649641-c902-48c0-bb64-6adc98969cff\") " pod="openshift-console/downloads-7c97dc4555-ppdzp"
Jul 24 21:16:55.997184 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:55.997068    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l" podStartSLOduration=1.614124774 podStartE2EDuration="3.997047602s" totalImagesPullingTime="2.382922828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:55.996497025 +0000 UTC m=+118.180170421" watchObservedRunningTime="2026-07-24 21:16:55.997047602 +0000 UTC m=+118.180720998"
Jul 24 21:16:56.053983 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:56.053945    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-ppdzp"
Jul 24 21:16:56.199522 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:56.199485    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-ppdzp"]
Jul 24 21:16:56.470650 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:16:56.470608    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded649641_c902_48c0_bb64_6adc98969cff.slice/crio-4ec11be7218e95faabe1a28ede53cf96096c2eb3d77dbcfe40ad58327e808cf5 WatchSource:0}: Error finding container 4ec11be7218e95faabe1a28ede53cf96096c2eb3d77dbcfe40ad58327e808cf5: Status 404 returned error can't find the container with id 4ec11be7218e95faabe1a28ede53cf96096c2eb3d77dbcfe40ad58327e808cf5
Jul 24 21:16:56.966162 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:56.966123    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-ppdzp" event={"ID":"ed649641-c902-48c0-bb64-6adc98969cff","Type":"ContainerStarted","Data":"4ec11be7218e95faabe1a28ede53cf96096c2eb3d77dbcfe40ad58327e808cf5"}
Jul 24 21:16:56.967845 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:56.967817    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd" event={"ID":"2527c8dd-74fe-4165-afb7-ebab68962c58","Type":"ContainerStarted","Data":"8344256ca2c9cbd0910aad9d4864dbc01300e83d2780d9e295fc5885857ed25d"}
Jul 24 21:16:56.968165 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:56.968111    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"
Jul 24 21:16:56.974207 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:56.974181    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd"
Jul 24 21:16:56.988815 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:56.988771    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-2pprd" podStartSLOduration=1.850469619 podStartE2EDuration="2.988757772s" totalImagesPullingTime="1.138288153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:16:56.988095184 +0000 UTC m=+119.171768580" watchObservedRunningTime="2026-07-24 21:16:56.988757772 +0000 UTC m=+119.172431199"
Jul 24 21:16:58.873605 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:16:58.873576    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:17:01.975247 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:01.975217    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b8998f574-7qw9l"
Jul 24 21:17:04.397805 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:04.397775    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb779c6bb-cr2px"]
Jul 24 21:17:07.153623 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:07.153581    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:17:07.156304 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:07.156249    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a761ee-8038-4b88-ab1d-c6b7462a7f13-metrics-certs\") pod \"network-metrics-daemon-swh5h\" (UID: \"09a761ee-8038-4b88-ab1d-c6b7462a7f13\") " pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:17:07.317732 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:07.317704    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qdtkv\""
Jul 24 21:17:07.325508 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:07.325488    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swh5h"
Jul 24 21:17:09.048679 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.048634    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85d9645584-z7p5x"]
Jul 24 21:17:09.052314 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.052282    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.056395 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.056369    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 21:17:09.056546 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.056413    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 21:17:09.056546 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.056494    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 21:17:09.056644 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.056420    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 21:17:09.056722 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.056704    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8tr87\""
Jul 24 21:17:09.056784 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.056770    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 21:17:09.060092 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.060072    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 21:17:09.066393 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.066174    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-oauth-serving-cert\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.066393 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.066215    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-service-ca\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.066393 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.066245    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-config\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.066393 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.066300    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-655sm\" (UniqueName: \"kubernetes.io/projected/2cb5f837-227d-4004-ad9c-5ea4059a0028-kube-api-access-655sm\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.066393 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.066360    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-serving-cert\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.066393 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.066385    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-oauth-config\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.066748 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.066416    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-trusted-ca-bundle\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.066748 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.066575    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d9645584-z7p5x"]
Jul 24 21:17:09.167205 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.167165    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-655sm\" (UniqueName: \"kubernetes.io/projected/2cb5f837-227d-4004-ad9c-5ea4059a0028-kube-api-access-655sm\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.167390 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.167243    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-serving-cert\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.167390 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.167296    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-oauth-config\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.167390 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.167337    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-trusted-ca-bundle\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.167390 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.167366    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-oauth-serving-cert\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.167390 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.167386    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-service-ca\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.167634 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.167418    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-config\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.168339 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.168313    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-trusted-ca-bundle\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.168456 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.168378    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-config\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.168456 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.168386    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-service-ca\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.168570 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.168466    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-oauth-serving-cert\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.170240 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.170218    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-serving-cert\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.170414 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.170395    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-oauth-config\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.176624 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.176591    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-655sm\" (UniqueName: \"kubernetes.io/projected/2cb5f837-227d-4004-ad9c-5ea4059a0028-kube-api-access-655sm\") pod \"console-85d9645584-z7p5x\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") " pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:09.363875 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:09.363789    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:12.872730 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:12.872711    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d9645584-z7p5x"]
Jul 24 21:17:12.889101 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:12.889054    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-swh5h"]
Jul 24 21:17:12.976011 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:17:12.975971    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb5f837_227d_4004_ad9c_5ea4059a0028.slice/crio-b5d5b9cdc8bc6316eaa10b9c6b9d1cd2414a0f790d2859923acd44bbd730fa4f WatchSource:0}: Error finding container b5d5b9cdc8bc6316eaa10b9c6b9d1cd2414a0f790d2859923acd44bbd730fa4f: Status 404 returned error can't find the container with id b5d5b9cdc8bc6316eaa10b9c6b9d1cd2414a0f790d2859923acd44bbd730fa4f
Jul 24 21:17:12.977023 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:17:12.976992    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a761ee_8038_4b88_ab1d_c6b7462a7f13.slice/crio-c1137f3868b005bb7ac995792e596b05d9d89ee6c7c691535df08f866836d24b WatchSource:0}: Error finding container c1137f3868b005bb7ac995792e596b05d9d89ee6c7c691535df08f866836d24b: Status 404 returned error can't find the container with id c1137f3868b005bb7ac995792e596b05d9d89ee6c7c691535df08f866836d24b
Jul 24 21:17:13.030474 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:13.030449    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d9645584-z7p5x" event={"ID":"2cb5f837-227d-4004-ad9c-5ea4059a0028","Type":"ContainerStarted","Data":"b5d5b9cdc8bc6316eaa10b9c6b9d1cd2414a0f790d2859923acd44bbd730fa4f"}
Jul 24 21:17:13.031631 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:13.031604    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-swh5h" event={"ID":"09a761ee-8038-4b88-ab1d-c6b7462a7f13","Type":"ContainerStarted","Data":"c1137f3868b005bb7ac995792e596b05d9d89ee6c7c691535df08f866836d24b"}
Jul 24 21:17:14.040577 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:14.040524    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-ppdzp" event={"ID":"ed649641-c902-48c0-bb64-6adc98969cff","Type":"ContainerStarted","Data":"3a5f03b6b25f41b6d5847d7ca7fa2663e6fc8cf82f800207c472de1a0efa6e69"}
Jul 24 21:17:14.043366 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:14.043339    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-ppdzp"
Jul 24 21:17:14.053255 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:14.053205    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-ppdzp"
Jul 24 21:17:14.064498 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:14.064441    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-ppdzp" podStartSLOduration=2.505402089 podStartE2EDuration="19.064425712s" totalImagesPullingTime="16.559023623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:17:14.062068992 +0000 UTC m=+136.245742387" watchObservedRunningTime="2026-07-24 21:17:14.064425712 +0000 UTC m=+136.248099109"
Jul 24 21:17:15.049377 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:15.048811    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-swh5h" event={"ID":"09a761ee-8038-4b88-ab1d-c6b7462a7f13","Type":"ContainerStarted","Data":"2172675f2e083dceb7b0a1fec24fa773ad661387e49165bc05616047cdf483d2"}
Jul 24 21:17:15.049377 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:15.048890    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-swh5h" event={"ID":"09a761ee-8038-4b88-ab1d-c6b7462a7f13","Type":"ContainerStarted","Data":"bdcbe0667d40bfce0c1f4aa6d7f70d1a71d7c742356f9f53382ae1f812524320"}
Jul 24 21:17:18.064189 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:18.064145    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d9645584-z7p5x" event={"ID":"2cb5f837-227d-4004-ad9c-5ea4059a0028","Type":"ContainerStarted","Data":"68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5"}
Jul 24 21:17:18.084430 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:18.084375    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-swh5h" podStartSLOduration=138.59931042 podStartE2EDuration="2m20.084354849s" totalImagesPullingTime="1.485044429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:17:15.065776184 +0000 UTC m=+137.249449590" watchObservedRunningTime="2026-07-24 21:17:18.084354849 +0000 UTC m=+140.268028246"
Jul 24 21:17:18.084655 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:18.084624    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85d9645584-z7p5x" podStartSLOduration=4.903409076 podStartE2EDuration="9.084614749s" totalImagesPullingTime="4.181205673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:17:18.083061793 +0000 UTC m=+140.266735191" watchObservedRunningTime="2026-07-24 21:17:18.084614749 +0000 UTC m=+140.268288144"
Jul 24 21:17:19.364288 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:19.364225    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:19.364769 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:19.364304    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:19.370345 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:19.370286    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:20.077307 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:20.077256    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:17:29.420810 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.420749    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px" podUID="48ca2954-8014-4947-b7d7-f2863879ced7" containerName="registry" containerID="cri-o://38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d" gracePeriod=30
Jul 24 21:17:29.707588 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.707560    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:17:29.746088 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.746057    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjv85\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-kube-api-access-mjv85\") pod \"48ca2954-8014-4947-b7d7-f2863879ced7\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") "
Jul 24 21:17:29.746281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.746095    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48ca2954-8014-4947-b7d7-f2863879ced7-installation-pull-secrets\") pod \"48ca2954-8014-4947-b7d7-f2863879ced7\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") "
Jul 24 21:17:29.746281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.746119    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48ca2954-8014-4947-b7d7-f2863879ced7-registry-certificates\") pod \"48ca2954-8014-4947-b7d7-f2863879ced7\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") "
Jul 24 21:17:29.746281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.746137    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-bound-sa-token\") pod \"48ca2954-8014-4947-b7d7-f2863879ced7\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") "
Jul 24 21:17:29.746463 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.746296    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48ca2954-8014-4947-b7d7-f2863879ced7-ca-trust-extracted\") pod \"48ca2954-8014-4947-b7d7-f2863879ced7\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") "
Jul 24 21:17:29.746463 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.746346    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls\") pod \"48ca2954-8014-4947-b7d7-f2863879ced7\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") "
Jul 24 21:17:29.746463 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.746368    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48ca2954-8014-4947-b7d7-f2863879ced7-trusted-ca\") pod \"48ca2954-8014-4947-b7d7-f2863879ced7\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") "
Jul 24 21:17:29.746463 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.746445    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48ca2954-8014-4947-b7d7-f2863879ced7-image-registry-private-configuration\") pod \"48ca2954-8014-4947-b7d7-f2863879ced7\" (UID: \"48ca2954-8014-4947-b7d7-f2863879ced7\") "
Jul 24 21:17:29.746664 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.746613    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48ca2954-8014-4947-b7d7-f2863879ced7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "48ca2954-8014-4947-b7d7-f2863879ced7" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:17:29.746852 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.746808    2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48ca2954-8014-4947-b7d7-f2863879ced7-registry-certificates\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:17:29.746852 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.746863    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48ca2954-8014-4947-b7d7-f2863879ced7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "48ca2954-8014-4947-b7d7-f2863879ced7" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:17:29.748852 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.748769    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "48ca2954-8014-4947-b7d7-f2863879ced7" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:17:29.748852 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.748794    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ca2954-8014-4947-b7d7-f2863879ced7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "48ca2954-8014-4947-b7d7-f2863879ced7" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:17:29.749016 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.748977    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "48ca2954-8014-4947-b7d7-f2863879ced7" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:17:29.749117 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.749085    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-kube-api-access-mjv85" (OuterVolumeSpecName: "kube-api-access-mjv85") pod "48ca2954-8014-4947-b7d7-f2863879ced7" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7"). InnerVolumeSpecName "kube-api-access-mjv85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:17:29.749211 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.749143    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ca2954-8014-4947-b7d7-f2863879ced7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "48ca2954-8014-4947-b7d7-f2863879ced7" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:17:29.755007 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.754968    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48ca2954-8014-4947-b7d7-f2863879ced7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "48ca2954-8014-4947-b7d7-f2863879ced7" (UID: "48ca2954-8014-4947-b7d7-f2863879ced7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:17:29.847937 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.847902    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjv85\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-kube-api-access-mjv85\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:17:29.847937 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.847930    2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48ca2954-8014-4947-b7d7-f2863879ced7-installation-pull-secrets\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:17:29.847937 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.847939    2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-bound-sa-token\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:17:29.848172 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.847951    2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48ca2954-8014-4947-b7d7-f2863879ced7-ca-trust-extracted\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:17:29.848172 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.847975    2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48ca2954-8014-4947-b7d7-f2863879ced7-registry-tls\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:17:29.848172 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.847987    2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48ca2954-8014-4947-b7d7-f2863879ced7-trusted-ca\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:17:29.848172 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:29.847997    2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48ca2954-8014-4947-b7d7-f2863879ced7-image-registry-private-configuration\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:17:30.116165 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:30.116127    2549 generic.go:356] "Generic (PLEG): container finished" podID="48ca2954-8014-4947-b7d7-f2863879ced7" containerID="38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d" exitCode=0
Jul 24 21:17:30.116165 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:30.116169    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px" event={"ID":"48ca2954-8014-4947-b7d7-f2863879ced7","Type":"ContainerDied","Data":"38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d"}
Jul 24 21:17:30.116442 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:30.116178    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px"
Jul 24 21:17:30.116442 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:30.116218    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb779c6bb-cr2px" event={"ID":"48ca2954-8014-4947-b7d7-f2863879ced7","Type":"ContainerDied","Data":"2c97d52e274ba30715ddd78e2b7442aa1ef7b411880efac54e8228408e34f282"}
Jul 24 21:17:30.116442 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:30.116244    2549 scope.go:117] "RemoveContainer" containerID="38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d"
Jul 24 21:17:30.124848 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:30.124830    2549 scope.go:117] "RemoveContainer" containerID="38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d"
Jul 24 21:17:30.125106 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:17:30.125087    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d\": container with ID starting with 38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d not found: ID does not exist" containerID="38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d"
Jul 24 21:17:30.125159 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:30.125116    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d"} err="failed to get container status \"38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d\": rpc error: code = NotFound desc = could not find container \"38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d\": container with ID starting with 38df1132d7a434eb754c054319dd016aefa80a4aa224ae2ce4a52f5de8c4046d not found: ID does not exist"
Jul 24 21:17:30.136199 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:30.136174    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb779c6bb-cr2px"]
Jul 24 21:17:30.140089 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:30.140070    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cb779c6bb-cr2px"]
Jul 24 21:17:30.408005 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:17:30.407926    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48ca2954-8014-4947-b7d7-f2863879ced7" path="/var/lib/kubelet/pods/48ca2954-8014-4947-b7d7-f2863879ced7/volumes"
Jul 24 21:18:12.700411 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.700372    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 21:18:12.700871 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.700713    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ca2954-8014-4947-b7d7-f2863879ced7" containerName="registry"
Jul 24 21:18:12.700871 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.700729    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ca2954-8014-4947-b7d7-f2863879ced7" containerName="registry"
Jul 24 21:18:12.700871 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.700790    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ca2954-8014-4947-b7d7-f2863879ced7" containerName="registry"
Jul 24 21:18:12.709592 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.709561    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.711962 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.711940    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2fgzg\""
Jul 24 21:18:12.712225 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.712206    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 21:18:12.712333 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.712247    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 21:18:12.712520 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.712504    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 21:18:12.712616 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.712514    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 21:18:12.712616 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.712541    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 21:18:12.712616 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.712504    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 21:18:12.712616 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.712504    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 21:18:12.712811 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.712798    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 21:18:12.717053 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.717024    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 21:18:12.717289 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.717251    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 21:18:12.872087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872046    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.872087 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872092    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.872333 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872109    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.872333 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872133    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-config-volume\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.872333 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872148    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-web-config\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.872333 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872164    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/43593b9e-5dc8-4560-a590-6813ddedefaa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.872333 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872180    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43593b9e-5dc8-4560-a590-6813ddedefaa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.872333 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872204    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.872333 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872226    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43593b9e-5dc8-4560-a590-6813ddedefaa-config-out\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.872333 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872299    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43593b9e-5dc8-4560-a590-6813ddedefaa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.872586 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872341    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnvzd\" (UniqueName: \"kubernetes.io/projected/43593b9e-5dc8-4560-a590-6813ddedefaa-kube-api-access-bnvzd\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.872586 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872384    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.872586 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.872413    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43593b9e-5dc8-4560-a590-6813ddedefaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.972898 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.972815    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-config-volume\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.972898 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.972854    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-web-config\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.972898 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.972877    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/43593b9e-5dc8-4560-a590-6813ddedefaa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.973151 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.972904    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43593b9e-5dc8-4560-a590-6813ddedefaa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.973151 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.972939    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.973151 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.972963    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43593b9e-5dc8-4560-a590-6813ddedefaa-config-out\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.973151 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.972988    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43593b9e-5dc8-4560-a590-6813ddedefaa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.973151 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.973054    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnvzd\" (UniqueName: \"kubernetes.io/projected/43593b9e-5dc8-4560-a590-6813ddedefaa-kube-api-access-bnvzd\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.973151 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.973104    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.973151 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.973135    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43593b9e-5dc8-4560-a590-6813ddedefaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.973522 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.973199    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.973522 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.973231    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.973522 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.973257    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.973522 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.973381    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/43593b9e-5dc8-4560-a590-6813ddedefaa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.973893 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.973844    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43593b9e-5dc8-4560-a590-6813ddedefaa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.974410 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.974384    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43593b9e-5dc8-4560-a590-6813ddedefaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.976649 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.976469    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.976649 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.976537    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-config-volume\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.976649 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.976565    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-web-config\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.976869 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.976706    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.976869 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.976716    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43593b9e-5dc8-4560-a590-6813ddedefaa-config-out\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.976995 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.976980    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.977097 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.977079    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43593b9e-5dc8-4560-a590-6813ddedefaa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.977168 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.977150    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.978926 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.978909    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/43593b9e-5dc8-4560-a590-6813ddedefaa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:12.981069 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:12.981053    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnvzd\" (UniqueName: \"kubernetes.io/projected/43593b9e-5dc8-4560-a590-6813ddedefaa-kube-api-access-bnvzd\") pod \"alertmanager-main-0\" (UID: \"43593b9e-5dc8-4560-a590-6813ddedefaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:13.020631 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:13.020591    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 21:18:13.161929 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:13.161894    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 21:18:13.164798 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:18:13.164770    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43593b9e_5dc8_4560_a590_6813ddedefaa.slice/crio-ca9edd37e6a241c0690cad2280d77d56d1754e44a2151de934496859d507f6c9 WatchSource:0}: Error finding container ca9edd37e6a241c0690cad2280d77d56d1754e44a2151de934496859d507f6c9: Status 404 returned error can't find the container with id ca9edd37e6a241c0690cad2280d77d56d1754e44a2151de934496859d507f6c9
Jul 24 21:18:13.279052 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:13.279018    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43593b9e-5dc8-4560-a590-6813ddedefaa","Type":"ContainerStarted","Data":"ca9edd37e6a241c0690cad2280d77d56d1754e44a2151de934496859d507f6c9"}
Jul 24 21:18:15.289737 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:15.289700    2549 generic.go:356] "Generic (PLEG): container finished" podID="43593b9e-5dc8-4560-a590-6813ddedefaa" containerID="c2e2160826d9bc40826daf6d58567b7a9d4b77a601f93db5e684d89dba586494" exitCode=0
Jul 24 21:18:15.290140 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:15.289767    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43593b9e-5dc8-4560-a590-6813ddedefaa","Type":"ContainerDied","Data":"c2e2160826d9bc40826daf6d58567b7a9d4b77a601f93db5e684d89dba586494"}
Jul 24 21:18:17.300282 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:17.300234    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43593b9e-5dc8-4560-a590-6813ddedefaa","Type":"ContainerStarted","Data":"f35fd9c51fc556aeae8bee80d35dc7b6bc073994334178a2d1e8a4aca73d05db"}
Jul 24 21:18:17.300703 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:17.300313    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43593b9e-5dc8-4560-a590-6813ddedefaa","Type":"ContainerStarted","Data":"22ac8e7b92348d5b71ac1e10dcf265b4195b2fdb270855138b6f716c519762f2"}
Jul 24 21:18:17.300703 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:17.300357    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43593b9e-5dc8-4560-a590-6813ddedefaa","Type":"ContainerStarted","Data":"0d03ab14d585d88125eabd96276ae06669956289e451a7b881f79931463d35d3"}
Jul 24 21:18:17.300703 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:17.300386    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43593b9e-5dc8-4560-a590-6813ddedefaa","Type":"ContainerStarted","Data":"a6b5e77bb7930a14560a1d872cb60fd16fda0836de7cc5472e6b6edd3d9dc066"}
Jul 24 21:18:17.300703 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:17.300412    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43593b9e-5dc8-4560-a590-6813ddedefaa","Type":"ContainerStarted","Data":"92217036394e9a22d36eadcad8d2174cf24e453d218769264f7b308e3cb07e5f"}
Jul 24 21:18:17.300703 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:17.300451    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"43593b9e-5dc8-4560-a590-6813ddedefaa","Type":"ContainerStarted","Data":"6cd662384b6db7edce3e6872e440905b472786b0672855c77dc8816f974a6361"}
Jul 24 21:18:17.326818 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:17.326757    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.802652231 podStartE2EDuration="5.326740626s" totalImagesPullingTime="2.507944835s" totalInitContainerRuntime="16.14356ms" isStatefulPod=false podCreationTimestamp="2026-07-24 21:18:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:18:17.325088235 +0000 UTC m=+199.508761631" watchObservedRunningTime="2026-07-24 21:18:17.326740626 +0000 UTC m=+199.510414020"
Jul 24 21:18:30.812146 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:30.812117    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85d9645584-z7p5x"]
Jul 24 21:18:55.832314 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:55.832230    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85d9645584-z7p5x" podUID="2cb5f837-227d-4004-ad9c-5ea4059a0028" containerName="console" containerID="cri-o://68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5" gracePeriod=15
Jul 24 21:18:56.073618 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.073590    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:18:56.179672 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.179573    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-655sm\" (UniqueName: \"kubernetes.io/projected/2cb5f837-227d-4004-ad9c-5ea4059a0028-kube-api-access-655sm\") pod \"2cb5f837-227d-4004-ad9c-5ea4059a0028\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") "
Jul 24 21:18:56.179672 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.179614    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-trusted-ca-bundle\") pod \"2cb5f837-227d-4004-ad9c-5ea4059a0028\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") "
Jul 24 21:18:56.179672 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.179654    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-oauth-serving-cert\") pod \"2cb5f837-227d-4004-ad9c-5ea4059a0028\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") "
Jul 24 21:18:56.179672 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.179670    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-config\") pod \"2cb5f837-227d-4004-ad9c-5ea4059a0028\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") "
Jul 24 21:18:56.179989 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.179699    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-service-ca\") pod \"2cb5f837-227d-4004-ad9c-5ea4059a0028\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") "
Jul 24 21:18:56.179989 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.179727    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-oauth-config\") pod \"2cb5f837-227d-4004-ad9c-5ea4059a0028\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") "
Jul 24 21:18:56.179989 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.179749    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-serving-cert\") pod \"2cb5f837-227d-4004-ad9c-5ea4059a0028\" (UID: \"2cb5f837-227d-4004-ad9c-5ea4059a0028\") "
Jul 24 21:18:56.180213 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.180180    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-service-ca" (OuterVolumeSpecName: "service-ca") pod "2cb5f837-227d-4004-ad9c-5ea4059a0028" (UID: "2cb5f837-227d-4004-ad9c-5ea4059a0028"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:18:56.180299 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.180193    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-config" (OuterVolumeSpecName: "console-config") pod "2cb5f837-227d-4004-ad9c-5ea4059a0028" (UID: "2cb5f837-227d-4004-ad9c-5ea4059a0028"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:18:56.180299 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.180207    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2cb5f837-227d-4004-ad9c-5ea4059a0028" (UID: "2cb5f837-227d-4004-ad9c-5ea4059a0028"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:18:56.180299 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.180211    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2cb5f837-227d-4004-ad9c-5ea4059a0028" (UID: "2cb5f837-227d-4004-ad9c-5ea4059a0028"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:18:56.182100 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.182078    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2cb5f837-227d-4004-ad9c-5ea4059a0028" (UID: "2cb5f837-227d-4004-ad9c-5ea4059a0028"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:18:56.182100 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.182089    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cb5f837-227d-4004-ad9c-5ea4059a0028-kube-api-access-655sm" (OuterVolumeSpecName: "kube-api-access-655sm") pod "2cb5f837-227d-4004-ad9c-5ea4059a0028" (UID: "2cb5f837-227d-4004-ad9c-5ea4059a0028"). InnerVolumeSpecName "kube-api-access-655sm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:18:56.182100 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.182095    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2cb5f837-227d-4004-ad9c-5ea4059a0028" (UID: "2cb5f837-227d-4004-ad9c-5ea4059a0028"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:18:56.280569 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.280515    2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-oauth-serving-cert\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:18:56.280569 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.280562    2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-config\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:18:56.280569 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.280577    2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-service-ca\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:18:56.280823 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.280588    2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-oauth-config\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:18:56.280823 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.280602    2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb5f837-227d-4004-ad9c-5ea4059a0028-console-serving-cert\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:18:56.280823 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.280615    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-655sm\" (UniqueName: \"kubernetes.io/projected/2cb5f837-227d-4004-ad9c-5ea4059a0028-kube-api-access-655sm\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:18:56.280823 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.280628    2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb5f837-227d-4004-ad9c-5ea4059a0028-trusted-ca-bundle\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:18:56.445750 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.445676    2549 generic.go:356] "Generic (PLEG): container finished" podID="2cb5f837-227d-4004-ad9c-5ea4059a0028" containerID="68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5" exitCode=0
Jul 24 21:18:56.445750 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.445725    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d9645584-z7p5x"
Jul 24 21:18:56.445916 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.445723    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d9645584-z7p5x" event={"ID":"2cb5f837-227d-4004-ad9c-5ea4059a0028","Type":"ContainerDied","Data":"68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5"}
Jul 24 21:18:56.445916 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.445837    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d9645584-z7p5x" event={"ID":"2cb5f837-227d-4004-ad9c-5ea4059a0028","Type":"ContainerDied","Data":"b5d5b9cdc8bc6316eaa10b9c6b9d1cd2414a0f790d2859923acd44bbd730fa4f"}
Jul 24 21:18:56.445916 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.445858    2549 scope.go:117] "RemoveContainer" containerID="68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5"
Jul 24 21:18:56.456508 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.456483    2549 scope.go:117] "RemoveContainer" containerID="68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5"
Jul 24 21:18:56.456786 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:18:56.456770    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5\": container with ID starting with 68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5 not found: ID does not exist" containerID="68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5"
Jul 24 21:18:56.456873 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.456796    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5"} err="failed to get container status \"68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5\": rpc error: code = NotFound desc = could not find container \"68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5\": container with ID starting with 68cb34ce03987fd3d06d882afe7bc54ed9d73c2b77e3c4c921f1907f8ab4fec5 not found: ID does not exist"
Jul 24 21:18:56.460758 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.460736    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85d9645584-z7p5x"]
Jul 24 21:18:56.464664 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:56.464645    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85d9645584-z7p5x"]
Jul 24 21:18:58.407555 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:18:58.407521    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cb5f837-227d-4004-ad9c-5ea4059a0028" path="/var/lib/kubelet/pods/2cb5f837-227d-4004-ad9c-5ea4059a0028/volumes"
Jul 24 21:19:55.764300 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.764257    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-566cc9cd9c-tlc9v"]
Jul 24 21:19:55.764812 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.764604    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb5f837-227d-4004-ad9c-5ea4059a0028" containerName="console"
Jul 24 21:19:55.764812 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.764616    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb5f837-227d-4004-ad9c-5ea4059a0028" containerName="console"
Jul 24 21:19:55.764812 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.764678    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cb5f837-227d-4004-ad9c-5ea4059a0028" containerName="console"
Jul 24 21:19:55.767621 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.767602    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.770880 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.770731    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 21:19:55.774772 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.774750    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 21:19:55.776288 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.776251    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8tr87\""
Jul 24 21:19:55.776392 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.776295    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 21:19:55.776392 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.776313    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 21:19:55.776392 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.776348    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 21:19:55.793900 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.793865    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566cc9cd9c-tlc9v"]
Jul 24 21:19:55.808426 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.808402    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 21:19:55.830163 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.830138    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-console-config\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.830258 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.830178    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-service-ca\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.830258 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.830219    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldsxz\" (UniqueName: \"kubernetes.io/projected/bd22ae13-c360-48b8-b69c-f909a42760d3-kube-api-access-ldsxz\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.830258 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.830243    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-trusted-ca-bundle\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.830377 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.830260    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-oauth-serving-cert\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.830377 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.830366    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd22ae13-c360-48b8-b69c-f909a42760d3-console-serving-cert\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.830442 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.830389    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd22ae13-c360-48b8-b69c-f909a42760d3-console-oauth-config\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.931542 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.931511    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-trusted-ca-bundle\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.931542 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.931544    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-oauth-serving-cert\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.931765 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.931573    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd22ae13-c360-48b8-b69c-f909a42760d3-console-serving-cert\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.931765 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.931591    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd22ae13-c360-48b8-b69c-f909a42760d3-console-oauth-config\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.931765 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.931628    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-console-config\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.931765 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.931665    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-service-ca\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.931949 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.931780    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldsxz\" (UniqueName: \"kubernetes.io/projected/bd22ae13-c360-48b8-b69c-f909a42760d3-kube-api-access-ldsxz\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.932428 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.932403    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-console-config\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.932533 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.932405    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-oauth-serving-cert\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.932740 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.932716    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-service-ca\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.932777 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.932751    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-trusted-ca-bundle\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.934283 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.934245    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd22ae13-c360-48b8-b69c-f909a42760d3-console-oauth-config\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.934371 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.934321    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd22ae13-c360-48b8-b69c-f909a42760d3-console-serving-cert\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:55.940416 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:55.940396    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldsxz\" (UniqueName: \"kubernetes.io/projected/bd22ae13-c360-48b8-b69c-f909a42760d3-kube-api-access-ldsxz\") pod \"console-566cc9cd9c-tlc9v\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") " pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:56.078323 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:56.078248    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:19:56.207090 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:56.207060    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566cc9cd9c-tlc9v"]
Jul 24 21:19:56.209447 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:19:56.209417    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd22ae13_c360_48b8_b69c_f909a42760d3.slice/crio-5a56edd791f12e99fb631a0d829c76497484df4154a6f4a7a02de99734af5135 WatchSource:0}: Error finding container 5a56edd791f12e99fb631a0d829c76497484df4154a6f4a7a02de99734af5135: Status 404 returned error can't find the container with id 5a56edd791f12e99fb631a0d829c76497484df4154a6f4a7a02de99734af5135
Jul 24 21:19:56.662900 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:56.662860    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566cc9cd9c-tlc9v" event={"ID":"bd22ae13-c360-48b8-b69c-f909a42760d3","Type":"ContainerStarted","Data":"c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d"}
Jul 24 21:19:56.663076 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:56.662911    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566cc9cd9c-tlc9v" event={"ID":"bd22ae13-c360-48b8-b69c-f909a42760d3","Type":"ContainerStarted","Data":"5a56edd791f12e99fb631a0d829c76497484df4154a6f4a7a02de99734af5135"}
Jul 24 21:19:56.680803 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:56.680755    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-566cc9cd9c-tlc9v" podStartSLOduration=1.680736885 podStartE2EDuration="1.680736885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:19:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:19:56.680356798 +0000 UTC m=+298.864030193" watchObservedRunningTime="2026-07-24 21:19:56.680736885 +0000 UTC m=+298.864410281"
Jul 24 21:19:58.243136 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:19:58.243106    2549 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 21:20:06.078625 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:06.078591    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:20:06.081102 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:06.078649    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:20:06.083037 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:06.083023    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:20:06.702930 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:06.702901    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:20:23.734787 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.734748    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w"]
Jul 24 21:20:23.737886 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.737869    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w"
Jul 24 21:20:23.740977 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.740941    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 21:20:23.740977 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.740941    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 21:20:23.741163 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.740983    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 21:20:23.741163 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.740941    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 24 21:20:23.741163 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.740991    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nwljg\""
Jul 24 21:20:23.747624 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.747602    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w"]
Jul 24 21:20:23.825322 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.825290    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"]
Jul 24 21:20:23.828673 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.828656    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:23.828857 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.828823    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19fdbb03-f1b4-4530-90c6-1d1b9bf5a340-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w\" (UID: \"19fdbb03-f1b4-4530-90c6-1d1b9bf5a340\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w"
Jul 24 21:20:23.828973 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.828890    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dj8f\" (UniqueName: \"kubernetes.io/projected/19fdbb03-f1b4-4530-90c6-1d1b9bf5a340-kube-api-access-7dj8f\") pod \"managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w\" (UID: \"19fdbb03-f1b4-4530-90c6-1d1b9bf5a340\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w"
Jul 24 21:20:23.831007 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.830981    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 24 21:20:23.831007 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.830999    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 24 21:20:23.831146 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.831042    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 24 21:20:23.831146 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.831084    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 24 21:20:23.838390 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.838369    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"]
Jul 24 21:20:23.929950 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.929916    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19fdbb03-f1b4-4530-90c6-1d1b9bf5a340-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w\" (UID: \"19fdbb03-f1b4-4530-90c6-1d1b9bf5a340\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w"
Jul 24 21:20:23.929950 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.929956    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2853a9d9-3bb9-4177-b928-9d26fb163bf5-hub\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:23.930207 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.929979    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpfkl\" (UniqueName: \"kubernetes.io/projected/2853a9d9-3bb9-4177-b928-9d26fb163bf5-kube-api-access-lpfkl\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:23.930207 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.929999    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2853a9d9-3bb9-4177-b928-9d26fb163bf5-ca\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:23.930207 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.930063    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dj8f\" (UniqueName: \"kubernetes.io/projected/19fdbb03-f1b4-4530-90c6-1d1b9bf5a340-kube-api-access-7dj8f\") pod \"managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w\" (UID: \"19fdbb03-f1b4-4530-90c6-1d1b9bf5a340\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w"
Jul 24 21:20:23.930207 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.930113    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2853a9d9-3bb9-4177-b928-9d26fb163bf5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:23.930207 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.930142    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2853a9d9-3bb9-4177-b928-9d26fb163bf5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:23.930207 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.930164    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2853a9d9-3bb9-4177-b928-9d26fb163bf5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:23.932619 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.932602    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19fdbb03-f1b4-4530-90c6-1d1b9bf5a340-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w\" (UID: \"19fdbb03-f1b4-4530-90c6-1d1b9bf5a340\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w"
Jul 24 21:20:23.938902 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:23.938879    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dj8f\" (UniqueName: \"kubernetes.io/projected/19fdbb03-f1b4-4530-90c6-1d1b9bf5a340-kube-api-access-7dj8f\") pod \"managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w\" (UID: \"19fdbb03-f1b4-4530-90c6-1d1b9bf5a340\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w"
Jul 24 21:20:24.031317 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.031246    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2853a9d9-3bb9-4177-b928-9d26fb163bf5-ca\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.031538 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.031356    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2853a9d9-3bb9-4177-b928-9d26fb163bf5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.031538 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.031386    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2853a9d9-3bb9-4177-b928-9d26fb163bf5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.031538 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.031404    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2853a9d9-3bb9-4177-b928-9d26fb163bf5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.031538 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.031429    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2853a9d9-3bb9-4177-b928-9d26fb163bf5-hub\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.031538 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.031444    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpfkl\" (UniqueName: \"kubernetes.io/projected/2853a9d9-3bb9-4177-b928-9d26fb163bf5-kube-api-access-lpfkl\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.032458 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.032425    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2853a9d9-3bb9-4177-b928-9d26fb163bf5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.033984 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.033957    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2853a9d9-3bb9-4177-b928-9d26fb163bf5-ca\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.034118 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.034103    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2853a9d9-3bb9-4177-b928-9d26fb163bf5-hub\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.034159 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.034125    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2853a9d9-3bb9-4177-b928-9d26fb163bf5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.034290 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.034252    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2853a9d9-3bb9-4177-b928-9d26fb163bf5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.040042 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.040025    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpfkl\" (UniqueName: \"kubernetes.io/projected/2853a9d9-3bb9-4177-b928-9d26fb163bf5-kube-api-access-lpfkl\") pod \"cluster-proxy-proxy-agent-d8f4c9d8d-9lc64\" (UID: \"2853a9d9-3bb9-4177-b928-9d26fb163bf5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.060022 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.059998    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w"
Jul 24 21:20:24.137427 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.137390    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"
Jul 24 21:20:24.187305 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.187250    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w"]
Jul 24 21:20:24.190971 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:20:24.190935    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19fdbb03_f1b4_4530_90c6_1d1b9bf5a340.slice/crio-30d6e8ddae0070ae6788d3967b9c3ea4d6f3e397d894de3271cf7fc585f9f7f3 WatchSource:0}: Error finding container 30d6e8ddae0070ae6788d3967b9c3ea4d6f3e397d894de3271cf7fc585f9f7f3: Status 404 returned error can't find the container with id 30d6e8ddae0070ae6788d3967b9c3ea4d6f3e397d894de3271cf7fc585f9f7f3
Jul 24 21:20:24.192863 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.192843    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 21:20:24.274565 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.274505    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64"]
Jul 24 21:20:24.276899 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:20:24.276874    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2853a9d9_3bb9_4177_b928_9d26fb163bf5.slice/crio-5fba72bced7b30584f4f3c8ec511c465474d24afb61afe71dff17189ad954f11 WatchSource:0}: Error finding container 5fba72bced7b30584f4f3c8ec511c465474d24afb61afe71dff17189ad954f11: Status 404 returned error can't find the container with id 5fba72bced7b30584f4f3c8ec511c465474d24afb61afe71dff17189ad954f11
Jul 24 21:20:24.768991 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.768955    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w" event={"ID":"19fdbb03-f1b4-4530-90c6-1d1b9bf5a340","Type":"ContainerStarted","Data":"30d6e8ddae0070ae6788d3967b9c3ea4d6f3e397d894de3271cf7fc585f9f7f3"}
Jul 24 21:20:24.770064 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:24.770042    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64" event={"ID":"2853a9d9-3bb9-4177-b928-9d26fb163bf5","Type":"ContainerStarted","Data":"5fba72bced7b30584f4f3c8ec511c465474d24afb61afe71dff17189ad954f11"}
Jul 24 21:20:27.788768 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:27.788727    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w" event={"ID":"19fdbb03-f1b4-4530-90c6-1d1b9bf5a340","Type":"ContainerStarted","Data":"8046bcfe53e37b73a25ddf2dfc035ec29c8929d2f5591165201b7ead1e82b545"}
Jul 24 21:20:27.808351 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:27.808289    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-856cdbbcbb-f4q7w" podStartSLOduration=1.763248025 podStartE2EDuration="4.808251251s" totalImagesPullingTime="3.045003226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:20:27.807141706 +0000 UTC m=+329.990815101" watchObservedRunningTime="2026-07-24 21:20:27.808251251 +0000 UTC m=+329.991924646"
Jul 24 21:20:28.796375 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:28.796255    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64" event={"ID":"2853a9d9-3bb9-4177-b928-9d26fb163bf5","Type":"ContainerStarted","Data":"7a1c3f066fb8dc3cdcb61d9daac949b7c4c04131cac8438ecc6ee45793052968"}
Jul 24 21:20:28.796375 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:28.796329    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64" event={"ID":"2853a9d9-3bb9-4177-b928-9d26fb163bf5","Type":"ContainerStarted","Data":"18bae98fbaaabd097b962405cc5d5e26ee67f9b916d97ed71a6172d613e8e861"}
Jul 24 21:20:28.796375 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:28.796343    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64" event={"ID":"2853a9d9-3bb9-4177-b928-9d26fb163bf5","Type":"ContainerStarted","Data":"9e9f37b8d20c03ce29b2c02d782fe5ae16b65e4318b572f54acdd83158be6cc5"}
Jul 24 21:20:28.815558 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:20:28.815504    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8f4c9d8d-9lc64" podStartSLOduration=1.559129524 podStartE2EDuration="5.815490468s" totalImagesPullingTime="4.256360944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:20:28.814688358 +0000 UTC m=+330.998361753" watchObservedRunningTime="2026-07-24 21:20:28.815490468 +0000 UTC m=+330.999163862"
Jul 24 21:23:33.011003 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:33.010958    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566cc9cd9c-tlc9v"]
Jul 24 21:23:58.030837 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.030796    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-566cc9cd9c-tlc9v" podUID="bd22ae13-c360-48b8-b69c-f909a42760d3" containerName="console" containerID="cri-o://c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d" gracePeriod=15
Jul 24 21:23:58.269494 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.269467    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:23:58.351578 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.351505    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-service-ca\") pod \"bd22ae13-c360-48b8-b69c-f909a42760d3\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") "
Jul 24 21:23:58.351578 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.351543    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd22ae13-c360-48b8-b69c-f909a42760d3-console-serving-cert\") pod \"bd22ae13-c360-48b8-b69c-f909a42760d3\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") "
Jul 24 21:23:58.351578 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.351573    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-oauth-serving-cert\") pod \"bd22ae13-c360-48b8-b69c-f909a42760d3\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") "
Jul 24 21:23:58.351826 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.351596    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd22ae13-c360-48b8-b69c-f909a42760d3-console-oauth-config\") pod \"bd22ae13-c360-48b8-b69c-f909a42760d3\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") "
Jul 24 21:23:58.351826 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.351670    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-trusted-ca-bundle\") pod \"bd22ae13-c360-48b8-b69c-f909a42760d3\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") "
Jul 24 21:23:58.351826 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.351711    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldsxz\" (UniqueName: \"kubernetes.io/projected/bd22ae13-c360-48b8-b69c-f909a42760d3-kube-api-access-ldsxz\") pod \"bd22ae13-c360-48b8-b69c-f909a42760d3\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") "
Jul 24 21:23:58.351826 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.351752    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-console-config\") pod \"bd22ae13-c360-48b8-b69c-f909a42760d3\" (UID: \"bd22ae13-c360-48b8-b69c-f909a42760d3\") "
Jul 24 21:23:58.352013 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.351926    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "bd22ae13-c360-48b8-b69c-f909a42760d3" (UID: "bd22ae13-c360-48b8-b69c-f909a42760d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:23:58.352120 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.352096    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bd22ae13-c360-48b8-b69c-f909a42760d3" (UID: "bd22ae13-c360-48b8-b69c-f909a42760d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:23:58.352215 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.352189    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bd22ae13-c360-48b8-b69c-f909a42760d3" (UID: "bd22ae13-c360-48b8-b69c-f909a42760d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:23:58.352293 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.352195    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-console-config" (OuterVolumeSpecName: "console-config") pod "bd22ae13-c360-48b8-b69c-f909a42760d3" (UID: "bd22ae13-c360-48b8-b69c-f909a42760d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:23:58.353844 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.353818    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd22ae13-c360-48b8-b69c-f909a42760d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bd22ae13-c360-48b8-b69c-f909a42760d3" (UID: "bd22ae13-c360-48b8-b69c-f909a42760d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:23:58.354407 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.354390    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd22ae13-c360-48b8-b69c-f909a42760d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bd22ae13-c360-48b8-b69c-f909a42760d3" (UID: "bd22ae13-c360-48b8-b69c-f909a42760d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:23:58.354501 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.354449    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd22ae13-c360-48b8-b69c-f909a42760d3-kube-api-access-ldsxz" (OuterVolumeSpecName: "kube-api-access-ldsxz") pod "bd22ae13-c360-48b8-b69c-f909a42760d3" (UID: "bd22ae13-c360-48b8-b69c-f909a42760d3"). InnerVolumeSpecName "kube-api-access-ldsxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:23:58.452672 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.452648    2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-trusted-ca-bundle\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:23:58.452672 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.452671    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldsxz\" (UniqueName: \"kubernetes.io/projected/bd22ae13-c360-48b8-b69c-f909a42760d3-kube-api-access-ldsxz\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:23:58.452836 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.452680    2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-console-config\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:23:58.452836 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.452689    2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-service-ca\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:23:58.452836 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.452697    2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd22ae13-c360-48b8-b69c-f909a42760d3-console-serving-cert\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:23:58.452836 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.452705    2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd22ae13-c360-48b8-b69c-f909a42760d3-oauth-serving-cert\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:23:58.452836 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.452718    2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd22ae13-c360-48b8-b69c-f909a42760d3-console-oauth-config\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:23:58.598253 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.598216    2549 generic.go:356] "Generic (PLEG): container finished" podID="bd22ae13-c360-48b8-b69c-f909a42760d3" containerID="c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d" exitCode=0
Jul 24 21:23:58.598465 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.598291    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566cc9cd9c-tlc9v"
Jul 24 21:23:58.598465 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.598306    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566cc9cd9c-tlc9v" event={"ID":"bd22ae13-c360-48b8-b69c-f909a42760d3","Type":"ContainerDied","Data":"c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d"}
Jul 24 21:23:58.598465 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.598351    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566cc9cd9c-tlc9v" event={"ID":"bd22ae13-c360-48b8-b69c-f909a42760d3","Type":"ContainerDied","Data":"5a56edd791f12e99fb631a0d829c76497484df4154a6f4a7a02de99734af5135"}
Jul 24 21:23:58.598465 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.598370    2549 scope.go:117] "RemoveContainer" containerID="c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d"
Jul 24 21:23:58.606421 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.606401    2549 scope.go:117] "RemoveContainer" containerID="c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d"
Jul 24 21:23:58.606672 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:23:58.606651    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d\": container with ID starting with c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d not found: ID does not exist" containerID="c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d"
Jul 24 21:23:58.606708 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.606681    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d"} err="failed to get container status \"c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d\": rpc error: code = NotFound desc = could not find container \"c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d\": container with ID starting with c0429740c690e540e47a708d1271e26e333646b0097e452f058e5ea94f51f90d not found: ID does not exist"
Jul 24 21:23:58.615183 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.615161    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566cc9cd9c-tlc9v"]
Jul 24 21:23:58.622665 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:23:58.622643    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-566cc9cd9c-tlc9v"]
Jul 24 21:24:00.408232 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:00.408198    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd22ae13-c360-48b8-b69c-f909a42760d3" path="/var/lib/kubelet/pods/bd22ae13-c360-48b8-b69c-f909a42760d3/volumes"
Jul 24 21:24:07.072722 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.072685    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-jv8md"]
Jul 24 21:24:07.073189 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.073118    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd22ae13-c360-48b8-b69c-f909a42760d3" containerName="console"
Jul 24 21:24:07.073189 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.073133    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd22ae13-c360-48b8-b69c-f909a42760d3" containerName="console"
Jul 24 21:24:07.073283 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.073231    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd22ae13-c360-48b8-b69c-f909a42760d3" containerName="console"
Jul 24 21:24:07.077771 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.077748    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-jv8md"
Jul 24 21:24:07.082783 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.082763    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 24 21:24:07.083443 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.083421    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Jul 24 21:24:07.083551 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.083472    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 24 21:24:07.083551 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.083529    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-rln9j\""
Jul 24 21:24:07.106854 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.106825    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-jv8md"]
Jul 24 21:24:07.225327 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.225253    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55tdq\" (UniqueName: \"kubernetes.io/projected/bd5f6d5c-6d93-4585-a45b-4872219ccb3d-kube-api-access-55tdq\") pod \"odh-model-controller-75d9cdbddf-jv8md\" (UID: \"bd5f6d5c-6d93-4585-a45b-4872219ccb3d\") " pod="kserve/odh-model-controller-75d9cdbddf-jv8md"
Jul 24 21:24:07.225525 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.225393    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5f6d5c-6d93-4585-a45b-4872219ccb3d-cert\") pod \"odh-model-controller-75d9cdbddf-jv8md\" (UID: \"bd5f6d5c-6d93-4585-a45b-4872219ccb3d\") " pod="kserve/odh-model-controller-75d9cdbddf-jv8md"
Jul 24 21:24:07.326343 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.326229    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5f6d5c-6d93-4585-a45b-4872219ccb3d-cert\") pod \"odh-model-controller-75d9cdbddf-jv8md\" (UID: \"bd5f6d5c-6d93-4585-a45b-4872219ccb3d\") " pod="kserve/odh-model-controller-75d9cdbddf-jv8md"
Jul 24 21:24:07.326343 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.326320    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55tdq\" (UniqueName: \"kubernetes.io/projected/bd5f6d5c-6d93-4585-a45b-4872219ccb3d-kube-api-access-55tdq\") pod \"odh-model-controller-75d9cdbddf-jv8md\" (UID: \"bd5f6d5c-6d93-4585-a45b-4872219ccb3d\") " pod="kserve/odh-model-controller-75d9cdbddf-jv8md"
Jul 24 21:24:07.328856 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.328832    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5f6d5c-6d93-4585-a45b-4872219ccb3d-cert\") pod \"odh-model-controller-75d9cdbddf-jv8md\" (UID: \"bd5f6d5c-6d93-4585-a45b-4872219ccb3d\") " pod="kserve/odh-model-controller-75d9cdbddf-jv8md"
Jul 24 21:24:07.337595 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.337568    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55tdq\" (UniqueName: \"kubernetes.io/projected/bd5f6d5c-6d93-4585-a45b-4872219ccb3d-kube-api-access-55tdq\") pod \"odh-model-controller-75d9cdbddf-jv8md\" (UID: \"bd5f6d5c-6d93-4585-a45b-4872219ccb3d\") " pod="kserve/odh-model-controller-75d9cdbddf-jv8md"
Jul 24 21:24:07.388341 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.388310    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-jv8md"
Jul 24 21:24:07.530575 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.530525    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-jv8md"]
Jul 24 21:24:07.532904 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:24:07.532872    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5f6d5c_6d93_4585_a45b_4872219ccb3d.slice/crio-50d32b950e30666a592f9689ec4b4c306dcca94f123c019bcd7479e6ce07952b WatchSource:0}: Error finding container 50d32b950e30666a592f9689ec4b4c306dcca94f123c019bcd7479e6ce07952b: Status 404 returned error can't find the container with id 50d32b950e30666a592f9689ec4b4c306dcca94f123c019bcd7479e6ce07952b
Jul 24 21:24:07.633458 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:07.633367    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-jv8md" event={"ID":"bd5f6d5c-6d93-4585-a45b-4872219ccb3d","Type":"ContainerStarted","Data":"50d32b950e30666a592f9689ec4b4c306dcca94f123c019bcd7479e6ce07952b"}
Jul 24 21:24:10.647098 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:10.647065    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-jv8md" event={"ID":"bd5f6d5c-6d93-4585-a45b-4872219ccb3d","Type":"ContainerStarted","Data":"99483f92c5825b7d15cf45ee858b1c7c74823858940d84fa1285c34ee4078a7c"}
Jul 24 21:24:10.647496 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:10.647187    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-75d9cdbddf-jv8md"
Jul 24 21:24:10.666667 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:10.666617    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-75d9cdbddf-jv8md" podStartSLOduration=1.23476558 podStartE2EDuration="3.666600031s" totalImagesPullingTime="2.431834451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:24:10.664979336 +0000 UTC m=+552.848652732" watchObservedRunningTime="2026-07-24 21:24:10.666600031 +0000 UTC m=+552.850273425"
Jul 24 21:24:21.653633 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:24:21.653601    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-75d9cdbddf-jv8md"
Jul 24 21:29:27.726671 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:27.726635    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"]
Jul 24 21:29:27.730234 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:27.730213    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"
Jul 24 21:29:27.732570 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:27.732541    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-8100c-kube-rbac-proxy-sar-config\""
Jul 24 21:29:27.732570 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:27.732545    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-dm6jh\""
Jul 24 21:29:27.732740 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:27.732543    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-8100c-serving-cert\""
Jul 24 21:29:27.732740 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:27.732548    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 24 21:29:27.739347 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:27.739326    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"]
Jul 24 21:29:27.831621 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:27.831591    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-proxy-tls\") pod \"model-chainer-raw-8100c-854d568c9-r2lrk\" (UID: \"287c01bc-b5c7-4101-a8c3-45caa1f5eb46\") " pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"
Jul 24 21:29:27.831794 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:27.831647    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-openshift-service-ca-bundle\") pod \"model-chainer-raw-8100c-854d568c9-r2lrk\" (UID: \"287c01bc-b5c7-4101-a8c3-45caa1f5eb46\") " pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"
Jul 24 21:29:27.932171 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:27.932140    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-proxy-tls\") pod \"model-chainer-raw-8100c-854d568c9-r2lrk\" (UID: \"287c01bc-b5c7-4101-a8c3-45caa1f5eb46\") " pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"
Jul 24 21:29:27.932378 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:27.932202    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-openshift-service-ca-bundle\") pod \"model-chainer-raw-8100c-854d568c9-r2lrk\" (UID: \"287c01bc-b5c7-4101-a8c3-45caa1f5eb46\") " pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"
Jul 24 21:29:27.932378 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:29:27.932312    2549 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-8100c-serving-cert: secret "model-chainer-raw-8100c-serving-cert" not found
Jul 24 21:29:27.932378 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:29:27.932375    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-proxy-tls podName:287c01bc-b5c7-4101-a8c3-45caa1f5eb46 nodeName:}" failed. No retries permitted until 2026-07-24 21:29:28.432356022 +0000 UTC m=+870.616029395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-proxy-tls") pod "model-chainer-raw-8100c-854d568c9-r2lrk" (UID: "287c01bc-b5c7-4101-a8c3-45caa1f5eb46") : secret "model-chainer-raw-8100c-serving-cert" not found
Jul 24 21:29:27.932813 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:27.932795    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-openshift-service-ca-bundle\") pod \"model-chainer-raw-8100c-854d568c9-r2lrk\" (UID: \"287c01bc-b5c7-4101-a8c3-45caa1f5eb46\") " pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"
Jul 24 21:29:28.435367 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:28.435334    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-proxy-tls\") pod \"model-chainer-raw-8100c-854d568c9-r2lrk\" (UID: \"287c01bc-b5c7-4101-a8c3-45caa1f5eb46\") " pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"
Jul 24 21:29:28.437961 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:28.437941    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-proxy-tls\") pod \"model-chainer-raw-8100c-854d568c9-r2lrk\" (UID: \"287c01bc-b5c7-4101-a8c3-45caa1f5eb46\") " pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"
Jul 24 21:29:28.640865 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:28.640835    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"
Jul 24 21:29:28.771468 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:28.771439    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"]
Jul 24 21:29:28.774357 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:29:28.774329    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287c01bc_b5c7_4101_a8c3_45caa1f5eb46.slice/crio-e4aaf3a5c8b4ad3b117a3a52d9944c61219c78af91702789763e8d529dbf223e WatchSource:0}: Error finding container e4aaf3a5c8b4ad3b117a3a52d9944c61219c78af91702789763e8d529dbf223e: Status 404 returned error can't find the container with id e4aaf3a5c8b4ad3b117a3a52d9944c61219c78af91702789763e8d529dbf223e
Jul 24 21:29:28.776232 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:28.776216    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 21:29:28.852035 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:28.852005    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" event={"ID":"287c01bc-b5c7-4101-a8c3-45caa1f5eb46","Type":"ContainerStarted","Data":"e4aaf3a5c8b4ad3b117a3a52d9944c61219c78af91702789763e8d529dbf223e"}
Jul 24 21:29:31.866665 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:31.866632    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" event={"ID":"287c01bc-b5c7-4101-a8c3-45caa1f5eb46","Type":"ContainerStarted","Data":"a73fed5cc45d152e0d713db69e6ccd9c7dc46a999285d1e9d14ec2a3c8d4154c"}
Jul 24 21:29:31.867071 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:31.866758    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"
Jul 24 21:29:31.885164 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:31.885121    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" podStartSLOduration=2.546006916 podStartE2EDuration="4.88510692s" totalImagesPullingTime="2.339100004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:29:31.883976151 +0000 UTC m=+874.067649547" watchObservedRunningTime="2026-07-24 21:29:31.88510692 +0000 UTC m=+874.068780360"
Jul 24 21:29:37.792236 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:37.792200    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"]
Jul 24 21:29:37.792644 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:37.792411    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" podUID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" containerName="model-chainer-raw-8100c" containerID="cri-o://a73fed5cc45d152e0d713db69e6ccd9c7dc46a999285d1e9d14ec2a3c8d4154c" gracePeriod=30
Jul 24 21:29:37.799583 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:37.799521    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" podUID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" containerName="model-chainer-raw-8100c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 21:29:42.796678 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:42.796637    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" podUID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" containerName="model-chainer-raw-8100c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 21:29:47.797976 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:47.797942    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" podUID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" containerName="model-chainer-raw-8100c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 21:29:52.797207 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:52.797116    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" podUID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" containerName="model-chainer-raw-8100c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 21:29:57.797531 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:29:57.797483    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" podUID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" containerName="model-chainer-raw-8100c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 21:30:02.796772 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:02.796732    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" podUID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" containerName="model-chainer-raw-8100c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 21:30:07.796751 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:07.796715    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" podUID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" containerName="model-chainer-raw-8100c" probeResult="failure" output="Get \"https://10.132.0.23:8080/readyz\": dial tcp 10.132.0.23:8080: connect: connection refused"
Jul 24 21:30:08.005972 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:08.005935    2549 generic.go:356] "Generic (PLEG): container finished" podID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" containerID="a73fed5cc45d152e0d713db69e6ccd9c7dc46a999285d1e9d14ec2a3c8d4154c" exitCode=0
Jul 24 21:30:08.006136 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:08.006015    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" event={"ID":"287c01bc-b5c7-4101-a8c3-45caa1f5eb46","Type":"ContainerDied","Data":"a73fed5cc45d152e0d713db69e6ccd9c7dc46a999285d1e9d14ec2a3c8d4154c"}
Jul 24 21:30:08.436141 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:08.436115    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"
Jul 24 21:30:08.551200 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:08.551172    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-openshift-service-ca-bundle\") pod \"287c01bc-b5c7-4101-a8c3-45caa1f5eb46\" (UID: \"287c01bc-b5c7-4101-a8c3-45caa1f5eb46\") "
Jul 24 21:30:08.551384 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:08.551207    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-proxy-tls\") pod \"287c01bc-b5c7-4101-a8c3-45caa1f5eb46\" (UID: \"287c01bc-b5c7-4101-a8c3-45caa1f5eb46\") "
Jul 24 21:30:08.551566 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:08.551543    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "287c01bc-b5c7-4101-a8c3-45caa1f5eb46" (UID: "287c01bc-b5c7-4101-a8c3-45caa1f5eb46"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:30:08.553642 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:08.553624    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "287c01bc-b5c7-4101-a8c3-45caa1f5eb46" (UID: "287c01bc-b5c7-4101-a8c3-45caa1f5eb46"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:30:08.652552 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:08.652476    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-openshift-service-ca-bundle\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:30:08.652552 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:08.652501    2549 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/287c01bc-b5c7-4101-a8c3-45caa1f5eb46-proxy-tls\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:30:09.011047 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:09.011021    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"
Jul 24 21:30:09.011047 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:09.011028    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk" event={"ID":"287c01bc-b5c7-4101-a8c3-45caa1f5eb46","Type":"ContainerDied","Data":"e4aaf3a5c8b4ad3b117a3a52d9944c61219c78af91702789763e8d529dbf223e"}
Jul 24 21:30:09.011540 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:09.011086    2549 scope.go:117] "RemoveContainer" containerID="a73fed5cc45d152e0d713db69e6ccd9c7dc46a999285d1e9d14ec2a3c8d4154c"
Jul 24 21:30:09.031865 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:09.031833    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"]
Jul 24 21:30:09.035416 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:09.035394    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-8100c-854d568c9-r2lrk"]
Jul 24 21:30:10.408499 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:30:10.408461    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" path="/var/lib/kubelet/pods/287c01bc-b5c7-4101-a8c3-45caa1f5eb46/volumes"
Jul 24 21:31:18.073933 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.073897    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"]
Jul 24 21:31:18.076461 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.074353    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" containerName="model-chainer-raw-8100c"
Jul 24 21:31:18.076461 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.074372    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" containerName="model-chainer-raw-8100c"
Jul 24 21:31:18.076461 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.074467    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="287c01bc-b5c7-4101-a8c3-45caa1f5eb46" containerName="model-chainer-raw-8100c"
Jul 24 21:31:18.077412 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.077396    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:18.079710 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.079681    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-dm6jh\""
Jul 24 21:31:18.079710 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.079714    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 24 21:31:18.079921 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.079825    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-6bdca-kube-rbac-proxy-sar-config\""
Jul 24 21:31:18.080143 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.080127    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-6bdca-serving-cert\""
Jul 24 21:31:18.086036 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.086009    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"]
Jul 24 21:31:18.201938 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.201907    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7f5617bf-b3e9-4e45-884b-571b1137a08d-proxy-tls\") pod \"model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp\" (UID: \"7f5617bf-b3e9-4e45-884b-571b1137a08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:18.202081 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.201960    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f5617bf-b3e9-4e45-884b-571b1137a08d-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp\" (UID: \"7f5617bf-b3e9-4e45-884b-571b1137a08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:18.302794 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.302756    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7f5617bf-b3e9-4e45-884b-571b1137a08d-proxy-tls\") pod \"model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp\" (UID: \"7f5617bf-b3e9-4e45-884b-571b1137a08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:18.302794 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.302796    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f5617bf-b3e9-4e45-884b-571b1137a08d-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp\" (UID: \"7f5617bf-b3e9-4e45-884b-571b1137a08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:18.303468 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.303447    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f5617bf-b3e9-4e45-884b-571b1137a08d-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp\" (UID: \"7f5617bf-b3e9-4e45-884b-571b1137a08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:18.305504 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.305487    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7f5617bf-b3e9-4e45-884b-571b1137a08d-proxy-tls\") pod \"model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp\" (UID: \"7f5617bf-b3e9-4e45-884b-571b1137a08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:18.388645 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.388553    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:18.520299 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:18.520259    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"]
Jul 24 21:31:18.523155 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:31:18.523131    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5617bf_b3e9_4e45_884b_571b1137a08d.slice/crio-3295ac02ee297901cc9d22a8f6f3bb2cbb58d50ffe148121dcd6cbb888f6b122 WatchSource:0}: Error finding container 3295ac02ee297901cc9d22a8f6f3bb2cbb58d50ffe148121dcd6cbb888f6b122: Status 404 returned error can't find the container with id 3295ac02ee297901cc9d22a8f6f3bb2cbb58d50ffe148121dcd6cbb888f6b122
Jul 24 21:31:19.278990 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:19.278950    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp" event={"ID":"7f5617bf-b3e9-4e45-884b-571b1137a08d","Type":"ContainerStarted","Data":"b572af5e6d8e19fed9e6c2ec9737553989383af7ed94d0bc6bc40f771646d555"}
Jul 24 21:31:19.279427 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:19.279006    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp" event={"ID":"7f5617bf-b3e9-4e45-884b-571b1137a08d","Type":"ContainerStarted","Data":"3295ac02ee297901cc9d22a8f6f3bb2cbb58d50ffe148121dcd6cbb888f6b122"}
Jul 24 21:31:19.279427 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:19.279109    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:19.293883 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:19.293829    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp" podStartSLOduration=1.2938087710000001 podStartE2EDuration="1.293808771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:31:19.293479192 +0000 UTC m=+981.477152588" watchObservedRunningTime="2026-07-24 21:31:19.293808771 +0000 UTC m=+981.477482167"
Jul 24 21:31:25.288676 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:25.288647    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:28.129841 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:28.129800    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"]
Jul 24 21:31:28.130313 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:28.129987    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp" podUID="7f5617bf-b3e9-4e45-884b-571b1137a08d" containerName="model-chainer-raw-hpa-6bdca" containerID="cri-o://b572af5e6d8e19fed9e6c2ec9737553989383af7ed94d0bc6bc40f771646d555" gracePeriod=30
Jul 24 21:31:30.287819 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:30.287780    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp" podUID="7f5617bf-b3e9-4e45-884b-571b1137a08d" containerName="model-chainer-raw-hpa-6bdca" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 21:31:35.288738 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:35.288696    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp" podUID="7f5617bf-b3e9-4e45-884b-571b1137a08d" containerName="model-chainer-raw-hpa-6bdca" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 21:31:40.287380 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:40.287338    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp" podUID="7f5617bf-b3e9-4e45-884b-571b1137a08d" containerName="model-chainer-raw-hpa-6bdca" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 21:31:40.287754 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:40.287441    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:45.287745 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:45.287708    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp" podUID="7f5617bf-b3e9-4e45-884b-571b1137a08d" containerName="model-chainer-raw-hpa-6bdca" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 21:31:50.287192 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:50.287146    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp" podUID="7f5617bf-b3e9-4e45-884b-571b1137a08d" containerName="model-chainer-raw-hpa-6bdca" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 21:31:55.287554 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:55.287515    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp" podUID="7f5617bf-b3e9-4e45-884b-571b1137a08d" containerName="model-chainer-raw-hpa-6bdca" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 21:31:58.429873 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:58.429791    2549 generic.go:356] "Generic (PLEG): container finished" podID="7f5617bf-b3e9-4e45-884b-571b1137a08d" containerID="b572af5e6d8e19fed9e6c2ec9737553989383af7ed94d0bc6bc40f771646d555" exitCode=0
Jul 24 21:31:58.429873 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:58.429841    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp" event={"ID":"7f5617bf-b3e9-4e45-884b-571b1137a08d","Type":"ContainerDied","Data":"b572af5e6d8e19fed9e6c2ec9737553989383af7ed94d0bc6bc40f771646d555"}
Jul 24 21:31:58.776319 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:58.776292    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:58.820931 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:58.820897    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f5617bf-b3e9-4e45-884b-571b1137a08d-openshift-service-ca-bundle\") pod \"7f5617bf-b3e9-4e45-884b-571b1137a08d\" (UID: \"7f5617bf-b3e9-4e45-884b-571b1137a08d\") "
Jul 24 21:31:58.821116 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:58.820992    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7f5617bf-b3e9-4e45-884b-571b1137a08d-proxy-tls\") pod \"7f5617bf-b3e9-4e45-884b-571b1137a08d\" (UID: \"7f5617bf-b3e9-4e45-884b-571b1137a08d\") "
Jul 24 21:31:58.821317 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:58.821291    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f5617bf-b3e9-4e45-884b-571b1137a08d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "7f5617bf-b3e9-4e45-884b-571b1137a08d" (UID: "7f5617bf-b3e9-4e45-884b-571b1137a08d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:31:58.823175 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:58.823155    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f5617bf-b3e9-4e45-884b-571b1137a08d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7f5617bf-b3e9-4e45-884b-571b1137a08d" (UID: "7f5617bf-b3e9-4e45-884b-571b1137a08d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:31:58.922404 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:58.922368    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f5617bf-b3e9-4e45-884b-571b1137a08d-openshift-service-ca-bundle\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:31:58.922404 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:58.922394    2549 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7f5617bf-b3e9-4e45-884b-571b1137a08d-proxy-tls\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:31:59.434588 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:59.434555    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp" event={"ID":"7f5617bf-b3e9-4e45-884b-571b1137a08d","Type":"ContainerDied","Data":"3295ac02ee297901cc9d22a8f6f3bb2cbb58d50ffe148121dcd6cbb888f6b122"}
Jul 24 21:31:59.434588 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:59.434581    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"
Jul 24 21:31:59.435070 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:59.434612    2549 scope.go:117] "RemoveContainer" containerID="b572af5e6d8e19fed9e6c2ec9737553989383af7ed94d0bc6bc40f771646d555"
Jul 24 21:31:59.456584 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:59.456558    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"]
Jul 24 21:31:59.465667 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:31:59.465645    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-6bdca-c66f8f685-9dhcp"]
Jul 24 21:32:00.408100 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:32:00.408057    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f5617bf-b3e9-4e45-884b-571b1137a08d" path="/var/lib/kubelet/pods/7f5617bf-b3e9-4e45-884b-571b1137a08d/volumes"
Jul 24 21:39:04.577210 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.577175    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"]
Jul 24 21:39:04.577686 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.577489    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5617bf-b3e9-4e45-884b-571b1137a08d" containerName="model-chainer-raw-hpa-6bdca"
Jul 24 21:39:04.577686 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.577500    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5617bf-b3e9-4e45-884b-571b1137a08d" containerName="model-chainer-raw-hpa-6bdca"
Jul 24 21:39:04.577686 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.577560    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f5617bf-b3e9-4e45-884b-571b1137a08d" containerName="model-chainer-raw-hpa-6bdca"
Jul 24 21:39:04.580569 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.580554    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.583396 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.583364    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\""
Jul 24 21:39:04.583720 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.583695    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 24 21:39:04.583875 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.583851    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 24 21:39:04.589930 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.589908    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 24 21:39:04.590115 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.590093    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-v2-predictor-serving-cert\""
Jul 24 21:39:04.590281 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.589994    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 24 21:39:04.590783 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.590761    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-dm6jh\""
Jul 24 21:39:04.592398 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.592379    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"]
Jul 24 21:39:04.638673 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.638647    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.638836 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.638678    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87xdd\" (UniqueName: \"kubernetes.io/projected/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kube-api-access-87xdd\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.638836 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.638708    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.638836 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.638733    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.638836 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.638752    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.739697 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.739661    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.739697 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.739698    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87xdd\" (UniqueName: \"kubernetes.io/projected/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kube-api-access-87xdd\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.739902 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.739727    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.739902 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.739759    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.739902 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.739781    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.740229 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.740207    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.740365 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.740347    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.740458 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.740439    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.742397 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.742377    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.748233 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.748210    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87xdd\" (UniqueName: \"kubernetes.io/projected/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kube-api-access-87xdd\") pod \"isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:04.895170 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:04.895070    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:05.026760 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:05.026737    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"]
Jul 24 21:39:05.029229 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:39:05.029200    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35c5a7b_c0f6_4f29_bc42_322b21b172f7.slice/crio-01903f9c30be357b00055b39e54cca245c153737335a1d13a47692b9e7627594 WatchSource:0}: Error finding container 01903f9c30be357b00055b39e54cca245c153737335a1d13a47692b9e7627594: Status 404 returned error can't find the container with id 01903f9c30be357b00055b39e54cca245c153737335a1d13a47692b9e7627594
Jul 24 21:39:05.031169 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:05.031153    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 21:39:06.016670 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:06.016633    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" event={"ID":"c35c5a7b-c0f6-4f29-bc42-322b21b172f7","Type":"ContainerStarted","Data":"01903f9c30be357b00055b39e54cca245c153737335a1d13a47692b9e7627594"}
Jul 24 21:39:09.032123 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:09.032086    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" event={"ID":"c35c5a7b-c0f6-4f29-bc42-322b21b172f7","Type":"ContainerStarted","Data":"203c950ae7ecacf0be2fb5a44a332d28aec640842e3ef931adda44a3dd0197d6"}
Jul 24 21:39:13.048795 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:13.048761    2549 generic.go:356] "Generic (PLEG): container finished" podID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerID="203c950ae7ecacf0be2fb5a44a332d28aec640842e3ef931adda44a3dd0197d6" exitCode=0
Jul 24 21:39:13.049169 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:13.048837    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" event={"ID":"c35c5a7b-c0f6-4f29-bc42-322b21b172f7","Type":"ContainerDied","Data":"203c950ae7ecacf0be2fb5a44a332d28aec640842e3ef931adda44a3dd0197d6"}
Jul 24 21:39:27.125979 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:27.125940    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" event={"ID":"c35c5a7b-c0f6-4f29-bc42-322b21b172f7","Type":"ContainerStarted","Data":"373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4"}
Jul 24 21:39:30.141004 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:30.140964    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" event={"ID":"c35c5a7b-c0f6-4f29-bc42-322b21b172f7","Type":"ContainerStarted","Data":"c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572"}
Jul 24 21:39:30.141442 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:30.141173    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:30.160844 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:30.160797    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podStartSLOduration=2.876381068 podStartE2EDuration="26.160778896s" totalImagesPullingTime="19.597471169s" totalInitContainerRuntime="3.686926659s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:39:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:39:30.159821199 +0000 UTC m=+1472.343494595" watchObservedRunningTime="2026-07-24 21:39:30.160778896 +0000 UTC m=+1472.344452292"
Jul 24 21:39:31.145316 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:31.145261    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:31.146427 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:31.146398    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 24 21:39:32.149470 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:32.149379    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 24 21:39:37.154069 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:37.154038    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:39:37.154603 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:37.154571    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 24 21:39:47.154722 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:47.154682    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 24 21:39:57.155494 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:39:57.155455    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 24 21:40:07.155449 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:07.155410    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 24 21:40:17.154720 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:17.154676    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 24 21:40:27.155398 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:27.155316    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 24 21:40:37.154753 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:37.154707    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 24 21:40:41.404317 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:41.404258    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:40:44.754740 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:44.754695    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"]
Jul 24 21:40:44.755329 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:44.755110    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container" containerID="cri-o://373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4" gracePeriod=30
Jul 24 21:40:44.755958 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:44.755584    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kube-rbac-proxy" containerID="cri-o://c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572" gracePeriod=30
Jul 24 21:40:45.439524 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:45.439491    2549 generic.go:356] "Generic (PLEG): container finished" podID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerID="c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572" exitCode=2
Jul 24 21:40:45.439690 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:45.439563    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" event={"ID":"c35c5a7b-c0f6-4f29-bc42-322b21b172f7","Type":"ContainerDied","Data":"c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572"}
Jul 24 21:40:47.149827 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:47.149789    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.25:8643/healthz\": dial tcp 10.132.0.25:8643: connect: connection refused"
Jul 24 21:40:49.405627 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.405604    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:40:49.456424 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.456392    2549 generic.go:356] "Generic (PLEG): container finished" podID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerID="373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4" exitCode=0
Jul 24 21:40:49.456569 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.456444    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" event={"ID":"c35c5a7b-c0f6-4f29-bc42-322b21b172f7","Type":"ContainerDied","Data":"373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4"}
Jul 24 21:40:49.456569 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.456455    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"
Jul 24 21:40:49.456569 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.456504    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k" event={"ID":"c35c5a7b-c0f6-4f29-bc42-322b21b172f7","Type":"ContainerDied","Data":"01903f9c30be357b00055b39e54cca245c153737335a1d13a47692b9e7627594"}
Jul 24 21:40:49.456569 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.456541    2549 scope.go:117] "RemoveContainer" containerID="c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572"
Jul 24 21:40:49.464643 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.464626    2549 scope.go:117] "RemoveContainer" containerID="373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4"
Jul 24 21:40:49.471842 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.471822    2549 scope.go:117] "RemoveContainer" containerID="203c950ae7ecacf0be2fb5a44a332d28aec640842e3ef931adda44a3dd0197d6"
Jul 24 21:40:49.478858 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.478842    2549 scope.go:117] "RemoveContainer" containerID="c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572"
Jul 24 21:40:49.479099 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:40:49.479082    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572\": container with ID starting with c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572 not found: ID does not exist" containerID="c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572"
Jul 24 21:40:49.479144 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.479108    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572"} err="failed to get container status \"c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572\": rpc error: code = NotFound desc = could not find container \"c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572\": container with ID starting with c4a8ef1b1de25a1d768c26eb98415bc7426402b585fcfa2ddf95c3c3d91b9572 not found: ID does not exist"
Jul 24 21:40:49.479144 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.479125    2549 scope.go:117] "RemoveContainer" containerID="373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4"
Jul 24 21:40:49.479406 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:40:49.479391    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4\": container with ID starting with 373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4 not found: ID does not exist" containerID="373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4"
Jul 24 21:40:49.479452 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.479409    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4"} err="failed to get container status \"373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4\": rpc error: code = NotFound desc = could not find container \"373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4\": container with ID starting with 373a2da2c5125a543c17f69caff3e732811f24bd3a6bdb33a4c93b287d7826e4 not found: ID does not exist"
Jul 24 21:40:49.479452 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.479421    2549 scope.go:117] "RemoveContainer" containerID="203c950ae7ecacf0be2fb5a44a332d28aec640842e3ef931adda44a3dd0197d6"
Jul 24 21:40:49.479621 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:40:49.479604    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203c950ae7ecacf0be2fb5a44a332d28aec640842e3ef931adda44a3dd0197d6\": container with ID starting with 203c950ae7ecacf0be2fb5a44a332d28aec640842e3ef931adda44a3dd0197d6 not found: ID does not exist" containerID="203c950ae7ecacf0be2fb5a44a332d28aec640842e3ef931adda44a3dd0197d6"
Jul 24 21:40:49.479674 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.479624    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203c950ae7ecacf0be2fb5a44a332d28aec640842e3ef931adda44a3dd0197d6"} err="failed to get container status \"203c950ae7ecacf0be2fb5a44a332d28aec640842e3ef931adda44a3dd0197d6\": rpc error: code = NotFound desc = could not find container \"203c950ae7ecacf0be2fb5a44a332d28aec640842e3ef931adda44a3dd0197d6\": container with ID starting with 203c950ae7ecacf0be2fb5a44a332d28aec640842e3ef931adda44a3dd0197d6 not found: ID does not exist"
Jul 24 21:40:49.490908 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.490886    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87xdd\" (UniqueName: \"kubernetes.io/projected/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kube-api-access-87xdd\") pod \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") "
Jul 24 21:40:49.490959 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.490917    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kube-rbac-proxy-sar-config\") pod \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") "
Jul 24 21:40:49.491000 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.490963    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-cabundle-cert\") pod \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") "
Jul 24 21:40:49.491000 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.490984    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-proxy-tls\") pod \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") "
Jul 24 21:40:49.491147 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.491121    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kserve-provision-location\") pod \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\" (UID: \"c35c5a7b-c0f6-4f29-bc42-322b21b172f7\") "
Jul 24 21:40:49.491381 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.491338    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c35c5a7b-c0f6-4f29-bc42-322b21b172f7" (UID: "c35c5a7b-c0f6-4f29-bc42-322b21b172f7"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:40:49.491483 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.491378    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c35c5a7b-c0f6-4f29-bc42-322b21b172f7" (UID: "c35c5a7b-c0f6-4f29-bc42-322b21b172f7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:40:49.491483 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.491418    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c35c5a7b-c0f6-4f29-bc42-322b21b172f7" (UID: "c35c5a7b-c0f6-4f29-bc42-322b21b172f7"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:40:49.491483 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.491437    2549 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:40:49.491483 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.491455    2549 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-cabundle-cert\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:40:49.493561 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.493544    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kube-api-access-87xdd" (OuterVolumeSpecName: "kube-api-access-87xdd") pod "c35c5a7b-c0f6-4f29-bc42-322b21b172f7" (UID: "c35c5a7b-c0f6-4f29-bc42-322b21b172f7"). InnerVolumeSpecName "kube-api-access-87xdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:40:49.493561 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.493550    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c35c5a7b-c0f6-4f29-bc42-322b21b172f7" (UID: "c35c5a7b-c0f6-4f29-bc42-322b21b172f7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:40:49.592133 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.592087    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87xdd\" (UniqueName: \"kubernetes.io/projected/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kube-api-access-87xdd\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:40:49.592133 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.592128    2549 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-proxy-tls\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:40:49.592133 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.592139    2549 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c35c5a7b-c0f6-4f29-bc42-322b21b172f7-kserve-provision-location\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:40:49.784117 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.784082    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"]
Jul 24 21:40:49.791054 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.791027    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5ff9f946fc-7h72k"]
Jul 24 21:40:49.970379 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.970344    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"]
Jul 24 21:40:49.970644 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.970631    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="storage-initializer"
Jul 24 21:40:49.970644 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.970644    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="storage-initializer"
Jul 24 21:40:49.970753 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.970652    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kube-rbac-proxy"
Jul 24 21:40:49.970753 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.970657    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kube-rbac-proxy"
Jul 24 21:40:49.970753 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.970666    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container"
Jul 24 21:40:49.970753 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.970672    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container"
Jul 24 21:40:49.970753 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.970723    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kube-rbac-proxy"
Jul 24 21:40:49.970753 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.970729    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" containerName="kserve-container"
Jul 24 21:40:49.975090 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.975069    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:49.977912 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.977889    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 24 21:40:49.978049 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.977914    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 24 21:40:49.978049 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.977930    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-dm6jh\""
Jul 24 21:40:49.978049 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.977896    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\""
Jul 24 21:40:49.978049 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.977896    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 24 21:40:49.978329 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.978313    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 24 21:40:49.978416 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.978318    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\""
Jul 24 21:40:49.991252 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:49.991232    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"]
Jul 24 21:40:50.097009 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.096923    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m8w5\" (UniqueName: \"kubernetes.io/projected/15c1997b-faff-4334-8e00-3bb42d516970-kube-api-access-8m8w5\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.097009 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.096971    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/15c1997b-faff-4334-8e00-3bb42d516970-proxy-tls\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.097214 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.097037    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15c1997b-faff-4334-8e00-3bb42d516970-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.097214 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.097102    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/15c1997b-faff-4334-8e00-3bb42d516970-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.097214 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.097137    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/15c1997b-faff-4334-8e00-3bb42d516970-cabundle-cert\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.197970 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.197940    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/15c1997b-faff-4334-8e00-3bb42d516970-cabundle-cert\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.198167 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.197986    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m8w5\" (UniqueName: \"kubernetes.io/projected/15c1997b-faff-4334-8e00-3bb42d516970-kube-api-access-8m8w5\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.198167 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.198007    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/15c1997b-faff-4334-8e00-3bb42d516970-proxy-tls\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.198167 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.198033    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15c1997b-faff-4334-8e00-3bb42d516970-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.198167 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.198068    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/15c1997b-faff-4334-8e00-3bb42d516970-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.198538 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.198514    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15c1997b-faff-4334-8e00-3bb42d516970-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.198748 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.198727    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/15c1997b-faff-4334-8e00-3bb42d516970-cabundle-cert\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.198807 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.198758    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/15c1997b-faff-4334-8e00-3bb42d516970-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.200699 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.200682    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/15c1997b-faff-4334-8e00-3bb42d516970-proxy-tls\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.208814 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.208795    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m8w5\" (UniqueName: \"kubernetes.io/projected/15c1997b-faff-4334-8e00-3bb42d516970-kube-api-access-8m8w5\") pod \"isvc-canary-rollback-predictor-6d775fdd5d-glsdr\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.286357 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.286325    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:50.413027 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.409177    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c35c5a7b-c0f6-4f29-bc42-322b21b172f7" path="/var/lib/kubelet/pods/c35c5a7b-c0f6-4f29-bc42-322b21b172f7/volumes"
Jul 24 21:40:50.419567 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.419543    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"]
Jul 24 21:40:50.423108 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:40:50.423078    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c1997b_faff_4334_8e00_3bb42d516970.slice/crio-6cc96bc059bff097bd25573487852ac10778a05fde5a0b187191a25169b0e644 WatchSource:0}: Error finding container 6cc96bc059bff097bd25573487852ac10778a05fde5a0b187191a25169b0e644: Status 404 returned error can't find the container with id 6cc96bc059bff097bd25573487852ac10778a05fde5a0b187191a25169b0e644
Jul 24 21:40:50.460907 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:50.460780    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" event={"ID":"15c1997b-faff-4334-8e00-3bb42d516970","Type":"ContainerStarted","Data":"6cc96bc059bff097bd25573487852ac10778a05fde5a0b187191a25169b0e644"}
Jul 24 21:40:51.467500 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:51.467460    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" event={"ID":"15c1997b-faff-4334-8e00-3bb42d516970","Type":"ContainerStarted","Data":"3be8a52cec7827450f74d1a594e6bff7ee08a4b3eddd7a6ab6f9fc9071695ce5"}
Jul 24 21:40:54.481947 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:54.481854    2549 generic.go:356] "Generic (PLEG): container finished" podID="15c1997b-faff-4334-8e00-3bb42d516970" containerID="3be8a52cec7827450f74d1a594e6bff7ee08a4b3eddd7a6ab6f9fc9071695ce5" exitCode=0
Jul 24 21:40:54.481947 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:54.481932    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" event={"ID":"15c1997b-faff-4334-8e00-3bb42d516970","Type":"ContainerDied","Data":"3be8a52cec7827450f74d1a594e6bff7ee08a4b3eddd7a6ab6f9fc9071695ce5"}
Jul 24 21:40:55.488351 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:55.488319    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" event={"ID":"15c1997b-faff-4334-8e00-3bb42d516970","Type":"ContainerStarted","Data":"8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363"}
Jul 24 21:40:55.488736 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:55.488379    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" event={"ID":"15c1997b-faff-4334-8e00-3bb42d516970","Type":"ContainerStarted","Data":"8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d"}
Jul 24 21:40:55.488736 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:55.488619    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:55.510779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:55.510728    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podStartSLOduration=2.765211694 podStartE2EDuration="6.510710938s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.745499244s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:40:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:40:55.510048448 +0000 UTC m=+1557.693721843" watchObservedRunningTime="2026-07-24 21:40:55.510710938 +0000 UTC m=+1557.694384333"
Jul 24 21:40:56.492378 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:56.492336    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:40:56.493557 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:56.493532    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 24 21:40:57.496531 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:40:57.496485    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 24 21:41:02.502515 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:41:02.502482    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:41:02.503101 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:41:02.503074    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 24 21:41:12.503226 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:41:12.503181    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 24 21:41:22.504059 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:41:22.504018    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 24 21:41:32.503044 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:41:32.503002    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 24 21:41:42.503483 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:41:42.503440    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 24 21:41:52.503507 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:41:52.503419    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 24 21:42:02.503115 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:42:02.503067    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 24 21:42:12.504483 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:42:12.504451    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:43:40.181297 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:40.181163    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"]
Jul 24 21:43:40.181827 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:40.181468    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container" containerID="cri-o://8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d" gracePeriod=30
Jul 24 21:43:40.181901 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:40.181828    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kube-rbac-proxy" containerID="cri-o://8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363" gracePeriod=30
Jul 24 21:43:41.114658 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:41.114628    2549 generic.go:356] "Generic (PLEG): container finished" podID="15c1997b-faff-4334-8e00-3bb42d516970" containerID="8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363" exitCode=2
Jul 24 21:43:41.114840 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:41.114705    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" event={"ID":"15c1997b-faff-4334-8e00-3bb42d516970","Type":"ContainerDied","Data":"8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363"}
Jul 24 21:43:42.497411 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:42.497367    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.26:8643/healthz\": dial tcp 10.132.0.26:8643: connect: connection refused"
Jul 24 21:43:42.503898 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:42.503868    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 24 21:43:44.927004 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:44.926974    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:43:44.958833 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:44.958807    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/15c1997b-faff-4334-8e00-3bb42d516970-kube-rbac-proxy-sar-config\") pod \"15c1997b-faff-4334-8e00-3bb42d516970\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") "
Jul 24 21:43:44.958993 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:44.958857    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/15c1997b-faff-4334-8e00-3bb42d516970-cabundle-cert\") pod \"15c1997b-faff-4334-8e00-3bb42d516970\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") "
Jul 24 21:43:44.958993 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:44.958909    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/15c1997b-faff-4334-8e00-3bb42d516970-proxy-tls\") pod \"15c1997b-faff-4334-8e00-3bb42d516970\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") "
Jul 24 21:43:44.958993 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:44.958940    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15c1997b-faff-4334-8e00-3bb42d516970-kserve-provision-location\") pod \"15c1997b-faff-4334-8e00-3bb42d516970\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") "
Jul 24 21:43:44.959195 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:44.959175    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15c1997b-faff-4334-8e00-3bb42d516970-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "15c1997b-faff-4334-8e00-3bb42d516970" (UID: "15c1997b-faff-4334-8e00-3bb42d516970"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:43:44.959331 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:44.959309    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15c1997b-faff-4334-8e00-3bb42d516970-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "15c1997b-faff-4334-8e00-3bb42d516970" (UID: "15c1997b-faff-4334-8e00-3bb42d516970"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:43:44.959331 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:44.959311    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15c1997b-faff-4334-8e00-3bb42d516970-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "15c1997b-faff-4334-8e00-3bb42d516970" (UID: "15c1997b-faff-4334-8e00-3bb42d516970"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:43:44.961053 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:44.961029    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15c1997b-faff-4334-8e00-3bb42d516970-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "15c1997b-faff-4334-8e00-3bb42d516970" (UID: "15c1997b-faff-4334-8e00-3bb42d516970"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:43:45.059429 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.059402    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m8w5\" (UniqueName: \"kubernetes.io/projected/15c1997b-faff-4334-8e00-3bb42d516970-kube-api-access-8m8w5\") pod \"15c1997b-faff-4334-8e00-3bb42d516970\" (UID: \"15c1997b-faff-4334-8e00-3bb42d516970\") "
Jul 24 21:43:45.059569 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.059547    2549 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/15c1997b-faff-4334-8e00-3bb42d516970-cabundle-cert\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:43:45.059569 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.059560    2549 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/15c1997b-faff-4334-8e00-3bb42d516970-proxy-tls\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:43:45.059569 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.059568    2549 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15c1997b-faff-4334-8e00-3bb42d516970-kserve-provision-location\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:43:45.059737 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.059576    2549 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/15c1997b-faff-4334-8e00-3bb42d516970-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:43:45.061486 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.061464    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15c1997b-faff-4334-8e00-3bb42d516970-kube-api-access-8m8w5" (OuterVolumeSpecName: "kube-api-access-8m8w5") pod "15c1997b-faff-4334-8e00-3bb42d516970" (UID: "15c1997b-faff-4334-8e00-3bb42d516970"). InnerVolumeSpecName "kube-api-access-8m8w5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:43:45.131763 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.131737    2549 generic.go:356] "Generic (PLEG): container finished" podID="15c1997b-faff-4334-8e00-3bb42d516970" containerID="8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d" exitCode=0
Jul 24 21:43:45.131873 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.131797    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"
Jul 24 21:43:45.131873 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.131802    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" event={"ID":"15c1997b-faff-4334-8e00-3bb42d516970","Type":"ContainerDied","Data":"8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d"}
Jul 24 21:43:45.131873 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.131852    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr" event={"ID":"15c1997b-faff-4334-8e00-3bb42d516970","Type":"ContainerDied","Data":"6cc96bc059bff097bd25573487852ac10778a05fde5a0b187191a25169b0e644"}
Jul 24 21:43:45.131972 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.131885    2549 scope.go:117] "RemoveContainer" containerID="8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363"
Jul 24 21:43:45.140754 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.140736    2549 scope.go:117] "RemoveContainer" containerID="8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d"
Jul 24 21:43:45.147695 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.147679    2549 scope.go:117] "RemoveContainer" containerID="3be8a52cec7827450f74d1a594e6bff7ee08a4b3eddd7a6ab6f9fc9071695ce5"
Jul 24 21:43:45.153598 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.153578    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"]
Jul 24 21:43:45.154994 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.154982    2549 scope.go:117] "RemoveContainer" containerID="8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363"
Jul 24 21:43:45.155257 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:43:45.155238    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363\": container with ID starting with 8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363 not found: ID does not exist" containerID="8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363"
Jul 24 21:43:45.155455 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.155396    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363"} err="failed to get container status \"8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363\": rpc error: code = NotFound desc = could not find container \"8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363\": container with ID starting with 8b8f021eb3df2d3e7f47bbf28425a49b14d213ecd7f4e450d3eb9cd6a196f363 not found: ID does not exist"
Jul 24 21:43:45.155455 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.155417    2549 scope.go:117] "RemoveContainer" containerID="8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d"
Jul 24 21:43:45.155673 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:43:45.155645    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d\": container with ID starting with 8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d not found: ID does not exist" containerID="8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d"
Jul 24 21:43:45.155714 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.155668    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d"} err="failed to get container status \"8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d\": rpc error: code = NotFound desc = could not find container \"8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d\": container with ID starting with 8378312dc061798128415ea12711a0d3bfa04d6f33b541af1371d090462c2c5d not found: ID does not exist"
Jul 24 21:43:45.155714 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.155687    2549 scope.go:117] "RemoveContainer" containerID="3be8a52cec7827450f74d1a594e6bff7ee08a4b3eddd7a6ab6f9fc9071695ce5"
Jul 24 21:43:45.155890 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:43:45.155873    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3be8a52cec7827450f74d1a594e6bff7ee08a4b3eddd7a6ab6f9fc9071695ce5\": container with ID starting with 3be8a52cec7827450f74d1a594e6bff7ee08a4b3eddd7a6ab6f9fc9071695ce5 not found: ID does not exist" containerID="3be8a52cec7827450f74d1a594e6bff7ee08a4b3eddd7a6ab6f9fc9071695ce5"
Jul 24 21:43:45.155955 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.155895    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3be8a52cec7827450f74d1a594e6bff7ee08a4b3eddd7a6ab6f9fc9071695ce5"} err="failed to get container status \"3be8a52cec7827450f74d1a594e6bff7ee08a4b3eddd7a6ab6f9fc9071695ce5\": rpc error: code = NotFound desc = could not find container \"3be8a52cec7827450f74d1a594e6bff7ee08a4b3eddd7a6ab6f9fc9071695ce5\": container with ID starting with 3be8a52cec7827450f74d1a594e6bff7ee08a4b3eddd7a6ab6f9fc9071695ce5 not found: ID does not exist"
Jul 24 21:43:45.158025 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.158006    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-6d775fdd5d-glsdr"]
Jul 24 21:43:45.159895 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.159877    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m8w5\" (UniqueName: \"kubernetes.io/projected/15c1997b-faff-4334-8e00-3bb42d516970-kube-api-access-8m8w5\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:43:45.375064 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.374974    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"]
Jul 24 21:43:45.375395 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.375377    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kube-rbac-proxy"
Jul 24 21:43:45.375395 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.375397    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kube-rbac-proxy"
Jul 24 21:43:45.375545 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.375426    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="storage-initializer"
Jul 24 21:43:45.375545 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.375435    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="storage-initializer"
Jul 24 21:43:45.375545 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.375445    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container"
Jul 24 21:43:45.375545 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.375454    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container"
Jul 24 21:43:45.375545 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.375543    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kserve-container"
Jul 24 21:43:45.375785 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.375558    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="15c1997b-faff-4334-8e00-3bb42d516970" containerName="kube-rbac-proxy"
Jul 24 21:43:45.380217 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.380195    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.382689 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.382665    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-v2-predictor-serving-cert\""
Jul 24 21:43:45.382786 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.382674    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 24 21:43:45.382786 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.382708    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-dm6jh\""
Jul 24 21:43:45.382786 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.382739    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\""
Jul 24 21:43:45.382943 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.382915    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 24 21:43:45.382943 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.382927    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 24 21:43:45.383169 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.383152    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 24 21:43:45.392130 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.392107    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"]
Jul 24 21:43:45.462381 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.462348    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2db18555-512c-4b4a-9bec-d90afcdf2d05-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.462535 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.462394    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2db18555-512c-4b4a-9bec-d90afcdf2d05-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.462535 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.462474    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4wcc\" (UniqueName: \"kubernetes.io/projected/2db18555-512c-4b4a-9bec-d90afcdf2d05-kube-api-access-k4wcc\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.462535 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.462508    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2db18555-512c-4b4a-9bec-d90afcdf2d05-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.462639 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.462547    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2db18555-512c-4b4a-9bec-d90afcdf2d05-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.563010 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.562978    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2db18555-512c-4b4a-9bec-d90afcdf2d05-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.563194 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.563039    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2db18555-512c-4b4a-9bec-d90afcdf2d05-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.563194 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.563082    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2db18555-512c-4b4a-9bec-d90afcdf2d05-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.563194 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.563125    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4wcc\" (UniqueName: \"kubernetes.io/projected/2db18555-512c-4b4a-9bec-d90afcdf2d05-kube-api-access-k4wcc\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.563194 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:43:45.563145    2549 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-serving-cert: secret "isvc-canary-stop-v2-predictor-serving-cert" not found
Jul 24 21:43:45.563435 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:43:45.563225    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2db18555-512c-4b4a-9bec-d90afcdf2d05-proxy-tls podName:2db18555-512c-4b4a-9bec-d90afcdf2d05 nodeName:}" failed. No retries permitted until 2026-07-24 21:43:46.063203462 +0000 UTC m=+1728.246876840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/2db18555-512c-4b4a-9bec-d90afcdf2d05-proxy-tls") pod "isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" (UID: "2db18555-512c-4b4a-9bec-d90afcdf2d05") : secret "isvc-canary-stop-v2-predictor-serving-cert" not found
Jul 24 21:43:45.563435 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.563147    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2db18555-512c-4b4a-9bec-d90afcdf2d05-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.563635 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.563615    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2db18555-512c-4b4a-9bec-d90afcdf2d05-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.563751 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.563734    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2db18555-512c-4b4a-9bec-d90afcdf2d05-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.563828 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.563807    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2db18555-512c-4b4a-9bec-d90afcdf2d05-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:45.571670 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:45.571650    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4wcc\" (UniqueName: \"kubernetes.io/projected/2db18555-512c-4b4a-9bec-d90afcdf2d05-kube-api-access-k4wcc\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:46.068009 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:46.067969    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2db18555-512c-4b4a-9bec-d90afcdf2d05-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:46.070405 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:46.070387    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2db18555-512c-4b4a-9bec-d90afcdf2d05-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-5b66dd5859-psnmx\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:46.291009 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:46.290958    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:46.409309 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:46.409257    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15c1997b-faff-4334-8e00-3bb42d516970" path="/var/lib/kubelet/pods/15c1997b-faff-4334-8e00-3bb42d516970/volumes"
Jul 24 21:43:46.425163 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:46.425123    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"]
Jul 24 21:43:46.427840 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:43:46.427813    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db18555_512c_4b4a_9bec_d90afcdf2d05.slice/crio-7efff5e31f121b7cf89f3ee70568ef722058b19cf96c6efc4feb6958f3bfefef WatchSource:0}: Error finding container 7efff5e31f121b7cf89f3ee70568ef722058b19cf96c6efc4feb6958f3bfefef: Status 404 returned error can't find the container with id 7efff5e31f121b7cf89f3ee70568ef722058b19cf96c6efc4feb6958f3bfefef
Jul 24 21:43:47.141524 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:47.141495    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" event={"ID":"2db18555-512c-4b4a-9bec-d90afcdf2d05","Type":"ContainerStarted","Data":"588bc8d9ebef3642f94957f10d6195bc073603816ce38424fde51903dfae7174"}
Jul 24 21:43:47.141914 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:47.141550    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" event={"ID":"2db18555-512c-4b4a-9bec-d90afcdf2d05","Type":"ContainerStarted","Data":"7efff5e31f121b7cf89f3ee70568ef722058b19cf96c6efc4feb6958f3bfefef"}
Jul 24 21:43:50.153474 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:50.153444    2549 generic.go:356] "Generic (PLEG): container finished" podID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerID="588bc8d9ebef3642f94957f10d6195bc073603816ce38424fde51903dfae7174" exitCode=0
Jul 24 21:43:50.153803 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:50.153523    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" event={"ID":"2db18555-512c-4b4a-9bec-d90afcdf2d05","Type":"ContainerDied","Data":"588bc8d9ebef3642f94957f10d6195bc073603816ce38424fde51903dfae7174"}
Jul 24 21:43:51.162380 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:51.162342    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" event={"ID":"2db18555-512c-4b4a-9bec-d90afcdf2d05","Type":"ContainerStarted","Data":"ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e"}
Jul 24 21:43:51.162759 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:51.162420    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" event={"ID":"2db18555-512c-4b4a-9bec-d90afcdf2d05","Type":"ContainerStarted","Data":"a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6"}
Jul 24 21:43:51.162759 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:51.162647    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:51.182718 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:51.182667    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podStartSLOduration=2.538381208 podStartE2EDuration="6.182654102s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.644272894s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:43:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:43:51.180787767 +0000 UTC m=+1733.364461164" watchObservedRunningTime="2026-07-24 21:43:51.182654102 +0000 UTC m=+1733.366327548"
Jul 24 21:43:52.165799 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:52.165767    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:52.167197 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:52.167167    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 24 21:43:53.169066 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:53.169031    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 24 21:43:58.173216 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:58.173187    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:43:58.173852 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:43:58.173822    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 24 21:44:08.173861 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:44:08.173816    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 24 21:44:18.174486 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:44:18.174448    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 24 21:44:28.173770 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:44:28.173726    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 24 21:44:38.173760 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:44:38.173718    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 24 21:44:48.173770 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:44:48.173728    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 24 21:44:58.174669 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:44:58.174629    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 24 21:45:03.404529 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:03.404497    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:45:15.444057 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:15.444017    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"]
Jul 24 21:45:15.444553 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:15.444369    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container" containerID="cri-o://a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6" gracePeriod=30
Jul 24 21:45:15.444553 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:15.444369    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kube-rbac-proxy" containerID="cri-o://ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e" gracePeriod=30
Jul 24 21:45:16.483539 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:16.483505    2549 generic.go:356] "Generic (PLEG): container finished" podID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerID="ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e" exitCode=2
Jul 24 21:45:16.483915 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:16.483587    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" event={"ID":"2db18555-512c-4b4a-9bec-d90afcdf2d05","Type":"ContainerDied","Data":"ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e"}
Jul 24 21:45:18.169939 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:18.169898    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.27:8643/healthz\": dial tcp 10.132.0.27:8643: connect: connection refused"
Jul 24 21:45:19.991962 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:19.991940    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:45:20.122490 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.122406    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2db18555-512c-4b4a-9bec-d90afcdf2d05-kube-rbac-proxy-sar-config\") pod \"2db18555-512c-4b4a-9bec-d90afcdf2d05\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") "
Jul 24 21:45:20.122490 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.122452    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2db18555-512c-4b4a-9bec-d90afcdf2d05-cabundle-cert\") pod \"2db18555-512c-4b4a-9bec-d90afcdf2d05\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") "
Jul 24 21:45:20.122672 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.122495    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2db18555-512c-4b4a-9bec-d90afcdf2d05-proxy-tls\") pod \"2db18555-512c-4b4a-9bec-d90afcdf2d05\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") "
Jul 24 21:45:20.122672 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.122595    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2db18555-512c-4b4a-9bec-d90afcdf2d05-kserve-provision-location\") pod \"2db18555-512c-4b4a-9bec-d90afcdf2d05\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") "
Jul 24 21:45:20.122672 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.122633    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4wcc\" (UniqueName: \"kubernetes.io/projected/2db18555-512c-4b4a-9bec-d90afcdf2d05-kube-api-access-k4wcc\") pod \"2db18555-512c-4b4a-9bec-d90afcdf2d05\" (UID: \"2db18555-512c-4b4a-9bec-d90afcdf2d05\") "
Jul 24 21:45:20.122860 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.122838    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2db18555-512c-4b4a-9bec-d90afcdf2d05-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "2db18555-512c-4b4a-9bec-d90afcdf2d05" (UID: "2db18555-512c-4b4a-9bec-d90afcdf2d05"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:45:20.122927 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.122882    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2db18555-512c-4b4a-9bec-d90afcdf2d05-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "2db18555-512c-4b4a-9bec-d90afcdf2d05" (UID: "2db18555-512c-4b4a-9bec-d90afcdf2d05"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:45:20.122927 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.122883    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2db18555-512c-4b4a-9bec-d90afcdf2d05-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "2db18555-512c-4b4a-9bec-d90afcdf2d05" (UID: "2db18555-512c-4b4a-9bec-d90afcdf2d05"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:45:20.124712 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.124690    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2db18555-512c-4b4a-9bec-d90afcdf2d05-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2db18555-512c-4b4a-9bec-d90afcdf2d05" (UID: "2db18555-512c-4b4a-9bec-d90afcdf2d05"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:45:20.124819 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.124770    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2db18555-512c-4b4a-9bec-d90afcdf2d05-kube-api-access-k4wcc" (OuterVolumeSpecName: "kube-api-access-k4wcc") pod "2db18555-512c-4b4a-9bec-d90afcdf2d05" (UID: "2db18555-512c-4b4a-9bec-d90afcdf2d05"). InnerVolumeSpecName "kube-api-access-k4wcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:45:20.223564 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.223530    2549 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2db18555-512c-4b4a-9bec-d90afcdf2d05-proxy-tls\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:45:20.223564 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.223557    2549 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2db18555-512c-4b4a-9bec-d90afcdf2d05-kserve-provision-location\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:45:20.223564 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.223570    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4wcc\" (UniqueName: \"kubernetes.io/projected/2db18555-512c-4b4a-9bec-d90afcdf2d05-kube-api-access-k4wcc\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:45:20.223775 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.223581    2549 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2db18555-512c-4b4a-9bec-d90afcdf2d05-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:45:20.223775 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.223595    2549 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2db18555-512c-4b4a-9bec-d90afcdf2d05-cabundle-cert\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:45:20.499109 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.499076    2549 generic.go:356] "Generic (PLEG): container finished" podID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerID="a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6" exitCode=0
Jul 24 21:45:20.499256 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.499140    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"
Jul 24 21:45:20.499256 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.499159    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" event={"ID":"2db18555-512c-4b4a-9bec-d90afcdf2d05","Type":"ContainerDied","Data":"a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6"}
Jul 24 21:45:20.499256 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.499217    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx" event={"ID":"2db18555-512c-4b4a-9bec-d90afcdf2d05","Type":"ContainerDied","Data":"7efff5e31f121b7cf89f3ee70568ef722058b19cf96c6efc4feb6958f3bfefef"}
Jul 24 21:45:20.499256 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.499243    2549 scope.go:117] "RemoveContainer" containerID="ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e"
Jul 24 21:45:20.507408 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.507391    2549 scope.go:117] "RemoveContainer" containerID="a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6"
Jul 24 21:45:20.515055 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.515033    2549 scope.go:117] "RemoveContainer" containerID="588bc8d9ebef3642f94957f10d6195bc073603816ce38424fde51903dfae7174"
Jul 24 21:45:20.516350 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.516250    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"]
Jul 24 21:45:20.522636 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.522616    2549 scope.go:117] "RemoveContainer" containerID="ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e"
Jul 24 21:45:20.522931 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:45:20.522904    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e\": container with ID starting with ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e not found: ID does not exist" containerID="ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e"
Jul 24 21:45:20.523031 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.522944    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e"} err="failed to get container status \"ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e\": rpc error: code = NotFound desc = could not find container \"ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e\": container with ID starting with ef22ee02b6daa70ed4e6e763123a219ceac950892c2fcb566ea4392a3f9a3d9e not found: ID does not exist"
Jul 24 21:45:20.523031 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.522966    2549 scope.go:117] "RemoveContainer" containerID="a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6"
Jul 24 21:45:20.523262 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.523241    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-5b66dd5859-psnmx"]
Jul 24 21:45:20.523342 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:45:20.523246    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6\": container with ID starting with a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6 not found: ID does not exist" containerID="a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6"
Jul 24 21:45:20.523342 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.523321    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6"} err="failed to get container status \"a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6\": rpc error: code = NotFound desc = could not find container \"a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6\": container with ID starting with a928507215bd0864b7515b6b254f032daed864c7a3ca125e59943011f02971f6 not found: ID does not exist"
Jul 24 21:45:20.523426 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.523342    2549 scope.go:117] "RemoveContainer" containerID="588bc8d9ebef3642f94957f10d6195bc073603816ce38424fde51903dfae7174"
Jul 24 21:45:20.523560 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:45:20.523542    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"588bc8d9ebef3642f94957f10d6195bc073603816ce38424fde51903dfae7174\": container with ID starting with 588bc8d9ebef3642f94957f10d6195bc073603816ce38424fde51903dfae7174 not found: ID does not exist" containerID="588bc8d9ebef3642f94957f10d6195bc073603816ce38424fde51903dfae7174"
Jul 24 21:45:20.523615 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:20.523567    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"588bc8d9ebef3642f94957f10d6195bc073603816ce38424fde51903dfae7174"} err="failed to get container status \"588bc8d9ebef3642f94957f10d6195bc073603816ce38424fde51903dfae7174\": rpc error: code = NotFound desc = could not find container \"588bc8d9ebef3642f94957f10d6195bc073603816ce38424fde51903dfae7174\": container with ID starting with 588bc8d9ebef3642f94957f10d6195bc073603816ce38424fde51903dfae7174 not found: ID does not exist"
Jul 24 21:45:22.407831 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:22.407798    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" path="/var/lib/kubelet/pods/2db18555-512c-4b4a-9bec-d90afcdf2d05/volumes"
Jul 24 21:45:25.812688 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.812648    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"]
Jul 24 21:45:25.813100 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.813085    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="storage-initializer"
Jul 24 21:45:25.813147 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.813103    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="storage-initializer"
Jul 24 21:45:25.813147 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.813121    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kube-rbac-proxy"
Jul 24 21:45:25.813147 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.813129    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kube-rbac-proxy"
Jul 24 21:45:25.813147 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.813142    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container"
Jul 24 21:45:25.813261 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.813151    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container"
Jul 24 21:45:25.813261 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.813220    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kube-rbac-proxy"
Jul 24 21:45:25.813261 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.813235    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2db18555-512c-4b4a-9bec-d90afcdf2d05" containerName="kserve-container"
Jul 24 21:45:25.818129 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.818109    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:25.820562 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.820542    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 24 21:45:25.820702 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.820571    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-primary-cbae98-predictor-serving-cert\""
Jul 24 21:45:25.820940 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.820921    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 24 21:45:25.821306 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.821264    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 24 21:45:25.821419 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.821310    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-dm6jh\""
Jul 24 21:45:25.821419 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.821346    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 24 21:45:25.821419 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.821388    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-primary-cbae98-kube-rbac-proxy-sar-config\""
Jul 24 21:45:25.826526 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.826506    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"]
Jul 24 21:45:25.971519 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.971478    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bmb2\" (UniqueName: \"kubernetes.io/projected/09542a9a-77fd-42b0-a39d-782700e91b08-kube-api-access-4bmb2\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:25.971720 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.971534    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09542a9a-77fd-42b0-a39d-782700e91b08-kube-rbac-proxy-sar-config\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:25.971720 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.971612    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09542a9a-77fd-42b0-a39d-782700e91b08-proxy-tls\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:25.971720 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.971691    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/09542a9a-77fd-42b0-a39d-782700e91b08-cabundle-cert\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:25.971720 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:25.971718    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09542a9a-77fd-42b0-a39d-782700e91b08-kserve-provision-location\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.072422 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.072351    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bmb2\" (UniqueName: \"kubernetes.io/projected/09542a9a-77fd-42b0-a39d-782700e91b08-kube-api-access-4bmb2\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.072422 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.072392    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09542a9a-77fd-42b0-a39d-782700e91b08-kube-rbac-proxy-sar-config\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.072422 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.072421    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09542a9a-77fd-42b0-a39d-782700e91b08-proxy-tls\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.072660 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.072461    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/09542a9a-77fd-42b0-a39d-782700e91b08-cabundle-cert\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.072660 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.072479    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09542a9a-77fd-42b0-a39d-782700e91b08-kserve-provision-location\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.072660 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:45:26.072619    2549 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-primary-cbae98-predictor-serving-cert: secret "isvc-primary-cbae98-predictor-serving-cert" not found
Jul 24 21:45:26.072806 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:45:26.072688    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09542a9a-77fd-42b0-a39d-782700e91b08-proxy-tls podName:09542a9a-77fd-42b0-a39d-782700e91b08 nodeName:}" failed. No retries permitted until 2026-07-24 21:45:26.572665741 +0000 UTC m=+1828.756339114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/09542a9a-77fd-42b0-a39d-782700e91b08-proxy-tls") pod "isvc-primary-cbae98-predictor-f485947c4-j2jzk" (UID: "09542a9a-77fd-42b0-a39d-782700e91b08") : secret "isvc-primary-cbae98-predictor-serving-cert" not found
Jul 24 21:45:26.072911 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.072892    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09542a9a-77fd-42b0-a39d-782700e91b08-kserve-provision-location\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.073124 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.073103    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/09542a9a-77fd-42b0-a39d-782700e91b08-cabundle-cert\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.073194 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.073147    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09542a9a-77fd-42b0-a39d-782700e91b08-kube-rbac-proxy-sar-config\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.083145 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.083114    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bmb2\" (UniqueName: \"kubernetes.io/projected/09542a9a-77fd-42b0-a39d-782700e91b08-kube-api-access-4bmb2\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.576794 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.576761    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09542a9a-77fd-42b0-a39d-782700e91b08-proxy-tls\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.579247 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.579218    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09542a9a-77fd-42b0-a39d-782700e91b08-proxy-tls\") pod \"isvc-primary-cbae98-predictor-f485947c4-j2jzk\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") " pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.730069 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.730015    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:26.859392 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:26.859167    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"]
Jul 24 21:45:26.861977 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:45:26.861950    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09542a9a_77fd_42b0_a39d_782700e91b08.slice/crio-652bf0a932dafcb0095884d26fcb813c59693631503584f48b22b3a3ecea13fb WatchSource:0}: Error finding container 652bf0a932dafcb0095884d26fcb813c59693631503584f48b22b3a3ecea13fb: Status 404 returned error can't find the container with id 652bf0a932dafcb0095884d26fcb813c59693631503584f48b22b3a3ecea13fb
Jul 24 21:45:27.525900 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:27.525853    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" event={"ID":"09542a9a-77fd-42b0-a39d-782700e91b08","Type":"ContainerStarted","Data":"e3c7776c9a926a99d39c44a5ab2993bb1e44ce2bfa07546f35eca9be477507aa"}
Jul 24 21:45:27.526072 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:27.525918    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" event={"ID":"09542a9a-77fd-42b0-a39d-782700e91b08","Type":"ContainerStarted","Data":"652bf0a932dafcb0095884d26fcb813c59693631503584f48b22b3a3ecea13fb"}
Jul 24 21:45:31.541909 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:31.541876    2549 generic.go:356] "Generic (PLEG): container finished" podID="09542a9a-77fd-42b0-a39d-782700e91b08" containerID="e3c7776c9a926a99d39c44a5ab2993bb1e44ce2bfa07546f35eca9be477507aa" exitCode=0
Jul 24 21:45:31.542263 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:31.541952    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" event={"ID":"09542a9a-77fd-42b0-a39d-782700e91b08","Type":"ContainerDied","Data":"e3c7776c9a926a99d39c44a5ab2993bb1e44ce2bfa07546f35eca9be477507aa"}
Jul 24 21:45:32.547719 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:32.547686    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" event={"ID":"09542a9a-77fd-42b0-a39d-782700e91b08","Type":"ContainerStarted","Data":"107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27"}
Jul 24 21:45:32.548093 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:32.547743    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" event={"ID":"09542a9a-77fd-42b0-a39d-782700e91b08","Type":"ContainerStarted","Data":"84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70"}
Jul 24 21:45:32.548093 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:32.547980    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:32.567410 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:32.567358    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podStartSLOduration=3.785010856 podStartE2EDuration="7.567342827s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.782331971s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:45:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:45:32.566684151 +0000 UTC m=+1834.750357544" watchObservedRunningTime="2026-07-24 21:45:32.567342827 +0000 UTC m=+1834.751016285"
Jul 24 21:45:33.551893 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:33.551859    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:33.553355 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:33.553325    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 24 21:45:34.556089 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:34.556046    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 24 21:45:39.560769 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:39.560739    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:45:39.561220 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:39.561196    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 24 21:45:49.561978 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:49.561933    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 24 21:45:59.561280 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:45:59.561232    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 24 21:46:09.561662 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:46:09.561621    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 24 21:46:19.561892 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:46:19.561848    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 24 21:46:29.561976 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:46:29.561934    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 24 21:46:39.562007 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:46:39.561965    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Jul 24 21:46:44.407502 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:46:44.407473    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:47:17.073231 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:17.073192    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"]
Jul 24 21:47:17.073809 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:17.073465    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container" containerID="cri-o://84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70" gracePeriod=30
Jul 24 21:47:17.073809 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:17.073494    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kube-rbac-proxy" containerID="cri-o://107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27" gracePeriod=30
Jul 24 21:47:17.956643 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:17.956609    2549 generic.go:356] "Generic (PLEG): container finished" podID="09542a9a-77fd-42b0-a39d-782700e91b08" containerID="107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27" exitCode=2
Jul 24 21:47:17.956818 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:17.956663    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" event={"ID":"09542a9a-77fd-42b0-a39d-782700e91b08","Type":"ContainerDied","Data":"107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27"}
Jul 24 21:47:19.557216 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:19.557176    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.28:8643/healthz\": dial tcp 10.132.0.28:8643: connect: connection refused"
Jul 24 21:47:21.723756 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.723731    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:47:21.754339 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.754312    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09542a9a-77fd-42b0-a39d-782700e91b08-kube-rbac-proxy-sar-config\") pod \"09542a9a-77fd-42b0-a39d-782700e91b08\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") "
Jul 24 21:47:21.754476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.754360    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09542a9a-77fd-42b0-a39d-782700e91b08-proxy-tls\") pod \"09542a9a-77fd-42b0-a39d-782700e91b08\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") "
Jul 24 21:47:21.754476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.754392    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/09542a9a-77fd-42b0-a39d-782700e91b08-cabundle-cert\") pod \"09542a9a-77fd-42b0-a39d-782700e91b08\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") "
Jul 24 21:47:21.754476 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.754460    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bmb2\" (UniqueName: \"kubernetes.io/projected/09542a9a-77fd-42b0-a39d-782700e91b08-kube-api-access-4bmb2\") pod \"09542a9a-77fd-42b0-a39d-782700e91b08\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") "
Jul 24 21:47:21.754593 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.754529    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09542a9a-77fd-42b0-a39d-782700e91b08-kserve-provision-location\") pod \"09542a9a-77fd-42b0-a39d-782700e91b08\" (UID: \"09542a9a-77fd-42b0-a39d-782700e91b08\") "
Jul 24 21:47:21.754764 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.754645    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09542a9a-77fd-42b0-a39d-782700e91b08-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "09542a9a-77fd-42b0-a39d-782700e91b08" (UID: "09542a9a-77fd-42b0-a39d-782700e91b08"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:47:21.754905 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.754806    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09542a9a-77fd-42b0-a39d-782700e91b08-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "09542a9a-77fd-42b0-a39d-782700e91b08" (UID: "09542a9a-77fd-42b0-a39d-782700e91b08"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:47:21.754975 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.754941    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09542a9a-77fd-42b0-a39d-782700e91b08-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "09542a9a-77fd-42b0-a39d-782700e91b08" (UID: "09542a9a-77fd-42b0-a39d-782700e91b08"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:47:21.756664 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.756632    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09542a9a-77fd-42b0-a39d-782700e91b08-kube-api-access-4bmb2" (OuterVolumeSpecName: "kube-api-access-4bmb2") pod "09542a9a-77fd-42b0-a39d-782700e91b08" (UID: "09542a9a-77fd-42b0-a39d-782700e91b08"). InnerVolumeSpecName "kube-api-access-4bmb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:47:21.756793 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.756706    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09542a9a-77fd-42b0-a39d-782700e91b08-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "09542a9a-77fd-42b0-a39d-782700e91b08" (UID: "09542a9a-77fd-42b0-a39d-782700e91b08"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:47:21.855315 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.855208    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bmb2\" (UniqueName: \"kubernetes.io/projected/09542a9a-77fd-42b0-a39d-782700e91b08-kube-api-access-4bmb2\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:47:21.855315 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.855253    2549 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09542a9a-77fd-42b0-a39d-782700e91b08-kserve-provision-location\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:47:21.855315 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.855263    2549 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09542a9a-77fd-42b0-a39d-782700e91b08-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:47:21.855315 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.855294    2549 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09542a9a-77fd-42b0-a39d-782700e91b08-proxy-tls\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:47:21.855315 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.855303    2549 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/09542a9a-77fd-42b0-a39d-782700e91b08-cabundle-cert\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:47:21.974739 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.974706    2549 generic.go:356] "Generic (PLEG): container finished" podID="09542a9a-77fd-42b0-a39d-782700e91b08" containerID="84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70" exitCode=0
Jul 24 21:47:21.974919 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.974769    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"
Jul 24 21:47:21.974919 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.974787    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" event={"ID":"09542a9a-77fd-42b0-a39d-782700e91b08","Type":"ContainerDied","Data":"84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70"}
Jul 24 21:47:21.974919 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.974858    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk" event={"ID":"09542a9a-77fd-42b0-a39d-782700e91b08","Type":"ContainerDied","Data":"652bf0a932dafcb0095884d26fcb813c59693631503584f48b22b3a3ecea13fb"}
Jul 24 21:47:21.974919 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.974900    2549 scope.go:117] "RemoveContainer" containerID="107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27"
Jul 24 21:47:21.983902 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.983885    2549 scope.go:117] "RemoveContainer" containerID="84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70"
Jul 24 21:47:21.993158 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.993141    2549 scope.go:117] "RemoveContainer" containerID="e3c7776c9a926a99d39c44a5ab2993bb1e44ce2bfa07546f35eca9be477507aa"
Jul 24 21:47:21.996252 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:21.996230    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"]
Jul 24 21:47:22.000588 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.000572    2549 scope.go:117] "RemoveContainer" containerID="107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27"
Jul 24 21:47:22.000950 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:47:22.000911    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27\": container with ID starting with 107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27 not found: ID does not exist" containerID="107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27"
Jul 24 21:47:22.001092 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.000967    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27"} err="failed to get container status \"107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27\": rpc error: code = NotFound desc = could not find container \"107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27\": container with ID starting with 107dc99dc108dafa75748a542be44e0b4fb7ad4160fd771cef50b4d636c8eb27 not found: ID does not exist"
Jul 24 21:47:22.001092 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.000992    2549 scope.go:117] "RemoveContainer" containerID="84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70"
Jul 24 21:47:22.001490 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:47:22.001452    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70\": container with ID starting with 84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70 not found: ID does not exist" containerID="84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70"
Jul 24 21:47:22.001562 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.001496    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70"} err="failed to get container status \"84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70\": rpc error: code = NotFound desc = could not find container \"84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70\": container with ID starting with 84ec326775622e17fdf9057eb796dabef3f2cc418686e0b4f7c79fcb2c76dd70 not found: ID does not exist"
Jul 24 21:47:22.001562 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.001512    2549 scope.go:117] "RemoveContainer" containerID="e3c7776c9a926a99d39c44a5ab2993bb1e44ce2bfa07546f35eca9be477507aa"
Jul 24 21:47:22.001853 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:47:22.001831    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3c7776c9a926a99d39c44a5ab2993bb1e44ce2bfa07546f35eca9be477507aa\": container with ID starting with e3c7776c9a926a99d39c44a5ab2993bb1e44ce2bfa07546f35eca9be477507aa not found: ID does not exist" containerID="e3c7776c9a926a99d39c44a5ab2993bb1e44ce2bfa07546f35eca9be477507aa"
Jul 24 21:47:22.001944 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.001856    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3c7776c9a926a99d39c44a5ab2993bb1e44ce2bfa07546f35eca9be477507aa"} err="failed to get container status \"e3c7776c9a926a99d39c44a5ab2993bb1e44ce2bfa07546f35eca9be477507aa\": rpc error: code = NotFound desc = could not find container \"e3c7776c9a926a99d39c44a5ab2993bb1e44ce2bfa07546f35eca9be477507aa\": container with ID starting with e3c7776c9a926a99d39c44a5ab2993bb1e44ce2bfa07546f35eca9be477507aa not found: ID does not exist"
Jul 24 21:47:22.002609 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.002589    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-primary-cbae98-predictor-f485947c4-j2jzk"]
Jul 24 21:47:22.251511 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.251479    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"]
Jul 24 21:47:22.251809 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.251796    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container"
Jul 24 21:47:22.251997 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.251811    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container"
Jul 24 21:47:22.251997 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.251824    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="storage-initializer"
Jul 24 21:47:22.251997 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.251830    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="storage-initializer"
Jul 24 21:47:22.251997 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.251836    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kube-rbac-proxy"
Jul 24 21:47:22.251997 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.251843    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kube-rbac-proxy"
Jul 24 21:47:22.251997 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.251891    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kube-rbac-proxy"
Jul 24 21:47:22.251997 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.251898    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" containerName="kserve-container"
Jul 24 21:47:22.256329 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.256307    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.259785 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.259766    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 24 21:47:22.260029 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.260014    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"fail-s3-sa-972622-dockercfg-65jxp\""
Jul 24 21:47:22.260151 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.260137    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-init-fail-972622-predictor-serving-cert\""
Jul 24 21:47:22.260203 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.260178    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"fail-s3-secret-972622\""
Jul 24 21:47:22.261193 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.261154    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-init-fail-972622-kube-rbac-proxy-sar-config\""
Jul 24 21:47:22.261193 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.261181    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 24 21:47:22.262013 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.261995    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 24 21:47:22.270671 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.270652    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"]
Jul 24 21:47:22.359542 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.359515    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-cabundle-cert\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.359720 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.359547    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shsqc\" (UniqueName: \"kubernetes.io/projected/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kube-api-access-shsqc\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.359720 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.359574    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kube-rbac-proxy-sar-config\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.359720 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.359592    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-proxy-tls\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.359720 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.359668    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kserve-provision-location\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.408678 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.408652    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09542a9a-77fd-42b0-a39d-782700e91b08" path="/var/lib/kubelet/pods/09542a9a-77fd-42b0-a39d-782700e91b08/volumes"
Jul 24 21:47:22.460781 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.460746    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kube-rbac-proxy-sar-config\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.460781 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.460787    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-proxy-tls\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.461045 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.460831    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kserve-provision-location\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.461045 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.460985    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-cabundle-cert\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.461045 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.461024    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shsqc\" (UniqueName: \"kubernetes.io/projected/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kube-api-access-shsqc\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.461304 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.461259    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kserve-provision-location\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.461621 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.461596    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kube-rbac-proxy-sar-config\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.461665 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.461616    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-cabundle-cert\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.463493 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.463477    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-proxy-tls\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.468532 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.468510    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shsqc\" (UniqueName: \"kubernetes.io/projected/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kube-api-access-shsqc\") pod \"isvc-init-fail-972622-predictor-84968b6f47-xn72g\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") " pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.566721 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.566644    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:22.704918 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.704893    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"]
Jul 24 21:47:22.707840 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:47:22.707811    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1f7063_8522_4e6d_8fd3_f164fd3b4441.slice/crio-b1900ebdc1ea12b330b5a7695dd6f37b4a14ec6764a4f0bade21a1c573f11ab8 WatchSource:0}: Error finding container b1900ebdc1ea12b330b5a7695dd6f37b4a14ec6764a4f0bade21a1c573f11ab8: Status 404 returned error can't find the container with id b1900ebdc1ea12b330b5a7695dd6f37b4a14ec6764a4f0bade21a1c573f11ab8
Jul 24 21:47:22.979962 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.979856    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g" event={"ID":"fb1f7063-8522-4e6d-8fd3-f164fd3b4441","Type":"ContainerStarted","Data":"b14ea790a3a7d2efb268058cd6ba8d73693c2ab34f48e30da9ab205258581bac"}
Jul 24 21:47:22.979962 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:22.979950    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g" event={"ID":"fb1f7063-8522-4e6d-8fd3-f164fd3b4441","Type":"ContainerStarted","Data":"b1900ebdc1ea12b330b5a7695dd6f37b4a14ec6764a4f0bade21a1c573f11ab8"}
Jul 24 21:47:28.000973 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:28.000946    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-init-fail-972622-predictor-84968b6f47-xn72g_fb1f7063-8522-4e6d-8fd3-f164fd3b4441/storage-initializer/0.log"
Jul 24 21:47:28.001361 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:28.000984    2549 generic.go:356] "Generic (PLEG): container finished" podID="fb1f7063-8522-4e6d-8fd3-f164fd3b4441" containerID="b14ea790a3a7d2efb268058cd6ba8d73693c2ab34f48e30da9ab205258581bac" exitCode=1
Jul 24 21:47:28.001361 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:28.001041    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g" event={"ID":"fb1f7063-8522-4e6d-8fd3-f164fd3b4441","Type":"ContainerDied","Data":"b14ea790a3a7d2efb268058cd6ba8d73693c2ab34f48e30da9ab205258581bac"}
Jul 24 21:47:29.006681 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:29.006651    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-init-fail-972622-predictor-84968b6f47-xn72g_fb1f7063-8522-4e6d-8fd3-f164fd3b4441/storage-initializer/0.log"
Jul 24 21:47:29.007040 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:29.006739    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g" event={"ID":"fb1f7063-8522-4e6d-8fd3-f164fd3b4441","Type":"ContainerStarted","Data":"928172f72224afc16f3a1ef7a1abf168e6d77d49d4e4f5de2f10e0e606f7a88d"}
Jul 24 21:47:32.019976 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:32.019950    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-init-fail-972622-predictor-84968b6f47-xn72g_fb1f7063-8522-4e6d-8fd3-f164fd3b4441/storage-initializer/1.log"
Jul 24 21:47:32.020413 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:32.020314    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-init-fail-972622-predictor-84968b6f47-xn72g_fb1f7063-8522-4e6d-8fd3-f164fd3b4441/storage-initializer/0.log"
Jul 24 21:47:32.020413 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:32.020350    2549 generic.go:356] "Generic (PLEG): container finished" podID="fb1f7063-8522-4e6d-8fd3-f164fd3b4441" containerID="928172f72224afc16f3a1ef7a1abf168e6d77d49d4e4f5de2f10e0e606f7a88d" exitCode=1
Jul 24 21:47:32.020488 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:32.020421    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g" event={"ID":"fb1f7063-8522-4e6d-8fd3-f164fd3b4441","Type":"ContainerDied","Data":"928172f72224afc16f3a1ef7a1abf168e6d77d49d4e4f5de2f10e0e606f7a88d"}
Jul 24 21:47:32.020521 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:32.020484    2549 scope.go:117] "RemoveContainer" containerID="b14ea790a3a7d2efb268058cd6ba8d73693c2ab34f48e30da9ab205258581bac"
Jul 24 21:47:32.020858 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:32.020830    2549 scope.go:117] "RemoveContainer" containerID="b14ea790a3a7d2efb268058cd6ba8d73693c2ab34f48e30da9ab205258581bac"
Jul 24 21:47:32.031453 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:47:32.031429    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-initializer\" with CrashLoopBackOff: \"back-off 10s restarting failed container=storage-initializer pod=isvc-init-fail-972622-predictor-84968b6f47-xn72g_kserve-ci-e2e-test(fb1f7063-8522-4e6d-8fd3-f164fd3b4441)\"" pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g" podUID="fb1f7063-8522-4e6d-8fd3-f164fd3b4441"
Jul 24 21:47:32.031702 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:47:32.031665    2549 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-init-fail-972622-predictor-84968b6f47-xn72g_kserve-ci-e2e-test_fb1f7063-8522-4e6d-8fd3-f164fd3b4441_0 in pod sandbox b1900ebdc1ea12b330b5a7695dd6f37b4a14ec6764a4f0bade21a1c573f11ab8 from index: no such id: 'b14ea790a3a7d2efb268058cd6ba8d73693c2ab34f48e30da9ab205258581bac'" containerID="b14ea790a3a7d2efb268058cd6ba8d73693c2ab34f48e30da9ab205258581bac"
Jul 24 21:47:32.031755 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:32.031713    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14ea790a3a7d2efb268058cd6ba8d73693c2ab34f48e30da9ab205258581bac"} err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-init-fail-972622-predictor-84968b6f47-xn72g_kserve-ci-e2e-test_fb1f7063-8522-4e6d-8fd3-f164fd3b4441_0 in pod sandbox b1900ebdc1ea12b330b5a7695dd6f37b4a14ec6764a4f0bade21a1c573f11ab8 from index: no such id: 'b14ea790a3a7d2efb268058cd6ba8d73693c2ab34f48e30da9ab205258581bac'"
Jul 24 21:47:32.247137 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:32.247050    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"]
Jul 24 21:47:33.025973 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.025944    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-init-fail-972622-predictor-84968b6f47-xn72g_fb1f7063-8522-4e6d-8fd3-f164fd3b4441/storage-initializer/1.log"
Jul 24 21:47:33.158493 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.158474    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-init-fail-972622-predictor-84968b6f47-xn72g_fb1f7063-8522-4e6d-8fd3-f164fd3b4441/storage-initializer/1.log"
Jul 24 21:47:33.161922 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.161905    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:33.246626 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.246597    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-proxy-tls\") pod \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") "
Jul 24 21:47:33.246748 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.246646    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kserve-provision-location\") pod \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") "
Jul 24 21:47:33.246798 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.246768    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-cabundle-cert\") pod \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") "
Jul 24 21:47:33.246837 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.246799    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shsqc\" (UniqueName: \"kubernetes.io/projected/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kube-api-access-shsqc\") pod \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") "
Jul 24 21:47:33.246837 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.246825    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kube-rbac-proxy-sar-config\") pod \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\" (UID: \"fb1f7063-8522-4e6d-8fd3-f164fd3b4441\") "
Jul 24 21:47:33.246948 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.246926    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "fb1f7063-8522-4e6d-8fd3-f164fd3b4441" (UID: "fb1f7063-8522-4e6d-8fd3-f164fd3b4441"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:47:33.247118 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.247098    2549 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kserve-provision-location\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:47:33.247192 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.247166    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "fb1f7063-8522-4e6d-8fd3-f164fd3b4441" (UID: "fb1f7063-8522-4e6d-8fd3-f164fd3b4441"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:47:33.247230 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.247202    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "fb1f7063-8522-4e6d-8fd3-f164fd3b4441" (UID: "fb1f7063-8522-4e6d-8fd3-f164fd3b4441"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:47:33.248900 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.248875    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kube-api-access-shsqc" (OuterVolumeSpecName: "kube-api-access-shsqc") pod "fb1f7063-8522-4e6d-8fd3-f164fd3b4441" (UID: "fb1f7063-8522-4e6d-8fd3-f164fd3b4441"). InnerVolumeSpecName "kube-api-access-shsqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:47:33.248996 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.248961    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fb1f7063-8522-4e6d-8fd3-f164fd3b4441" (UID: "fb1f7063-8522-4e6d-8fd3-f164fd3b4441"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:47:33.347804 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.347723    2549 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-cabundle-cert\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:47:33.347804 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.347751    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shsqc\" (UniqueName: \"kubernetes.io/projected/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kube-api-access-shsqc\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:47:33.347804 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.347761    2549 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:47:33.347804 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:33.347771    2549 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb1f7063-8522-4e6d-8fd3-f164fd3b4441-proxy-tls\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:47:34.031201 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:34.031171    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-init-fail-972622-predictor-84968b6f47-xn72g_fb1f7063-8522-4e6d-8fd3-f164fd3b4441/storage-initializer/1.log"
Jul 24 21:47:34.031617 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:34.031305    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"
Jul 24 21:47:34.031617 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:34.031324    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g" event={"ID":"fb1f7063-8522-4e6d-8fd3-f164fd3b4441","Type":"ContainerDied","Data":"b1900ebdc1ea12b330b5a7695dd6f37b4a14ec6764a4f0bade21a1c573f11ab8"}
Jul 24 21:47:34.031617 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:34.031396    2549 scope.go:117] "RemoveContainer" containerID="928172f72224afc16f3a1ef7a1abf168e6d77d49d4e4f5de2f10e0e606f7a88d"
Jul 24 21:47:34.065776 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:34.065747    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"]
Jul 24 21:47:34.072047 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:34.072016    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-init-fail-972622-predictor-84968b6f47-xn72g"]
Jul 24 21:47:34.408299 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:47:34.408189    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb1f7063-8522-4e6d-8fd3-f164fd3b4441" path="/var/lib/kubelet/pods/fb1f7063-8522-4e6d-8fd3-f164fd3b4441/volumes"
Jul 24 21:49:12.811880 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.811847    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"]
Jul 24 21:49:12.812323 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.812183    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb1f7063-8522-4e6d-8fd3-f164fd3b4441" containerName="storage-initializer"
Jul 24 21:49:12.812323 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.812196    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb1f7063-8522-4e6d-8fd3-f164fd3b4441" containerName="storage-initializer"
Jul 24 21:49:12.812323 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.812211    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb1f7063-8522-4e6d-8fd3-f164fd3b4441" containerName="storage-initializer"
Jul 24 21:49:12.812323 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.812216    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb1f7063-8522-4e6d-8fd3-f164fd3b4441" containerName="storage-initializer"
Jul 24 21:49:12.812323 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.812261    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb1f7063-8522-4e6d-8fd3-f164fd3b4441" containerName="storage-initializer"
Jul 24 21:49:12.812323 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.812285    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb1f7063-8522-4e6d-8fd3-f164fd3b4441" containerName="storage-initializer"
Jul 24 21:49:12.815410 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.815374    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:12.817851 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.817824    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"raw-sklearn-runtime-700df-kube-rbac-proxy-sar-config\""
Jul 24 21:49:12.818004 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.817896    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"raw-sklearn-runtime-700df-predictor-serving-cert\""
Jul 24 21:49:12.818004 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.817922    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 24 21:49:12.818004 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.817924    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-dm6jh\""
Jul 24 21:49:12.818322 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.818252    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 24 21:49:12.818482 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.818458    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 24 21:49:12.818482 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.818481    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 24 21:49:12.826549 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.826529    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"]
Jul 24 21:49:12.963655 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.963618    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-cabundle-cert\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:12.963846 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.963677    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:12.963846 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.963748    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-proxy-tls\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:12.963846 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.963799    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kxmw\" (UniqueName: \"kubernetes.io/projected/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kube-api-access-4kxmw\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:12.963846 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:12.963827    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kserve-provision-location\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:13.064971 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.064880    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kxmw\" (UniqueName: \"kubernetes.io/projected/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kube-api-access-4kxmw\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:13.064971 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.064925    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kserve-provision-location\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:13.064971 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.064950    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-cabundle-cert\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:13.064971 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.064980    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:13.065292 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.065081    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-proxy-tls\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:13.065421 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.065398    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kserve-provision-location\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:13.065694 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.065672    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-cabundle-cert\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:13.065804 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.065673    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:13.067590 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.067557    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-proxy-tls\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:13.073625 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.073603    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kxmw\" (UniqueName: \"kubernetes.io/projected/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kube-api-access-4kxmw\") pod \"raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:13.127541 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.127516    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:13.259644 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.259618    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"]
Jul 24 21:49:13.262392 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:49:13.262365    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90deb294_6975_44dd_ac00_1f8fcf8e8fe8.slice/crio-60bc4ebd8151328f4c254429406b91bd63eda34eecc7b70ca9aec836d41e18aa WatchSource:0}: Error finding container 60bc4ebd8151328f4c254429406b91bd63eda34eecc7b70ca9aec836d41e18aa: Status 404 returned error can't find the container with id 60bc4ebd8151328f4c254429406b91bd63eda34eecc7b70ca9aec836d41e18aa
Jul 24 21:49:13.407745 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.407705    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" event={"ID":"90deb294-6975-44dd-ac00-1f8fcf8e8fe8","Type":"ContainerStarted","Data":"19b1011054d9149f5fbdaf83368d5c6e9073d722c268299df7c6aa0892d3495f"}
Jul 24 21:49:13.407919 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:13.407772    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" event={"ID":"90deb294-6975-44dd-ac00-1f8fcf8e8fe8","Type":"ContainerStarted","Data":"60bc4ebd8151328f4c254429406b91bd63eda34eecc7b70ca9aec836d41e18aa"}
Jul 24 21:49:17.424008 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:17.423974    2549 generic.go:356] "Generic (PLEG): container finished" podID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerID="19b1011054d9149f5fbdaf83368d5c6e9073d722c268299df7c6aa0892d3495f" exitCode=0
Jul 24 21:49:17.424409 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:17.424047    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" event={"ID":"90deb294-6975-44dd-ac00-1f8fcf8e8fe8","Type":"ContainerDied","Data":"19b1011054d9149f5fbdaf83368d5c6e9073d722c268299df7c6aa0892d3495f"}
Jul 24 21:49:18.430908 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:18.430874    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" event={"ID":"90deb294-6975-44dd-ac00-1f8fcf8e8fe8","Type":"ContainerStarted","Data":"6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa"}
Jul 24 21:49:18.431341 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:18.430931    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" event={"ID":"90deb294-6975-44dd-ac00-1f8fcf8e8fe8","Type":"ContainerStarted","Data":"70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5"}
Jul 24 21:49:18.431341 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:18.431190    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:18.431341 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:18.431294    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:18.432535 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:18.432509    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 24 21:49:18.450237 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:18.450193    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podStartSLOduration=2.807103974 podStartE2EDuration="6.450179936s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.643075962s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:49:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:49:18.448548577 +0000 UTC m=+2060.632221972" watchObservedRunningTime="2026-07-24 21:49:18.450179936 +0000 UTC m=+2060.633853331"
Jul 24 21:49:19.434521 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:19.434476    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 24 21:49:24.438495 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:24.438464    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:49:24.439035 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:24.439008    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 24 21:49:34.439084 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:34.439043    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 24 21:49:44.439020 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:44.438984    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 24 21:49:54.438948 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:49:54.438901    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 24 21:50:04.438990 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:04.438944    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 24 21:50:14.439041 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:14.438996    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 24 21:50:24.439206 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:24.439172    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 24 21:50:34.439960 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:34.439930    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:50:42.919878 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:42.919848    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"]
Jul 24 21:50:42.920366 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:42.920072    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container" containerID="cri-o://70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5" gracePeriod=30
Jul 24 21:50:42.920366 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:42.920105    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kube-rbac-proxy" containerID="cri-o://6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa" gracePeriod=30
Jul 24 21:50:43.756976 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:43.756937    2549 generic.go:356] "Generic (PLEG): container finished" podID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerID="6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa" exitCode=2
Jul 24 21:50:43.756976 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:43.756983    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" event={"ID":"90deb294-6975-44dd-ac00-1f8fcf8e8fe8","Type":"ContainerDied","Data":"6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa"}
Jul 24 21:50:44.435131 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:44.435092    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.30:8643/healthz\": dial tcp 10.132.0.30:8643: connect: connection refused"
Jul 24 21:50:44.439446 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:44.439425    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Jul 24 21:50:47.664564 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.664537    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:50:47.715779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.715696    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kxmw\" (UniqueName: \"kubernetes.io/projected/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kube-api-access-4kxmw\") pod \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") "
Jul 24 21:50:47.715779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.715749    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-proxy-tls\") pod \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") "
Jul 24 21:50:47.715779 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.715777    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-cabundle-cert\") pod \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") "
Jul 24 21:50:47.716051 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.715820    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kube-rbac-proxy-sar-config\") pod \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") "
Jul 24 21:50:47.716051 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.715844    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kserve-provision-location\") pod \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\" (UID: \"90deb294-6975-44dd-ac00-1f8fcf8e8fe8\") "
Jul 24 21:50:47.716159 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.716131    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "90deb294-6975-44dd-ac00-1f8fcf8e8fe8" (UID: "90deb294-6975-44dd-ac00-1f8fcf8e8fe8"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:50:47.716202 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.716167    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "90deb294-6975-44dd-ac00-1f8fcf8e8fe8" (UID: "90deb294-6975-44dd-ac00-1f8fcf8e8fe8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:50:47.716202 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.716167    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "90deb294-6975-44dd-ac00-1f8fcf8e8fe8" (UID: "90deb294-6975-44dd-ac00-1f8fcf8e8fe8"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 21:50:47.718078 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.718053    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kube-api-access-4kxmw" (OuterVolumeSpecName: "kube-api-access-4kxmw") pod "90deb294-6975-44dd-ac00-1f8fcf8e8fe8" (UID: "90deb294-6975-44dd-ac00-1f8fcf8e8fe8"). InnerVolumeSpecName "kube-api-access-4kxmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:50:47.718078 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.718064    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "90deb294-6975-44dd-ac00-1f8fcf8e8fe8" (UID: "90deb294-6975-44dd-ac00-1f8fcf8e8fe8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 21:50:47.773908 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.773876    2549 generic.go:356] "Generic (PLEG): container finished" podID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerID="70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5" exitCode=0
Jul 24 21:50:47.774044 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.773927    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"
Jul 24 21:50:47.774044 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.773953    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" event={"ID":"90deb294-6975-44dd-ac00-1f8fcf8e8fe8","Type":"ContainerDied","Data":"70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5"}
Jul 24 21:50:47.774044 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.774018    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh" event={"ID":"90deb294-6975-44dd-ac00-1f8fcf8e8fe8","Type":"ContainerDied","Data":"60bc4ebd8151328f4c254429406b91bd63eda34eecc7b70ca9aec836d41e18aa"}
Jul 24 21:50:47.774044 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.774045    2549 scope.go:117] "RemoveContainer" containerID="6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa"
Jul 24 21:50:47.782881 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.782861    2549 scope.go:117] "RemoveContainer" containerID="70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5"
Jul 24 21:50:47.790099 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.790081    2549 scope.go:117] "RemoveContainer" containerID="19b1011054d9149f5fbdaf83368d5c6e9073d722c268299df7c6aa0892d3495f"
Jul 24 21:50:47.797293 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.797254    2549 scope.go:117] "RemoveContainer" containerID="6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa"
Jul 24 21:50:47.797603 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:50:47.797578    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa\": container with ID starting with 6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa not found: ID does not exist" containerID="6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa"
Jul 24 21:50:47.797686 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.797613    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa"} err="failed to get container status \"6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa\": rpc error: code = NotFound desc = could not find container \"6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa\": container with ID starting with 6bfb3e850412a3d8c0baa337ec20e56801761cc43f9f239b6513ada172af40aa not found: ID does not exist"
Jul 24 21:50:47.797686 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.797632    2549 scope.go:117] "RemoveContainer" containerID="70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5"
Jul 24 21:50:47.797925 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:50:47.797903    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5\": container with ID starting with 70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5 not found: ID does not exist" containerID="70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5"
Jul 24 21:50:47.797985 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.797930    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5"} err="failed to get container status \"70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5\": rpc error: code = NotFound desc = could not find container \"70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5\": container with ID starting with 70adb327c72208fe7f2169fb39bb399faa85eec8a007f0245ba4c5c431a511b5 not found: ID does not exist"
Jul 24 21:50:47.797985 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.797945    2549 scope.go:117] "RemoveContainer" containerID="19b1011054d9149f5fbdaf83368d5c6e9073d722c268299df7c6aa0892d3495f"
Jul 24 21:50:47.798188 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:50:47.798166    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19b1011054d9149f5fbdaf83368d5c6e9073d722c268299df7c6aa0892d3495f\": container with ID starting with 19b1011054d9149f5fbdaf83368d5c6e9073d722c268299df7c6aa0892d3495f not found: ID does not exist" containerID="19b1011054d9149f5fbdaf83368d5c6e9073d722c268299df7c6aa0892d3495f"
Jul 24 21:50:47.798242 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.798195    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19b1011054d9149f5fbdaf83368d5c6e9073d722c268299df7c6aa0892d3495f"} err="failed to get container status \"19b1011054d9149f5fbdaf83368d5c6e9073d722c268299df7c6aa0892d3495f\": rpc error: code = NotFound desc = could not find container \"19b1011054d9149f5fbdaf83368d5c6e9073d722c268299df7c6aa0892d3495f\": container with ID starting with 19b1011054d9149f5fbdaf83368d5c6e9073d722c268299df7c6aa0892d3495f not found: ID does not exist"
Jul 24 21:50:47.800723 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.800700    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"]
Jul 24 21:50:47.806682 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.806661    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-runtime-700df-predictor-55c55666bc-mzbgh"]
Jul 24 21:50:47.816931 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.816906    2549 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-proxy-tls\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:50:47.816931 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.816934    2549 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-cabundle-cert\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:50:47.817078 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.816944    2549 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:50:47.817078 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.816953    2549 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kserve-provision-location\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:50:47.817078 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:47.816963    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kxmw\" (UniqueName: \"kubernetes.io/projected/90deb294-6975-44dd-ac00-1f8fcf8e8fe8-kube-api-access-4kxmw\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:50:48.408892 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:48.408856    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" path="/var/lib/kubelet/pods/90deb294-6975-44dd-ac00-1f8fcf8e8fe8/volumes"
Jul 24 21:50:49.040772 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.040740    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mls98/must-gather-87rs9"]
Jul 24 21:50:49.041157 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.041049    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="storage-initializer"
Jul 24 21:50:49.041157 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.041059    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="storage-initializer"
Jul 24 21:50:49.041157 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.041069    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container"
Jul 24 21:50:49.041157 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.041075    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container"
Jul 24 21:50:49.041157 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.041083    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kube-rbac-proxy"
Jul 24 21:50:49.041157 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.041088    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kube-rbac-proxy"
Jul 24 21:50:49.041157 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.041139    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kube-rbac-proxy"
Jul 24 21:50:49.041157 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.041147    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="90deb294-6975-44dd-ac00-1f8fcf8e8fe8" containerName="kserve-container"
Jul 24 21:50:49.045398 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.045381    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mls98/must-gather-87rs9"
Jul 24 21:50:49.047840 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.047820    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mls98\"/\"kube-root-ca.crt\""
Jul 24 21:50:49.047963 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.047860    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mls98\"/\"openshift-service-ca.crt\""
Jul 24 21:50:49.047963 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.047885    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mls98\"/\"default-dockercfg-n59sk\""
Jul 24 21:50:49.053055 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.053034    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mls98/must-gather-87rs9"]
Jul 24 21:50:49.126243 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.126198    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ab39b16b-02e6-492e-9a1c-999503ef33ad-must-gather-output\") pod \"must-gather-87rs9\" (UID: \"ab39b16b-02e6-492e-9a1c-999503ef33ad\") " pod="openshift-must-gather-mls98/must-gather-87rs9"
Jul 24 21:50:49.126462 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.126251    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rblgd\" (UniqueName: \"kubernetes.io/projected/ab39b16b-02e6-492e-9a1c-999503ef33ad-kube-api-access-rblgd\") pod \"must-gather-87rs9\" (UID: \"ab39b16b-02e6-492e-9a1c-999503ef33ad\") " pod="openshift-must-gather-mls98/must-gather-87rs9"
Jul 24 21:50:49.226790 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.226755    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ab39b16b-02e6-492e-9a1c-999503ef33ad-must-gather-output\") pod \"must-gather-87rs9\" (UID: \"ab39b16b-02e6-492e-9a1c-999503ef33ad\") " pod="openshift-must-gather-mls98/must-gather-87rs9"
Jul 24 21:50:49.226947 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.226796    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rblgd\" (UniqueName: \"kubernetes.io/projected/ab39b16b-02e6-492e-9a1c-999503ef33ad-kube-api-access-rblgd\") pod \"must-gather-87rs9\" (UID: \"ab39b16b-02e6-492e-9a1c-999503ef33ad\") " pod="openshift-must-gather-mls98/must-gather-87rs9"
Jul 24 21:50:49.227139 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.227118    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ab39b16b-02e6-492e-9a1c-999503ef33ad-must-gather-output\") pod \"must-gather-87rs9\" (UID: \"ab39b16b-02e6-492e-9a1c-999503ef33ad\") " pod="openshift-must-gather-mls98/must-gather-87rs9"
Jul 24 21:50:49.236101 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.236077    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rblgd\" (UniqueName: \"kubernetes.io/projected/ab39b16b-02e6-492e-9a1c-999503ef33ad-kube-api-access-rblgd\") pod \"must-gather-87rs9\" (UID: \"ab39b16b-02e6-492e-9a1c-999503ef33ad\") " pod="openshift-must-gather-mls98/must-gather-87rs9"
Jul 24 21:50:49.354963 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.354874    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mls98/must-gather-87rs9"
Jul 24 21:50:49.484650 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.484621    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mls98/must-gather-87rs9"]
Jul 24 21:50:49.487184 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:50:49.487142    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab39b16b_02e6_492e_9a1c_999503ef33ad.slice/crio-0dd5d763277ec5cd50224c379c5efad551b7bab5dbade4a12966dae12091ccf0 WatchSource:0}: Error finding container 0dd5d763277ec5cd50224c379c5efad551b7bab5dbade4a12966dae12091ccf0: Status 404 returned error can't find the container with id 0dd5d763277ec5cd50224c379c5efad551b7bab5dbade4a12966dae12091ccf0
Jul 24 21:50:49.488876 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.488860    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 21:50:49.784122 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:49.784087    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mls98/must-gather-87rs9" event={"ID":"ab39b16b-02e6-492e-9a1c-999503ef33ad","Type":"ContainerStarted","Data":"0dd5d763277ec5cd50224c379c5efad551b7bab5dbade4a12966dae12091ccf0"}
Jul 24 21:50:55.813380 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:55.813351    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mls98/must-gather-87rs9" event={"ID":"ab39b16b-02e6-492e-9a1c-999503ef33ad","Type":"ContainerStarted","Data":"de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8"}
Jul 24 21:50:56.820069 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:56.820033    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mls98/must-gather-87rs9" event={"ID":"ab39b16b-02e6-492e-9a1c-999503ef33ad","Type":"ContainerStarted","Data":"2b5f8f4e9ddfe5fb3f96bd6f64c492dd011ee497b04d9eb58c49f584a330650a"}
Jul 24 21:50:56.836468 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:50:56.836419    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mls98/must-gather-87rs9" podStartSLOduration=1.7520023249999999 podStartE2EDuration="7.836404383s" totalImagesPullingTime="6.084402058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:50:56.835335209 +0000 UTC m=+2159.019008605" watchObservedRunningTime="2026-07-24 21:50:56.836404383 +0000 UTC m=+2159.020077824"
Jul 24 21:51:17.908162 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:17.908072    2549 generic.go:356] "Generic (PLEG): container finished" podID="ab39b16b-02e6-492e-9a1c-999503ef33ad" containerID="de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8" exitCode=0
Jul 24 21:51:17.908644 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:17.908150    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mls98/must-gather-87rs9" event={"ID":"ab39b16b-02e6-492e-9a1c-999503ef33ad","Type":"ContainerDied","Data":"de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8"}
Jul 24 21:51:17.908644 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:17.908474    2549 scope.go:117] "RemoveContainer" containerID="de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8"
Jul 24 21:51:18.561080 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:18.561055    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mls98_must-gather-87rs9_ab39b16b-02e6-492e-9a1c-999503ef33ad/gather/0.log"
Jul 24 21:51:21.880995 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:21.880967    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z9mv2_a8284212-d460-42a6-89de-5dde8f3ebb2e/global-pull-secret-syncer/0.log"
Jul 24 21:51:21.971027 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:21.970997    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-45wph_f4c98a31-a4ff-4948-b133-4d5d1bb852d1/konnectivity-agent/0.log"
Jul 24 21:51:22.080071 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:22.080047    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-234.ec2.internal_58841f079534c869b41ffecd7da2f5d6/haproxy/0.log"
Jul 24 21:51:24.000165 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.000131    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-mls98/must-gather-87rs9"]
Jul 24 21:51:24.000597 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.000327    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-mls98/must-gather-87rs9" podUID="ab39b16b-02e6-492e-9a1c-999503ef33ad" containerName="copy" containerID="cri-o://2b5f8f4e9ddfe5fb3f96bd6f64c492dd011ee497b04d9eb58c49f584a330650a" gracePeriod=2
Jul 24 21:51:24.004843 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.004558    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-mls98/must-gather-87rs9"]
Jul 24 21:51:24.229688 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.229662    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mls98_must-gather-87rs9_ab39b16b-02e6-492e-9a1c-999503ef33ad/copy/0.log"
Jul 24 21:51:24.232166 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.232149    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mls98/must-gather-87rs9"
Jul 24 21:51:24.234254 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:51:24.234230    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-87rs9\" is forbidden: User \"system:node:ip-10-0-138-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-mls98\": no relationship found between node 'ip-10-0-138-234.ec2.internal' and this object" podUID="ab39b16b-02e6-492e-9a1c-999503ef33ad" pod="openshift-must-gather-mls98/must-gather-87rs9"
Jul 24 21:51:24.322628 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.322542    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rblgd\" (UniqueName: \"kubernetes.io/projected/ab39b16b-02e6-492e-9a1c-999503ef33ad-kube-api-access-rblgd\") pod \"ab39b16b-02e6-492e-9a1c-999503ef33ad\" (UID: \"ab39b16b-02e6-492e-9a1c-999503ef33ad\") "
Jul 24 21:51:24.322628 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.322595    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ab39b16b-02e6-492e-9a1c-999503ef33ad-must-gather-output\") pod \"ab39b16b-02e6-492e-9a1c-999503ef33ad\" (UID: \"ab39b16b-02e6-492e-9a1c-999503ef33ad\") "
Jul 24 21:51:24.323990 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.323958    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab39b16b-02e6-492e-9a1c-999503ef33ad-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "ab39b16b-02e6-492e-9a1c-999503ef33ad" (UID: "ab39b16b-02e6-492e-9a1c-999503ef33ad"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 21:51:24.324788 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.324766    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab39b16b-02e6-492e-9a1c-999503ef33ad-kube-api-access-rblgd" (OuterVolumeSpecName: "kube-api-access-rblgd") pod "ab39b16b-02e6-492e-9a1c-999503ef33ad" (UID: "ab39b16b-02e6-492e-9a1c-999503ef33ad"). InnerVolumeSpecName "kube-api-access-rblgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 21:51:24.408339 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.408307    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab39b16b-02e6-492e-9a1c-999503ef33ad" path="/var/lib/kubelet/pods/ab39b16b-02e6-492e-9a1c-999503ef33ad/volumes"
Jul 24 21:51:24.423203 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.423178    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rblgd\" (UniqueName: \"kubernetes.io/projected/ab39b16b-02e6-492e-9a1c-999503ef33ad-kube-api-access-rblgd\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:51:24.423203 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.423202    2549 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ab39b16b-02e6-492e-9a1c-999503ef33ad-must-gather-output\") on node \"ip-10-0-138-234.ec2.internal\" DevicePath \"\""
Jul 24 21:51:24.935793 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.935765    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mls98_must-gather-87rs9_ab39b16b-02e6-492e-9a1c-999503ef33ad/copy/0.log"
Jul 24 21:51:24.936127 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.936101    2549 generic.go:356] "Generic (PLEG): container finished" podID="ab39b16b-02e6-492e-9a1c-999503ef33ad" containerID="2b5f8f4e9ddfe5fb3f96bd6f64c492dd011ee497b04d9eb58c49f584a330650a" exitCode=143
Jul 24 21:51:24.936189 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.936153    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mls98/must-gather-87rs9"
Jul 24 21:51:24.936189 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.936178    2549 scope.go:117] "RemoveContainer" containerID="2b5f8f4e9ddfe5fb3f96bd6f64c492dd011ee497b04d9eb58c49f584a330650a"
Jul 24 21:51:24.943675 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.943655    2549 scope.go:117] "RemoveContainer" containerID="de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8"
Jul 24 21:51:24.955633 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.955615    2549 scope.go:117] "RemoveContainer" containerID="2b5f8f4e9ddfe5fb3f96bd6f64c492dd011ee497b04d9eb58c49f584a330650a"
Jul 24 21:51:24.955884 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:51:24.955858    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b5f8f4e9ddfe5fb3f96bd6f64c492dd011ee497b04d9eb58c49f584a330650a\": container with ID starting with 2b5f8f4e9ddfe5fb3f96bd6f64c492dd011ee497b04d9eb58c49f584a330650a not found: ID does not exist" containerID="2b5f8f4e9ddfe5fb3f96bd6f64c492dd011ee497b04d9eb58c49f584a330650a"
Jul 24 21:51:24.956002 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.955888    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b5f8f4e9ddfe5fb3f96bd6f64c492dd011ee497b04d9eb58c49f584a330650a"} err="failed to get container status \"2b5f8f4e9ddfe5fb3f96bd6f64c492dd011ee497b04d9eb58c49f584a330650a\": rpc error: code = NotFound desc = could not find container \"2b5f8f4e9ddfe5fb3f96bd6f64c492dd011ee497b04d9eb58c49f584a330650a\": container with ID starting with 2b5f8f4e9ddfe5fb3f96bd6f64c492dd011ee497b04d9eb58c49f584a330650a not found: ID does not exist"
Jul 24 21:51:24.956002 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.955906    2549 scope.go:117] "RemoveContainer" containerID="de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8"
Jul 24 21:51:24.956178 ip-10-0-138-234 kubenswrapper[2549]: E0724 21:51:24.956160    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8\": container with ID starting with de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8 not found: ID does not exist" containerID="de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8"
Jul 24 21:51:24.956219 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:24.956184    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8"} err="failed to get container status \"de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8\": rpc error: code = NotFound desc = could not find container \"de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8\": container with ID starting with de70ea0bbdd07c9ee984b31f3ff3f68ab48a2462c9e17db2bcc449cca9bed8c8 not found: ID does not exist"
Jul 24 21:51:25.762389 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:25.762362    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43593b9e-5dc8-4560-a590-6813ddedefaa/alertmanager/0.log"
Jul 24 21:51:25.798378 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:25.798353    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43593b9e-5dc8-4560-a590-6813ddedefaa/config-reloader/0.log"
Jul 24 21:51:25.834358 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:25.834336    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43593b9e-5dc8-4560-a590-6813ddedefaa/kube-rbac-proxy-web/0.log"
Jul 24 21:51:25.863636 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:25.863616    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43593b9e-5dc8-4560-a590-6813ddedefaa/kube-rbac-proxy/0.log"
Jul 24 21:51:25.903417 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:25.903391    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43593b9e-5dc8-4560-a590-6813ddedefaa/kube-rbac-proxy-metric/0.log"
Jul 24 21:51:25.948956 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:25.948933    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43593b9e-5dc8-4560-a590-6813ddedefaa/prom-label-proxy/0.log"
Jul 24 21:51:25.992876 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:25.992852    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_43593b9e-5dc8-4560-a590-6813ddedefaa/init-config-reloader/0.log"
Jul 24 21:51:26.211672 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:26.211588    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-2pprd_2527c8dd-74fe-4165-afb7-ebab68962c58/monitoring-plugin/0.log"
Jul 24 21:51:26.456944 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:26.456917    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wc7pw_d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8/node-exporter/0.log"
Jul 24 21:51:26.491734 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:26.491663    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wc7pw_d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8/kube-rbac-proxy/0.log"
Jul 24 21:51:26.533236 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:26.533210    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wc7pw_d69c6959-a5fe-41b5-a638-6d9c5c7b2fe8/init-textfile/0.log"
Jul 24 21:51:27.363554 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:27.363521    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b8998f574-7qw9l_15f7819d-7e38-4a9e-9f65-2b79a6437c55/thanos-query/0.log"
Jul 24 21:51:27.392571 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:27.392548    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b8998f574-7qw9l_15f7819d-7e38-4a9e-9f65-2b79a6437c55/kube-rbac-proxy-web/0.log"
Jul 24 21:51:27.419132 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:27.419102    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b8998f574-7qw9l_15f7819d-7e38-4a9e-9f65-2b79a6437c55/kube-rbac-proxy/0.log"
Jul 24 21:51:27.446516 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:27.446490    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b8998f574-7qw9l_15f7819d-7e38-4a9e-9f65-2b79a6437c55/prom-label-proxy/0.log"
Jul 24 21:51:27.470508 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:27.470485    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b8998f574-7qw9l_15f7819d-7e38-4a9e-9f65-2b79a6437c55/kube-rbac-proxy-rules/0.log"
Jul 24 21:51:27.495797 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:27.495763    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b8998f574-7qw9l_15f7819d-7e38-4a9e-9f65-2b79a6437c55/kube-rbac-proxy-metrics/0.log"
Jul 24 21:51:28.862702 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:28.862675    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-48z8b_69462d3d-76a5-4c50-bff1-acc487aaa2ed/networking-console-plugin/0.log"
Jul 24 21:51:29.842360 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.842316    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-ppdzp_ed649641-c902-48c0-bb64-6adc98969cff/download-server/0.log"
Jul 24 21:51:29.872235 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.872205    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"]
Jul 24 21:51:29.872600 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.872535    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab39b16b-02e6-492e-9a1c-999503ef33ad" containerName="gather"
Jul 24 21:51:29.872600 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.872551    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab39b16b-02e6-492e-9a1c-999503ef33ad" containerName="gather"
Jul 24 21:51:29.872600 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.872579    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab39b16b-02e6-492e-9a1c-999503ef33ad" containerName="copy"
Jul 24 21:51:29.872600 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.872585    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab39b16b-02e6-492e-9a1c-999503ef33ad" containerName="copy"
Jul 24 21:51:29.872724 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.872633    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab39b16b-02e6-492e-9a1c-999503ef33ad" containerName="gather"
Jul 24 21:51:29.872724 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.872644    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab39b16b-02e6-492e-9a1c-999503ef33ad" containerName="copy"
Jul 24 21:51:29.877544 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.877526    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:29.880233 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.880213    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-64p2h\"/\"kube-root-ca.crt\""
Jul 24 21:51:29.880938 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.880920    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-64p2h\"/\"openshift-service-ca.crt\""
Jul 24 21:51:29.881021 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.880939    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-64p2h\"/\"default-dockercfg-7x6wv\""
Jul 24 21:51:29.887520 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.887498    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"]
Jul 24 21:51:29.962537 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.962509    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d48bd392-ac99-43fc-af7a-236f41c036f3-proc\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:29.962705 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.962560    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckbmq\" (UniqueName: \"kubernetes.io/projected/d48bd392-ac99-43fc-af7a-236f41c036f3-kube-api-access-ckbmq\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:29.962705 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.962588    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d48bd392-ac99-43fc-af7a-236f41c036f3-podres\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:29.962705 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.962607    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d48bd392-ac99-43fc-af7a-236f41c036f3-lib-modules\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:29.962705 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:29.962622    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d48bd392-ac99-43fc-af7a-236f41c036f3-sys\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.063912 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.063877    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d48bd392-ac99-43fc-af7a-236f41c036f3-lib-modules\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.063912 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.063913    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d48bd392-ac99-43fc-af7a-236f41c036f3-sys\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.064121 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.063941    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d48bd392-ac99-43fc-af7a-236f41c036f3-proc\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.064121 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.063975    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckbmq\" (UniqueName: \"kubernetes.io/projected/d48bd392-ac99-43fc-af7a-236f41c036f3-kube-api-access-ckbmq\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.064121 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.064003    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d48bd392-ac99-43fc-af7a-236f41c036f3-podres\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.064121 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.064025    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d48bd392-ac99-43fc-af7a-236f41c036f3-sys\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.064121 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.064069    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d48bd392-ac99-43fc-af7a-236f41c036f3-lib-modules\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.064121 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.064087    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d48bd392-ac99-43fc-af7a-236f41c036f3-podres\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.064121 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.064086    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d48bd392-ac99-43fc-af7a-236f41c036f3-proc\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.072951 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.072925    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckbmq\" (UniqueName: \"kubernetes.io/projected/d48bd392-ac99-43fc-af7a-236f41c036f3-kube-api-access-ckbmq\") pod \"perf-node-gather-daemonset-6zk4x\" (UID: \"d48bd392-ac99-43fc-af7a-236f41c036f3\") " pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.187870 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.187790    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.317918 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.317884    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"]
Jul 24 21:51:30.320109 ip-10-0-138-234 kubenswrapper[2549]: W0724 21:51:30.320083    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd48bd392_ac99_43fc_af7a_236f41c036f3.slice/crio-9e208b36b1295bfb878a3f77c4021bd307a2a6dd31b24c704f0e560f1e247d3e WatchSource:0}: Error finding container 9e208b36b1295bfb878a3f77c4021bd307a2a6dd31b24c704f0e560f1e247d3e: Status 404 returned error can't find the container with id 9e208b36b1295bfb878a3f77c4021bd307a2a6dd31b24c704f0e560f1e247d3e
Jul 24 21:51:30.959741 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.959709    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x" event={"ID":"d48bd392-ac99-43fc-af7a-236f41c036f3","Type":"ContainerStarted","Data":"2cfd5f537851e38c5ae06da753c2c4838b9e7ecc9d403c49b18547b45938dd82"}
Jul 24 21:51:30.960132 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.959766    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x" event={"ID":"d48bd392-ac99-43fc-af7a-236f41c036f3","Type":"ContainerStarted","Data":"9e208b36b1295bfb878a3f77c4021bd307a2a6dd31b24c704f0e560f1e247d3e"}
Jul 24 21:51:30.960132 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.959801    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:30.982105 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:30.982058    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x" podStartSLOduration=1.9820453740000001 podStartE2EDuration="1.982045374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:51:30.981542906 +0000 UTC m=+2193.165216299" watchObservedRunningTime="2026-07-24 21:51:30.982045374 +0000 UTC m=+2193.165718768"
Jul 24 21:51:31.594948 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:31.594919    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lvgr5_0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb/dns/0.log"
Jul 24 21:51:31.619360 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:31.619337    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lvgr5_0dc92fe0-bd51-4a01-92b1-27a6bf0c40bb/kube-rbac-proxy/0.log"
Jul 24 21:51:31.645678 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:31.645653    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8n4t9_b98f23e3-646c-4930-a5c6-e4296ea2ca8d/dns-node-resolver/0.log"
Jul 24 21:51:32.178761 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:32.178718    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2jdzt_4114fa7c-7465-42c3-b98b-2464c726d3b6/node-ca/0.log"
Jul 24 21:51:33.439503 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:33.439456    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fxhh6_4d9cd2ce-4f5b-4cbb-9dfa-e8b8a4a21841/serve-healthcheck-canary/0.log"
Jul 24 21:51:34.033935 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:34.033908    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxmn8_42ad4077-85e7-4098-9a9b-36ca924f16ad/kube-rbac-proxy/0.log"
Jul 24 21:51:34.069692 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:34.069666    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxmn8_42ad4077-85e7-4098-9a9b-36ca924f16ad/exporter/0.log"
Jul 24 21:51:34.103959 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:34.103932    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxmn8_42ad4077-85e7-4098-9a9b-36ca924f16ad/extractor/0.log"
Jul 24 21:51:36.974355 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:36.974327    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-64p2h/perf-node-gather-daemonset-6zk4x"
Jul 24 21:51:36.978217 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:36.978193    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-75d9cdbddf-jv8md_bd5f6d5c-6d93-4585-a45b-4872219ccb3d/manager/0.log"
Jul 24 21:51:41.559845 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:41.559809    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-tpmr4_c37eb170-2b48-4f09-a240-05dc74b643f8/migrator/0.log"
Jul 24 21:51:41.599867 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:41.599835    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-tpmr4_c37eb170-2b48-4f09-a240-05dc74b643f8/graceful-termination/0.log"
Jul 24 21:51:42.989810 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:42.989783    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f66pj_84ea809a-0e0a-43ae-9887-511531a13985/kube-multus-additional-cni-plugins/0.log"
Jul 24 21:51:43.017511 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:43.017488    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f66pj_84ea809a-0e0a-43ae-9887-511531a13985/egress-router-binary-copy/0.log"
Jul 24 21:51:43.056990 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:43.056970    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f66pj_84ea809a-0e0a-43ae-9887-511531a13985/cni-plugins/0.log"
Jul 24 21:51:43.092771 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:43.092750    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f66pj_84ea809a-0e0a-43ae-9887-511531a13985/bond-cni-plugin/0.log"
Jul 24 21:51:43.126090 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:43.126064    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f66pj_84ea809a-0e0a-43ae-9887-511531a13985/routeoverride-cni/0.log"
Jul 24 21:51:43.159755 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:43.159730    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f66pj_84ea809a-0e0a-43ae-9887-511531a13985/whereabouts-cni-bincopy/0.log"
Jul 24 21:51:43.184890 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:43.184868    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f66pj_84ea809a-0e0a-43ae-9887-511531a13985/whereabouts-cni/0.log"
Jul 24 21:51:43.628787 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:43.628745    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ml8jl_4de9c6b6-0e66-4773-b4d4-6b395f1f6cef/kube-multus/0.log"
Jul 24 21:51:43.729632 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:43.729594    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-swh5h_09a761ee-8038-4b88-ab1d-c6b7462a7f13/network-metrics-daemon/0.log"
Jul 24 21:51:43.751900 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:43.751854    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-swh5h_09a761ee-8038-4b88-ab1d-c6b7462a7f13/kube-rbac-proxy/0.log"
Jul 24 21:51:45.098433 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:45.098396    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z75rk_52a8bba3-fd08-4389-b149-fb57d0def826/ovn-controller/0.log"
Jul 24 21:51:45.120490 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:45.120462    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z75rk_52a8bba3-fd08-4389-b149-fb57d0def826/ovn-acl-logging/0.log"
Jul 24 21:51:45.146857 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:45.146824    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z75rk_52a8bba3-fd08-4389-b149-fb57d0def826/kube-rbac-proxy-node/0.log"
Jul 24 21:51:45.177533 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:45.177504    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z75rk_52a8bba3-fd08-4389-b149-fb57d0def826/kube-rbac-proxy-ovn-metrics/0.log"
Jul 24 21:51:45.197921 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:45.197900    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z75rk_52a8bba3-fd08-4389-b149-fb57d0def826/northd/0.log"
Jul 24 21:51:45.221493 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:45.221470    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z75rk_52a8bba3-fd08-4389-b149-fb57d0def826/nbdb/0.log"
Jul 24 21:51:45.247315 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:45.247292    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z75rk_52a8bba3-fd08-4389-b149-fb57d0def826/sbdb/0.log"
Jul 24 21:51:45.290463 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:45.290440    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z75rk_52a8bba3-fd08-4389-b149-fb57d0def826/ovnkube-controller/0.log"
Jul 24 21:51:46.324419 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:46.324395    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-mq8gd_6419d2df-c692-4ca0-85af-316a83c3b6b3/check-endpoints/0.log"
Jul 24 21:51:46.375077 ip-10-0-138-234 kubenswrapper[2549]: I0724 21:51:46.375037    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-cp457_73bd674d-7f25-417d-b153-d8d1351c991b/network-check-target-container/0.log"