Jul 13 18:48:41.687816 ip-10-0-137-93 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 13 18:48:41.687825 ip-10-0-137-93 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 13 18:48:41.687832 ip-10-0-137-93 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 13 18:48:41.687971 ip-10-0-137-93 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 13 18:48:51.722221 ip-10-0-137-93 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 13 18:48:51.722245 ip-10-0-137-93 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c5af0aeaed1f42e08cc89372239debc7 --
Jul 13 18:50:32.463525 ip-10-0-137-93 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.835548    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840826    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840844    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840848    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840851    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840856    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840860    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840863    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840866    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:50:32.859044 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840868    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840871    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840874    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840876    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840879    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840882    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840884    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840887    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840890    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840893    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840896    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840902    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840905    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840908    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840910    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840913    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840918    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840922    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840925    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840927    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:50:33.105930 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840930    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:50:32.906610 ip-10-0-137-93 systemd[1]: Started Kubernetes Kubelet.
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840933    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840936    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840939    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840942    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840944    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840947    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840950    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840953    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840956    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840959    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840961    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840964    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840968    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840971    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840974    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840977    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840979    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840982    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:50:33.119454 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840985    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840990    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840994    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.840999    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841002    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841006    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841008    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841011    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841014    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841016    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841019    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841022    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841025    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841028    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841030    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841033    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841036    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841038    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841041    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:50:33.121916 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841044    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841047    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841049    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841052    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841054    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841058    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841060    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841063    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841065    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841071    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841075    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841078    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841082    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841085    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841088    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841091    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841094    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841097    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841100    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:50:33.123902 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841103    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841105    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841108    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841110    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841113    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841116    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841119    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841122    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841124    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841127    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841129    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841132    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841135    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841138    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841957    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841964    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841967    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841971    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841976    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:50:33.126528 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841979    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841982    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841985    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841988    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841990    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841993    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841996    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.841999    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842002    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842005    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842008    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842011    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842014    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842017    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842019    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842022    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842025    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842028    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842031    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842034    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:50:33.134375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842037    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842040    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842043    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842046    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842049    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842052    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842054    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842057    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842059    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842062    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842065    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842067    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842070    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842073    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842076    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842078    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842081    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842083    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842086    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842088    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:50:33.135160 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842091    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842093    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842096    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842098    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842100    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842103    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842106    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842108    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842111    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842115    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842119    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842122    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842125    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842128    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842131    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842133    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842136    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842139    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842141    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:50:33.135954 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842144    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842148    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842151    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842154    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842157    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842160    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842162    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842165    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842168    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842170    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842173    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842175    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842178    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842181    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842183    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842186    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842188    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842191    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842193    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842196    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:50:33.136639 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842199    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842203    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842205    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842208    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842210    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842232    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842235    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842238    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842241    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842244    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842246    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842249    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842251    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842254    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842257    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842654    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842658    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842661    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842664    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:50:33.137348 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842667    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842670    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842673    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842675    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842678    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842681    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842684    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842686    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842689    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842692    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842695    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842697    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842700    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842703    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842707    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842711    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842714    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842717    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842720    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842723    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:50:33.137949 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842725    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842728    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842731    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842733    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842735    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842740    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842743    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842746    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842749    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842752    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842755    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842758    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842761    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842764    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842766    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842769    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842771    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842774    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842777    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842780    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:50:33.138751 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842783    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842785    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842788    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842791    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842793    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842796    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842798    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842801    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842804    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842806    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842809    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842812    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842815    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842819    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842822    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842824    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842827    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842830    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842832    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:50:33.139391 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842835    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842837    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842840    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842842    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842845    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842847    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842853    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842855    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842858    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842860    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842863    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842865    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842868    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842871    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842873    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842876    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842878    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842880    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842883    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:50:33.140031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842886    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842888    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842891    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842894    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842896    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842902    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842905    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842908    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842910    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842913    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842915    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842918    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842921    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842923    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842925    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842928    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.842931    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843008    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843016    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843022    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843027    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 18:50:33.140779 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843031    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843035    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843047    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843051    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843054    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843058    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843061    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843064    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843067    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843070    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843073    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843076    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843079    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843083    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843087    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843090    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843095    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843098    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843101    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843105    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843108    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843111    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843114    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843117    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 18:50:33.142205 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843120    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843123    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843126    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843129    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843135    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843138    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843141    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843144    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843148    2563 flags.go:64] FLAG: --enable-server="true"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843150    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843154    2563 flags.go:64] FLAG: --event-burst="100"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843158    2563 flags.go:64] FLAG: --event-qps="50"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843161    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843164    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843166    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843170    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843173    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843176    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843179    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843182    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843185    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843188    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843191    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843194    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843199    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 18:50:33.143006 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843202    2563 flags.go:64] FLAG: --feature-gates=""
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843206    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843209    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843212    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843230    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843233    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843236    2563 flags.go:64] FLAG: --help="false"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843239    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843242    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843245    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843248    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843253    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843257    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843260    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843263    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843265    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843268    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843271    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843274    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843277    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843280    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843282    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843285    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843288    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 18:50:33.143677 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843291    2563 flags.go:64] FLAG: --lock-file=""
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843294    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843297    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843300    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843306    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843315    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843318    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843322    2563 flags.go:64] FLAG: --logging-format="text"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843325    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843328    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843331    2563 flags.go:64] FLAG: --manifest-url=""
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843334    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843338    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843341    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843345    2563 flags.go:64] FLAG: --max-pods="110"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843348    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843351    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843354    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843357    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843361    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843365    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843368    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843375    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843379    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843382    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 18:50:33.144353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843384    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843387    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843392    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843395    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843398    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843401    2563 flags.go:64] FLAG: --port="10250"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843404    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843407    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09dcc69084506a457"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843410    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843413    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843416    2563 flags.go:64] FLAG: --register-node="true"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843419    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843423    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843426    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843429    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843433    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843437    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843440    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843443    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843446    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843449    2563 flags.go:64] FLAG: --runonce="false"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843452    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843454    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843457    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843460    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 18:50:33.145021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843463    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843468    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843471    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843474    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843477    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843480    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843483    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843485    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843488    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843491    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843494    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843499    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843502    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843505    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843510    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843513    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843515    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843518    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843521    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843524    2563 flags.go:64] FLAG: --v="2"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843528    2563 flags.go:64] FLAG: --version="false"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843536    2563 flags.go:64] FLAG: --vmodule=""
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843541    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.843544    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843666    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:50:33.145803 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843670    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843673    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843676    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843679    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843682    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843684    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843687    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843690    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843694    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843697    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843699    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843701    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843704    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843706    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843709    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843711    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843714    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843716    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843719    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843722    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:50:33.146462 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843724    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843727    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843729    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843732    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843735    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843737    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843739    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843742    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843744    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843749    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843754    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843757    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843760    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843763    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843766    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843769    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843772    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843775    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843777    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:50:33.147031 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843780    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843785    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843788    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843791    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843794    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843796    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843799    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843802    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843805    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843808    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843811    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843813    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843816    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843818    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843821    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843824    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843827    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843829    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843832    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843834    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:50:33.147545 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843837    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843839    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843843    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843846    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843849    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843851    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843854    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843856    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843859    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843862    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843864    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843867    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843869    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843873    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843875    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843878    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843880    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843883    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843885    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:50:33.148090 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843889    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843892    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843895    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843898    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843901    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843904    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843906    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843909    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843912    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843914    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843917    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843920    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843922    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843925    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843928    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843933    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843937    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843940    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843943    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:50:33.336829 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.843946    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.844814    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.854370    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.854387    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.855258    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.855265    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855331    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855338    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855343    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855347    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855350    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855353    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855356    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855359    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:50:33.337590 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855362    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855364    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855367    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855370    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855372    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855376    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855379    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855381    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855384    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855387    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855390    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855393    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855395    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855398    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855401    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855404    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855407    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855410    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855413    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855416    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:50:33.338161 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855418    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855421    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855423    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855429    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855432    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855435    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855438    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855440    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855443    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855446    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855448    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855451    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855453    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855456    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855459    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855461    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855464    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855467    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855470    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855473    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:50:33.338820 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855475    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855478    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855481    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855483    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855486    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855489    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855492    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855495    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855497    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855506    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855509    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855511    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855517    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855519    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855522    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855525    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855527    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855530    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855533    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855535    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:50:33.339516 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855538    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855540    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855543    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855545    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855548    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855551    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855553    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855556    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855558    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855562    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855565    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855567    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855570    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855573    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855575    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855578    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855581    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855583    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855586    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:50:33.340084 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855588    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855592    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855596    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855600    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855604    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855609    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855613    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855616    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855618    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855621    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855623    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855626    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.855631    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855782    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:50:33.340734 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855786    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855790    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855793    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855795    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855798    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855801    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855803    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855806    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855810    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855812    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855815    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855817    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855820    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855822    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855825    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855827    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855830    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855832    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855835    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855837    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:50:33.341162 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855841    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855843    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855847    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855849    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855853    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855856    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855858    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855861    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855864    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855867    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855871    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855874    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855876    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855879    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855881    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855884    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855887    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855889    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855891    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855894    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:50:33.341792 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855898    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855900    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855903    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855905    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855908    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855910    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855913    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855915    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855918    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855920    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855923    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855925    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855928    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855930    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855932    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855941    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855945    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855949    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855952    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:50:33.342375 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855955    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855958    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855961    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855963    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855966    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855968    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855971    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855973    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855975    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855978    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855981    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855983    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855986    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855989    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855992    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855995    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.855997    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856000    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856002    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856005    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:50:33.342907 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856008    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856010    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856013    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856015    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856018    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856020    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856023    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856027    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856030    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856040    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856043    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856046    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856049    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856052    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856054    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856057    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856059    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856062    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:50:33.343536 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:32.856065    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:50:33.344040 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.856070    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 18:50:33.344040 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.856195    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 18:50:33.344040 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.860158    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 18:50:33.344040 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.861784    2563 server.go:1019] "Starting client certificate rotation"
Jul 13 18:50:33.344040 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.861891    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 18:50:33.344040 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.861938    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 18:50:33.344040 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.864452    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 18:50:33.344040 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.865814    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 18:50:33.344040 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.875089    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 13 18:50:33.344040 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.877791    2563 log.go:25] "Validated CRI v1 image API"
Jul 13 18:50:33.344040 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.878546    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 18:50:33.344040 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.880856    2563 fs.go:135] Filesystem UUIDs: map[3036fee6-6edf-4945-bbf5-5fef52c2dff5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 992dc1d5-8318-47a1-96af-f2c956102bfd:/dev/nvme0n1p4]
Jul 13 18:50:33.344403 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.880873    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 18:50:33.344515 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.885949    2563 manager.go:216] Machine: {Timestamp:2026-07-13 18:50:32.8846859 +0000 UTC m=+0.309197040 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094748 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec233f0698fd656c2ad448c3f515ce3e SystemUUID:ec233f06-98fd-656c-2ad4-48c3f515ce3e BootID:c5af0aea-ed1f-42e0-8cc8-9372239debc7 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:63:bf:0d:0b:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:63:bf:0d:0b:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:df:d8:ab:4e:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 18:50:33.344515 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.886054    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 18:50:33.344515 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.886134    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 18:50:33.344515 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.889185    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 18:50:33.344515 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.889229    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-93.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 18:50:33.344515 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.889974    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 18:50:33.344515 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.889984    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 18:50:33.344515 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.889992    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.890604    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.891743    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.895387    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.895511    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.895539    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.895556    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.895571    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.895581    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.895591    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.895959    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.895976    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.896243    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.898095    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.900425    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.900453    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.900992    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901005    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901011    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901016    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901024    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901029    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901173    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901179    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901185    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901190    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901204    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901228    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901929    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.901936    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.905823    2563 server.go:1268] "Started kubelet"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.906207    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.906194    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.906357    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.908452    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.909062    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.912752    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.913181    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-93.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.913646    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 18:50:33.345240 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.913650    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.913204    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1ee050eca0b12  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 18:50:32.90579637 +0000 UTC m=+0.330307489,LastTimestamp:2026-07-13 18:50:32.90579637 +0000 UTC m=+0.330307489,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.915522    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.915530    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.915651    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.916298    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.916299    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.916332    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.916389    2563 factory.go:55] Registering systemd factory
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.916404    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.916462    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.916474    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.916623    2563 factory.go:153] Registering CRI-O factory
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.916634    2563 factory.go:223] Registration of the crio container factory successfully
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.916686    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.916713    2563 factory.go:103] Registering Raw factory
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.916726    2563 manager.go:1196] Started watching for new ooms in manager
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.917475    2563 manager.go:349] Starting recovery of all containers
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.918423    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.918651    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.932484    2563 manager.go:354] Recovery completed
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.936635    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.939987    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.940025    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.940043    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.940617    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.940629    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.940648    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.940666    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.941404    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.941428    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.941438    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.942789    2563 policy_none.go:49] "None policy: Start"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.942803    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 18:50:33.346470 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.942817    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 18:50:33.347875 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.942920    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1ee0510d40ca4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-93.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 18:50:32.940006564 +0000 UTC m=+0.364517683,LastTimestamp:2026-07-13 18:50:32.940006564 +0000 UTC m=+0.364517683,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 18:50:33.347875 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.944004    2563 policy_none.go:47] "Start"
Jul 13 18:50:33.347875 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.951462    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1ee0510d476d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-93.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 18:50:32.940033747 +0000 UTC m=+0.364544869,LastTimestamp:2026-07-13 18:50:32.940033747 +0000 UTC m=+0.364544869,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 18:50:33.347875 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.964777    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1ee0510d4b404  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-93.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 18:50:32.940049412 +0000 UTC m=+0.364560530,LastTimestamp:2026-07-13 18:50:32.940049412 +0000 UTC m=+0.364560530,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 18:50:33.347875 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.968622    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-93.ec2.internal.18c1ee0510d40ca4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1ee0510d40ca4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-93.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 18:50:32.940006564 +0000 UTC m=+0.364517683,LastTimestamp:2026-07-13 18:50:32.941414877 +0000 UTC m=+0.365925996,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.977248    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-93.ec2.internal.18c1ee0510d476d3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1ee0510d476d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-93.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 18:50:32.940033747 +0000 UTC m=+0.364544869,LastTimestamp:2026-07-13 18:50:32.941433008 +0000 UTC m=+0.365944126,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.980425    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-93.ec2.internal.18c1ee0510d4b404\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1ee0510d4b404  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-93.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 18:50:32.940049412 +0000 UTC m=+0.364560530,LastTimestamp:2026-07-13 18:50:32.941442415 +0000 UTC m=+0.365953532,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.988843    2563 manager.go:337] "Starting Device Plugin manager"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.988872    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.988882    2563 server.go:87] "Starting device plugin registration server"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.989179    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.989191    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.989286    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.989368    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:32.989376    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.989861    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.989914    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:32.993462    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1ee0513ddd749  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 18:50:32.990979913 +0000 UTC m=+0.415491018,LastTimestamp:2026-07-13 18:50:32.990979913 +0000 UTC m=+0.415491018,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.002336    2563 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2595 into the system container \"/system.slice\": <nil>"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.007483    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zq42b"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.018595    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zq42b"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.090342    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:50:33.348110 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.091433    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.091464    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.091475    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.091500    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.105021    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-93.ec2.internal.18c1ee0510d40ca4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1ee0510d40ca4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-93.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 18:50:32.940006564 +0000 UTC m=+0.364517683,LastTimestamp:2026-07-13 18:50:33.091451228 +0000 UTC m=+0.515962346,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.107718    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-93.ec2.internal.18c1ee0510d476d3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1ee0510d476d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-93.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 18:50:32.940033747 +0000 UTC m=+0.364544869,LastTimestamp:2026-07-13 18:50:33.091469632 +0000 UTC m=+0.515980751,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.107853    2563 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-137-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.126695    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-93.ec2.internal\" not found" node="ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.194628    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.195888    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.195934    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.195969    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.196011    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.198317    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.296760    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"]
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.296858    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.298927    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.298961    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.298975    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.300384    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.300502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.557750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.300536    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.301396    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.301404    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.301427    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.301424    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.301439    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.301444    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.302643    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.302667    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.303352    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.303375    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.303384    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.308821    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.309622    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.309654    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.309664    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.309688    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.315815    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.315834    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-93.ec2.internal\": node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.318031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eda63208df358e0e9bf9d712ad8f74a0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-93.ec2.internal\" (UID: \"eda63208df358e0e9bf9d712ad8f74a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.318051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be909fcc1006eb3f5b3a01699bb59d5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"be909fcc1006eb3f5b3a01699bb59d5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.318069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be909fcc1006eb3f5b3a01699bb59d5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"be909fcc1006eb3f5b3a01699bb59d5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.329922    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-93.ec2.internal\" not found" node="ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.334384    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-93.ec2.internal\" not found" node="ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.338515    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 18:50:33.558631 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.418990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eda63208df358e0e9bf9d712ad8f74a0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-93.ec2.internal\" (UID: \"eda63208df358e0e9bf9d712ad8f74a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.559477 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.419024    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be909fcc1006eb3f5b3a01699bb59d5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"be909fcc1006eb3f5b3a01699bb59d5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.559477 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.419040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be909fcc1006eb3f5b3a01699bb59d5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"be909fcc1006eb3f5b3a01699bb59d5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.559477 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.419091    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be909fcc1006eb3f5b3a01699bb59d5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"be909fcc1006eb3f5b3a01699bb59d5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.559477 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.419093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eda63208df358e0e9bf9d712ad8f74a0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-93.ec2.internal\" (UID: \"eda63208df358e0e9bf9d712ad8f74a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.559477 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.419104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be909fcc1006eb3f5b3a01699bb59d5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"be909fcc1006eb3f5b3a01699bb59d5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:33.559477 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.439112    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 18:50:33.559477 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.539910    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 18:50:34.998241 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.632500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:34.998241 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:33.637874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:34.998241 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.640841    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 18:50:34.998241 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:33.741495    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 18:50:35.250050 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:35.026105    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 18:50:35.250050 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.045272    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 18:50:35.250050 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.045432    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 18:50:35.250050 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.124933    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:50:35.250050 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:35.126547    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 18:50:35.250050 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.150018    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:50:35.250050 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.151343    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:50:35.250050 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.151373    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:50:35.250050 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.151383    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:50:35.250050 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.215574    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:50:35.467692 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.290727    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 18:45:34 +0000 UTC" deadline="2028-04-18 09:31:40.474476454 +0000 UTC"
Jul 13 18:50:35.467692 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.290790    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15470h41m5.183689633s"
Jul 13 18:50:35.467692 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.299870    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:35.467692 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.314634    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 18:50:35.467692 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.315448    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"
Jul 13 18:50:35.467692 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.328854    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 18:50:35.676263 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.515088    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:50:35.676263 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:35.586112    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda63208df358e0e9bf9d712ad8f74a0.slice/crio-94ec72c04b6282c9c22a8bfe1dbd05556afa45464ba0d06517c1a143b80c2a48 WatchSource:0}: Error finding container 94ec72c04b6282c9c22a8bfe1dbd05556afa45464ba0d06517c1a143b80c2a48: Status 404 returned error can't find the container with id 94ec72c04b6282c9c22a8bfe1dbd05556afa45464ba0d06517c1a143b80c2a48
Jul 13 18:50:35.676263 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:35.586367    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe909fcc1006eb3f5b3a01699bb59d5e.slice/crio-e79802c61ac1e964929c5f73408f689d9ca440a55481455922f04c593d4f0ae2 WatchSource:0}: Error finding container e79802c61ac1e964929c5f73408f689d9ca440a55481455922f04c593d4f0ae2: Status 404 returned error can't find the container with id e79802c61ac1e964929c5f73408f689d9ca440a55481455922f04c593d4f0ae2
Jul 13 18:50:35.676263 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:35.589894    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 18:50:36.270028 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.268939    2563 apiserver.go:52] "Watching apiserver"
Jul 13 18:50:36.270028 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.269212    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 18:50:36.280751 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.280714    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 18:50:36.283663 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.283629    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jk8fj","kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m","openshift-cluster-node-tuning-operator/tuned-26hxg","openshift-image-registry/node-ca-6qlzx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal","openshift-multus/multus-additional-cni-plugins-zv8ht","openshift-multus/network-metrics-daemon-hfp2m","kube-system/konnectivity-agent-q9p6z","openshift-dns/node-resolver-x96gs","openshift-multus/multus-zqxzx","openshift-network-diagnostics/network-check-target-vw9qv","openshift-network-operator/iptables-alerter-vzc4p","openshift-ovn-kubernetes/ovnkube-node-wv7rg"]
Jul 13 18:50:36.286212 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.286182    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.286345 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.286306    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 18:50:36.288075 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.287628    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vzc4p"
Jul 13 18:50:36.289940 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.289021    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.290033 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.289936    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gvlgg\""
Jul 13 18:50:36.290033 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.290000    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 18:50:36.290033 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.290012    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 18:50:36.290033 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.290024    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 18:50:36.290260 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.290230    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 18:50:36.290325 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.290313    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.290397 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.290380    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hqftg\""
Jul 13 18:50:36.290462 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.290446    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:50:36.290731 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.290714    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 18:50:36.290902 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.290888    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 18:50:36.291647 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.291630    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 18:50:36.293196 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.292826    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 18:50:36.293196 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.292967    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 18:50:36.293196 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.293077    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 18:50:36.293196 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.293181    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fn6nj\""
Jul 13 18:50:36.293444 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.293180    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:50:36.293444 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.293348    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 18:50:36.293877 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.293852    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qlzx"
Jul 13 18:50:36.294560 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.294505    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w4p8m\""
Jul 13 18:50:36.295579 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.294955    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.297346 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.297192    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 18:50:36.297346 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.297344    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vv6cw\""
Jul 13 18:50:36.298258 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.297639    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q9p6z"
Jul 13 18:50:36.298258 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.297662    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 18:50:36.298258 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.297815    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4d59l\""
Jul 13 18:50:36.298258 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.297870    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 18:50:36.298258 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.297889    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 18:50:36.298258 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.298034    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:36.298258 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.298078    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 18:50:36.298258 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.298128    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 18:50:36.298258 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.298178    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 18:50:36.298736 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.298265    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 18:50:36.298736 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.298323    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 18:50:36.299515 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.299205    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:50:36.299515 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.299405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:36.299515 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.299483    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:50:36.301002 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.300963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x96gs"
Jul 13 18:50:36.301703 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.301552    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 18:50:36.301703 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.301612    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 18:50:36.302214 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.302023    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mv8w6\""
Jul 13 18:50:36.302907 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.302471    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.304108 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.303505    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 18:50:36.304108 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.303710    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rtbkd\""
Jul 13 18:50:36.304108 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.303880    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 18:50:36.304108 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.303974    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:36.304108 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.304042    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:50:36.305199 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.305011    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 18:50:36.305199 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.305014    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dzjz4\""
Jul 13 18:50:36.310111 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.310081    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4kf29"
Jul 13 18:50:36.318358 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.318335    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4kf29"
Jul 13 18:50:36.370840 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.370609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d48252d-f661-4f65-83a0-21de770514c6-os-release\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.370840 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.370646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89172f0d-6dea-4555-8d41-e50e2b851fea-host-slash\") pod \"iptables-alerter-vzc4p\" (UID: \"89172f0d-6dea-4555-8d41-e50e2b851fea\") " pod="openshift-network-operator/iptables-alerter-vzc4p"
Jul 13 18:50:36.370840 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.370677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:36.370840 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.370703    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:36.370840 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.370725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d48252d-f661-4f65-83a0-21de770514c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.370840 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.370749    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-host\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.370840 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.370772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-log-socket\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.370840 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.370805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9j6b\" (UniqueName: \"kubernetes.io/projected/1314aee4-22f1-483d-a144-4df45468fb5d-kube-api-access-h9j6b\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.370845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4c17dfc-0204-4039-89ff-97908d34bc39-host\") pod \"node-ca-6qlzx\" (UID: \"e4c17dfc-0204-4039-89ff-97908d34bc39\") " pod="openshift-image-registry/node-ca-6qlzx"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.370895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-var-lib-openvswitch\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.370943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-run-ovn\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.370995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4d48252d-f661-4f65-83a0-21de770514c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-var-lib-kubelet\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371052    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s8dc\" (UniqueName: \"kubernetes.io/projected/77d65125-686b-44c9-a11b-1d76c422750a-kube-api-access-5s8dc\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-slash\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-socket-dir\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-systemd-units\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-run-systemd\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-cni-bin\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-sysctl-conf\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.371289 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d48252d-f661-4f65-83a0-21de770514c6-system-cni-dir\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371302    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-sysconfig\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1314aee4-22f1-483d-a144-4df45468fb5d-ovn-node-metrics-cert\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77d65125-686b-44c9-a11b-1d76c422750a-etc-tuned\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77d65125-686b-44c9-a11b-1d76c422750a-tmp\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-kubelet\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-cni-netd\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d737860c-a9d2-4449-8efd-0e657689675d-dbus\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d48252d-f661-4f65-83a0-21de770514c6-cnibin\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89172f0d-6dea-4555-8d41-e50e2b851fea-iptables-alerter-script\") pod \"iptables-alerter-vzc4p\" (UID: \"89172f0d-6dea-4555-8d41-e50e2b851fea\") " pod="openshift-network-operator/iptables-alerter-vzc4p"
Jul 13 18:50:36.371874 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-sysctl-d\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-lib-modules\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371645    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/96b30717-80d6-4db4-b93d-e6a8851547ac-hosts-file\") pod \"node-resolver-x96gs\" (UID: \"96b30717-80d6-4db4-b93d-e6a8851547ac\") " pod="openshift-dns/node-resolver-x96gs"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d48252d-f661-4f65-83a0-21de770514c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4d48252d-f661-4f65-83a0-21de770514c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4tbn\" (UniqueName: \"kubernetes.io/projected/4d48252d-f661-4f65-83a0-21de770514c6-kube-api-access-x4tbn\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371730    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5n7l\" (UniqueName: \"kubernetes.io/projected/89172f0d-6dea-4555-8d41-e50e2b851fea-kube-api-access-m5n7l\") pod \"iptables-alerter-vzc4p\" (UID: \"89172f0d-6dea-4555-8d41-e50e2b851fea\") " pod="openshift-network-operator/iptables-alerter-vzc4p"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-sys-fs\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371757    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-kubernetes\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1314aee4-22f1-483d-a144-4df45468fb5d-ovnkube-config\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-systemd\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-run\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-sys\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.372506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-etc-openvswitch\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371876    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-node-log\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjb8x\" (UniqueName: \"kubernetes.io/projected/96b30717-80d6-4db4-b93d-e6a8851547ac-kube-api-access-bjb8x\") pod \"node-resolver-x96gs\" (UID: \"96b30717-80d6-4db4-b93d-e6a8851547ac\") " pod="openshift-dns/node-resolver-x96gs"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-registration-dir\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6sdb\" (UniqueName: \"kubernetes.io/projected/03c21da3-e4a8-4282-8391-deaaac76aba1-kube-api-access-w6sdb\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1314aee4-22f1-483d-a144-4df45468fb5d-env-overrides\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.371988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1314aee4-22f1-483d-a144-4df45468fb5d-ovnkube-script-lib\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.372025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42-agent-certs\") pod \"konnectivity-agent-q9p6z\" (UID: \"7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42\") " pod="kube-system/konnectivity-agent-q9p6z"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.372040    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74t4n\" (UniqueName: \"kubernetes.io/projected/b7e0b486-78b0-47b8-a1c6-191368ae0913-kube-api-access-74t4n\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.372057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4c17dfc-0204-4039-89ff-97908d34bc39-serviceca\") pod \"node-ca-6qlzx\" (UID: \"e4c17dfc-0204-4039-89ff-97908d34bc39\") " pod="openshift-image-registry/node-ca-6qlzx"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.372080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-device-dir\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.372116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-etc-selinux\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.372136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-modprobe-d\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.373131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.372150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-run-netns\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.373770 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.372166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d737860c-a9d2-4449-8efd-0e657689675d-kubelet-config\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:36.373770 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.372182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-run-openvswitch\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.373770 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.372195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42-konnectivity-ca\") pod \"konnectivity-agent-q9p6z\" (UID: \"7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42\") " pod="kube-system/konnectivity-agent-q9p6z"
Jul 13 18:50:36.373770 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.372214    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9jxq\" (UniqueName: \"kubernetes.io/projected/e4c17dfc-0204-4039-89ff-97908d34bc39-kube-api-access-h9jxq\") pod \"node-ca-6qlzx\" (UID: \"e4c17dfc-0204-4039-89ff-97908d34bc39\") " pod="openshift-image-registry/node-ca-6qlzx"
Jul 13 18:50:36.373770 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.372229    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96b30717-80d6-4db4-b93d-e6a8851547ac-tmp-dir\") pod \"node-resolver-x96gs\" (UID: \"96b30717-80d6-4db4-b93d-e6a8851547ac\") " pod="openshift-dns/node-resolver-x96gs"
Jul 13 18:50:36.385559 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.385516    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" event={"ID":"be909fcc1006eb3f5b3a01699bb59d5e","Type":"ContainerStarted","Data":"e79802c61ac1e964929c5f73408f689d9ca440a55481455922f04c593d4f0ae2"}
Jul 13 18:50:36.386732 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.386701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" event={"ID":"eda63208df358e0e9bf9d712ad8f74a0","Type":"ContainerStarted","Data":"94ec72c04b6282c9c22a8bfe1dbd05556afa45464ba0d06517c1a143b80c2a48"}
Jul 13 18:50:36.402303 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.402284    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 18:50:36.438315 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.438288    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.472964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-sysconfig\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1314aee4-22f1-483d-a144-4df45468fb5d-ovn-node-metrics-cert\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-var-lib-cni-multus\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-hostroot\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-run-multus-certs\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77d65125-686b-44c9-a11b-1d76c422750a-etc-tuned\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77d65125-686b-44c9-a11b-1d76c422750a-tmp\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-kubelet\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-multus-cni-dir\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-multus-socket-dir-parent\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvp88\" (UniqueName: \"kubernetes.io/projected/67048f8b-9f47-401c-899c-a5cfb8bb2743-kube-api-access-vvp88\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.475279 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-cni-netd\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d737860c-a9d2-4449-8efd-0e657689675d-dbus\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d48252d-f661-4f65-83a0-21de770514c6-cnibin\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89172f0d-6dea-4555-8d41-e50e2b851fea-iptables-alerter-script\") pod \"iptables-alerter-vzc4p\" (UID: \"89172f0d-6dea-4555-8d41-e50e2b851fea\") " pod="openshift-network-operator/iptables-alerter-vzc4p"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-sysctl-d\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-lib-modules\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473465    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/96b30717-80d6-4db4-b93d-e6a8851547ac-hosts-file\") pod \"node-resolver-x96gs\" (UID: \"96b30717-80d6-4db4-b93d-e6a8851547ac\") " pod="openshift-dns/node-resolver-x96gs"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-kubelet\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474305    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-cni-netd\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474306    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d48252d-f661-4f65-83a0-21de770514c6-cnibin\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-sysconfig\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-sysctl-d\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.476063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d737860c-a9d2-4449-8efd-0e657689675d-dbus\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474662    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-lib-modules\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.473472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/96b30717-80d6-4db4-b93d-e6a8851547ac-hosts-file\") pod \"node-resolver-x96gs\" (UID: \"96b30717-80d6-4db4-b93d-e6a8851547ac\") " pod="openshift-dns/node-resolver-x96gs"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d48252d-f661-4f65-83a0-21de770514c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4d48252d-f661-4f65-83a0-21de770514c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474761    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89172f0d-6dea-4555-8d41-e50e2b851fea-iptables-alerter-script\") pod \"iptables-alerter-vzc4p\" (UID: \"89172f0d-6dea-4555-8d41-e50e2b851fea\") " pod="openshift-network-operator/iptables-alerter-vzc4p"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4tbn\" (UniqueName: \"kubernetes.io/projected/4d48252d-f661-4f65-83a0-21de770514c6-kube-api-access-x4tbn\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5n7l\" (UniqueName: \"kubernetes.io/projected/89172f0d-6dea-4555-8d41-e50e2b851fea-kube-api-access-m5n7l\") pod \"iptables-alerter-vzc4p\" (UID: \"89172f0d-6dea-4555-8d41-e50e2b851fea\") " pod="openshift-network-operator/iptables-alerter-vzc4p"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-sys-fs\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-kubernetes\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1314aee4-22f1-483d-a144-4df45468fb5d-ovnkube-config\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-systemd\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474922    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d48252d-f661-4f65-83a0-21de770514c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-run\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.476953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-sys\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-etc-openvswitch\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-sys-fs\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.474993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-node-log\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-cnibin\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjb8x\" (UniqueName: \"kubernetes.io/projected/96b30717-80d6-4db4-b93d-e6a8851547ac-kube-api-access-bjb8x\") pod \"node-resolver-x96gs\" (UID: \"96b30717-80d6-4db4-b93d-e6a8851547ac\") " pod="openshift-dns/node-resolver-x96gs"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-registration-dir\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-systemd\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6sdb\" (UniqueName: \"kubernetes.io/projected/03c21da3-e4a8-4282-8391-deaaac76aba1-kube-api-access-w6sdb\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1314aee4-22f1-483d-a144-4df45468fb5d-env-overrides\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1314aee4-22f1-483d-a144-4df45468fb5d-ovnkube-script-lib\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42-agent-certs\") pod \"konnectivity-agent-q9p6z\" (UID: \"7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42\") " pod="kube-system/konnectivity-agent-q9p6z"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475175    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-kubernetes\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74t4n\" (UniqueName: \"kubernetes.io/projected/b7e0b486-78b0-47b8-a1c6-191368ae0913-kube-api-access-74t4n\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:36.477623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4c17dfc-0204-4039-89ff-97908d34bc39-serviceca\") pod \"node-ca-6qlzx\" (UID: \"e4c17dfc-0204-4039-89ff-97908d34bc39\") " pod="openshift-image-registry/node-ca-6qlzx"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-device-dir\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-etc-selinux\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-modprobe-d\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475307    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-registration-dir\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475310    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4d48252d-f661-4f65-83a0-21de770514c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-etc-kubernetes\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475398    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-etc-openvswitch\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475404    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-run\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475434    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-sys\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-run-netns\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-modprobe-d\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-device-dir\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475748    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-node-log\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.478281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-run-netns\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67048f8b-9f47-401c-899c-a5cfb8bb2743-cni-binary-copy\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-724kf\" (UniqueName: \"kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf\") pod \"network-check-target-vw9qv\" (UID: \"b56462b4-a20f-4b98-8ee8-c482da1e19e3\") " pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d737860c-a9d2-4449-8efd-0e657689675d-kubelet-config\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.475994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4c17dfc-0204-4039-89ff-97908d34bc39-serviceca\") pod \"node-ca-6qlzx\" (UID: \"e4c17dfc-0204-4039-89ff-97908d34bc39\") " pod="openshift-image-registry/node-ca-6qlzx"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-run-openvswitch\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42-konnectivity-ca\") pod \"konnectivity-agent-q9p6z\" (UID: \"7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42\") " pod="kube-system/konnectivity-agent-q9p6z"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9jxq\" (UniqueName: \"kubernetes.io/projected/e4c17dfc-0204-4039-89ff-97908d34bc39-kube-api-access-h9jxq\") pod \"node-ca-6qlzx\" (UID: \"e4c17dfc-0204-4039-89ff-97908d34bc39\") " pod="openshift-image-registry/node-ca-6qlzx"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-os-release\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476163    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1314aee4-22f1-483d-a144-4df45468fb5d-env-overrides\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476164    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-run-k8s-cni-cncf-io\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-var-lib-kubelet\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d737860c-a9d2-4449-8efd-0e657689675d-kubelet-config\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96b30717-80d6-4db4-b93d-e6a8851547ac-tmp-dir\") pod \"node-resolver-x96gs\" (UID: \"96b30717-80d6-4db4-b93d-e6a8851547ac\") " pod="openshift-dns/node-resolver-x96gs"
Jul 13 18:50:36.479057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-run-netns\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476330    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1314aee4-22f1-483d-a144-4df45468fb5d-ovnkube-script-lib\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d48252d-f661-4f65-83a0-21de770514c6-os-release\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89172f0d-6dea-4555-8d41-e50e2b851fea-host-slash\") pod \"iptables-alerter-vzc4p\" (UID: \"89172f0d-6dea-4555-8d41-e50e2b851fea\") " pod="openshift-network-operator/iptables-alerter-vzc4p"
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1314aee4-22f1-483d-a144-4df45468fb5d-ovnkube-config\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d48252d-f661-4f65-83a0-21de770514c6-os-release\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476501    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89172f0d-6dea-4555-8d41-e50e2b851fea-host-slash\") pod \"iptables-alerter-vzc4p\" (UID: \"89172f0d-6dea-4555-8d41-e50e2b851fea\") " pod="openshift-network-operator/iptables-alerter-vzc4p"
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.476534    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-system-cni-dir\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-run-openvswitch\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96b30717-80d6-4db4-b93d-e6a8851547ac-tmp-dir\") pod \"node-resolver-x96gs\" (UID: \"96b30717-80d6-4db4-b93d-e6a8851547ac\") " pod="openshift-dns/node-resolver-x96gs"
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.476616    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret podName:d737860c-a9d2-4449-8efd-0e657689675d nodeName:}" failed. No retries permitted until 2026-07-13 18:50:36.976596305 +0000 UTC m=+3.217077240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret") pod "global-pull-secret-syncer-jk8fj" (UID: "d737860c-a9d2-4449-8efd-0e657689675d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:50:36.479776 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476535    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-etc-selinux\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-var-lib-cni-bin\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d48252d-f661-4f65-83a0-21de770514c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-host\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-log-socket\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9j6b\" (UniqueName: \"kubernetes.io/projected/1314aee4-22f1-483d-a144-4df45468fb5d-kube-api-access-h9j6b\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476796    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4c17dfc-0204-4039-89ff-97908d34bc39-host\") pod \"node-ca-6qlzx\" (UID: \"e4c17dfc-0204-4039-89ff-97908d34bc39\") " pod="openshift-image-registry/node-ca-6qlzx"
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-multus-conf-dir\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-var-lib-openvswitch\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.476869    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476903    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-run-ovn\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.476927    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs podName:b7e0b486-78b0-47b8-a1c6-191368ae0913 nodeName:}" failed. No retries permitted until 2026-07-13 18:50:36.976910639 +0000 UTC m=+3.217391572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs") pod "network-metrics-daemon-hfp2m" (UID: "b7e0b486-78b0-47b8-a1c6-191368ae0913") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-run-ovn\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476963    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-log-socket\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.480506 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4d48252d-f661-4f65-83a0-21de770514c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.476998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-var-lib-kubelet\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s8dc\" (UniqueName: \"kubernetes.io/projected/77d65125-686b-44c9-a11b-1d76c422750a-kube-api-access-5s8dc\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-slash\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-socket-dir\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-systemd-units\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42-konnectivity-ca\") pod \"konnectivity-agent-q9p6z\" (UID: \"7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42\") " pod="kube-system/konnectivity-agent-q9p6z"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-run-systemd\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-cni-bin\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-sysctl-conf\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67048f8b-9f47-401c-899c-a5cfb8bb2743-multus-daemon-config\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d48252d-f661-4f65-83a0-21de770514c6-system-cni-dir\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477401    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-systemd-units\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.481051 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-slash\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03c21da3-e4a8-4282-8391-deaaac76aba1-socket-dir\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-run-systemd\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-host-cni-bin\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477657    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77d65125-686b-44c9-a11b-1d76c422750a-tmp\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-host\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477737    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-etc-sysctl-conf\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d48252d-f661-4f65-83a0-21de770514c6-system-cni-dir\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1314aee4-22f1-483d-a144-4df45468fb5d-var-lib-openvswitch\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477840    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4d48252d-f661-4f65-83a0-21de770514c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477896    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77d65125-686b-44c9-a11b-1d76c422750a-var-lib-kubelet\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477947    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4c17dfc-0204-4039-89ff-97908d34bc39-host\") pod \"node-ca-6qlzx\" (UID: \"e4c17dfc-0204-4039-89ff-97908d34bc39\") " pod="openshift-image-registry/node-ca-6qlzx"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.477986    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d48252d-f661-4f65-83a0-21de770514c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.478568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1314aee4-22f1-483d-a144-4df45468fb5d-ovn-node-metrics-cert\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.481512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.480047    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77d65125-686b-44c9-a11b-1d76c422750a-etc-tuned\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.482079 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.480820    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42-agent-certs\") pod \"konnectivity-agent-q9p6z\" (UID: \"7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42\") " pod="kube-system/konnectivity-agent-q9p6z"
Jul 13 18:50:36.486593 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.486559    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5n7l\" (UniqueName: \"kubernetes.io/projected/89172f0d-6dea-4555-8d41-e50e2b851fea-kube-api-access-m5n7l\") pod \"iptables-alerter-vzc4p\" (UID: \"89172f0d-6dea-4555-8d41-e50e2b851fea\") " pod="openshift-network-operator/iptables-alerter-vzc4p"
Jul 13 18:50:36.486985 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.486956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4tbn\" (UniqueName: \"kubernetes.io/projected/4d48252d-f661-4f65-83a0-21de770514c6-kube-api-access-x4tbn\") pod \"multus-additional-cni-plugins-zv8ht\" (UID: \"4d48252d-f661-4f65-83a0-21de770514c6\") " pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.489682 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.489655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6sdb\" (UniqueName: \"kubernetes.io/projected/03c21da3-e4a8-4282-8391-deaaac76aba1-kube-api-access-w6sdb\") pod \"aws-ebs-csi-driver-node-72c9m\" (UID: \"03c21da3-e4a8-4282-8391-deaaac76aba1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.496166 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.496142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjb8x\" (UniqueName: \"kubernetes.io/projected/96b30717-80d6-4db4-b93d-e6a8851547ac-kube-api-access-bjb8x\") pod \"node-resolver-x96gs\" (UID: \"96b30717-80d6-4db4-b93d-e6a8851547ac\") " pod="openshift-dns/node-resolver-x96gs"
Jul 13 18:50:36.497401 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.497367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9jxq\" (UniqueName: \"kubernetes.io/projected/e4c17dfc-0204-4039-89ff-97908d34bc39-kube-api-access-h9jxq\") pod \"node-ca-6qlzx\" (UID: \"e4c17dfc-0204-4039-89ff-97908d34bc39\") " pod="openshift-image-registry/node-ca-6qlzx"
Jul 13 18:50:36.497965 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.497943    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s8dc\" (UniqueName: \"kubernetes.io/projected/77d65125-686b-44c9-a11b-1d76c422750a-kube-api-access-5s8dc\") pod \"tuned-26hxg\" (UID: \"77d65125-686b-44c9-a11b-1d76c422750a\") " pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.498137 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.498114    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9j6b\" (UniqueName: \"kubernetes.io/projected/1314aee4-22f1-483d-a144-4df45468fb5d-kube-api-access-h9j6b\") pod \"ovnkube-node-wv7rg\" (UID: \"1314aee4-22f1-483d-a144-4df45468fb5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.499483 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.499461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74t4n\" (UniqueName: \"kubernetes.io/projected/b7e0b486-78b0-47b8-a1c6-191368ae0913-kube-api-access-74t4n\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:36.577832 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.577796    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-system-cni-dir\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578000 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.577849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-var-lib-cni-bin\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578000 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.577877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-multus-conf-dir\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578000 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.577875    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-system-cni-dir\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578000 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.577908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67048f8b-9f47-401c-899c-a5cfb8bb2743-multus-daemon-config\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578000 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.577935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-var-lib-cni-multus\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578000 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.577938    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-multus-conf-dir\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578000 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.577939    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-var-lib-cni-bin\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578000 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.577958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-hostroot\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578000 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.577982    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-run-multus-certs\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578000 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.577987    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-var-lib-cni-multus\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578000 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-multus-cni-dir\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578025    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-hostroot\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-multus-socket-dir-parent\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvp88\" (UniqueName: \"kubernetes.io/projected/67048f8b-9f47-401c-899c-a5cfb8bb2743-kube-api-access-vvp88\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-run-multus-certs\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-cnibin\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-etc-kubernetes\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67048f8b-9f47-401c-899c-a5cfb8bb2743-cni-binary-copy\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724kf\" (UniqueName: \"kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf\") pod \"network-check-target-vw9qv\" (UID: \"b56462b4-a20f-4b98-8ee8-c482da1e19e3\") " pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-os-release\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-run-k8s-cni-cncf-io\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-var-lib-kubelet\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-run-netns\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-multus-cni-dir\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-os-release\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.578638 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578471    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-run-k8s-cni-cncf-io\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.579406 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578481    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67048f8b-9f47-401c-899c-a5cfb8bb2743-multus-daemon-config\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.579406 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-var-lib-kubelet\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.579406 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578548    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-etc-kubernetes\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.579406 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-cnibin\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.579406 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578549    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-multus-socket-dir-parent\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.579406 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.578559    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67048f8b-9f47-401c-899c-a5cfb8bb2743-host-run-netns\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.579406 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.579287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67048f8b-9f47-401c-899c-a5cfb8bb2743-cni-binary-copy\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.584831 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.584811    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:50:36.584933 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.584837    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:50:36.584933 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.584850    2563 projected.go:196] Error preparing data for projected volume kube-api-access-724kf for pod openshift-network-diagnostics/network-check-target-vw9qv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:50:36.584933 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.584911    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf podName:b56462b4-a20f-4b98-8ee8-c482da1e19e3 nodeName:}" failed. No retries permitted until 2026-07-13 18:50:37.08489419 +0000 UTC m=+3.325375129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-724kf" (UniqueName: "kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf") pod "network-check-target-vw9qv" (UID: "b56462b4-a20f-4b98-8ee8-c482da1e19e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:50:36.587731 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.587692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvp88\" (UniqueName: \"kubernetes.io/projected/67048f8b-9f47-401c-899c-a5cfb8bb2743-kube-api-access-vvp88\") pod \"multus-zqxzx\" (UID: \"67048f8b-9f47-401c-899c-a5cfb8bb2743\") " pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.601607 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.601549    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zv8ht"
Jul 13 18:50:36.611331 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.611304    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vzc4p"
Jul 13 18:50:36.611759 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:36.611726    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d48252d_f661_4f65_83a0_21de770514c6.slice/crio-1d09fffa708951e85b3f6d3ea557b8d15f781f40dff9c2fc6c36b92bf5e25543 WatchSource:0}: Error finding container 1d09fffa708951e85b3f6d3ea557b8d15f781f40dff9c2fc6c36b92bf5e25543: Status 404 returned error can't find the container with id 1d09fffa708951e85b3f6d3ea557b8d15f781f40dff9c2fc6c36b92bf5e25543
Jul 13 18:50:36.619548 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.619523    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m"
Jul 13 18:50:36.620921 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:36.620898    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89172f0d_6dea_4555_8d41_e50e2b851fea.slice/crio-d9f9c07a2ff20b45b0dab8491a1f50e3544052b945739eb072ad4aa1b19534ad WatchSource:0}: Error finding container d9f9c07a2ff20b45b0dab8491a1f50e3544052b945739eb072ad4aa1b19534ad: Status 404 returned error can't find the container with id d9f9c07a2ff20b45b0dab8491a1f50e3544052b945739eb072ad4aa1b19534ad
Jul 13 18:50:36.627889 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:36.627866    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c21da3_e4a8_4282_8391_deaaac76aba1.slice/crio-f9898fb4bc372fbd5ef7286ca0198b17c284635f6393f2b35f8eb3c030ba53f8 WatchSource:0}: Error finding container f9898fb4bc372fbd5ef7286ca0198b17c284635f6393f2b35f8eb3c030ba53f8: Status 404 returned error can't find the container with id f9898fb4bc372fbd5ef7286ca0198b17c284635f6393f2b35f8eb3c030ba53f8
Jul 13 18:50:36.631878 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.631858    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26hxg"
Jul 13 18:50:36.639643 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.639620    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qlzx"
Jul 13 18:50:36.639964 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:36.639939    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d65125_686b_44c9_a11b_1d76c422750a.slice/crio-3e80b87a14b3b8533fb80ef096fa0f98c1a64db6c2311ce07e020e6fc31a5714 WatchSource:0}: Error finding container 3e80b87a14b3b8533fb80ef096fa0f98c1a64db6c2311ce07e020e6fc31a5714: Status 404 returned error can't find the container with id 3e80b87a14b3b8533fb80ef096fa0f98c1a64db6c2311ce07e020e6fc31a5714
Jul 13 18:50:36.648053 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.648028    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:50:36.649066 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:36.649039    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c17dfc_0204_4039_89ff_97908d34bc39.slice/crio-138232d9453311782b5809562a6f11a9e8290839a91dc875d55d5bb5da94227b WatchSource:0}: Error finding container 138232d9453311782b5809562a6f11a9e8290839a91dc875d55d5bb5da94227b: Status 404 returned error can't find the container with id 138232d9453311782b5809562a6f11a9e8290839a91dc875d55d5bb5da94227b
Jul 13 18:50:36.655994 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.655946    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q9p6z"
Jul 13 18:50:36.656752 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:36.656727    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1314aee4_22f1_483d_a144_4df45468fb5d.slice/crio-ff50a94a8bd43a8b4f70170568ed9972bc447bc33f408fb8377b9d38c2622fe0 WatchSource:0}: Error finding container ff50a94a8bd43a8b4f70170568ed9972bc447bc33f408fb8377b9d38c2622fe0: Status 404 returned error can't find the container with id ff50a94a8bd43a8b4f70170568ed9972bc447bc33f408fb8377b9d38c2622fe0
Jul 13 18:50:36.665750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.665728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x96gs"
Jul 13 18:50:36.672626 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.672600    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zqxzx"
Jul 13 18:50:36.981089 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.981013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:36.981089 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:36.981048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:36.981290 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.981184    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:50:36.981290 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.981211    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:50:36.981290 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.981264    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs podName:b7e0b486-78b0-47b8-a1c6-191368ae0913 nodeName:}" failed. No retries permitted until 2026-07-13 18:50:37.98122856 +0000 UTC m=+4.221709491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs") pod "network-metrics-daemon-hfp2m" (UID: "b7e0b486-78b0-47b8-a1c6-191368ae0913") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:50:36.981443 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:36.981317    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret podName:d737860c-a9d2-4449-8efd-0e657689675d nodeName:}" failed. No retries permitted until 2026-07-13 18:50:37.981297964 +0000 UTC m=+4.221778895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret") pod "global-pull-secret-syncer-jk8fj" (UID: "d737860c-a9d2-4449-8efd-0e657689675d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:50:37.182375 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:37.182334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724kf\" (UniqueName: \"kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf\") pod \"network-check-target-vw9qv\" (UID: \"b56462b4-a20f-4b98-8ee8-c482da1e19e3\") " pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:37.182538 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:37.182511    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:50:37.182538 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:37.182538    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:50:37.182625 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:37.182551    2563 projected.go:196] Error preparing data for projected volume kube-api-access-724kf for pod openshift-network-diagnostics/network-check-target-vw9qv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:50:37.182625 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:37.182617    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf podName:b56462b4-a20f-4b98-8ee8-c482da1e19e3 nodeName:}" failed. No retries permitted until 2026-07-13 18:50:38.182596982 +0000 UTC m=+4.423077900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-724kf" (UniqueName: "kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf") pod "network-check-target-vw9qv" (UID: "b56462b4-a20f-4b98-8ee8-c482da1e19e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:50:37.320572 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:37.320464    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 18:45:36 +0000 UTC" deadline="2028-03-23 10:34:23.448096392 +0000 UTC"
Jul 13 18:50:37.320572 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:37.320520    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14847h43m46.127579885s"
Jul 13 18:50:37.389676 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:37.389633    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m" event={"ID":"03c21da3-e4a8-4282-8391-deaaac76aba1","Type":"ContainerStarted","Data":"f9898fb4bc372fbd5ef7286ca0198b17c284635f6393f2b35f8eb3c030ba53f8"}
Jul 13 18:50:37.390945 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:37.390919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vzc4p" event={"ID":"89172f0d-6dea-4555-8d41-e50e2b851fea","Type":"ContainerStarted","Data":"d9f9c07a2ff20b45b0dab8491a1f50e3544052b945739eb072ad4aa1b19534ad"}
Jul 13 18:50:37.392443 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:37.392414    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zv8ht" event={"ID":"4d48252d-f661-4f65-83a0-21de770514c6","Type":"ContainerStarted","Data":"1d09fffa708951e85b3f6d3ea557b8d15f781f40dff9c2fc6c36b92bf5e25543"}
Jul 13 18:50:37.393800 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:37.393717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg" event={"ID":"1314aee4-22f1-483d-a144-4df45468fb5d","Type":"ContainerStarted","Data":"ff50a94a8bd43a8b4f70170568ed9972bc447bc33f408fb8377b9d38c2622fe0"}
Jul 13 18:50:37.394905 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:37.394868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qlzx" event={"ID":"e4c17dfc-0204-4039-89ff-97908d34bc39","Type":"ContainerStarted","Data":"138232d9453311782b5809562a6f11a9e8290839a91dc875d55d5bb5da94227b"}
Jul 13 18:50:37.396088 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:37.396067    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26hxg" event={"ID":"77d65125-686b-44c9-a11b-1d76c422750a","Type":"ContainerStarted","Data":"3e80b87a14b3b8533fb80ef096fa0f98c1a64db6c2311ce07e020e6fc31a5714"}
Jul 13 18:50:37.736581 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:37.736527    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8ac0fb_625e_4dfc_9d02_04b7b6a6bd42.slice/crio-55d6cc67bdb183e8220ad00403012790d45411e8994aa487136adf00ef456a0e WatchSource:0}: Error finding container 55d6cc67bdb183e8220ad00403012790d45411e8994aa487136adf00ef456a0e: Status 404 returned error can't find the container with id 55d6cc67bdb183e8220ad00403012790d45411e8994aa487136adf00ef456a0e
Jul 13 18:50:37.742365 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:37.742343    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b30717_80d6_4db4_b93d_e6a8851547ac.slice/crio-8a6e1bf99aeb4783bf15b57b63356be969679633c332c043cd6f2d69ae8eb353 WatchSource:0}: Error finding container 8a6e1bf99aeb4783bf15b57b63356be969679633c332c043cd6f2d69ae8eb353: Status 404 returned error can't find the container with id 8a6e1bf99aeb4783bf15b57b63356be969679633c332c043cd6f2d69ae8eb353
Jul 13 18:50:37.744276 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:50:37.744229    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67048f8b_9f47_401c_899c_a5cfb8bb2743.slice/crio-79753db574eb7bf164b32d89339a9115b8b17299d8018e9d8204e5f83115acd9 WatchSource:0}: Error finding container 79753db574eb7bf164b32d89339a9115b8b17299d8018e9d8204e5f83115acd9: Status 404 returned error can't find the container with id 79753db574eb7bf164b32d89339a9115b8b17299d8018e9d8204e5f83115acd9
Jul 13 18:50:37.989193 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:37.988851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:37.989193 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:37.989140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:37.989420 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:37.989004    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:50:37.989420 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:37.989374    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret podName:d737860c-a9d2-4449-8efd-0e657689675d nodeName:}" failed. No retries permitted until 2026-07-13 18:50:39.989356455 +0000 UTC m=+6.229837386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret") pod "global-pull-secret-syncer-jk8fj" (UID: "d737860c-a9d2-4449-8efd-0e657689675d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:50:37.989728 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:37.989312    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:50:37.989822 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:37.989747    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs podName:b7e0b486-78b0-47b8-a1c6-191368ae0913 nodeName:}" failed. No retries permitted until 2026-07-13 18:50:39.98973042 +0000 UTC m=+6.230211337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs") pod "network-metrics-daemon-hfp2m" (UID: "b7e0b486-78b0-47b8-a1c6-191368ae0913") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:50:38.190274 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:38.189878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724kf\" (UniqueName: \"kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf\") pod \"network-check-target-vw9qv\" (UID: \"b56462b4-a20f-4b98-8ee8-c482da1e19e3\") " pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:38.190274 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:38.190076    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:50:38.190274 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:38.190095    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:50:38.190274 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:38.190108    2563 projected.go:196] Error preparing data for projected volume kube-api-access-724kf for pod openshift-network-diagnostics/network-check-target-vw9qv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:50:38.190274 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:38.190163    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf podName:b56462b4-a20f-4b98-8ee8-c482da1e19e3 nodeName:}" failed. No retries permitted until 2026-07-13 18:50:40.190143522 +0000 UTC m=+6.430624442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-724kf" (UniqueName: "kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf") pod "network-check-target-vw9qv" (UID: "b56462b4-a20f-4b98-8ee8-c482da1e19e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:50:38.321457 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:38.321341    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 18:45:36 +0000 UTC" deadline="2028-01-28 15:01:50.975756734 +0000 UTC"
Jul 13 18:50:38.321457 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:38.321381    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13532h11m12.654381141s"
Jul 13 18:50:38.381395 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:38.381365    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:38.381614 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:38.381503    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:50:38.381943 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:38.381924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:38.382041 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:38.382023    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:50:38.384019 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:38.383995    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:38.384125 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:38.384084    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:50:38.400527 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:38.400386    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" event={"ID":"eda63208df358e0e9bf9d712ad8f74a0","Type":"ContainerStarted","Data":"2dfaef92b65379f0f71fd419b03af1f91bbb21e45cdf78047a2d02ba00ef7092"}
Jul 13 18:50:38.403493 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:38.403438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zqxzx" event={"ID":"67048f8b-9f47-401c-899c-a5cfb8bb2743","Type":"ContainerStarted","Data":"79753db574eb7bf164b32d89339a9115b8b17299d8018e9d8204e5f83115acd9"}
Jul 13 18:50:38.405756 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:38.405730    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x96gs" event={"ID":"96b30717-80d6-4db4-b93d-e6a8851547ac","Type":"ContainerStarted","Data":"8a6e1bf99aeb4783bf15b57b63356be969679633c332c043cd6f2d69ae8eb353"}
Jul 13 18:50:38.409733 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:38.409701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q9p6z" event={"ID":"7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42","Type":"ContainerStarted","Data":"55d6cc67bdb183e8220ad00403012790d45411e8994aa487136adf00ef456a0e"}
Jul 13 18:50:38.412720 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:38.412691    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" event={"ID":"be909fcc1006eb3f5b3a01699bb59d5e","Type":"ContainerStarted","Data":"0119e469f66ec04826aa506b687f89610694893788dcbf874744caf6a13765fe"}
Jul 13 18:50:38.437274 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:38.436365    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" podStartSLOduration=3.436344867 podStartE2EDuration="3.436344867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:50:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:50:38.417132973 +0000 UTC m=+4.657613912" watchObservedRunningTime="2026-07-13 18:50:38.436344867 +0000 UTC m=+4.676825809"
Jul 13 18:50:39.416867 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:39.416781    2563 generic.go:356] "Generic (PLEG): container finished" podID="be909fcc1006eb3f5b3a01699bb59d5e" containerID="0119e469f66ec04826aa506b687f89610694893788dcbf874744caf6a13765fe" exitCode=0
Jul 13 18:50:39.417353 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:39.417329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" event={"ID":"be909fcc1006eb3f5b3a01699bb59d5e","Type":"ContainerDied","Data":"0119e469f66ec04826aa506b687f89610694893788dcbf874744caf6a13765fe"}
Jul 13 18:50:40.005586 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:40.005546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:40.005734 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:40.005599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:40.005785 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:40.005761    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:50:40.005837 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:40.005825    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs podName:b7e0b486-78b0-47b8-a1c6-191368ae0913 nodeName:}" failed. No retries permitted until 2026-07-13 18:50:44.005805959 +0000 UTC m=+10.246286918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs") pod "network-metrics-daemon-hfp2m" (UID: "b7e0b486-78b0-47b8-a1c6-191368ae0913") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:50:40.006308 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:40.006288    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:50:40.006391 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:40.006346    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret podName:d737860c-a9d2-4449-8efd-0e657689675d nodeName:}" failed. No retries permitted until 2026-07-13 18:50:44.006330414 +0000 UTC m=+10.246811350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret") pod "global-pull-secret-syncer-jk8fj" (UID: "d737860c-a9d2-4449-8efd-0e657689675d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:50:40.207144 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:40.207031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724kf\" (UniqueName: \"kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf\") pod \"network-check-target-vw9qv\" (UID: \"b56462b4-a20f-4b98-8ee8-c482da1e19e3\") " pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:40.207330 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:40.207217    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:50:40.207330 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:40.207259    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:50:40.207330 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:40.207274    2563 projected.go:196] Error preparing data for projected volume kube-api-access-724kf for pod openshift-network-diagnostics/network-check-target-vw9qv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:50:40.207483 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:40.207339    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf podName:b56462b4-a20f-4b98-8ee8-c482da1e19e3 nodeName:}" failed. No retries permitted until 2026-07-13 18:50:44.207319495 +0000 UTC m=+10.447800414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-724kf" (UniqueName: "kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf") pod "network-check-target-vw9qv" (UID: "b56462b4-a20f-4b98-8ee8-c482da1e19e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:50:40.380357 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:40.380235    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:40.380538 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:40.380413    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:50:40.380841 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:40.380818    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:40.380952 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:40.380916    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:50:40.381088 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:40.381071    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:40.381178 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:40.381159    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:50:42.381063 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:42.381032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:42.381543 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:42.381170    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:50:42.381543 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:42.381032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:42.381543 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:42.381322    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:50:42.381543 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:42.381372    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:42.381543 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:42.381445    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:50:44.039525 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:44.039491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:44.039967 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:44.039538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:44.039967 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:44.039661    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:50:44.039967 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:44.039717    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs podName:b7e0b486-78b0-47b8-a1c6-191368ae0913 nodeName:}" failed. No retries permitted until 2026-07-13 18:50:52.039698504 +0000 UTC m=+18.280179422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs") pod "network-metrics-daemon-hfp2m" (UID: "b7e0b486-78b0-47b8-a1c6-191368ae0913") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:50:44.039967 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:44.039854    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:50:44.044156 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:44.040184    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret podName:d737860c-a9d2-4449-8efd-0e657689675d nodeName:}" failed. No retries permitted until 2026-07-13 18:50:52.040161054 +0000 UTC m=+18.280642383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret") pod "global-pull-secret-syncer-jk8fj" (UID: "d737860c-a9d2-4449-8efd-0e657689675d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:50:44.241212 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:44.241178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724kf\" (UniqueName: \"kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf\") pod \"network-check-target-vw9qv\" (UID: \"b56462b4-a20f-4b98-8ee8-c482da1e19e3\") " pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:44.241393 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:44.241374    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:50:44.241452 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:44.241403    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:50:44.241452 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:44.241416    2563 projected.go:196] Error preparing data for projected volume kube-api-access-724kf for pod openshift-network-diagnostics/network-check-target-vw9qv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:50:44.241566 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:44.241471    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf podName:b56462b4-a20f-4b98-8ee8-c482da1e19e3 nodeName:}" failed. No retries permitted until 2026-07-13 18:50:52.241451931 +0000 UTC m=+18.481932862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-724kf" (UniqueName: "kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf") pod "network-check-target-vw9qv" (UID: "b56462b4-a20f-4b98-8ee8-c482da1e19e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:50:44.381405 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:44.381317    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:44.381561 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:44.381440    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:50:44.381561 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:44.381489    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:44.381561 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:44.381560    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:44.381709 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:44.381642    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:50:44.381762 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:44.381716    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:50:45.433951 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:45.433694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q9p6z" event={"ID":"7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42","Type":"ContainerStarted","Data":"86528234ac79a87e2735e881602690c708e44e0aa804f5360f4daab7b584ae8a"}
Jul 13 18:50:45.438684 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:45.438646    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" event={"ID":"be909fcc1006eb3f5b3a01699bb59d5e","Type":"ContainerStarted","Data":"d23c152ae227a078e9e3229cd8ebb2e1cf3a22c49a389bdc990af30249e93618"}
Jul 13 18:50:45.440809 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:45.440780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26hxg" event={"ID":"77d65125-686b-44c9-a11b-1d76c422750a","Type":"ContainerStarted","Data":"935d29eab8d4b9be220b213350daa10e95b1119277c75c0c2f4cffe05c659e79"}
Jul 13 18:50:45.443129 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:45.443103    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qlzx" event={"ID":"e4c17dfc-0204-4039-89ff-97908d34bc39","Type":"ContainerStarted","Data":"37b403d0cf8e95325515778ab7244b982844b4a695b767f339a1622faf0c3f24"}
Jul 13 18:50:45.445704 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:45.445679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m" event={"ID":"03c21da3-e4a8-4282-8391-deaaac76aba1","Type":"ContainerStarted","Data":"c961e84e7496e0be91daae6d0b3357261e85019b8bfd80fc2cceab60dfd5368f"}
Jul 13 18:50:45.447821 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:45.447794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zv8ht" event={"ID":"4d48252d-f661-4f65-83a0-21de770514c6","Type":"ContainerStarted","Data":"d0f69671c2983563a5e497c39cc5e0893c4c5bd18b8f9fd268ccf2fc920d5883"}
Jul 13 18:50:45.451758 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:45.451733    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x96gs" event={"ID":"96b30717-80d6-4db4-b93d-e6a8851547ac","Type":"ContainerStarted","Data":"68a045b9e16a92f27584407c8742afacf6774fdf94acc9b0a6920a3a765e4a83"}
Jul 13 18:50:45.475182 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:45.472001    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q9p6z" podStartSLOduration=4.06548232 podStartE2EDuration="11.471980446s" totalImagesPullingTime="7.406498126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:50:45.449659912 +0000 UTC m=+11.690140853" watchObservedRunningTime="2026-07-13 18:50:45.471980446 +0000 UTC m=+11.712461390"
Jul 13 18:50:45.487619 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:45.487572    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-26hxg" podStartSLOduration=3.028108688 podStartE2EDuration="11.48755402s" totalImagesPullingTime="8.459445332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:50:45.472158636 +0000 UTC m=+11.712639566" watchObservedRunningTime="2026-07-13 18:50:45.48755402 +0000 UTC m=+11.728034961"
Jul 13 18:50:45.507784 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:45.507738    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" podStartSLOduration=10.507720141 podStartE2EDuration="10.507720141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:50:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:50:45.488173695 +0000 UTC m=+11.728654635" watchObservedRunningTime="2026-07-13 18:50:45.507720141 +0000 UTC m=+11.748201082"
Jul 13 18:50:45.523412 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:45.522839    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6qlzx" podStartSLOduration=3.072338464 podStartE2EDuration="11.522820862s" totalImagesPullingTime="8.450482398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:50:45.522128309 +0000 UTC m=+11.762609248" watchObservedRunningTime="2026-07-13 18:50:45.522820862 +0000 UTC m=+11.763301803"
Jul 13 18:50:45.537929 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:45.537536    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x96gs" podStartSLOduration=4.17990992 podStartE2EDuration="11.537522822s" totalImagesPullingTime="7.357612902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:50:45.537169372 +0000 UTC m=+11.777650313" watchObservedRunningTime="2026-07-13 18:50:45.537522822 +0000 UTC m=+11.778003760"
Jul 13 18:50:46.382461 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:46.382382    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:46.382598 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:46.382518    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:50:46.382884 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:46.382858    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:46.383015 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:46.382947    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:50:46.383015 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:46.383010    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:46.383130 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:46.383090    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:50:46.456132 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:46.456095    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d48252d-f661-4f65-83a0-21de770514c6" containerID="d0f69671c2983563a5e497c39cc5e0893c4c5bd18b8f9fd268ccf2fc920d5883" exitCode=0
Jul 13 18:50:46.456579 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:46.456240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zv8ht" event={"ID":"4d48252d-f661-4f65-83a0-21de770514c6","Type":"ContainerDied","Data":"d0f69671c2983563a5e497c39cc5e0893c4c5bd18b8f9fd268ccf2fc920d5883"}
Jul 13 18:50:47.460390 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:47.460355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vzc4p" event={"ID":"89172f0d-6dea-4555-8d41-e50e2b851fea","Type":"ContainerStarted","Data":"cd57ece398645a27d71fdf94507460eb1c9e66729e8bab547caf1bb125184143"}
Jul 13 18:50:47.477887 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:47.477832    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vzc4p" podStartSLOduration=5.573640028 podStartE2EDuration="13.477812219s" totalImagesPullingTime="7.904172191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:50:47.477658368 +0000 UTC m=+13.718139307" watchObservedRunningTime="2026-07-13 18:50:47.477812219 +0000 UTC m=+13.718293159"
Jul 13 18:50:47.636688 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:47.636654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:50:47.726640 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:47.726529    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:50:48.164432 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:48.164351    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:50:48.253979 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:48.253944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:50:48.380803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:48.380772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:48.380803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:48.380786    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:48.381029 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:48.380773    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:48.381029 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:48.380936    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:50:48.381029 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:48.380992    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:50:48.381175 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:48.381061    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:50:49.690150 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:49.689861    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q9p6z"
Jul 13 18:50:49.690961 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:49.690775    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q9p6z"
Jul 13 18:50:50.380976 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:50.380945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:50.380976 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:50.380978    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:50.381211 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:50.380945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:50.381211 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:50.381067    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:50:50.381211 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:50.381154    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:50:50.381385 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:50.381280    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:50:50.534387 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:50.534355    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:50:52.102671 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:52.102638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:52.102671 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:52.102676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:52.103378 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:52.102832    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:50:52.103378 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:52.102924    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret podName:d737860c-a9d2-4449-8efd-0e657689675d nodeName:}" failed. No retries permitted until 2026-07-13 18:51:08.102899911 +0000 UTC m=+34.343380843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret") pod "global-pull-secret-syncer-jk8fj" (UID: "d737860c-a9d2-4449-8efd-0e657689675d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:50:52.103378 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:52.102939    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:50:52.103378 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:52.102975    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs podName:b7e0b486-78b0-47b8-a1c6-191368ae0913 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:08.102964086 +0000 UTC m=+34.343445022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs") pod "network-metrics-daemon-hfp2m" (UID: "b7e0b486-78b0-47b8-a1c6-191368ae0913") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:50:52.303558 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:52.303494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724kf\" (UniqueName: \"kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf\") pod \"network-check-target-vw9qv\" (UID: \"b56462b4-a20f-4b98-8ee8-c482da1e19e3\") " pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:52.303774 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:52.303747    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:50:52.303774 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:52.303773    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:50:52.303894 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:52.303790    2563 projected.go:196] Error preparing data for projected volume kube-api-access-724kf for pod openshift-network-diagnostics/network-check-target-vw9qv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:50:52.303894 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:52.303856    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf podName:b56462b4-a20f-4b98-8ee8-c482da1e19e3 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:08.303835736 +0000 UTC m=+34.544316676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-724kf" (UniqueName: "kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf") pod "network-check-target-vw9qv" (UID: "b56462b4-a20f-4b98-8ee8-c482da1e19e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:50:52.381732 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:52.381099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:52.381732 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:52.381099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:52.381732 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:52.381298    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:50:52.381732 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:52.381368    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:50:52.381732 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:52.381425    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:52.381732 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:52.381497    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:50:52.536718 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:52.536650    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q9p6z"
Jul 13 18:50:52.536891 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:52.536811    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 13 18:50:52.537510 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:52.537473    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q9p6z"
Jul 13 18:50:53.134261 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:53.134192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:50:54.381497 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:54.381261    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:54.381958 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:54.381314    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:54.381958 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:54.381609    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:50:54.381958 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:54.381689    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:50:54.381958 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:54.381334    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:54.381958 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:54.381810    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:50:54.617493 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:54.617458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:50:54.963733 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:54.963682    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:50:55.072882 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:55.072850    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:50:56.380907 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:56.380873    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:56.381361 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:56.380915    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:56.381361 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:56.380874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:56.381361 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:56.381004    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:50:56.381361 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:56.381101    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:50:56.381361 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:56.381201    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:50:57.597133 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:57.597104    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 18:50:58.286623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.286266    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T18:50:57.597128541Z","UUID":"af861907-0666-410a-9ba3-da7f31620e82","Handler":null,"Name":"","Endpoint":""}
Jul 13 18:50:58.289803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.289778    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 18:50:58.289956 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.289824    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 18:50:58.380670 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.380609    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:50:58.380670 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.380665    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:50:58.380878 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.380609    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:50:58.380878 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:58.380753    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:50:58.380878 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:58.380803    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:50:58.381008 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:50:58.380880    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:50:58.487817 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.487788    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 18:50:58.488193 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.488167    2563 generic.go:356] "Generic (PLEG): container finished" podID="1314aee4-22f1-483d-a144-4df45468fb5d" containerID="36de5fa40887fbe9160feb95199ab1da1d58acbf3f7d71a6c1c5a6e2de64d53d" exitCode=1
Jul 13 18:50:58.488329 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.488289    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg" event={"ID":"1314aee4-22f1-483d-a144-4df45468fb5d","Type":"ContainerStarted","Data":"ac3284e2aa108777a72b169d565c09cb96515b23571d821be19b4089fb161a59"}
Jul 13 18:50:58.488396 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.488372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg" event={"ID":"1314aee4-22f1-483d-a144-4df45468fb5d","Type":"ContainerStarted","Data":"9071a1cbba06462a7b4da4f339bda64bf0d8271435c553e614e079ae2154ff7e"}
Jul 13 18:50:58.488452 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.488438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg" event={"ID":"1314aee4-22f1-483d-a144-4df45468fb5d","Type":"ContainerStarted","Data":"d3ef39d479878abc7c50ee8d5128fcf618722b0aaf8c23d9533c149c17a3aa09"}
Jul 13 18:50:58.488505 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.488487    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg" event={"ID":"1314aee4-22f1-483d-a144-4df45468fb5d","Type":"ContainerStarted","Data":"02162d259bc3073048f212033d1b02e1e76edf59b970f5d1a8c14de820bb81aa"}
Jul 13 18:50:58.488565 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.488533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg" event={"ID":"1314aee4-22f1-483d-a144-4df45468fb5d","Type":"ContainerDied","Data":"36de5fa40887fbe9160feb95199ab1da1d58acbf3f7d71a6c1c5a6e2de64d53d"}
Jul 13 18:50:58.488623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.488591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg" event={"ID":"1314aee4-22f1-483d-a144-4df45468fb5d","Type":"ContainerStarted","Data":"55ba11db5b6432e60f1211429646f66c5906b4b70f95f83ae50bf724e4f6f06a"}
Jul 13 18:50:58.490402 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.490373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zqxzx" event={"ID":"67048f8b-9f47-401c-899c-a5cfb8bb2743","Type":"ContainerStarted","Data":"695a02616f703854bddfb20e628b4a4435b1d7782d5f9767f5d14e83d73c3e69"}
Jul 13 18:50:58.492308 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.492283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m" event={"ID":"03c21da3-e4a8-4282-8391-deaaac76aba1","Type":"ContainerStarted","Data":"8c1f907f6a8390408254ac70741df6a362c3e25e267a234964e99651cee99441"}
Jul 13 18:50:58.495258 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.494938    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d48252d-f661-4f65-83a0-21de770514c6" containerID="0e37825c8acc63700168553ab367f5cb01ddd9b749a7b26a80697fad95ecfa3a" exitCode=0
Jul 13 18:50:58.495258 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.494975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zv8ht" event={"ID":"4d48252d-f661-4f65-83a0-21de770514c6","Type":"ContainerDied","Data":"0e37825c8acc63700168553ab367f5cb01ddd9b749a7b26a80697fad95ecfa3a"}
Jul 13 18:50:58.509828 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.509792    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zqxzx" podStartSLOduration=4.8569582 podStartE2EDuration="24.509781072s" totalImagesPullingTime="19.652822872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:50:58.509383761 +0000 UTC m=+24.749864740" watchObservedRunningTime="2026-07-13 18:50:58.509781072 +0000 UTC m=+24.750262011"
Jul 13 18:50:58.631577 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.631503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:50:58.763838 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:58.763807    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:50:59.499071 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:50:59.499034    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m" event={"ID":"03c21da3-e4a8-4282-8391-deaaac76aba1","Type":"ContainerStarted","Data":"b6789db6c02228b832539f4178f27b9554d83ee5423fb72d47bcb6c5ee452c7a"}
Jul 13 18:51:00.380782 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:00.380743    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:00.380782 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:00.380788    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:51:00.381210 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:00.380865    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:51:00.381210 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:00.380937    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:51:00.381210 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:00.380966    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:51:00.381210 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:00.381056    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:51:00.503526 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:00.503449    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d48252d-f661-4f65-83a0-21de770514c6" containerID="712437771b5436eb8e422dfafd24e1c2caa83f4e8fd95c4f163e3e1e6529a1a2" exitCode=0
Jul 13 18:51:00.503678 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:00.503529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zv8ht" event={"ID":"4d48252d-f661-4f65-83a0-21de770514c6","Type":"ContainerDied","Data":"712437771b5436eb8e422dfafd24e1c2caa83f4e8fd95c4f163e3e1e6529a1a2"}
Jul 13 18:51:00.506725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:00.506709    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 18:51:00.507078 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:00.507059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg" event={"ID":"1314aee4-22f1-483d-a144-4df45468fb5d","Type":"ContainerStarted","Data":"d08aaae7d987901d467ea46e758136ea3218b8698281c60ab09bdf91cb9b3aea"}
Jul 13 18:51:00.537988 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:00.537943    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72c9m" podStartSLOduration=4.74479351 podStartE2EDuration="26.537930368s" totalImagesPullingTime="21.793136858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:50:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:50:59.529938337 +0000 UTC m=+25.770419276" watchObservedRunningTime="2026-07-13 18:51:00.537930368 +0000 UTC m=+26.778411307"
Jul 13 18:51:02.381027 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.380761    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:51:02.381953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.380771    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:02.381953 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:02.381083    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:51:02.381953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.380845    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:51:02.381953 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:02.381164    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:51:02.381953 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:02.381269    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:51:02.512893 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.512857    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d48252d-f661-4f65-83a0-21de770514c6" containerID="3fa3c466b38b1dd3a8b5d2f085290418e798f742c77d0ee0d40b6fe266d65b7b" exitCode=0
Jul 13 18:51:02.513070 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.512936    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zv8ht" event={"ID":"4d48252d-f661-4f65-83a0-21de770514c6","Type":"ContainerDied","Data":"3fa3c466b38b1dd3a8b5d2f085290418e798f742c77d0ee0d40b6fe266d65b7b"}
Jul 13 18:51:02.516516 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.516501    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 18:51:02.516890 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.516869    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg" event={"ID":"1314aee4-22f1-483d-a144-4df45468fb5d","Type":"ContainerStarted","Data":"7fb8228b5081d19b186255b4ae9e848c0a7fb3819062383cc2869b52e3855237"}
Jul 13 18:51:02.517142 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.517127    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:51:02.517192 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.517181    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:51:02.517236 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.517221    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:51:02.517309 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.517284    2563 scope.go:117] "RemoveContainer" containerID="36de5fa40887fbe9160feb95199ab1da1d58acbf3f7d71a6c1c5a6e2de64d53d"
Jul 13 18:51:02.532477 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.532379    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:51:02.532567 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:02.532552    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:51:03.524166 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:03.524140    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 18:51:03.524603 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:03.524508    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg" event={"ID":"1314aee4-22f1-483d-a144-4df45468fb5d","Type":"ContainerStarted","Data":"6ee5127dd9de5e750091adcb96e725f902c94e1ac9e0c9a9bdf47c6262fda44d"}
Jul 13 18:51:03.563728 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:03.563262    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg" podStartSLOduration=8.822673742 podStartE2EDuration="29.563220442s" totalImagesPullingTime="20.7405467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:51:03.561455297 +0000 UTC m=+29.801936263" watchObservedRunningTime="2026-07-13 18:51:03.563220442 +0000 UTC m=+29.803701382"
Jul 13 18:51:04.381699 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:04.381666    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:04.381856 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:04.381748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:51:04.381856 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:04.381761    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:51:04.381856 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:04.381804    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:51:04.382017 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:04.381912    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:51:04.382063 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:04.382013    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:51:04.530595 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:04.530564    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jk8fj"]
Jul 13 18:51:04.531025 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:04.530669    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:51:04.531025 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:04.530775    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:51:04.533803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:04.533774    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hfp2m"]
Jul 13 18:51:04.533938 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:04.533893    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:51:04.534023 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:04.534005    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:51:04.554296 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:04.554262    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vw9qv"]
Jul 13 18:51:04.554466 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:04.554369    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:04.554530 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:04.554465    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:51:05.931350 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:05.931311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:51:06.381201 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:06.381127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:51:06.381366 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:06.381128    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:51:06.381366 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:06.381269    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:51:06.381366 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:06.381337    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:51:06.381512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:06.381398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:06.381512 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:06.381466    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:51:07.536223 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:07.535967    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d48252d-f661-4f65-83a0-21de770514c6" containerID="1dc6a31b71aa1005e8df9c1814f3e1b5078b947f418178e66b5e29ab894b0a97" exitCode=0
Jul 13 18:51:07.536760 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:07.536036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zv8ht" event={"ID":"4d48252d-f661-4f65-83a0-21de770514c6","Type":"ContainerDied","Data":"1dc6a31b71aa1005e8df9c1814f3e1b5078b947f418178e66b5e29ab894b0a97"}
Jul 13 18:51:08.111168 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:08.111135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:51:08.111348 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:08.111173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:51:08.111348 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:08.111306    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:51:08.111348 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:08.111310    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:51:08.111456 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:08.111358    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs podName:b7e0b486-78b0-47b8-a1c6-191368ae0913 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:40.111344501 +0000 UTC m=+66.351825418 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs") pod "network-metrics-daemon-hfp2m" (UID: "b7e0b486-78b0-47b8-a1c6-191368ae0913") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:51:08.111456 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:08.111378    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret podName:d737860c-a9d2-4449-8efd-0e657689675d nodeName:}" failed. No retries permitted until 2026-07-13 18:51:40.111364042 +0000 UTC m=+66.351844960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret") pod "global-pull-secret-syncer-jk8fj" (UID: "d737860c-a9d2-4449-8efd-0e657689675d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:51:08.311963 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:08.311927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724kf\" (UniqueName: \"kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf\") pod \"network-check-target-vw9qv\" (UID: \"b56462b4-a20f-4b98-8ee8-c482da1e19e3\") " pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:08.312142 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:08.312101    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:51:08.312142 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:08.312123    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:51:08.312142 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:08.312133    2563 projected.go:196] Error preparing data for projected volume kube-api-access-724kf for pod openshift-network-diagnostics/network-check-target-vw9qv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:51:08.312279 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:08.312182    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf podName:b56462b4-a20f-4b98-8ee8-c482da1e19e3 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:40.312169635 +0000 UTC m=+66.552650564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-724kf" (UniqueName: "kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf") pod "network-check-target-vw9qv" (UID: "b56462b4-a20f-4b98-8ee8-c482da1e19e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:51:08.380608 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:08.380516    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:51:08.380608 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:08.380555    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:08.380799 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:08.380519    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:51:08.380799 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:08.380642    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:51:08.380799 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:08.380725    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:51:08.380799 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:08.380787    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:51:08.540797 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:08.540766    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d48252d-f661-4f65-83a0-21de770514c6" containerID="217735f20fbef0f13516eeb29b2b10618f359145b30780214ab8ed3d5b521226" exitCode=0
Jul 13 18:51:08.541269 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:08.540835    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zv8ht" event={"ID":"4d48252d-f661-4f65-83a0-21de770514c6","Type":"ContainerDied","Data":"217735f20fbef0f13516eeb29b2b10618f359145b30780214ab8ed3d5b521226"}
Jul 13 18:51:09.546258 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:09.546215    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zv8ht" event={"ID":"4d48252d-f661-4f65-83a0-21de770514c6","Type":"ContainerStarted","Data":"4e12ad9d6bc50995397e83b7fbd1d2acad080eb448b5927681ac712909ea39ea"}
Jul 13 18:51:09.578646 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:09.578597    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zv8ht" podStartSLOduration=8.863048879 podStartE2EDuration="35.578580337s" totalImagesPullingTime="26.715531458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:50:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:51:09.577212028 +0000 UTC m=+35.817692970" watchObservedRunningTime="2026-07-13 18:51:09.578580337 +0000 UTC m=+35.819061275"
Jul 13 18:51:09.712129 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:09.712094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:51:09.811813 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:09.811731    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:51:10.380379 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:10.380347    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:10.380379 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:10.380383    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:51:10.380609 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:10.380347    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:51:10.380609 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:10.380452    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw9qv" podUID="b56462b4-a20f-4b98-8ee8-c482da1e19e3"
Jul 13 18:51:10.380609 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:10.380549    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8fj" podUID="d737860c-a9d2-4449-8efd-0e657689675d"
Jul 13 18:51:10.380696 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:10.380617    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfp2m" podUID="b7e0b486-78b0-47b8-a1c6-191368ae0913"
Jul 13 18:51:11.074560 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.074528    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeReady"
Jul 13 18:51:11.075222 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.074716    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 18:51:11.133764 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.133693    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gc897"]
Jul 13 18:51:11.146075 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.146049    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5clww"]
Jul 13 18:51:11.146276 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.146173    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.149114 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.149094    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 18:51:11.149277 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.149094    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 18:51:11.149277 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.149098    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5rh7g\""
Jul 13 18:51:11.154566 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.154542    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5clww"]
Jul 13 18:51:11.154667 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.154582    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gc897"]
Jul 13 18:51:11.154728 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.154662    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5clww"
Jul 13 18:51:11.157510 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.157494    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9r5lq\""
Jul 13 18:51:11.157623 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.157545    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 18:51:11.157842 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.157826    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 18:51:11.157842 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.157837    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 18:51:11.233292 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.233260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4v2p\" (UniqueName: \"kubernetes.io/projected/6c434c9f-c8cb-4b4e-8506-46e98ff06e76-kube-api-access-h4v2p\") pod \"ingress-canary-5clww\" (UID: \"6c434c9f-c8cb-4b4e-8506-46e98ff06e76\") " pod="openshift-ingress-canary/ingress-canary-5clww"
Jul 13 18:51:11.233489 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.233298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53e87220-710d-4fda-a1b2-a87c09fa99b8-tmp-dir\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.233489 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.233327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53e87220-710d-4fda-a1b2-a87c09fa99b8-config-volume\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.233489 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.233394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r89gp\" (UniqueName: \"kubernetes.io/projected/53e87220-710d-4fda-a1b2-a87c09fa99b8-kube-api-access-r89gp\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.233489 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.233423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.233489 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.233454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c434c9f-c8cb-4b4e-8506-46e98ff06e76-cert\") pod \"ingress-canary-5clww\" (UID: \"6c434c9f-c8cb-4b4e-8506-46e98ff06e76\") " pod="openshift-ingress-canary/ingress-canary-5clww"
Jul 13 18:51:11.333725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.333694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4v2p\" (UniqueName: \"kubernetes.io/projected/6c434c9f-c8cb-4b4e-8506-46e98ff06e76-kube-api-access-h4v2p\") pod \"ingress-canary-5clww\" (UID: \"6c434c9f-c8cb-4b4e-8506-46e98ff06e76\") " pod="openshift-ingress-canary/ingress-canary-5clww"
Jul 13 18:51:11.333906 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.333734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53e87220-710d-4fda-a1b2-a87c09fa99b8-tmp-dir\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.333906 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.333859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53e87220-710d-4fda-a1b2-a87c09fa99b8-config-volume\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.334004 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.333910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r89gp\" (UniqueName: \"kubernetes.io/projected/53e87220-710d-4fda-a1b2-a87c09fa99b8-kube-api-access-r89gp\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.334004 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.333938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.334104 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:11.334032    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:51:11.334104 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.334069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c434c9f-c8cb-4b4e-8506-46e98ff06e76-cert\") pod \"ingress-canary-5clww\" (UID: \"6c434c9f-c8cb-4b4e-8506-46e98ff06e76\") " pod="openshift-ingress-canary/ingress-canary-5clww"
Jul 13 18:51:11.334104 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:11.334089    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls podName:53e87220-710d-4fda-a1b2-a87c09fa99b8 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:11.834071364 +0000 UTC m=+38.074552297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls") pod "dns-default-gc897" (UID: "53e87220-710d-4fda-a1b2-a87c09fa99b8") : secret "dns-default-metrics-tls" not found
Jul 13 18:51:11.334104 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.334089    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53e87220-710d-4fda-a1b2-a87c09fa99b8-tmp-dir\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.334526 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.334505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53e87220-710d-4fda-a1b2-a87c09fa99b8-config-volume\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.338123 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.338104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c434c9f-c8cb-4b4e-8506-46e98ff06e76-cert\") pod \"ingress-canary-5clww\" (UID: \"6c434c9f-c8cb-4b4e-8506-46e98ff06e76\") " pod="openshift-ingress-canary/ingress-canary-5clww"
Jul 13 18:51:11.344474 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.344329    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r89gp\" (UniqueName: \"kubernetes.io/projected/53e87220-710d-4fda-a1b2-a87c09fa99b8-kube-api-access-r89gp\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.344588 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.344522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4v2p\" (UniqueName: \"kubernetes.io/projected/6c434c9f-c8cb-4b4e-8506-46e98ff06e76-kube-api-access-h4v2p\") pod \"ingress-canary-5clww\" (UID: \"6c434c9f-c8cb-4b4e-8506-46e98ff06e76\") " pod="openshift-ingress-canary/ingress-canary-5clww"
Jul 13 18:51:11.463565 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.463482    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5clww"
Jul 13 18:51:11.663774 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.663745    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5clww"]
Jul 13 18:51:11.667458 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:51:11.667427    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c434c9f_c8cb_4b4e_8506_46e98ff06e76.slice/crio-041c8e025082bf620f2bc6a04398591edf3dd2849e7172360ffa96ef25153db3 WatchSource:0}: Error finding container 041c8e025082bf620f2bc6a04398591edf3dd2849e7172360ffa96ef25153db3: Status 404 returned error can't find the container with id 041c8e025082bf620f2bc6a04398591edf3dd2849e7172360ffa96ef25153db3
Jul 13 18:51:11.837549 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:11.837443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:11.837695 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:11.837572    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:51:11.837695 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:11.837622    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls podName:53e87220-710d-4fda-a1b2-a87c09fa99b8 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:12.83760965 +0000 UTC m=+39.078090567 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls") pod "dns-default-gc897" (UID: "53e87220-710d-4fda-a1b2-a87c09fa99b8") : secret "dns-default-metrics-tls" not found
Jul 13 18:51:12.380935 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:12.380900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:51:12.381469 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:12.380900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:51:12.381469 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:12.380901    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:12.384831 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:12.384811    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 18:51:12.384831 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:12.384822    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 18:51:12.384831 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:12.384828    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 18:51:12.385970 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:12.385948    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tkcn\""
Jul 13 18:51:12.386077 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:12.385982    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 18:51:12.386077 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:12.386005    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g7ddc\""
Jul 13 18:51:12.554474 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:12.554432    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5clww" event={"ID":"6c434c9f-c8cb-4b4e-8506-46e98ff06e76","Type":"ContainerStarted","Data":"041c8e025082bf620f2bc6a04398591edf3dd2849e7172360ffa96ef25153db3"}
Jul 13 18:51:12.843390 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:12.843304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:12.843538 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:12.843449    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:51:12.843538 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:12.843510    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls podName:53e87220-710d-4fda-a1b2-a87c09fa99b8 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:14.843492725 +0000 UTC m=+41.083973660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls") pod "dns-default-gc897" (UID: "53e87220-710d-4fda-a1b2-a87c09fa99b8") : secret "dns-default-metrics-tls" not found
Jul 13 18:51:13.004449 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:13.004414    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:51:13.067207 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:13.067173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:51:13.136572 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:13.136485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:51:14.792155 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:14.792004    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:51:14.855738 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:14.855693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:14.855881 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:14.855820    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:51:14.855881 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:14.855874    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls podName:53e87220-710d-4fda-a1b2-a87c09fa99b8 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:18.855859912 +0000 UTC m=+45.096340828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls") pod "dns-default-gc897" (UID: "53e87220-710d-4fda-a1b2-a87c09fa99b8") : secret "dns-default-metrics-tls" not found
Jul 13 18:51:14.890795 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:14.890764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log" limit=1024
Jul 13 18:51:15.563559 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:15.563522    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5clww" event={"ID":"6c434c9f-c8cb-4b4e-8506-46e98ff06e76","Type":"ContainerStarted","Data":"521e9412618cd8856573e3a61742d706a6153c45dea3f66cc0b1a26fac57b8aa"}
Jul 13 18:51:15.583419 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:15.583362    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5clww" podStartSLOduration=1.505101005 podStartE2EDuration="4.583343824s" totalImagesPullingTime="3.078242819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:51:15.582999677 +0000 UTC m=+41.823480636" watchObservedRunningTime="2026-07-13 18:51:15.583343824 +0000 UTC m=+41.823824762"
Jul 13 18:51:18.882098 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:18.882061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:18.882694 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:18.882181    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:51:18.882694 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:18.882232    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls podName:53e87220-710d-4fda-a1b2-a87c09fa99b8 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:26.882219185 +0000 UTC m=+53.122700102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls") pod "dns-default-gc897" (UID: "53e87220-710d-4fda-a1b2-a87c09fa99b8") : secret "dns-default-metrics-tls" not found
Jul 13 18:51:26.935338 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:26.935278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:26.935821 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:26.935437    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:51:26.935821 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:26.935508    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls podName:53e87220-710d-4fda-a1b2-a87c09fa99b8 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:42.935492724 +0000 UTC m=+69.175973641 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls") pod "dns-default-gc897" (UID: "53e87220-710d-4fda-a1b2-a87c09fa99b8") : secret "dns-default-metrics-tls" not found
Jul 13 18:51:31.735418 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.735384    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-rs6pz"]
Jul 13 18:51:31.766070 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.766039    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-rs6pz"]
Jul 13 18:51:31.766242 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.766146    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-rs6pz"
Jul 13 18:51:31.767702 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.767674    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"]
Jul 13 18:51:31.770239 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.770221    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:51:31.770364 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.770345    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hnrw6\""
Jul 13 18:51:31.770415 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.770348    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 13 18:51:31.790117 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.790095    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"]
Jul 13 18:51:31.790216 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.790185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:51:31.793726 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.793704    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:51:31.793833 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.793706    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 13 18:51:31.793833 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.793765    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xmgkr\""
Jul 13 18:51:31.793833 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.793732    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 13 18:51:31.869926 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.869891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r69q5\" (UniqueName: \"kubernetes.io/projected/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-kube-api-access-r69q5\") pod \"cluster-samples-operator-65db858894-b9nj9\" (UID: \"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:51:31.869926 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.869928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht6nd\" (UniqueName: \"kubernetes.io/projected/0a434a2d-125b-48eb-8ba5-ed46293e594e-kube-api-access-ht6nd\") pod \"volume-data-source-validator-78495597f6-rs6pz\" (UID: \"0a434a2d-125b-48eb-8ba5-ed46293e594e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-rs6pz"
Jul 13 18:51:31.870122 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.869989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-b9nj9\" (UID: \"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:51:31.873431 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.873407    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58b44f8f99-z2rnz"]
Jul 13 18:51:31.897823 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.897797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:31.917451 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.917426    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 18:51:31.917580 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.917459    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 18:51:31.918641 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.918624    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 18:51:31.920231 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.920213    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58b44f8f99-z2rnz"]
Jul 13 18:51:31.922659 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.922642    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 18:51:31.927089 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.927070    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j66bj\""
Jul 13 18:51:31.970398 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.970363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-certificates\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:31.970559 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.970418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a8b9bf8-d461-4e23-a594-6c20460432af-installation-pull-secrets\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:31.970559 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.970456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:31.970559 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.970491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a8b9bf8-d461-4e23-a594-6c20460432af-trusted-ca\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:31.970559 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.970541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a8b9bf8-d461-4e23-a594-6c20460432af-image-registry-private-configuration\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:31.970754 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.970597    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-b9nj9\" (UID: \"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:51:31.970754 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.970626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a8b9bf8-d461-4e23-a594-6c20460432af-ca-trust-extracted\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:31.970754 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.970643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-bound-sa-token\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:31.970754 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:31.970743    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 18:51:31.970947 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.970776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqmvp\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-kube-api-access-dqmvp\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:31.970947 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:31.970816    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls podName:4c63ce6a-d286-4614-bf2f-f4ef1a503d0d nodeName:}" failed. No retries permitted until 2026-07-13 18:51:32.470795156 +0000 UTC m=+58.711276087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls") pod "cluster-samples-operator-65db858894-b9nj9" (UID: "4c63ce6a-d286-4614-bf2f-f4ef1a503d0d") : secret "samples-operator-tls" not found
Jul 13 18:51:31.970947 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.970868    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r69q5\" (UniqueName: \"kubernetes.io/projected/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-kube-api-access-r69q5\") pod \"cluster-samples-operator-65db858894-b9nj9\" (UID: \"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:51:31.970947 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.970896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht6nd\" (UniqueName: \"kubernetes.io/projected/0a434a2d-125b-48eb-8ba5-ed46293e594e-kube-api-access-ht6nd\") pod \"volume-data-source-validator-78495597f6-rs6pz\" (UID: \"0a434a2d-125b-48eb-8ba5-ed46293e594e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-rs6pz"
Jul 13 18:51:31.973105 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.973085    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"]
Jul 13 18:51:31.993918 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.993861    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"
Jul 13 18:51:31.997045 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.997026    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 13 18:51:31.997683 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.997661    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 13 18:51:31.997789 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.997715    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:51:31.997962 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.997946    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ldg2l\""
Jul 13 18:51:31.999942 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:31.999815    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r69q5\" (UniqueName: \"kubernetes.io/projected/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-kube-api-access-r69q5\") pod \"cluster-samples-operator-65db858894-b9nj9\" (UID: \"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:51:32.002054 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.002037    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 13 18:51:32.004911 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.004893    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht6nd\" (UniqueName: \"kubernetes.io/projected/0a434a2d-125b-48eb-8ba5-ed46293e594e-kube-api-access-ht6nd\") pod \"volume-data-source-validator-78495597f6-rs6pz\" (UID: \"0a434a2d-125b-48eb-8ba5-ed46293e594e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-rs6pz"
Jul 13 18:51:32.010493 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.010470    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"]
Jul 13 18:51:32.071505 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.071469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.071505 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.071513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a8b9bf8-d461-4e23-a594-6c20460432af-trusted-ca\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.071725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.071547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a8b9bf8-d461-4e23-a594-6c20460432af-image-registry-private-configuration\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.071725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.071573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a8b9bf8-d461-4e23-a594-6c20460432af-ca-trust-extracted\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.071725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.071589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-bound-sa-token\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.071725 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:32.071634    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 18:51:32.071725 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:32.071653    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58b44f8f99-z2rnz: secret "image-registry-tls" not found
Jul 13 18:51:32.071725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.071666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9898ab75-3992-4a0e-a632-068a30b6c83f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-d2wjl\" (UID: \"9898ab75-3992-4a0e-a632-068a30b6c83f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"
Jul 13 18:51:32.071725 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:32.071699    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls podName:3a8b9bf8-d461-4e23-a594-6c20460432af nodeName:}" failed. No retries permitted until 2026-07-13 18:51:32.571685194 +0000 UTC m=+58.812166114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls") pod "image-registry-58b44f8f99-z2rnz" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af") : secret "image-registry-tls" not found
Jul 13 18:51:32.071725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.071725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9898ab75-3992-4a0e-a632-068a30b6c83f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-d2wjl\" (UID: \"9898ab75-3992-4a0e-a632-068a30b6c83f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"
Jul 13 18:51:32.072069 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.071778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqmvp\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-kube-api-access-dqmvp\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.072069 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.071804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n48zl\" (UniqueName: \"kubernetes.io/projected/9898ab75-3992-4a0e-a632-068a30b6c83f-kube-api-access-n48zl\") pod \"kube-storage-version-migrator-operator-799cb7f958-d2wjl\" (UID: \"9898ab75-3992-4a0e-a632-068a30b6c83f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"
Jul 13 18:51:32.072069 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.071867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-certificates\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.072069 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.071903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a8b9bf8-d461-4e23-a594-6c20460432af-installation-pull-secrets\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.072069 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.072051    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a8b9bf8-d461-4e23-a594-6c20460432af-ca-trust-extracted\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.072381 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.072354    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-certificates\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.072564 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.072546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a8b9bf8-d461-4e23-a594-6c20460432af-trusted-ca\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.074186 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.074167    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a8b9bf8-d461-4e23-a594-6c20460432af-image-registry-private-configuration\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.074281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.074217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a8b9bf8-d461-4e23-a594-6c20460432af-installation-pull-secrets\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.075045 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.075023    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-rs6pz"
Jul 13 18:51:32.085015 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.084990    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-bound-sa-token\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.085101 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.085077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqmvp\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-kube-api-access-dqmvp\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.172726 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.172695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9898ab75-3992-4a0e-a632-068a30b6c83f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-d2wjl\" (UID: \"9898ab75-3992-4a0e-a632-068a30b6c83f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"
Jul 13 18:51:32.172726 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.172730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9898ab75-3992-4a0e-a632-068a30b6c83f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-d2wjl\" (UID: \"9898ab75-3992-4a0e-a632-068a30b6c83f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"
Jul 13 18:51:32.172905 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.172755    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n48zl\" (UniqueName: \"kubernetes.io/projected/9898ab75-3992-4a0e-a632-068a30b6c83f-kube-api-access-n48zl\") pod \"kube-storage-version-migrator-operator-799cb7f958-d2wjl\" (UID: \"9898ab75-3992-4a0e-a632-068a30b6c83f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"
Jul 13 18:51:32.173459 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.173439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9898ab75-3992-4a0e-a632-068a30b6c83f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-d2wjl\" (UID: \"9898ab75-3992-4a0e-a632-068a30b6c83f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"
Jul 13 18:51:32.176656 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.175203    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9898ab75-3992-4a0e-a632-068a30b6c83f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-d2wjl\" (UID: \"9898ab75-3992-4a0e-a632-068a30b6c83f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"
Jul 13 18:51:32.182405 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.182384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n48zl\" (UniqueName: \"kubernetes.io/projected/9898ab75-3992-4a0e-a632-068a30b6c83f-kube-api-access-n48zl\") pod \"kube-storage-version-migrator-operator-799cb7f958-d2wjl\" (UID: \"9898ab75-3992-4a0e-a632-068a30b6c83f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"
Jul 13 18:51:32.227284 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.227240    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-rs6pz"]
Jul 13 18:51:32.230817 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:51:32.230796    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a434a2d_125b_48eb_8ba5_ed46293e594e.slice/crio-25f9fdd3eb4743fe982dba31d36c389a69f99e4b1ce0b62f6fd985a0633838a1 WatchSource:0}: Error finding container 25f9fdd3eb4743fe982dba31d36c389a69f99e4b1ce0b62f6fd985a0633838a1: Status 404 returned error can't find the container with id 25f9fdd3eb4743fe982dba31d36c389a69f99e4b1ce0b62f6fd985a0633838a1
Jul 13 18:51:32.305982 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.305883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"
Jul 13 18:51:32.429841 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.429810    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl"]
Jul 13 18:51:32.433048 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:51:32.433021    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9898ab75_3992_4a0e_a632_068a30b6c83f.slice/crio-fd8528de711b8292f85fe84dcd53cec2c21b09179fa07bfaa67eaa9afefcd986 WatchSource:0}: Error finding container fd8528de711b8292f85fe84dcd53cec2c21b09179fa07bfaa67eaa9afefcd986: Status 404 returned error can't find the container with id fd8528de711b8292f85fe84dcd53cec2c21b09179fa07bfaa67eaa9afefcd986
Jul 13 18:51:32.475714 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.475683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-b9nj9\" (UID: \"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:51:32.475868 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:32.475847    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 18:51:32.475948 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:32.475928    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls podName:4c63ce6a-d286-4614-bf2f-f4ef1a503d0d nodeName:}" failed. No retries permitted until 2026-07-13 18:51:33.475905617 +0000 UTC m=+59.716386554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls") pod "cluster-samples-operator-65db858894-b9nj9" (UID: "4c63ce6a-d286-4614-bf2f-f4ef1a503d0d") : secret "samples-operator-tls" not found
Jul 13 18:51:32.576746 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.576713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:32.576919 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:32.576883    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 18:51:32.576919 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:32.576906    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58b44f8f99-z2rnz: secret "image-registry-tls" not found
Jul 13 18:51:32.577023 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:32.576972    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls podName:3a8b9bf8-d461-4e23-a594-6c20460432af nodeName:}" failed. No retries permitted until 2026-07-13 18:51:33.576952478 +0000 UTC m=+59.817433414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls") pod "image-registry-58b44f8f99-z2rnz" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af") : secret "image-registry-tls" not found
Jul 13 18:51:32.601982 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.601948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl" event={"ID":"9898ab75-3992-4a0e-a632-068a30b6c83f","Type":"ContainerStarted","Data":"fd8528de711b8292f85fe84dcd53cec2c21b09179fa07bfaa67eaa9afefcd986"}
Jul 13 18:51:32.603077 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:32.603051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-rs6pz" event={"ID":"0a434a2d-125b-48eb-8ba5-ed46293e594e","Type":"ContainerStarted","Data":"25f9fdd3eb4743fe982dba31d36c389a69f99e4b1ce0b62f6fd985a0633838a1"}
Jul 13 18:51:33.485095 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:33.485058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-b9nj9\" (UID: \"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:51:33.485551 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:33.485235    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 18:51:33.485551 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:33.485341    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls podName:4c63ce6a-d286-4614-bf2f-f4ef1a503d0d nodeName:}" failed. No retries permitted until 2026-07-13 18:51:35.485313803 +0000 UTC m=+61.725794747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls") pod "cluster-samples-operator-65db858894-b9nj9" (UID: "4c63ce6a-d286-4614-bf2f-f4ef1a503d0d") : secret "samples-operator-tls" not found
Jul 13 18:51:33.585736 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:33.585698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:33.585909 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:33.585822    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 18:51:33.585909 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:33.585840    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58b44f8f99-z2rnz: secret "image-registry-tls" not found
Jul 13 18:51:33.585909 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:33.585907    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls podName:3a8b9bf8-d461-4e23-a594-6c20460432af nodeName:}" failed. No retries permitted until 2026-07-13 18:51:35.585887791 +0000 UTC m=+61.826368732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls") pod "image-registry-58b44f8f99-z2rnz" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af") : secret "image-registry-tls" not found
Jul 13 18:51:34.546053 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:34.546029    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv7rg"
Jul 13 18:51:34.609151 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:34.609110    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl" event={"ID":"9898ab75-3992-4a0e-a632-068a30b6c83f","Type":"ContainerStarted","Data":"35b1b99ae2de12112db12799938832ec8b31415cf3a8661e0d8ed3ffe5749056"}
Jul 13 18:51:34.611401 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:34.611373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-rs6pz" event={"ID":"0a434a2d-125b-48eb-8ba5-ed46293e594e","Type":"ContainerStarted","Data":"a33f050f5ec706e41c556df92de79d85edb8e8b48c1c2c423ea0b0cade2aaa9d"}
Jul 13 18:51:34.628024 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:34.627970    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl" podStartSLOduration=1.549418741 podStartE2EDuration="3.627953005s" totalImagesPullingTime="2.078534264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:51:34.627465959 +0000 UTC m=+60.867946895" watchObservedRunningTime="2026-07-13 18:51:34.627953005 +0000 UTC m=+60.868433944"
Jul 13 18:51:34.643938 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:34.643840    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-rs6pz" podStartSLOduration=2.200679474 podStartE2EDuration="3.64382397s" totalImagesPullingTime="1.443144496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:51:34.643678348 +0000 UTC m=+60.884159284" watchObservedRunningTime="2026-07-13 18:51:34.64382397 +0000 UTC m=+60.884304900"
Jul 13 18:51:35.501740 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:35.501694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-b9nj9\" (UID: \"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:51:35.501952 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:35.501835    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 18:51:35.501952 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:35.501898    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls podName:4c63ce6a-d286-4614-bf2f-f4ef1a503d0d nodeName:}" failed. No retries permitted until 2026-07-13 18:51:39.501881302 +0000 UTC m=+65.742362226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls") pod "cluster-samples-operator-65db858894-b9nj9" (UID: "4c63ce6a-d286-4614-bf2f-f4ef1a503d0d") : secret "samples-operator-tls" not found
Jul 13 18:51:35.602941 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:35.602898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:35.603355 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:35.603053    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 18:51:35.603355 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:35.603070    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58b44f8f99-z2rnz: secret "image-registry-tls" not found
Jul 13 18:51:35.603355 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:35.603126    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls podName:3a8b9bf8-d461-4e23-a594-6c20460432af nodeName:}" failed. No retries permitted until 2026-07-13 18:51:39.603108998 +0000 UTC m=+65.843589934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls") pod "image-registry-58b44f8f99-z2rnz" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af") : secret "image-registry-tls" not found
Jul 13 18:51:35.981072 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:35.981037    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dp9pw"]
Jul 13 18:51:35.983436 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:35.983419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:35.986215 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:35.986186    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 18:51:35.986336 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:35.986309    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 18:51:35.986523 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:35.986505    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 18:51:35.986906 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:35.986887    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g9bc6\""
Jul 13 18:51:35.986996 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:35.986969    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 18:51:36.000236 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.000215    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dp9pw"]
Jul 13 18:51:36.105604 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.105557    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbwz7\" (UniqueName: \"kubernetes.io/projected/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-api-access-hbwz7\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.105755 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.105617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eaa9e8c7-6a76-4029-9f5e-841291f6b695-crio-socket\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.105755 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.105696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.105755 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.105729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa9e8c7-6a76-4029-9f5e-841291f6b695-data-volume\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.105755 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.105748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.206960 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.206909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbwz7\" (UniqueName: \"kubernetes.io/projected/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-api-access-hbwz7\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.207046 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.206984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eaa9e8c7-6a76-4029-9f5e-841291f6b695-crio-socket\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.207046 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.207025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.207120 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.207047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa9e8c7-6a76-4029-9f5e-841291f6b695-data-volume\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.207120 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.207107    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eaa9e8c7-6a76-4029-9f5e-841291f6b695-crio-socket\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.207191 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.207110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.207191 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:36.207126    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 18:51:36.207191 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:36.207174    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 18:51:36.207191 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:36.207186    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls podName:eaa9e8c7-6a76-4029-9f5e-841291f6b695 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:36.707168123 +0000 UTC m=+62.947649054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dp9pw" (UID: "eaa9e8c7-6a76-4029-9f5e-841291f6b695") : secret "insights-runtime-extractor-tls" not found
Jul 13 18:51:36.207349 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:36.207234    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm podName:eaa9e8c7-6a76-4029-9f5e-841291f6b695 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:36.707215722 +0000 UTC m=+62.947696660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dp9pw" (UID: "eaa9e8c7-6a76-4029-9f5e-841291f6b695") : configmap "kube-rbac-proxy" not found
Jul 13 18:51:36.207387 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.207378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa9e8c7-6a76-4029-9f5e-841291f6b695-data-volume\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.222759 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.222734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbwz7\" (UniqueName: \"kubernetes.io/projected/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-api-access-hbwz7\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.711402 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.711365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.711402 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:36.711409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:36.711859 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:36.711492    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 18:51:36.711859 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:36.711540    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm podName:eaa9e8c7-6a76-4029-9f5e-841291f6b695 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:37.711525982 +0000 UTC m=+63.952006901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dp9pw" (UID: "eaa9e8c7-6a76-4029-9f5e-841291f6b695") : configmap "kube-rbac-proxy" not found
Jul 13 18:51:36.711859 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:36.711542    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 18:51:36.711859 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:36.711605    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls podName:eaa9e8c7-6a76-4029-9f5e-841291f6b695 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:37.711587372 +0000 UTC m=+63.952068306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dp9pw" (UID: "eaa9e8c7-6a76-4029-9f5e-841291f6b695") : secret "insights-runtime-extractor-tls" not found
Jul 13 18:51:37.721072 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:37.721031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:37.721583 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:37.721147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:37.721583 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:37.721167    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 18:51:37.721583 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:37.721234    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 18:51:37.721583 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:37.721269    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm podName:eaa9e8c7-6a76-4029-9f5e-841291f6b695 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:39.721232766 +0000 UTC m=+65.961713700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dp9pw" (UID: "eaa9e8c7-6a76-4029-9f5e-841291f6b695") : configmap "kube-rbac-proxy" not found
Jul 13 18:51:37.721583 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:37.721296    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls podName:eaa9e8c7-6a76-4029-9f5e-841291f6b695 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:39.721285186 +0000 UTC m=+65.961766116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dp9pw" (UID: "eaa9e8c7-6a76-4029-9f5e-841291f6b695") : secret "insights-runtime-extractor-tls" not found
Jul 13 18:51:38.149782 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:38.149756    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x96gs_96b30717-80d6-4db4-b93d-e6a8851547ac/dns-node-resolver/0.log"
Jul 13 18:51:38.750969 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:38.750943    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qlzx_e4c17dfc-0204-4039-89ff-97908d34bc39/node-ca/0.log"
Jul 13 18:51:39.538645 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:39.538608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-b9nj9\" (UID: \"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:51:39.538829 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:39.538772    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 18:51:39.538884 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:39.538839    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls podName:4c63ce6a-d286-4614-bf2f-f4ef1a503d0d nodeName:}" failed. No retries permitted until 2026-07-13 18:51:47.538823519 +0000 UTC m=+73.779304437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls") pod "cluster-samples-operator-65db858894-b9nj9" (UID: "4c63ce6a-d286-4614-bf2f-f4ef1a503d0d") : secret "samples-operator-tls" not found
Jul 13 18:51:39.561238 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:39.561216    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5clww_6c434c9f-c8cb-4b4e-8506-46e98ff06e76/serve-healthcheck-canary/0.log"
Jul 13 18:51:39.639029 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:39.638996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:39.639192 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:39.639143    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 18:51:39.639192 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:39.639157    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58b44f8f99-z2rnz: secret "image-registry-tls" not found
Jul 13 18:51:39.639292 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:39.639211    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls podName:3a8b9bf8-d461-4e23-a594-6c20460432af nodeName:}" failed. No retries permitted until 2026-07-13 18:51:47.639194365 +0000 UTC m=+73.879675295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls") pod "image-registry-58b44f8f99-z2rnz" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af") : secret "image-registry-tls" not found
Jul 13 18:51:39.739731 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:39.739698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:39.739883 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:39.739814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:39.739883 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:39.739814    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 18:51:39.739883 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:39.739877    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 18:51:39.739982 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:39.739893    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm podName:eaa9e8c7-6a76-4029-9f5e-841291f6b695 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:43.739877024 +0000 UTC m=+69.980357942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dp9pw" (UID: "eaa9e8c7-6a76-4029-9f5e-841291f6b695") : configmap "kube-rbac-proxy" not found
Jul 13 18:51:39.739982 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:39.739921    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls podName:eaa9e8c7-6a76-4029-9f5e-841291f6b695 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:43.739909044 +0000 UTC m=+69.980389965 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dp9pw" (UID: "eaa9e8c7-6a76-4029-9f5e-841291f6b695") : secret "insights-runtime-extractor-tls" not found
Jul 13 18:51:40.143620 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.143579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:51:40.143620 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.143621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:51:40.147032 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.147005    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 18:51:40.147106 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.147021    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 18:51:40.154560 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:40.154539    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 18:51:40.154617 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:40.154603    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs podName:b7e0b486-78b0-47b8-a1c6-191368ae0913 nodeName:}" failed. No retries permitted until 2026-07-13 18:52:44.154582373 +0000 UTC m=+130.395063292 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs") pod "network-metrics-daemon-hfp2m" (UID: "b7e0b486-78b0-47b8-a1c6-191368ae0913") : secret "metrics-daemon-secret" not found
Jul 13 18:51:40.156558 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.156539    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d737860c-a9d2-4449-8efd-0e657689675d-original-pull-secret\") pod \"global-pull-secret-syncer-jk8fj\" (UID: \"d737860c-a9d2-4449-8efd-0e657689675d\") " pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:51:40.291093 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.291047    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8fj"
Jul 13 18:51:40.345416 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.345380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724kf\" (UniqueName: \"kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf\") pod \"network-check-target-vw9qv\" (UID: \"b56462b4-a20f-4b98-8ee8-c482da1e19e3\") " pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:40.349733 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.349707    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 18:51:40.360522 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.360491    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 18:51:40.369526 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.369465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-724kf\" (UniqueName: \"kubernetes.io/projected/b56462b4-a20f-4b98-8ee8-c482da1e19e3-kube-api-access-724kf\") pod \"network-check-target-vw9qv\" (UID: \"b56462b4-a20f-4b98-8ee8-c482da1e19e3\") " pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:40.438784 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.438711    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jk8fj"]
Jul 13 18:51:40.441737 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:51:40.441707    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd737860c_a9d2_4449_8efd_0e657689675d.slice/crio-da07b7a8321f15b225f0f2cfb0dc56492aa2ff7ec2194e3527e704f5cf1c4e2c WatchSource:0}: Error finding container da07b7a8321f15b225f0f2cfb0dc56492aa2ff7ec2194e3527e704f5cf1c4e2c: Status 404 returned error can't find the container with id da07b7a8321f15b225f0f2cfb0dc56492aa2ff7ec2194e3527e704f5cf1c4e2c
Jul 13 18:51:40.605568 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.605540    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g7ddc\""
Jul 13 18:51:40.613379 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.613355    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:40.628083 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.628051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jk8fj" event={"ID":"d737860c-a9d2-4449-8efd-0e657689675d","Type":"ContainerStarted","Data":"da07b7a8321f15b225f0f2cfb0dc56492aa2ff7ec2194e3527e704f5cf1c4e2c"}
Jul 13 18:51:40.738157 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.738113    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vw9qv"]
Jul 13 18:51:40.742725 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:51:40.742698    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56462b4_a20f_4b98_8ee8_c482da1e19e3.slice/crio-e0de186f36225a4882818204d4c55f3ce40bd1368ceeaa05888cf298fbce1950 WatchSource:0}: Error finding container e0de186f36225a4882818204d4c55f3ce40bd1368ceeaa05888cf298fbce1950: Status 404 returned error can't find the container with id e0de186f36225a4882818204d4c55f3ce40bd1368ceeaa05888cf298fbce1950
Jul 13 18:51:40.950129 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.950040    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-thnll"]
Jul 13 18:51:40.952812 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.952788    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-thnll"
Jul 13 18:51:40.955512 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.955489    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 13 18:51:40.955618 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.955591    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wr6hx\""
Jul 13 18:51:40.955667 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.955591    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 13 18:51:40.955711 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.955591    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 13 18:51:40.956642 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.956624    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 13 18:51:40.964159 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:40.964138    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-thnll"]
Jul 13 18:51:41.051474 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.051429    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhnq4\" (UniqueName: \"kubernetes.io/projected/1bcbbadf-39c4-46e2-b293-2adc71e0f95d-kube-api-access-dhnq4\") pod \"service-ca-79f68b9f4f-thnll\" (UID: \"1bcbbadf-39c4-46e2-b293-2adc71e0f95d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-thnll"
Jul 13 18:51:41.051652 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.051487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1bcbbadf-39c4-46e2-b293-2adc71e0f95d-signing-key\") pod \"service-ca-79f68b9f4f-thnll\" (UID: \"1bcbbadf-39c4-46e2-b293-2adc71e0f95d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-thnll"
Jul 13 18:51:41.051652 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.051521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1bcbbadf-39c4-46e2-b293-2adc71e0f95d-signing-cabundle\") pod \"service-ca-79f68b9f4f-thnll\" (UID: \"1bcbbadf-39c4-46e2-b293-2adc71e0f95d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-thnll"
Jul 13 18:51:41.152715 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.152677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhnq4\" (UniqueName: \"kubernetes.io/projected/1bcbbadf-39c4-46e2-b293-2adc71e0f95d-kube-api-access-dhnq4\") pod \"service-ca-79f68b9f4f-thnll\" (UID: \"1bcbbadf-39c4-46e2-b293-2adc71e0f95d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-thnll"
Jul 13 18:51:41.153166 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.152746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1bcbbadf-39c4-46e2-b293-2adc71e0f95d-signing-key\") pod \"service-ca-79f68b9f4f-thnll\" (UID: \"1bcbbadf-39c4-46e2-b293-2adc71e0f95d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-thnll"
Jul 13 18:51:41.153166 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.152778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1bcbbadf-39c4-46e2-b293-2adc71e0f95d-signing-cabundle\") pod \"service-ca-79f68b9f4f-thnll\" (UID: \"1bcbbadf-39c4-46e2-b293-2adc71e0f95d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-thnll"
Jul 13 18:51:41.153607 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.153582    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1bcbbadf-39c4-46e2-b293-2adc71e0f95d-signing-cabundle\") pod \"service-ca-79f68b9f4f-thnll\" (UID: \"1bcbbadf-39c4-46e2-b293-2adc71e0f95d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-thnll"
Jul 13 18:51:41.155322 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.155301    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1bcbbadf-39c4-46e2-b293-2adc71e0f95d-signing-key\") pod \"service-ca-79f68b9f4f-thnll\" (UID: \"1bcbbadf-39c4-46e2-b293-2adc71e0f95d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-thnll"
Jul 13 18:51:41.179317 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.179288    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhnq4\" (UniqueName: \"kubernetes.io/projected/1bcbbadf-39c4-46e2-b293-2adc71e0f95d-kube-api-access-dhnq4\") pod \"service-ca-79f68b9f4f-thnll\" (UID: \"1bcbbadf-39c4-46e2-b293-2adc71e0f95d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-thnll"
Jul 13 18:51:41.261676 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.261591    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-thnll"
Jul 13 18:51:41.409295 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.409261    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-thnll"]
Jul 13 18:51:41.412960 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:51:41.412903    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bcbbadf_39c4_46e2_b293_2adc71e0f95d.slice/crio-206c074f286acca813fffc9e45486882f0821c01b981914fc3e21bed17bc346d WatchSource:0}: Error finding container 206c074f286acca813fffc9e45486882f0821c01b981914fc3e21bed17bc346d: Status 404 returned error can't find the container with id 206c074f286acca813fffc9e45486882f0821c01b981914fc3e21bed17bc346d
Jul 13 18:51:41.632261 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.632205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-thnll" event={"ID":"1bcbbadf-39c4-46e2-b293-2adc71e0f95d","Type":"ContainerStarted","Data":"206c074f286acca813fffc9e45486882f0821c01b981914fc3e21bed17bc346d"}
Jul 13 18:51:41.633380 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:41.633344    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vw9qv" event={"ID":"b56462b4-a20f-4b98-8ee8-c482da1e19e3","Type":"ContainerStarted","Data":"e0de186f36225a4882818204d4c55f3ce40bd1368ceeaa05888cf298fbce1950"}
Jul 13 18:51:42.970920 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:42.970883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:51:42.971426 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:42.971064    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 18:51:42.971426 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:42.971144    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls podName:53e87220-710d-4fda-a1b2-a87c09fa99b8 nodeName:}" failed. No retries permitted until 2026-07-13 18:52:14.971119541 +0000 UTC m=+101.211600481 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls") pod "dns-default-gc897" (UID: "53e87220-710d-4fda-a1b2-a87c09fa99b8") : secret "dns-default-metrics-tls" not found
Jul 13 18:51:43.779272 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:43.779220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:43.779463 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:43.779382    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 18:51:43.779463 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:43.779399    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:43.779463 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:43.779460    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls podName:eaa9e8c7-6a76-4029-9f5e-841291f6b695 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:51.779438127 +0000 UTC m=+78.019919063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dp9pw" (UID: "eaa9e8c7-6a76-4029-9f5e-841291f6b695") : secret "insights-runtime-extractor-tls" not found
Jul 13 18:51:43.779651 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:43.779496    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 18:51:43.779651 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:43.779546    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm podName:eaa9e8c7-6a76-4029-9f5e-841291f6b695 nodeName:}" failed. No retries permitted until 2026-07-13 18:51:51.779530373 +0000 UTC m=+78.020011310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dp9pw" (UID: "eaa9e8c7-6a76-4029-9f5e-841291f6b695") : configmap "kube-rbac-proxy" not found
Jul 13 18:51:46.649892 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:46.649844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-thnll" event={"ID":"1bcbbadf-39c4-46e2-b293-2adc71e0f95d","Type":"ContainerStarted","Data":"00628801224c0c5a149937396bc1aa6444a0df1c754dc3f07dcd2dfc43f2cfd6"}
Jul 13 18:51:46.651412 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:46.651377    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vw9qv" event={"ID":"b56462b4-a20f-4b98-8ee8-c482da1e19e3","Type":"ContainerStarted","Data":"70bb88b7eb179168ba5bd3fd5bee2a19d9535f62f05f3b3f9c998c27d1d190fb"}
Jul 13 18:51:46.651552 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:46.651444    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:51:46.652676 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:46.652655    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jk8fj" event={"ID":"d737860c-a9d2-4449-8efd-0e657689675d","Type":"ContainerStarted","Data":"30e3fe437a4bb102378599401b13ce81761c1653c9ad4d9ba7703601f1e0e629"}
Jul 13 18:51:46.677292 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:46.677232    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-thnll" podStartSLOduration=2.214034642 podStartE2EDuration="6.677216185s" totalImagesPullingTime="4.463181543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:51:46.676430668 +0000 UTC m=+72.916911628" watchObservedRunningTime="2026-07-13 18:51:46.677216185 +0000 UTC m=+72.917697123"
Jul 13 18:51:46.703298 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:46.703225    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jk8fj" podStartSLOduration=67.256004628 podStartE2EDuration="1m12.703210416s" totalImagesPullingTime="5.447205788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:51:46.702389037 +0000 UTC m=+72.942869976" watchObservedRunningTime="2026-07-13 18:51:46.703210416 +0000 UTC m=+72.943691354"
Jul 13 18:51:46.720880 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:46.720817    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vw9qv" podStartSLOduration=67.580924844 podStartE2EDuration="1m12.720796892s" totalImagesPullingTime="5.139872048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:51:46.720476788 +0000 UTC m=+72.960957742" watchObservedRunningTime="2026-07-13 18:51:46.720796892 +0000 UTC m=+72.961277832"
Jul 13 18:51:47.612818 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:47.612761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-b9nj9\" (UID: \"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:51:47.613037 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:47.612935    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 18:51:47.613037 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:47.613024    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls podName:4c63ce6a-d286-4614-bf2f-f4ef1a503d0d nodeName:}" failed. No retries permitted until 2026-07-13 18:52:03.613004267 +0000 UTC m=+89.853485198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls") pod "cluster-samples-operator-65db858894-b9nj9" (UID: "4c63ce6a-d286-4614-bf2f-f4ef1a503d0d") : secret "samples-operator-tls" not found
Jul 13 18:51:47.713732 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:47.713697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:51:47.714152 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:47.713864    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 18:51:47.714152 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:47.713889    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58b44f8f99-z2rnz: secret "image-registry-tls" not found
Jul 13 18:51:47.714152 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:47.713950    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls podName:3a8b9bf8-d461-4e23-a594-6c20460432af nodeName:}" failed. No retries permitted until 2026-07-13 18:52:03.713930947 +0000 UTC m=+89.954411895 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls") pod "image-registry-58b44f8f99-z2rnz" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af") : secret "image-registry-tls" not found
Jul 13 18:51:51.849097 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:51.849060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:51.849097 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:51.849101    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:51:51.849731 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:51.849223    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 18:51:51.849731 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:51:51.849324    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls podName:eaa9e8c7-6a76-4029-9f5e-841291f6b695 nodeName:}" failed. No retries permitted until 2026-07-13 18:52:07.849303094 +0000 UTC m=+94.089784028 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dp9pw" (UID: "eaa9e8c7-6a76-4029-9f5e-841291f6b695") : secret "insights-runtime-extractor-tls" not found
Jul 13 18:51:51.849731 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:51:51.849569    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa9e8c7-6a76-4029-9f5e-841291f6b695-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:52:01.795207 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.795086    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9"]
Jul 13 18:52:01.799022 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.799000    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9"
Jul 13 18:52:01.802132 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.802107    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 13 18:52:01.802275 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.802106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-76jrx\""
Jul 13 18:52:01.803282 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.803263    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 13 18:52:01.803403 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.803382    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 13 18:52:01.803502 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.803487    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 13 18:52:01.816030 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.816001    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9"]
Jul 13 18:52:01.826413 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.826380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t6l7\" (UniqueName: \"kubernetes.io/projected/76619717-6f72-4389-a814-39fd40cdc848-kube-api-access-6t6l7\") pod \"managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9\" (UID: \"76619717-6f72-4389-a814-39fd40cdc848\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9"
Jul 13 18:52:01.826545 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.826424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/76619717-6f72-4389-a814-39fd40cdc848-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9\" (UID: \"76619717-6f72-4389-a814-39fd40cdc848\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9"
Jul 13 18:52:01.915688 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.915635    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58b44f8f99-z2rnz"]
Jul 13 18:52:01.915881 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:52:01.915859    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz" podUID="3a8b9bf8-d461-4e23-a594-6c20460432af"
Jul 13 18:52:01.927643 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.927602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t6l7\" (UniqueName: \"kubernetes.io/projected/76619717-6f72-4389-a814-39fd40cdc848-kube-api-access-6t6l7\") pod \"managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9\" (UID: \"76619717-6f72-4389-a814-39fd40cdc848\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9"
Jul 13 18:52:01.927806 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.927648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/76619717-6f72-4389-a814-39fd40cdc848-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9\" (UID: \"76619717-6f72-4389-a814-39fd40cdc848\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9"
Jul 13 18:52:01.930200 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.930169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/76619717-6f72-4389-a814-39fd40cdc848-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9\" (UID: \"76619717-6f72-4389-a814-39fd40cdc848\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9"
Jul 13 18:52:01.947235 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.947201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t6l7\" (UniqueName: \"kubernetes.io/projected/76619717-6f72-4389-a814-39fd40cdc848-kube-api-access-6t6l7\") pod \"managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9\" (UID: \"76619717-6f72-4389-a814-39fd40cdc848\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9"
Jul 13 18:52:01.954186 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.954163    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-969f9595c-9fjvb"]
Jul 13 18:52:01.957049 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.957031    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:01.977697 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:01.977672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-969f9595c-9fjvb"]
Jul 13 18:52:02.027990 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.027957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-bound-sa-token\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.028156 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.027994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-installation-pull-secrets\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.028156 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.028109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh24n\" (UniqueName: \"kubernetes.io/projected/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-kube-api-access-jh24n\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.028156 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.028150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-registry-tls\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.028281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.028173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-ca-trust-extracted\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.028281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.028219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-registry-certificates\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.028281 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.028235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-trusted-ca\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.028373 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.028282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-image-registry-private-configuration\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.117162 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.117128    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9"
Jul 13 18:52:02.128784 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.128752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-installation-pull-secrets\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.128928 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.128830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh24n\" (UniqueName: \"kubernetes.io/projected/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-kube-api-access-jh24n\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.128928 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.128858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-registry-tls\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.128928 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.128879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-ca-trust-extracted\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.129213 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.129092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-registry-certificates\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.129213 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.129138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-trusted-ca\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.129213 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.129181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-image-registry-private-configuration\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.129384 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.129233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-bound-sa-token\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.129384 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.129305    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-ca-trust-extracted\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.129908 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.129881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-registry-certificates\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.130419 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.130399    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-trusted-ca\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.131911 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.131885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-installation-pull-secrets\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.132118 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.132013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-registry-tls\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.132118 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.132076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-image-registry-private-configuration\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.143037 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.143013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-bound-sa-token\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.146687 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.146661    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh24n\" (UniqueName: \"kubernetes.io/projected/caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa-kube-api-access-jh24n\") pod \"image-registry-969f9595c-9fjvb\" (UID: \"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa\") " pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.248064 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.248032    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9"]
Jul 13 18:52:02.250695 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:52:02.250668    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76619717_6f72_4389_a814_39fd40cdc848.slice/crio-3be0de53444349f9627c0df5acc25d0a5cd072f39830fcc4b34e2c29c15e831a WatchSource:0}: Error finding container 3be0de53444349f9627c0df5acc25d0a5cd072f39830fcc4b34e2c29c15e831a: Status 404 returned error can't find the container with id 3be0de53444349f9627c0df5acc25d0a5cd072f39830fcc4b34e2c29c15e831a
Jul 13 18:52:02.268096 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.268077    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j66bj\""
Jul 13 18:52:02.276376 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.276353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.406143 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.406071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-969f9595c-9fjvb"]
Jul 13 18:52:02.409493 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:52:02.409471    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa5e9f2_7e63_4430_bb2a_fb9e040dd6fa.slice/crio-6d9ff842f8f61b2f81da41964245c57ba1ac095f7fbd2eff41cd244ea3712d7d WatchSource:0}: Error finding container 6d9ff842f8f61b2f81da41964245c57ba1ac095f7fbd2eff41cd244ea3712d7d: Status 404 returned error can't find the container with id 6d9ff842f8f61b2f81da41964245c57ba1ac095f7fbd2eff41cd244ea3712d7d
Jul 13 18:52:02.704889 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.704794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-969f9595c-9fjvb" event={"ID":"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa","Type":"ContainerStarted","Data":"df9093f6fcdd73987b656f513a65163fceebb5f546524dc713a6dfd5c7183ca8"}
Jul 13 18:52:02.704889 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.704853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-969f9595c-9fjvb" event={"ID":"caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa","Type":"ContainerStarted","Data":"6d9ff842f8f61b2f81da41964245c57ba1ac095f7fbd2eff41cd244ea3712d7d"}
Jul 13 18:52:02.705121 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.704893    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:02.706130 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.706109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9" event={"ID":"76619717-6f72-4389-a814-39fd40cdc848","Type":"ContainerStarted","Data":"3be0de53444349f9627c0df5acc25d0a5cd072f39830fcc4b34e2c29c15e831a"}
Jul 13 18:52:02.706130 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.706124    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:52:02.712436 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.712416    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:52:02.733563 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.733535    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-certificates\") pod \"3a8b9bf8-d461-4e23-a594-6c20460432af\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") "
Jul 13 18:52:02.733725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.733583    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a8b9bf8-d461-4e23-a594-6c20460432af-ca-trust-extracted\") pod \"3a8b9bf8-d461-4e23-a594-6c20460432af\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") "
Jul 13 18:52:02.733725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.733603    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-bound-sa-token\") pod \"3a8b9bf8-d461-4e23-a594-6c20460432af\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") "
Jul 13 18:52:02.733725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.733629    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a8b9bf8-d461-4e23-a594-6c20460432af-trusted-ca\") pod \"3a8b9bf8-d461-4e23-a594-6c20460432af\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") "
Jul 13 18:52:02.733725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.733649    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a8b9bf8-d461-4e23-a594-6c20460432af-image-registry-private-configuration\") pod \"3a8b9bf8-d461-4e23-a594-6c20460432af\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") "
Jul 13 18:52:02.733725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.733672    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqmvp\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-kube-api-access-dqmvp\") pod \"3a8b9bf8-d461-4e23-a594-6c20460432af\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") "
Jul 13 18:52:02.733725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.733718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a8b9bf8-d461-4e23-a594-6c20460432af-installation-pull-secrets\") pod \"3a8b9bf8-d461-4e23-a594-6c20460432af\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") "
Jul 13 18:52:02.734033 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.733854    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8b9bf8-d461-4e23-a594-6c20460432af-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3a8b9bf8-d461-4e23-a594-6c20460432af" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:52:02.734033 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.733913    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3a8b9bf8-d461-4e23-a594-6c20460432af" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:52:02.734033 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.734028    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-certificates\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:52:02.734185 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.734047    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a8b9bf8-d461-4e23-a594-6c20460432af-ca-trust-extracted\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:52:02.734656 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.734451    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a8b9bf8-d461-4e23-a594-6c20460432af-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3a8b9bf8-d461-4e23-a594-6c20460432af" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:52:02.736399 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.736365    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a8b9bf8-d461-4e23-a594-6c20460432af-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3a8b9bf8-d461-4e23-a594-6c20460432af" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:52:02.736484 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.736410    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3a8b9bf8-d461-4e23-a594-6c20460432af" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:52:02.736484 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.736449    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-kube-api-access-dqmvp" (OuterVolumeSpecName: "kube-api-access-dqmvp") pod "3a8b9bf8-d461-4e23-a594-6c20460432af" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af"). InnerVolumeSpecName "kube-api-access-dqmvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:52:02.736562 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.736535    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a8b9bf8-d461-4e23-a594-6c20460432af-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3a8b9bf8-d461-4e23-a594-6c20460432af" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:52:02.751829 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.751784    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-969f9595c-9fjvb" podStartSLOduration=1.7517671240000001 podStartE2EDuration="1.751767124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:52:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:52:02.730450767 +0000 UTC m=+88.970931724" watchObservedRunningTime="2026-07-13 18:52:02.751767124 +0000 UTC m=+88.992248054"
Jul 13 18:52:02.834879 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.834847    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a8b9bf8-d461-4e23-a594-6c20460432af-installation-pull-secrets\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:52:02.834879 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.834872    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-bound-sa-token\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:52:02.834879 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.834881    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a8b9bf8-d461-4e23-a594-6c20460432af-trusted-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:52:02.834879 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.834891    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a8b9bf8-d461-4e23-a594-6c20460432af-image-registry-private-configuration\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:52:02.835345 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:02.834900    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqmvp\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-kube-api-access-dqmvp\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:52:03.642698 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:03.642654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-b9nj9\" (UID: \"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:52:03.645557 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:03.645528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c63ce6a-d286-4614-bf2f-f4ef1a503d0d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-b9nj9\" (UID: \"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:52:03.708845 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:03.708813    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:52:03.740853 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:03.740821    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58b44f8f99-z2rnz"]
Jul 13 18:52:03.743180 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:03.743124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:52:03.744879 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:03.744826    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58b44f8f99-z2rnz"]
Jul 13 18:52:03.746442 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:03.746421    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls\") pod \"image-registry-58b44f8f99-z2rnz\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") " pod="openshift-image-registry/image-registry-58b44f8f99-z2rnz"
Jul 13 18:52:03.844355 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:03.844308    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls\") pod \"3a8b9bf8-d461-4e23-a594-6c20460432af\" (UID: \"3a8b9bf8-d461-4e23-a594-6c20460432af\") "
Jul 13 18:52:03.846546 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:03.846510    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3a8b9bf8-d461-4e23-a594-6c20460432af" (UID: "3a8b9bf8-d461-4e23-a594-6c20460432af"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:52:03.901211 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:03.901140    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xmgkr\""
Jul 13 18:52:03.909347 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:03.909321    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"
Jul 13 18:52:03.945472 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:03.945442    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a8b9bf8-d461-4e23-a594-6c20460432af-registry-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:52:04.385675 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:04.385639    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a8b9bf8-d461-4e23-a594-6c20460432af" path="/var/lib/kubelet/pods/3a8b9bf8-d461-4e23-a594-6c20460432af/volumes"
Jul 13 18:52:04.842773 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:04.842750    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9"]
Jul 13 18:52:05.718834 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:05.718785    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9" event={"ID":"76619717-6f72-4389-a814-39fd40cdc848","Type":"ContainerStarted","Data":"259a3bcb09c8896aa760e30f73bca0f7c69c2db1b37007eb9973b39fb669dbdc"}
Jul 13 18:52:05.719979 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:05.719952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9" event={"ID":"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d","Type":"ContainerStarted","Data":"39585708d18e5878451617a1d6c73be6e2b50b7fa7357751915c5df255ad43e1"}
Jul 13 18:52:05.737814 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:05.737756    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dd79fc4f8-jhhq9" podStartSLOduration=2.216831398 podStartE2EDuration="4.737735217s" totalImagesPullingTime="2.520903819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:52:05.73703927 +0000 UTC m=+91.977520210" watchObservedRunningTime="2026-07-13 18:52:05.737735217 +0000 UTC m=+91.978216157"
Jul 13 18:52:07.729131 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:07.729093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9" event={"ID":"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d","Type":"ContainerStarted","Data":"a19cdabc72055ee51851361ef19304611720d43c77d7b9f1873325b299bab3a0"}
Jul 13 18:52:07.729610 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:07.729148    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9" event={"ID":"4c63ce6a-d286-4614-bf2f-f4ef1a503d0d","Type":"ContainerStarted","Data":"17e68e7035bd8f90af4c8bb47821b828db52a56fc11640b8fe9189f251976349"}
Jul 13 18:52:07.746087 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:07.746038    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-b9nj9" podStartSLOduration=34.852287529 podStartE2EDuration="36.746021226s" totalImagesPullingTime="1.893733697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:52:07.745123989 +0000 UTC m=+93.985604926" watchObservedRunningTime="2026-07-13 18:52:07.746021226 +0000 UTC m=+93.986502165"
Jul 13 18:52:07.877914 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:07.877872    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:52:07.880103 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:07.880074    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa9e8c7-6a76-4029-9f5e-841291f6b695-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp9pw\" (UID: \"eaa9e8c7-6a76-4029-9f5e-841291f6b695\") " pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:52:08.092311 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:08.092270    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dp9pw"
Jul 13 18:52:08.222169 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:08.222131    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dp9pw"]
Jul 13 18:52:08.225566 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:52:08.225539    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa9e8c7_6a76_4029_9f5e_841291f6b695.slice/crio-8d55b4e244f489c03d708a63586c695676b033117b178d766603debf4de3c399 WatchSource:0}: Error finding container 8d55b4e244f489c03d708a63586c695676b033117b178d766603debf4de3c399: Status 404 returned error can't find the container with id 8d55b4e244f489c03d708a63586c695676b033117b178d766603debf4de3c399
Jul 13 18:52:08.734054 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:08.734016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp9pw" event={"ID":"eaa9e8c7-6a76-4029-9f5e-841291f6b695","Type":"ContainerStarted","Data":"8d55b4e244f489c03d708a63586c695676b033117b178d766603debf4de3c399"}
Jul 13 18:52:12.753415 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:12.753377    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp9pw" event={"ID":"eaa9e8c7-6a76-4029-9f5e-841291f6b695","Type":"ContainerStarted","Data":"b8836e08c751cc7388768e37f17efbff3f18ee7a1fafb5094d6d852a12e86377"}
Jul 13 18:52:13.758599 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:13.758567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp9pw" event={"ID":"eaa9e8c7-6a76-4029-9f5e-841291f6b695","Type":"ContainerStarted","Data":"5a8ce50dc1fc5f5537a9c2bb4868ded414ccc12c6548182a4a500c5db16766a3"}
Jul 13 18:52:14.640227 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.640190    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-frxh5"]
Jul 13 18:52:14.643467 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.643449    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.647500 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.647472    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 18:52:14.647500 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.647494    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 13 18:52:14.647784 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.647472    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 13 18:52:14.647784 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.647775    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 18:52:14.647911 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.647826    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 18:52:14.647911 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.647874    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-98xkj\""
Jul 13 18:52:14.651804 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.651780    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-frxh5"]
Jul 13 18:52:14.735100 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.735058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fece8507-e2e2-4fba-8ae7-c045824593ac-metrics-client-ca\") pod \"prometheus-operator-64785b6675-frxh5\" (UID: \"fece8507-e2e2-4fba-8ae7-c045824593ac\") " pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.735297 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.735114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fece8507-e2e2-4fba-8ae7-c045824593ac-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-frxh5\" (UID: \"fece8507-e2e2-4fba-8ae7-c045824593ac\") " pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.735297 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.735225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl6tr\" (UniqueName: \"kubernetes.io/projected/fece8507-e2e2-4fba-8ae7-c045824593ac-kube-api-access-nl6tr\") pod \"prometheus-operator-64785b6675-frxh5\" (UID: \"fece8507-e2e2-4fba-8ae7-c045824593ac\") " pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.735375 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.735330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fece8507-e2e2-4fba-8ae7-c045824593ac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-frxh5\" (UID: \"fece8507-e2e2-4fba-8ae7-c045824593ac\") " pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.836273 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.836201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fece8507-e2e2-4fba-8ae7-c045824593ac-metrics-client-ca\") pod \"prometheus-operator-64785b6675-frxh5\" (UID: \"fece8507-e2e2-4fba-8ae7-c045824593ac\") " pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.836739 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.836297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fece8507-e2e2-4fba-8ae7-c045824593ac-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-frxh5\" (UID: \"fece8507-e2e2-4fba-8ae7-c045824593ac\") " pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.836739 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.836337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl6tr\" (UniqueName: \"kubernetes.io/projected/fece8507-e2e2-4fba-8ae7-c045824593ac-kube-api-access-nl6tr\") pod \"prometheus-operator-64785b6675-frxh5\" (UID: \"fece8507-e2e2-4fba-8ae7-c045824593ac\") " pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.836739 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.836373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fece8507-e2e2-4fba-8ae7-c045824593ac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-frxh5\" (UID: \"fece8507-e2e2-4fba-8ae7-c045824593ac\") " pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.836884 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.836860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fece8507-e2e2-4fba-8ae7-c045824593ac-metrics-client-ca\") pod \"prometheus-operator-64785b6675-frxh5\" (UID: \"fece8507-e2e2-4fba-8ae7-c045824593ac\") " pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.838742 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.838713    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fece8507-e2e2-4fba-8ae7-c045824593ac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-frxh5\" (UID: \"fece8507-e2e2-4fba-8ae7-c045824593ac\") " pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.838845 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.838823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fece8507-e2e2-4fba-8ae7-c045824593ac-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-frxh5\" (UID: \"fece8507-e2e2-4fba-8ae7-c045824593ac\") " pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.845570 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.845550    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl6tr\" (UniqueName: \"kubernetes.io/projected/fece8507-e2e2-4fba-8ae7-c045824593ac-kube-api-access-nl6tr\") pod \"prometheus-operator-64785b6675-frxh5\" (UID: \"fece8507-e2e2-4fba-8ae7-c045824593ac\") " pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:14.952757 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:14.952672    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5"
Jul 13 18:52:15.037796 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:15.037767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:52:15.040075 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:15.040048    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53e87220-710d-4fda-a1b2-a87c09fa99b8-metrics-tls\") pod \"dns-default-gc897\" (UID: \"53e87220-710d-4fda-a1b2-a87c09fa99b8\") " pod="openshift-dns/dns-default-gc897"
Jul 13 18:52:15.059336 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:15.059308    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5rh7g\""
Jul 13 18:52:15.066941 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:15.066914    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gc897"
Jul 13 18:52:15.085390 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:15.085367    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-frxh5"]
Jul 13 18:52:15.087619 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:52:15.087588    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfece8507_e2e2_4fba_8ae7_c045824593ac.slice/crio-b16cf87a92b084ac05bda9087dadc19a4e778667c92f7b22fa43b0a4b0809424 WatchSource:0}: Error finding container b16cf87a92b084ac05bda9087dadc19a4e778667c92f7b22fa43b0a4b0809424: Status 404 returned error can't find the container with id b16cf87a92b084ac05bda9087dadc19a4e778667c92f7b22fa43b0a4b0809424
Jul 13 18:52:15.193452 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:15.193421    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gc897"]
Jul 13 18:52:15.196413 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:52:15.196385    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e87220_710d_4fda_a1b2_a87c09fa99b8.slice/crio-8408dc474d1df29760851866bf269c17dd967a742ad389e34b35bd32576b82f0 WatchSource:0}: Error finding container 8408dc474d1df29760851866bf269c17dd967a742ad389e34b35bd32576b82f0: Status 404 returned error can't find the container with id 8408dc474d1df29760851866bf269c17dd967a742ad389e34b35bd32576b82f0
Jul 13 18:52:15.766948 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:15.766910    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5" event={"ID":"fece8507-e2e2-4fba-8ae7-c045824593ac","Type":"ContainerStarted","Data":"b16cf87a92b084ac05bda9087dadc19a4e778667c92f7b22fa43b0a4b0809424"}
Jul 13 18:52:15.767995 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:15.767970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gc897" event={"ID":"53e87220-710d-4fda-a1b2-a87c09fa99b8","Type":"ContainerStarted","Data":"8408dc474d1df29760851866bf269c17dd967a742ad389e34b35bd32576b82f0"}
Jul 13 18:52:17.659908 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:17.659878    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vw9qv"
Jul 13 18:52:18.781084 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:18.781052    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp9pw" event={"ID":"eaa9e8c7-6a76-4029-9f5e-841291f6b695","Type":"ContainerStarted","Data":"68a730d53a2d4ee067bf8835f41195d0044f48df8ee3abb68be94a20ff7bd6b1"}
Jul 13 18:52:18.782959 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:18.782894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gc897" event={"ID":"53e87220-710d-4fda-a1b2-a87c09fa99b8","Type":"ContainerStarted","Data":"5c76a1700df1d536e7d30c21605679924b18d3d53411e830418c555616bc25e8"}
Jul 13 18:52:18.806670 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:18.806599    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dp9pw" podStartSLOduration=33.530837671 podStartE2EDuration="43.806577175s" totalImagesPullingTime="10.275739504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:51:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:52:18.805591078 +0000 UTC m=+105.046072018" watchObservedRunningTime="2026-07-13 18:52:18.806577175 +0000 UTC m=+105.047058117"
Jul 13 18:52:19.787841 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:19.787804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gc897" event={"ID":"53e87220-710d-4fda-a1b2-a87c09fa99b8","Type":"ContainerStarted","Data":"d118734c9af6085485f06d481b1ea7fa794b72ac1d512ea0ad51c8bc9a54378c"}
Jul 13 18:52:19.788299 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:19.787905    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gc897"
Jul 13 18:52:20.792914 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:20.792868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5" event={"ID":"fece8507-e2e2-4fba-8ae7-c045824593ac","Type":"ContainerStarted","Data":"63213b0ff3b21b69448e73017c70f1680119be6ae8ec40d95d1840f7b1896475"}
Jul 13 18:52:20.793403 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:20.792936    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5" event={"ID":"fece8507-e2e2-4fba-8ae7-c045824593ac","Type":"ContainerStarted","Data":"72937ca975fcf1b017257e87b81237d888f4c1244be165f0b598aa785be3ea6b"}
Jul 13 18:52:20.817198 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:20.817144    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gc897" podStartSLOduration=66.394503696 podStartE2EDuration="1m9.81712858s" totalImagesPullingTime="3.422624884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:52:19.810485643 +0000 UTC m=+106.050966582" watchObservedRunningTime="2026-07-13 18:52:20.81712858 +0000 UTC m=+107.057609518"
Jul 13 18:52:20.817402 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:20.817359    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-frxh5" podStartSLOduration=2.028973421 podStartE2EDuration="6.817348598s" totalImagesPullingTime="4.788375177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:52:20.815919564 +0000 UTC m=+107.056400531" watchObservedRunningTime="2026-07-13 18:52:20.817348598 +0000 UTC m=+107.057829540"
Jul 13 18:52:22.281352 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:22.281319    2563 patch_prober.go:28] interesting pod/image-registry-969f9595c-9fjvb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 18:52:22.281745 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:22.281378    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-969f9595c-9fjvb" podUID="caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 18:52:23.713712 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:23.713684    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-969f9595c-9fjvb"
Jul 13 18:52:26.974435 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:26.974392    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5kblj"]
Jul 13 18:52:26.977027 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:26.976986    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:26.980166 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:26.980143    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 18:52:26.980322 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:26.980143    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 18:52:26.980322 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:26.980145    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6pnlk\""
Jul 13 18:52:26.988036 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:26.988014    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 18:52:27.037684 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.037648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df044b2e-c67e-4113-a84c-30d111af07fe-root\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.037684 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.037688    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df044b2e-c67e-4113-a84c-30d111af07fe-metrics-client-ca\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.037911 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.037780    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-textfile\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.037911 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.037812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.037911 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.037849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df044b2e-c67e-4113-a84c-30d111af07fe-sys\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.037911 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.037891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-tls\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.038067 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.037929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-wtmp\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.038067 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.037960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z97zp\" (UniqueName: \"kubernetes.io/projected/df044b2e-c67e-4113-a84c-30d111af07fe-kube-api-access-z97zp\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.038067 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.037999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-tls\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139057 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139072    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-wtmp\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139340 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z97zp\" (UniqueName: \"kubernetes.io/projected/df044b2e-c67e-4113-a84c-30d111af07fe-kube-api-access-z97zp\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139340 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139282    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139340 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-wtmp\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139478 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139424    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df044b2e-c67e-4113-a84c-30d111af07fe-root\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139478 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df044b2e-c67e-4113-a84c-30d111af07fe-metrics-client-ca\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139577 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-textfile\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139577 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df044b2e-c67e-4113-a84c-30d111af07fe-root\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139577 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139709 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df044b2e-c67e-4113-a84c-30d111af07fe-sys\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139709 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df044b2e-c67e-4113-a84c-30d111af07fe-sys\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.139875 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.139819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-textfile\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.140096 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.140076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df044b2e-c67e-4113-a84c-30d111af07fe-metrics-client-ca\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.140219 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.140193    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.141511 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.141492    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-tls\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.141661 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.141634    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df044b2e-c67e-4113-a84c-30d111af07fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.148363 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.148339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z97zp\" (UniqueName: \"kubernetes.io/projected/df044b2e-c67e-4113-a84c-30d111af07fe-kube-api-access-z97zp\") pod \"node-exporter-5kblj\" (UID: \"df044b2e-c67e-4113-a84c-30d111af07fe\") " pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.287943 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.287853    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5kblj"
Jul 13 18:52:27.296931 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:52:27.296905    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf044b2e_c67e_4113_a84c_30d111af07fe.slice/crio-d8b3780d2fc94a09b8ec77679aa6785ae8217a6d73b9ff05fc15822e570189d7 WatchSource:0}: Error finding container d8b3780d2fc94a09b8ec77679aa6785ae8217a6d73b9ff05fc15822e570189d7: Status 404 returned error can't find the container with id d8b3780d2fc94a09b8ec77679aa6785ae8217a6d73b9ff05fc15822e570189d7
Jul 13 18:52:27.819050 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.819017    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kblj" event={"ID":"df044b2e-c67e-4113-a84c-30d111af07fe","Type":"ContainerStarted","Data":"d8b3780d2fc94a09b8ec77679aa6785ae8217a6d73b9ff05fc15822e570189d7"}
Jul 13 18:52:27.979146 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.979115    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 18:52:27.987212 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.987178    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:27.990119 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.990097    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s6bhr\""
Jul 13 18:52:27.990232 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.990097    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 18:52:27.990841 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.990820    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 18:52:27.990841 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.990830    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 18:52:27.990970 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.990838    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 18:52:27.990970 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.990921    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 18:52:27.991082 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.991066    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 18:52:27.991151 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.991081    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 18:52:27.991381 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.991366    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 18:52:27.991547 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:27.991534    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 18:52:28.006408 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.006383    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 18:52:28.047447 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.047415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-config-volume\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.047670 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.047509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.047670 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.047542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-web-config\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.047670 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.047565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d3c477-b15c-4059-9b81-bfd65918e842-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.047809 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.047678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42d3c477-b15c-4059-9b81-bfd65918e842-tls-assets\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.047809 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.047713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ms8g\" (UniqueName: \"kubernetes.io/projected/42d3c477-b15c-4059-9b81-bfd65918e842-kube-api-access-5ms8g\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.047809 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.047740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/42d3c477-b15c-4059-9b81-bfd65918e842-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.047809 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.047781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42d3c477-b15c-4059-9b81-bfd65918e842-config-out\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.047809 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.047802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.048052 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.047879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.048052 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.047918    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.048052 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.047974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.048052 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.048023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d3c477-b15c-4059-9b81-bfd65918e842-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.148910 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.148819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.148910 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.148860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.149106 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.148959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.149106 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:52:28.148978    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 13 18:52:28.149106 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.148998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d3c477-b15c-4059-9b81-bfd65918e842-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.149106 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.149040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-config-volume\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.149106 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:52:28.149085    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-main-tls podName:42d3c477-b15c-4059-9b81-bfd65918e842 nodeName:}" failed. No retries permitted until 2026-07-13 18:52:28.649038477 +0000 UTC m=+114.889519410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842") : secret "alertmanager-main-tls" not found
Jul 13 18:52:28.149370 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.149122    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.149370 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.149148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-web-config\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.149370 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.149176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d3c477-b15c-4059-9b81-bfd65918e842-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.149370 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.149217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42d3c477-b15c-4059-9b81-bfd65918e842-tls-assets\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.149370 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.149267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ms8g\" (UniqueName: \"kubernetes.io/projected/42d3c477-b15c-4059-9b81-bfd65918e842-kube-api-access-5ms8g\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.149370 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.149303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/42d3c477-b15c-4059-9b81-bfd65918e842-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.149370 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.149328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42d3c477-b15c-4059-9b81-bfd65918e842-config-out\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.149370 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.149366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.150012 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.149873    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/42d3c477-b15c-4059-9b81-bfd65918e842-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.150012 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.149901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d3c477-b15c-4059-9b81-bfd65918e842-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.150359 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.150336    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d3c477-b15c-4059-9b81-bfd65918e842-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.152474 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.152424    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.152786 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.152749    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42d3c477-b15c-4059-9b81-bfd65918e842-config-out\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.153038 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.153016    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42d3c477-b15c-4059-9b81-bfd65918e842-tls-assets\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.153038 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.153027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-config-volume\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.153144 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.153033    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.153207 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.153183    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.153669 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.153646    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-web-config\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.153963 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.153946    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.157899 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.157882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ms8g\" (UniqueName: \"kubernetes.io/projected/42d3c477-b15c-4059-9b81-bfd65918e842-kube-api-access-5ms8g\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.652831 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.652786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.655143 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.655118    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:28.899652 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:28.899609    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:52:29.057905 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:29.057872    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 18:52:29.059239 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:52:29.059210    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d3c477_b15c_4059_9b81_bfd65918e842.slice/crio-aa3e68a67099799529cb6e543de53b1e66046a120070c9d041bfb5ed0295fd32 WatchSource:0}: Error finding container aa3e68a67099799529cb6e543de53b1e66046a120070c9d041bfb5ed0295fd32: Status 404 returned error can't find the container with id aa3e68a67099799529cb6e543de53b1e66046a120070c9d041bfb5ed0295fd32
Jul 13 18:52:29.795794 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:29.795710    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gc897"
Jul 13 18:52:29.829448 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:29.829409    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerStarted","Data":"aa3e68a67099799529cb6e543de53b1e66046a120070c9d041bfb5ed0295fd32"}
Jul 13 18:52:29.831567 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:29.831535    2563 generic.go:356] "Generic (PLEG): container finished" podID="df044b2e-c67e-4113-a84c-30d111af07fe" containerID="603d278a31fa8292f51264b4768c754f234efdb5e380ce2e5fc35bddda69418b" exitCode=0
Jul 13 18:52:29.831747 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:29.831640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kblj" event={"ID":"df044b2e-c67e-4113-a84c-30d111af07fe","Type":"ContainerDied","Data":"603d278a31fa8292f51264b4768c754f234efdb5e380ce2e5fc35bddda69418b"}
Jul 13 18:52:30.836385 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:30.836340    2563 generic.go:356] "Generic (PLEG): container finished" podID="42d3c477-b15c-4059-9b81-bfd65918e842" containerID="3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3" exitCode=0
Jul 13 18:52:30.836885 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:30.836421    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerDied","Data":"3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3"}
Jul 13 18:52:30.838575 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:30.838547    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kblj" event={"ID":"df044b2e-c67e-4113-a84c-30d111af07fe","Type":"ContainerStarted","Data":"cd1e5eac7c7864b9986ac2ddbfe54a1c42ded656af1b1794f2820696e46b1cac"}
Jul 13 18:52:30.838686 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:30.838597    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kblj" event={"ID":"df044b2e-c67e-4113-a84c-30d111af07fe","Type":"ContainerStarted","Data":"771e629eee9d87a8c8a5d259ca9008e6ee69817a1a4b258ecf6c4f4e56d7c559"}
Jul 13 18:52:30.888294 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:30.888222    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5kblj" podStartSLOduration=2.77395618 podStartE2EDuration="4.888206875s" totalImagesPullingTime="2.050213977s" totalInitContainerRuntime="64.036718ms" isStatefulPod=true podCreationTimestamp="2026-07-13 18:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:52:30.8875019 +0000 UTC m=+117.127982839" watchObservedRunningTime="2026-07-13 18:52:30.888206875 +0000 UTC m=+117.128687813"
Jul 13 18:52:32.850619 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:32.850591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerStarted","Data":"675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c"}
Jul 13 18:52:32.850958 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:32.850660    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerStarted","Data":"0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6"}
Jul 13 18:52:32.850958 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:32.850689    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerStarted","Data":"9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d"}
Jul 13 18:52:32.850958 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:32.850715    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerStarted","Data":"abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e"}
Jul 13 18:52:32.850958 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:32.850743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerStarted","Data":"c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265"}
Jul 13 18:52:34.861544 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:34.861504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerStarted","Data":"8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644"}
Jul 13 18:52:34.898241 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:34.898181    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.869291272 podStartE2EDuration="7.89816222s" totalImagesPullingTime="4.009513117s" totalInitContainerRuntime="19.357831ms" isStatefulPod=false podCreationTimestamp="2026-07-13 18:52:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:52:34.896347271 +0000 UTC m=+121.136828231" watchObservedRunningTime="2026-07-13 18:52:34.89816222 +0000 UTC m=+121.138643160"
Jul 13 18:52:39.979547 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:39.979500    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7567d44766-h54w2"]
Jul 13 18:52:39.986860 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:39.986834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.001427 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.001402    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 18:52:40.001645 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.001627    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 18:52:40.001787 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.001663    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 18:52:40.001787 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.001663    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 18:52:40.002904 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.002879    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 18:52:40.002990 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.002922    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 18:52:40.002990 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.002932    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xzzm2\""
Jul 13 18:52:40.003093 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.003038    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7567d44766-h54w2"]
Jul 13 18:52:40.003140 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.003128    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 18:52:40.151223 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.151182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd37eec1-aa28-4289-b3be-93353c41e05c-console-serving-cert\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.151223 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.151225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd37eec1-aa28-4289-b3be-93353c41e05c-console-oauth-config\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.151480 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.151290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-oauth-serving-cert\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.151480 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.151325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-console-config\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.151480 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.151344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-service-ca\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.151480 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.151361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj2m9\" (UniqueName: \"kubernetes.io/projected/cd37eec1-aa28-4289-b3be-93353c41e05c-kube-api-access-gj2m9\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.252602 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.252507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd37eec1-aa28-4289-b3be-93353c41e05c-console-serving-cert\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.252602 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.252547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd37eec1-aa28-4289-b3be-93353c41e05c-console-oauth-config\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.252602 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.252577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-oauth-serving-cert\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.252878 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.252713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-console-config\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.252878 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.252753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-service-ca\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.252878 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.252775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj2m9\" (UniqueName: \"kubernetes.io/projected/cd37eec1-aa28-4289-b3be-93353c41e05c-kube-api-access-gj2m9\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.253358 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.253330    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-oauth-serving-cert\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.253537 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.253405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-console-config\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.253537 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.253419    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-service-ca\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.255039 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.255018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd37eec1-aa28-4289-b3be-93353c41e05c-console-serving-cert\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.255133 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.255033    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd37eec1-aa28-4289-b3be-93353c41e05c-console-oauth-config\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.262683 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.262659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj2m9\" (UniqueName: \"kubernetes.io/projected/cd37eec1-aa28-4289-b3be-93353c41e05c-kube-api-access-gj2m9\") pod \"console-7567d44766-h54w2\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") " pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.296411 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.296381    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:40.427426 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.427396    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7567d44766-h54w2"]
Jul 13 18:52:40.430626 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:52:40.430596    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd37eec1_aa28_4289_b3be_93353c41e05c.slice/crio-a7f57277a61137f323a7791384d6ebbe011052417f8fc9d26453760f67444135 WatchSource:0}: Error finding container a7f57277a61137f323a7791384d6ebbe011052417f8fc9d26453760f67444135: Status 404 returned error can't find the container with id a7f57277a61137f323a7791384d6ebbe011052417f8fc9d26453760f67444135
Jul 13 18:52:40.883999 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:40.883963    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7567d44766-h54w2" event={"ID":"cd37eec1-aa28-4289-b3be-93353c41e05c","Type":"ContainerStarted","Data":"a7f57277a61137f323a7791384d6ebbe011052417f8fc9d26453760f67444135"}
Jul 13 18:52:44.184428 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:44.184390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:52:44.187064 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:44.187041    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e0b486-78b0-47b8-a1c6-191368ae0913-metrics-certs\") pod \"network-metrics-daemon-hfp2m\" (UID: \"b7e0b486-78b0-47b8-a1c6-191368ae0913\") " pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:52:44.199937 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:44.199909    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tkcn\""
Jul 13 18:52:44.207190 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:44.207171    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfp2m"
Jul 13 18:52:44.426458 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:44.426422    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hfp2m"]
Jul 13 18:52:44.428805 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:52:44.428776    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e0b486_78b0_47b8_a1c6_191368ae0913.slice/crio-4180a72521dbacb46d5c5f63c9bcbd0afa7553cda075373dd0d9046813f4e6ea WatchSource:0}: Error finding container 4180a72521dbacb46d5c5f63c9bcbd0afa7553cda075373dd0d9046813f4e6ea: Status 404 returned error can't find the container with id 4180a72521dbacb46d5c5f63c9bcbd0afa7553cda075373dd0d9046813f4e6ea
Jul 13 18:52:44.900758 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:44.900719    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hfp2m" event={"ID":"b7e0b486-78b0-47b8-a1c6-191368ae0913","Type":"ContainerStarted","Data":"4180a72521dbacb46d5c5f63c9bcbd0afa7553cda075373dd0d9046813f4e6ea"}
Jul 13 18:52:46.909765 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:46.909724    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7567d44766-h54w2" event={"ID":"cd37eec1-aa28-4289-b3be-93353c41e05c","Type":"ContainerStarted","Data":"c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956"}
Jul 13 18:52:46.911461 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:46.911430    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hfp2m" event={"ID":"b7e0b486-78b0-47b8-a1c6-191368ae0913","Type":"ContainerStarted","Data":"a89feecd09787392c30e8e2fe1546a3e853d9c8055eb83850397dfa684ad66a3"}
Jul 13 18:52:46.911576 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:46.911487    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hfp2m" event={"ID":"b7e0b486-78b0-47b8-a1c6-191368ae0913","Type":"ContainerStarted","Data":"5377b1f499b4f8929a7b72c3bbb987090d0a408519b9ba4a27041423183e9919"}
Jul 13 18:52:46.929970 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:46.929922    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7567d44766-h54w2" podStartSLOduration=2.0979307289999998 podStartE2EDuration="7.929908481s" totalImagesPullingTime="5.831977752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:52:46.928705064 +0000 UTC m=+133.169186008" watchObservedRunningTime="2026-07-13 18:52:46.929908481 +0000 UTC m=+133.170389420"
Jul 13 18:52:46.946095 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:46.946044    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hfp2m" podStartSLOduration=131.114239059 podStartE2EDuration="2m12.946027505s" totalImagesPullingTime="1.831788446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:52:46.945223596 +0000 UTC m=+133.185704535" watchObservedRunningTime="2026-07-13 18:52:46.946027505 +0000 UTC m=+133.186508514"
Jul 13 18:52:50.296632 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:50.296544    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:50.297099 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:50.296808    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:50.301599 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:50.301576    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:50.932008 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:50.931972    2563 generic.go:356] "Generic (PLEG): container finished" podID="9898ab75-3992-4a0e-a632-068a30b6c83f" containerID="35b1b99ae2de12112db12799938832ec8b31415cf3a8661e0d8ed3ffe5749056" exitCode=0
Jul 13 18:52:50.932175 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:50.932040    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl" event={"ID":"9898ab75-3992-4a0e-a632-068a30b6c83f","Type":"ContainerDied","Data":"35b1b99ae2de12112db12799938832ec8b31415cf3a8661e0d8ed3ffe5749056"}
Jul 13 18:52:50.932421 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:50.932401    2563 scope.go:117] "RemoveContainer" containerID="35b1b99ae2de12112db12799938832ec8b31415cf3a8661e0d8ed3ffe5749056"
Jul 13 18:52:50.936134 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:50.936113    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:52:51.937735 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:51.937698    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d2wjl" event={"ID":"9898ab75-3992-4a0e-a632-068a30b6c83f","Type":"ContainerStarted","Data":"19500ca92dd7de5c5cf9a35da570f612cf0a597b1a22913724e1b6d15e8d3ada"}
Jul 13 18:52:57.243309 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:57.243267    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_42d3c477-b15c-4059-9b81-bfd65918e842/init-config-reloader/0.log"
Jul 13 18:52:57.443379 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:57.443339    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_42d3c477-b15c-4059-9b81-bfd65918e842/alertmanager/0.log"
Jul 13 18:52:57.644987 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:57.644966    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_42d3c477-b15c-4059-9b81-bfd65918e842/config-reloader/0.log"
Jul 13 18:52:57.842223 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:57.842187    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_42d3c477-b15c-4059-9b81-bfd65918e842/kube-rbac-proxy-web/0.log"
Jul 13 18:52:58.042100 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:58.041998    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_42d3c477-b15c-4059-9b81-bfd65918e842/kube-rbac-proxy/0.log"
Jul 13 18:52:58.242856 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:58.242813    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_42d3c477-b15c-4059-9b81-bfd65918e842/kube-rbac-proxy-metric/0.log"
Jul 13 18:52:58.450220 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:58.450184    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_42d3c477-b15c-4059-9b81-bfd65918e842/prom-label-proxy/0.log"
Jul 13 18:52:59.068437 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:52:59.068402    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7567d44766-h54w2"]
Jul 13 18:53:00.243240 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:00.243212    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kblj_df044b2e-c67e-4113-a84c-30d111af07fe/init-textfile/0.log"
Jul 13 18:53:00.444417 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:00.444394    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kblj_df044b2e-c67e-4113-a84c-30d111af07fe/node-exporter/0.log"
Jul 13 18:53:00.643327 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:00.643301    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kblj_df044b2e-c67e-4113-a84c-30d111af07fe/kube-rbac-proxy/0.log"
Jul 13 18:53:04.046321 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:04.046290    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-frxh5_fece8507-e2e2-4fba-8ae7-c045824593ac/prometheus-operator/0.log"
Jul 13 18:53:04.243585 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:04.243553    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-frxh5_fece8507-e2e2-4fba-8ae7-c045824593ac/kube-rbac-proxy/0.log"
Jul 13 18:53:07.043924 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:07.043895    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7567d44766-h54w2_cd37eec1-aa28-4289-b3be-93353c41e05c/console/0.log"
Jul 13 18:53:07.843902 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:07.843857    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5clww_6c434c9f-c8cb-4b4e-8506-46e98ff06e76/serve-healthcheck-canary/0.log"
Jul 13 18:53:24.096516 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.096448    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7567d44766-h54w2" podUID="cd37eec1-aa28-4289-b3be-93353c41e05c" containerName="console" containerID="cri-o://c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956" gracePeriod=15
Jul 13 18:53:24.335215 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.335191    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:53:24.408041 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.407953    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd37eec1-aa28-4289-b3be-93353c41e05c-console-serving-cert\") pod \"cd37eec1-aa28-4289-b3be-93353c41e05c\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") "
Jul 13 18:53:24.408041 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.408004    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-oauth-serving-cert\") pod \"cd37eec1-aa28-4289-b3be-93353c41e05c\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") "
Jul 13 18:53:24.408229 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.408062    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd37eec1-aa28-4289-b3be-93353c41e05c-console-oauth-config\") pod \"cd37eec1-aa28-4289-b3be-93353c41e05c\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") "
Jul 13 18:53:24.408229 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.408079    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-service-ca\") pod \"cd37eec1-aa28-4289-b3be-93353c41e05c\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") "
Jul 13 18:53:24.408229 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.408111    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj2m9\" (UniqueName: \"kubernetes.io/projected/cd37eec1-aa28-4289-b3be-93353c41e05c-kube-api-access-gj2m9\") pod \"cd37eec1-aa28-4289-b3be-93353c41e05c\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") "
Jul 13 18:53:24.408407 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.408291    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-console-config\") pod \"cd37eec1-aa28-4289-b3be-93353c41e05c\" (UID: \"cd37eec1-aa28-4289-b3be-93353c41e05c\") "
Jul 13 18:53:24.408601 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.408569    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd37eec1-aa28-4289-b3be-93353c41e05c" (UID: "cd37eec1-aa28-4289-b3be-93353c41e05c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:53:24.408601 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.408579    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd37eec1-aa28-4289-b3be-93353c41e05c" (UID: "cd37eec1-aa28-4289-b3be-93353c41e05c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:53:24.408803 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.408632    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-console-config" (OuterVolumeSpecName: "console-config") pod "cd37eec1-aa28-4289-b3be-93353c41e05c" (UID: "cd37eec1-aa28-4289-b3be-93353c41e05c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:53:24.410374 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.410353    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd37eec1-aa28-4289-b3be-93353c41e05c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd37eec1-aa28-4289-b3be-93353c41e05c" (UID: "cd37eec1-aa28-4289-b3be-93353c41e05c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:53:24.410469 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.410391    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd37eec1-aa28-4289-b3be-93353c41e05c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd37eec1-aa28-4289-b3be-93353c41e05c" (UID: "cd37eec1-aa28-4289-b3be-93353c41e05c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:53:24.410469 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.410445    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd37eec1-aa28-4289-b3be-93353c41e05c-kube-api-access-gj2m9" (OuterVolumeSpecName: "kube-api-access-gj2m9") pod "cd37eec1-aa28-4289-b3be-93353c41e05c" (UID: "cd37eec1-aa28-4289-b3be-93353c41e05c"). InnerVolumeSpecName "kube-api-access-gj2m9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:53:24.509838 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.509800    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd37eec1-aa28-4289-b3be-93353c41e05c-console-oauth-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:24.509838 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.509832    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:24.509838 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.509842    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj2m9\" (UniqueName: \"kubernetes.io/projected/cd37eec1-aa28-4289-b3be-93353c41e05c-kube-api-access-gj2m9\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:24.509838 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.509850    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-console-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:24.510091 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.509860    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd37eec1-aa28-4289-b3be-93353c41e05c-console-serving-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:24.510091 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:24.509871    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd37eec1-aa28-4289-b3be-93353c41e05c-oauth-serving-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:25.070764 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:25.070725    2563 generic.go:356] "Generic (PLEG): container finished" podID="cd37eec1-aa28-4289-b3be-93353c41e05c" containerID="c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956" exitCode=0
Jul 13 18:53:25.070961 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:25.070791    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7567d44766-h54w2"
Jul 13 18:53:25.070961 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:25.070805    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7567d44766-h54w2" event={"ID":"cd37eec1-aa28-4289-b3be-93353c41e05c","Type":"ContainerDied","Data":"c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956"}
Jul 13 18:53:25.070961 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:25.070882    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7567d44766-h54w2" event={"ID":"cd37eec1-aa28-4289-b3be-93353c41e05c","Type":"ContainerDied","Data":"a7f57277a61137f323a7791384d6ebbe011052417f8fc9d26453760f67444135"}
Jul 13 18:53:25.070961 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:25.070903    2563 scope.go:117] "RemoveContainer" containerID="c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956"
Jul 13 18:53:25.079452 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:25.079432    2563 scope.go:117] "RemoveContainer" containerID="c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956"
Jul 13 18:53:25.079714 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:53:25.079694    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956\": container with ID starting with c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956 not found: ID does not exist" containerID="c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956"
Jul 13 18:53:25.079759 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:25.079722    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956"} err="failed to get container status \"c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956\": rpc error: code = NotFound desc = could not find container \"c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956\": container with ID starting with c96afd7e3ff09621a3bc69dc44562c1f2500b9012821de0c82566be437297956 not found: ID does not exist"
Jul 13 18:53:25.091757 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:25.091733    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7567d44766-h54w2"]
Jul 13 18:53:25.095398 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:25.095373    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7567d44766-h54w2"]
Jul 13 18:53:26.385708 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:26.385664    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd37eec1-aa28-4289-b3be-93353c41e05c" path="/var/lib/kubelet/pods/cd37eec1-aa28-4289-b3be-93353c41e05c/volumes"
Jul 13 18:53:47.287526 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:47.287490    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 18:53:47.287976 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:47.287770    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="alertmanager" containerID="cri-o://c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265" gracePeriod=120
Jul 13 18:53:47.287976 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:47.287877    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="kube-rbac-proxy" containerID="cri-o://0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6" gracePeriod=120
Jul 13 18:53:47.287976 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:47.287903    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="prom-label-proxy" containerID="cri-o://8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644" gracePeriod=120
Jul 13 18:53:47.287976 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:47.287906    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="config-reloader" containerID="cri-o://abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e" gracePeriod=120
Jul 13 18:53:47.288187 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:47.287855    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="kube-rbac-proxy-metric" containerID="cri-o://675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c" gracePeriod=120
Jul 13 18:53:47.288187 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:47.287856    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="kube-rbac-proxy-web" containerID="cri-o://9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d" gracePeriod=120
Jul 13 18:53:48.154520 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.154483    2563 generic.go:356] "Generic (PLEG): container finished" podID="42d3c477-b15c-4059-9b81-bfd65918e842" containerID="8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644" exitCode=0
Jul 13 18:53:48.154520 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.154509    2563 generic.go:356] "Generic (PLEG): container finished" podID="42d3c477-b15c-4059-9b81-bfd65918e842" containerID="0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6" exitCode=0
Jul 13 18:53:48.154520 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.154517    2563 generic.go:356] "Generic (PLEG): container finished" podID="42d3c477-b15c-4059-9b81-bfd65918e842" containerID="abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e" exitCode=0
Jul 13 18:53:48.154520 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.154526    2563 generic.go:356] "Generic (PLEG): container finished" podID="42d3c477-b15c-4059-9b81-bfd65918e842" containerID="c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265" exitCode=0
Jul 13 18:53:48.154774 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.154553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerDied","Data":"8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644"}
Jul 13 18:53:48.154774 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.154641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerDied","Data":"0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6"}
Jul 13 18:53:48.154774 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.154670    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerDied","Data":"abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e"}
Jul 13 18:53:48.154774 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.154693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerDied","Data":"c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265"}
Jul 13 18:53:48.184735 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.184705    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f75c8b67f-j5zhm"]
Jul 13 18:53:48.184978 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.184966    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd37eec1-aa28-4289-b3be-93353c41e05c" containerName="console"
Jul 13 18:53:48.185021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.184980    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd37eec1-aa28-4289-b3be-93353c41e05c" containerName="console"
Jul 13 18:53:48.185100 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.185049    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd37eec1-aa28-4289-b3be-93353c41e05c" containerName="console"
Jul 13 18:53:48.187994 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.187977    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.190957 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.190936    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 18:53:48.191091 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.191072    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 18:53:48.191166 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.191149    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 18:53:48.191208 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.191167    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xzzm2\""
Jul 13 18:53:48.191208 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.191179    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 18:53:48.191641 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.191621    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 18:53:48.191724 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.191622    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 18:53:48.191724 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.191651    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 18:53:48.196404 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.196362    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 18:53:48.197639 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.197616    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f75c8b67f-j5zhm"]
Jul 13 18:53:48.301545 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.301505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-oauth-serving-cert\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.301545 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.301542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b552620b-ad8a-41f2-8a65-042360063674-console-serving-cert\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.302001 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.301560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b552620b-ad8a-41f2-8a65-042360063674-console-oauth-config\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.302001 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.301630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-console-config\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.302001 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.301661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-service-ca\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.302001 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.301725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-trusted-ca-bundle\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.302001 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.301760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkm59\" (UniqueName: \"kubernetes.io/projected/b552620b-ad8a-41f2-8a65-042360063674-kube-api-access-vkm59\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.402457 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.402434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-oauth-serving-cert\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.402531 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.402473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b552620b-ad8a-41f2-8a65-042360063674-console-serving-cert\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.402531 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.402493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b552620b-ad8a-41f2-8a65-042360063674-console-oauth-config\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.402607 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.402539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-console-config\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.402607 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.402563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-service-ca\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.402607 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.402596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-trusted-ca-bundle\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.402749 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.402621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkm59\" (UniqueName: \"kubernetes.io/projected/b552620b-ad8a-41f2-8a65-042360063674-kube-api-access-vkm59\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.403291 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.403199    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-oauth-serving-cert\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.403291 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.403202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-console-config\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.403435 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.403336    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-service-ca\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.404015 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.403989    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-trusted-ca-bundle\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.404742 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.404691    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b552620b-ad8a-41f2-8a65-042360063674-console-serving-cert\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.404987 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.404968    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b552620b-ad8a-41f2-8a65-042360063674-console-oauth-config\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.410164 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.410140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkm59\" (UniqueName: \"kubernetes.io/projected/b552620b-ad8a-41f2-8a65-042360063674-kube-api-access-vkm59\") pod \"console-5f75c8b67f-j5zhm\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") " pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.498338 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.498308    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:48.533459 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.533430    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:48.653192 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.653159    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f75c8b67f-j5zhm"]
Jul 13 18:53:48.656351 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:53:48.656284    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb552620b_ad8a_41f2_8a65_042360063674.slice/crio-7579b4145a82defb188e00e26378b11d639638986ad97aa3811142f802dbf481 WatchSource:0}: Error finding container 7579b4145a82defb188e00e26378b11d639638986ad97aa3811142f802dbf481: Status 404 returned error can't find the container with id 7579b4145a82defb188e00e26378b11d639638986ad97aa3811142f802dbf481
Jul 13 18:53:48.706315 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706290    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy-metric\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.706415 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706338    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d3c477-b15c-4059-9b81-bfd65918e842-metrics-client-ca\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.706415 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706371    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42d3c477-b15c-4059-9b81-bfd65918e842-config-out\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.706415 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706390    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy-web\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.706563 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706446    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42d3c477-b15c-4059-9b81-bfd65918e842-tls-assets\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.706563 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706472    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ms8g\" (UniqueName: \"kubernetes.io/projected/42d3c477-b15c-4059-9b81-bfd65918e842-kube-api-access-5ms8g\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.706563 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706510    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-main-tls\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.706563 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706552    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-config-volume\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.706761 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706587    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-web-config\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.706761 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706610    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/42d3c477-b15c-4059-9b81-bfd65918e842-alertmanager-main-db\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.706761 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706646    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d3c477-b15c-4059-9b81-bfd65918e842-alertmanager-trusted-ca-bundle\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.706761 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706673    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.706761 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.706700    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-cluster-tls-config\") pod \"42d3c477-b15c-4059-9b81-bfd65918e842\" (UID: \"42d3c477-b15c-4059-9b81-bfd65918e842\") "
Jul 13 18:53:48.707358 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.707327    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42d3c477-b15c-4059-9b81-bfd65918e842-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:53:48.707736 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.707708    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d3c477-b15c-4059-9b81-bfd65918e842-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:53:48.708118 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.708090    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42d3c477-b15c-4059-9b81-bfd65918e842-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:53:48.709600 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.709475    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:53:48.709600 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.709562    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:53:48.709872 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.709851    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d3c477-b15c-4059-9b81-bfd65918e842-config-out" (OuterVolumeSpecName: "config-out") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:53:48.711077 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.711044    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42d3c477-b15c-4059-9b81-bfd65918e842-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:53:48.711260 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.711219    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:53:48.711401 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.711372    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42d3c477-b15c-4059-9b81-bfd65918e842-kube-api-access-5ms8g" (OuterVolumeSpecName: "kube-api-access-5ms8g") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "kube-api-access-5ms8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:53:48.711583 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.711559    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-config-volume" (OuterVolumeSpecName: "config-volume") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:53:48.712453 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.712430    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:53:48.714943 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.714923    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:53:48.720544 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.720521    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-web-config" (OuterVolumeSpecName: "web-config") pod "42d3c477-b15c-4059-9b81-bfd65918e842" (UID: "42d3c477-b15c-4059-9b81-bfd65918e842"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:53:48.807533 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807499    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42d3c477-b15c-4059-9b81-bfd65918e842-config-out\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:48.807533 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807530    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:48.807737 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807543    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42d3c477-b15c-4059-9b81-bfd65918e842-tls-assets\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:48.807737 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807558    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ms8g\" (UniqueName: \"kubernetes.io/projected/42d3c477-b15c-4059-9b81-bfd65918e842-kube-api-access-5ms8g\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:48.807737 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807570    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-main-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:48.807737 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807581    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-config-volume\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:48.807737 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807592    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-web-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:48.807737 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807603    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/42d3c477-b15c-4059-9b81-bfd65918e842-alertmanager-main-db\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:48.807737 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807616    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d3c477-b15c-4059-9b81-bfd65918e842-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:48.807737 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807629    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:48.807737 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807644    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-cluster-tls-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:48.807737 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807658    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/42d3c477-b15c-4059-9b81-bfd65918e842-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:48.807737 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:48.807673    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d3c477-b15c-4059-9b81-bfd65918e842-metrics-client-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:53:49.159981 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.159940    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f75c8b67f-j5zhm" event={"ID":"b552620b-ad8a-41f2-8a65-042360063674","Type":"ContainerStarted","Data":"7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605"}
Jul 13 18:53:49.160188 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.159997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f75c8b67f-j5zhm" event={"ID":"b552620b-ad8a-41f2-8a65-042360063674","Type":"ContainerStarted","Data":"7579b4145a82defb188e00e26378b11d639638986ad97aa3811142f802dbf481"}
Jul 13 18:53:49.162877 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.162847    2563 generic.go:356] "Generic (PLEG): container finished" podID="42d3c477-b15c-4059-9b81-bfd65918e842" containerID="675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c" exitCode=0
Jul 13 18:53:49.162877 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.162873    2563 generic.go:356] "Generic (PLEG): container finished" podID="42d3c477-b15c-4059-9b81-bfd65918e842" containerID="9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d" exitCode=0
Jul 13 18:53:49.163024 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.162920    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerDied","Data":"675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c"}
Jul 13 18:53:49.163024 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.162984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerDied","Data":"9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d"}
Jul 13 18:53:49.163024 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.162928    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.163024 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.163014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42d3c477-b15c-4059-9b81-bfd65918e842","Type":"ContainerDied","Data":"aa3e68a67099799529cb6e543de53b1e66046a120070c9d041bfb5ed0295fd32"}
Jul 13 18:53:49.163176 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.163048    2563 scope.go:117] "RemoveContainer" containerID="8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644"
Jul 13 18:53:49.170607 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.170425    2563 scope.go:117] "RemoveContainer" containerID="675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c"
Jul 13 18:53:49.177741 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.177718    2563 scope.go:117] "RemoveContainer" containerID="0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6"
Jul 13 18:53:49.180945 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.180887    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f75c8b67f-j5zhm" podStartSLOduration=1.180868118 podStartE2EDuration="1.180868118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:53:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:53:49.179491916 +0000 UTC m=+195.419972882" watchObservedRunningTime="2026-07-13 18:53:49.180868118 +0000 UTC m=+195.421349067"
Jul 13 18:53:49.185351 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.185328    2563 scope.go:117] "RemoveContainer" containerID="9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d"
Jul 13 18:53:49.191852 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.191822    2563 scope.go:117] "RemoveContainer" containerID="abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e"
Jul 13 18:53:49.193740 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.193719    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 18:53:49.199438 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.199421    2563 scope.go:117] "RemoveContainer" containerID="c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265"
Jul 13 18:53:49.199615 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.199600    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 18:53:49.206211 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.206193    2563 scope.go:117] "RemoveContainer" containerID="3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3"
Jul 13 18:53:49.212736 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.212720    2563 scope.go:117] "RemoveContainer" containerID="8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644"
Jul 13 18:53:49.212979 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:53:49.212961    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644\": container with ID starting with 8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644 not found: ID does not exist" containerID="8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644"
Jul 13 18:53:49.213026 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.212991    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644"} err="failed to get container status \"8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644\": rpc error: code = NotFound desc = could not find container \"8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644\": container with ID starting with 8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644 not found: ID does not exist"
Jul 13 18:53:49.213026 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.213011    2563 scope.go:117] "RemoveContainer" containerID="675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c"
Jul 13 18:53:49.213287 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:53:49.213267    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c\": container with ID starting with 675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c not found: ID does not exist" containerID="675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c"
Jul 13 18:53:49.213375 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.213291    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c"} err="failed to get container status \"675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c\": rpc error: code = NotFound desc = could not find container \"675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c\": container with ID starting with 675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c not found: ID does not exist"
Jul 13 18:53:49.213375 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.213309    2563 scope.go:117] "RemoveContainer" containerID="0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6"
Jul 13 18:53:49.213532 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:53:49.213515    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6\": container with ID starting with 0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6 not found: ID does not exist" containerID="0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6"
Jul 13 18:53:49.213575 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.213537    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6"} err="failed to get container status \"0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6\": rpc error: code = NotFound desc = could not find container \"0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6\": container with ID starting with 0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6 not found: ID does not exist"
Jul 13 18:53:49.213575 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.213551    2563 scope.go:117] "RemoveContainer" containerID="9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d"
Jul 13 18:53:49.213791 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:53:49.213774    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d\": container with ID starting with 9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d not found: ID does not exist" containerID="9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d"
Jul 13 18:53:49.213828 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.213795    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d"} err="failed to get container status \"9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d\": rpc error: code = NotFound desc = could not find container \"9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d\": container with ID starting with 9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d not found: ID does not exist"
Jul 13 18:53:49.213828 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.213812    2563 scope.go:117] "RemoveContainer" containerID="abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e"
Jul 13 18:53:49.214039 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:53:49.214024    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e\": container with ID starting with abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e not found: ID does not exist" containerID="abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e"
Jul 13 18:53:49.214074 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.214043    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e"} err="failed to get container status \"abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e\": rpc error: code = NotFound desc = could not find container \"abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e\": container with ID starting with abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e not found: ID does not exist"
Jul 13 18:53:49.214074 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.214056    2563 scope.go:117] "RemoveContainer" containerID="c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265"
Jul 13 18:53:49.214285 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:53:49.214268    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265\": container with ID starting with c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265 not found: ID does not exist" containerID="c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265"
Jul 13 18:53:49.214377 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.214289    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265"} err="failed to get container status \"c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265\": rpc error: code = NotFound desc = could not find container \"c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265\": container with ID starting with c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265 not found: ID does not exist"
Jul 13 18:53:49.214377 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.214302    2563 scope.go:117] "RemoveContainer" containerID="3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3"
Jul 13 18:53:49.214507 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:53:49.214490    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3\": container with ID starting with 3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3 not found: ID does not exist" containerID="3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3"
Jul 13 18:53:49.214547 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.214512    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3"} err="failed to get container status \"3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3\": rpc error: code = NotFound desc = could not find container \"3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3\": container with ID starting with 3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3 not found: ID does not exist"
Jul 13 18:53:49.214547 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.214530    2563 scope.go:117] "RemoveContainer" containerID="8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644"
Jul 13 18:53:49.214724 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.214705    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644"} err="failed to get container status \"8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644\": rpc error: code = NotFound desc = could not find container \"8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644\": container with ID starting with 8040661eb7e881af2f23e9f78cfa4d180d536ef698e014ade91293b90d86b644 not found: ID does not exist"
Jul 13 18:53:49.214790 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.214726    2563 scope.go:117] "RemoveContainer" containerID="675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c"
Jul 13 18:53:49.214941 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.214924    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c"} err="failed to get container status \"675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c\": rpc error: code = NotFound desc = could not find container \"675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c\": container with ID starting with 675f7c9d92523d52097ac4ba62030e2150a39eb35861bd433c1d9aa1d9a1ee0c not found: ID does not exist"
Jul 13 18:53:49.215007 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.214942    2563 scope.go:117] "RemoveContainer" containerID="0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6"
Jul 13 18:53:49.215152 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.215135    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6"} err="failed to get container status \"0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6\": rpc error: code = NotFound desc = could not find container \"0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6\": container with ID starting with 0344495fa0e277a59cd13a5d0e2f04cf6e6e614d24ee77a7d5c320c12333dce6 not found: ID does not exist"
Jul 13 18:53:49.215202 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.215153    2563 scope.go:117] "RemoveContainer" containerID="9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d"
Jul 13 18:53:49.215386 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.215367    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d"} err="failed to get container status \"9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d\": rpc error: code = NotFound desc = could not find container \"9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d\": container with ID starting with 9854ab210690dd270ae89d556168796bf08112cbbaa2787550a7d5480e2fdf0d not found: ID does not exist"
Jul 13 18:53:49.215451 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.215388    2563 scope.go:117] "RemoveContainer" containerID="abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e"
Jul 13 18:53:49.215621 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.215603    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e"} err="failed to get container status \"abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e\": rpc error: code = NotFound desc = could not find container \"abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e\": container with ID starting with abce52cf06bd2b19b5c010657104f552d3d938b8c31cdf803ee0f316c1889c4e not found: ID does not exist"
Jul 13 18:53:49.215668 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.215623    2563 scope.go:117] "RemoveContainer" containerID="c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265"
Jul 13 18:53:49.215836 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.215816    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265"} err="failed to get container status \"c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265\": rpc error: code = NotFound desc = could not find container \"c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265\": container with ID starting with c2f8b363dc34ce90b195941de7d45f2f85f138d5e01026df0c179419be565265 not found: ID does not exist"
Jul 13 18:53:49.215907 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.215838    2563 scope.go:117] "RemoveContainer" containerID="3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3"
Jul 13 18:53:49.216032 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.216016    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3"} err="failed to get container status \"3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3\": rpc error: code = NotFound desc = could not find container \"3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3\": container with ID starting with 3cedf1614664deee2fc028458c65cc9d696af71518ffc1ac2e3cd291fd826df3 not found: ID does not exist"
Jul 13 18:53:49.227724 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.227701    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 18:53:49.227995 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.227982    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="config-reloader"
Jul 13 18:53:49.228034 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.227997    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="config-reloader"
Jul 13 18:53:49.228034 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228005    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="kube-rbac-proxy-metric"
Jul 13 18:53:49.228034 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228013    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="kube-rbac-proxy-metric"
Jul 13 18:53:49.228034 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228023    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="kube-rbac-proxy-web"
Jul 13 18:53:49.228034 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228028    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="kube-rbac-proxy-web"
Jul 13 18:53:49.228034 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228035    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="init-config-reloader"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228041    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="init-config-reloader"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228050    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="kube-rbac-proxy"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228058    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="kube-rbac-proxy"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228069    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="alertmanager"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228075    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="alertmanager"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228089    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="prom-label-proxy"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228094    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="prom-label-proxy"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228146    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="alertmanager"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228153    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="kube-rbac-proxy-web"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228158    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="kube-rbac-proxy"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228163    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="kube-rbac-proxy-metric"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228169    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="prom-label-proxy"
Jul 13 18:53:49.228209 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.228175    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" containerName="config-reloader"
Jul 13 18:53:49.233133 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.233115    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.237225 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.237088    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 18:53:49.237225 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.237106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 18:53:49.237225 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.237106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 18:53:49.237225 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.237180    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 18:53:49.237519 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.237266    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 18:53:49.237519 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.237328    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 18:53:49.237519 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.237389    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 18:53:49.237519 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.237466    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s6bhr\""
Jul 13 18:53:49.237679 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.237664    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 18:53:49.241008 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.240990    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 18:53:49.246207 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.246185    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 18:53:49.411854 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.411767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.411854 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.411810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.411854 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.411835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.412299 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.411897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.412299 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.411936    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-config-out\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.412299 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.411953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbl8s\" (UniqueName: \"kubernetes.io/projected/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-kube-api-access-zbl8s\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.412299 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.412013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.412299 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.412031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.412299 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.412070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.412299 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.412090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.412299 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.412112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-web-config\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.412299 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.412135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.412299 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.412190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.512815 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.512773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.512993 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.512828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.512993 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.512865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.512993 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.512890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.512993 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.512914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.512993 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.512937    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.512993 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.512959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-config-out\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.512993 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.512979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbl8s\" (UniqueName: \"kubernetes.io/projected/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-kube-api-access-zbl8s\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.513386 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.513027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.513386 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.513052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.513386 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.513085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.513386 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.513113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.513386 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.513144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-web-config\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.513629 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.513443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.513871 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.513841    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.514577 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.514545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.515808 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.515780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-config-out\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.516017 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.515969    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-web-config\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.516017 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.515973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.516173 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.516110    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.516332 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.516312    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.516396 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.516378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.516680 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.516656    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.516996 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.516975    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.517710 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.517693    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.521671 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.521651    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbl8s\" (UniqueName: \"kubernetes.io/projected/e61fc0c5-d0c8-4712-8432-95cbe36fe2f2-kube-api-access-zbl8s\") pod \"alertmanager-main-0\" (UID: \"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.543502 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.543480    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 18:53:49.682725 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:49.682552    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 18:53:49.684667 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:53:49.684635    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61fc0c5_d0c8_4712_8432_95cbe36fe2f2.slice/crio-0d4b1e728357f0da20a4397159a4d0cf4007a0819c2fdb3bba198db601b941c2 WatchSource:0}: Error finding container 0d4b1e728357f0da20a4397159a4d0cf4007a0819c2fdb3bba198db601b941c2: Status 404 returned error can't find the container with id 0d4b1e728357f0da20a4397159a4d0cf4007a0819c2fdb3bba198db601b941c2
Jul 13 18:53:50.168775 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:50.168736    2563 generic.go:356] "Generic (PLEG): container finished" podID="e61fc0c5-d0c8-4712-8432-95cbe36fe2f2" containerID="2de4373bdd57875b258639624f51376af501c1926e6e83b723fe4ce9dcf4fe52" exitCode=0
Jul 13 18:53:50.168929 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:50.168826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2","Type":"ContainerDied","Data":"2de4373bdd57875b258639624f51376af501c1926e6e83b723fe4ce9dcf4fe52"}
Jul 13 18:53:50.168929 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:50.168891    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2","Type":"ContainerStarted","Data":"0d4b1e728357f0da20a4397159a4d0cf4007a0819c2fdb3bba198db601b941c2"}
Jul 13 18:53:50.386204 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:50.386176    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42d3c477-b15c-4059-9b81-bfd65918e842" path="/var/lib/kubelet/pods/42d3c477-b15c-4059-9b81-bfd65918e842/volumes"
Jul 13 18:53:51.175808 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:51.175775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2","Type":"ContainerStarted","Data":"c99ae673ad76db308e9189e263d38c082896a646eeacd71b771d2c47f16a9668"}
Jul 13 18:53:51.176262 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:51.175838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2","Type":"ContainerStarted","Data":"784ee8c268ab08bcdc42eabbc0766535793cecf9265abf5c528402fd928ce9a1"}
Jul 13 18:53:51.176262 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:51.175864    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2","Type":"ContainerStarted","Data":"0327cbcf6252de87c47d12c9f676b143d69fa48d45c4a64a5ee7231364018e20"}
Jul 13 18:53:51.176262 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:51.175888    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2","Type":"ContainerStarted","Data":"0184ce96b01b36680c0cf50b18d571be49f3f6917cd393b25f02ce43543e2900"}
Jul 13 18:53:51.176262 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:51.175910    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2","Type":"ContainerStarted","Data":"1045d8dc1faf9c1542d105708e97e49d8cdae0f60029e6a1db63d9583985ee19"}
Jul 13 18:53:51.176262 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:51.175932    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e61fc0c5-d0c8-4712-8432-95cbe36fe2f2","Type":"ContainerStarted","Data":"a73cc8d7a541df30b8b1bd666e57e8cd9e8c237d0e3f89ea324e89b6f6869fc4"}
Jul 13 18:53:51.206774 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:51.206723    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.188409009 podStartE2EDuration="2.206704526s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.295517ms" isStatefulPod=false podCreationTimestamp="2026-07-13 18:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:53:51.205571042 +0000 UTC m=+197.446051977" watchObservedRunningTime="2026-07-13 18:53:51.206704526 +0000 UTC m=+197.447185465"
Jul 13 18:53:58.498849 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:58.498804    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:58.499238 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:58.498889    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:58.503737 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:58.503715    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:53:59.214914 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:53:59.214883    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:55:26.677378 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.677328    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"]
Jul 13 18:55:26.680575 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.680553    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"
Jul 13 18:55:26.683625 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.683599    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 13 18:55:26.683750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.683636    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 13 18:55:26.683750 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.683605    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-jtvq4\""
Jul 13 18:55:26.683842 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.683750    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 13 18:55:26.692286 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.692259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"]
Jul 13 18:55:26.753323 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.753273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dc2v\" (UniqueName: \"kubernetes.io/projected/cac172fd-3699-473e-9b1d-4544a2c2f040-kube-api-access-8dc2v\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj\" (UID: \"cac172fd-3699-473e-9b1d-4544a2c2f040\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"
Jul 13 18:55:26.753503 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.753348    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/cac172fd-3699-473e-9b1d-4544a2c2f040-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj\" (UID: \"cac172fd-3699-473e-9b1d-4544a2c2f040\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"
Jul 13 18:55:26.854318 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.854276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dc2v\" (UniqueName: \"kubernetes.io/projected/cac172fd-3699-473e-9b1d-4544a2c2f040-kube-api-access-8dc2v\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj\" (UID: \"cac172fd-3699-473e-9b1d-4544a2c2f040\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"
Jul 13 18:55:26.854499 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.854354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/cac172fd-3699-473e-9b1d-4544a2c2f040-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj\" (UID: \"cac172fd-3699-473e-9b1d-4544a2c2f040\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"
Jul 13 18:55:26.856664 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.856627    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/cac172fd-3699-473e-9b1d-4544a2c2f040-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj\" (UID: \"cac172fd-3699-473e-9b1d-4544a2c2f040\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"
Jul 13 18:55:26.862980 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.862943    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dc2v\" (UniqueName: \"kubernetes.io/projected/cac172fd-3699-473e-9b1d-4544a2c2f040-kube-api-access-8dc2v\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj\" (UID: \"cac172fd-3699-473e-9b1d-4544a2c2f040\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"
Jul 13 18:55:26.990291 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:26.990182    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"
Jul 13 18:55:27.142778 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:27.142749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"]
Jul 13 18:55:27.144591 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:55:27.144561    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac172fd_3699_473e_9b1d_4544a2c2f040.slice/crio-8c3a12ecf75e32ed58d46ca873903c814604be45f6e8544cde3214fdf767e185 WatchSource:0}: Error finding container 8c3a12ecf75e32ed58d46ca873903c814604be45f6e8544cde3214fdf767e185: Status 404 returned error can't find the container with id 8c3a12ecf75e32ed58d46ca873903c814604be45f6e8544cde3214fdf767e185
Jul 13 18:55:27.528543 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:27.528501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj" event={"ID":"cac172fd-3699-473e-9b1d-4544a2c2f040","Type":"ContainerStarted","Data":"8c3a12ecf75e32ed58d46ca873903c814604be45f6e8544cde3214fdf767e185"}
Jul 13 18:55:34.114604 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:34.114571    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 18:55:34.116879 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:34.116856    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 18:55:34.121066 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:55:34.121041    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 18:56:20.607812 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.607772    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"]
Jul 13 18:56:20.611474 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.611454    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:20.614525 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.614498    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 13 18:56:20.614525 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.614515    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 13 18:56:20.614907 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.614885    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-nc756\""
Jul 13 18:56:20.621548 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.621421    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"]
Jul 13 18:56:20.698467 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.698426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d602c8c0-d17c-44cc-ba62-c48b8442679d-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-4w8ck\" (UID: \"d602c8c0-d17c-44cc-ba62-c48b8442679d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:20.698659 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.698491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k8hp\" (UniqueName: \"kubernetes.io/projected/d602c8c0-d17c-44cc-ba62-c48b8442679d-kube-api-access-2k8hp\") pod \"keda-metrics-apiserver-55557df8c-4w8ck\" (UID: \"d602c8c0-d17c-44cc-ba62-c48b8442679d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:20.698659 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.698517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d602c8c0-d17c-44cc-ba62-c48b8442679d-certificates\") pod \"keda-metrics-apiserver-55557df8c-4w8ck\" (UID: \"d602c8c0-d17c-44cc-ba62-c48b8442679d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:20.730711 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.730672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj" event={"ID":"cac172fd-3699-473e-9b1d-4544a2c2f040","Type":"ContainerStarted","Data":"9dc6cbb3c63fc134e75165b9dcf7ba7fb6aef027aa76b67da3dfec89b6eac645"}
Jul 13 18:56:20.730904 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.730855    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"
Jul 13 18:56:20.751089 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.751032    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj" podStartSLOduration=2.225802415 podStartE2EDuration="54.751008359s" totalImagesPullingTime="52.525205944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:56:20.750148439 +0000 UTC m=+346.990629399" watchObservedRunningTime="2026-07-13 18:56:20.751008359 +0000 UTC m=+346.991489299"
Jul 13 18:56:20.799752 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.799718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d602c8c0-d17c-44cc-ba62-c48b8442679d-certificates\") pod \"keda-metrics-apiserver-55557df8c-4w8ck\" (UID: \"d602c8c0-d17c-44cc-ba62-c48b8442679d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:20.799949 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.799786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d602c8c0-d17c-44cc-ba62-c48b8442679d-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-4w8ck\" (UID: \"d602c8c0-d17c-44cc-ba62-c48b8442679d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:20.799949 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.799824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k8hp\" (UniqueName: \"kubernetes.io/projected/d602c8c0-d17c-44cc-ba62-c48b8442679d-kube-api-access-2k8hp\") pod \"keda-metrics-apiserver-55557df8c-4w8ck\" (UID: \"d602c8c0-d17c-44cc-ba62-c48b8442679d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:20.800266 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.800223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d602c8c0-d17c-44cc-ba62-c48b8442679d-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-4w8ck\" (UID: \"d602c8c0-d17c-44cc-ba62-c48b8442679d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:20.802230 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.802206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d602c8c0-d17c-44cc-ba62-c48b8442679d-certificates\") pod \"keda-metrics-apiserver-55557df8c-4w8ck\" (UID: \"d602c8c0-d17c-44cc-ba62-c48b8442679d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:20.808991 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.808969    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k8hp\" (UniqueName: \"kubernetes.io/projected/d602c8c0-d17c-44cc-ba62-c48b8442679d-kube-api-access-2k8hp\") pod \"keda-metrics-apiserver-55557df8c-4w8ck\" (UID: \"d602c8c0-d17c-44cc-ba62-c48b8442679d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:20.926670 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.926570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:20.976396 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.976358    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-b4jjq"]
Jul 13 18:56:20.983320 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.982428    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-b4jjq"
Jul 13 18:56:20.987795 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.985833    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 13 18:56:21.005562 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:20.999331    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-b4jjq"]
Jul 13 18:56:21.005562 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:21.002231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/144d2ac6-30a3-4cb7-a851-719df0c46fc0-certificates\") pod \"keda-admission-56f9798bb4-b4jjq\" (UID: \"144d2ac6-30a3-4cb7-a851-719df0c46fc0\") " pod="openshift-keda/keda-admission-56f9798bb4-b4jjq"
Jul 13 18:56:21.005562 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:21.002338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxqxz\" (UniqueName: \"kubernetes.io/projected/144d2ac6-30a3-4cb7-a851-719df0c46fc0-kube-api-access-vxqxz\") pod \"keda-admission-56f9798bb4-b4jjq\" (UID: \"144d2ac6-30a3-4cb7-a851-719df0c46fc0\") " pod="openshift-keda/keda-admission-56f9798bb4-b4jjq"
Jul 13 18:56:21.091167 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:21.091122    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"]
Jul 13 18:56:21.094126 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:56:21.094093    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd602c8c0_d17c_44cc_ba62_c48b8442679d.slice/crio-ff57bca755b3d49f907d9f33ebf6b4bbc0b03380c66868e2b21ac69b5c0835d4 WatchSource:0}: Error finding container ff57bca755b3d49f907d9f33ebf6b4bbc0b03380c66868e2b21ac69b5c0835d4: Status 404 returned error can't find the container with id ff57bca755b3d49f907d9f33ebf6b4bbc0b03380c66868e2b21ac69b5c0835d4
Jul 13 18:56:21.095669 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:21.095648    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 18:56:21.103331 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:21.103300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/144d2ac6-30a3-4cb7-a851-719df0c46fc0-certificates\") pod \"keda-admission-56f9798bb4-b4jjq\" (UID: \"144d2ac6-30a3-4cb7-a851-719df0c46fc0\") " pod="openshift-keda/keda-admission-56f9798bb4-b4jjq"
Jul 13 18:56:21.103449 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:21.103378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxqxz\" (UniqueName: \"kubernetes.io/projected/144d2ac6-30a3-4cb7-a851-719df0c46fc0-kube-api-access-vxqxz\") pod \"keda-admission-56f9798bb4-b4jjq\" (UID: \"144d2ac6-30a3-4cb7-a851-719df0c46fc0\") " pod="openshift-keda/keda-admission-56f9798bb4-b4jjq"
Jul 13 18:56:21.103510 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:56:21.103467    2563 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Jul 13 18:56:21.103510 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:56:21.103495    2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-56f9798bb4-b4jjq: secret "keda-admission-webhooks-certs" not found
Jul 13 18:56:21.103662 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:56:21.103556    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/144d2ac6-30a3-4cb7-a851-719df0c46fc0-certificates podName:144d2ac6-30a3-4cb7-a851-719df0c46fc0 nodeName:}" failed. No retries permitted until 2026-07-13 18:56:21.603536112 +0000 UTC m=+347.844017043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/144d2ac6-30a3-4cb7-a851-719df0c46fc0-certificates") pod "keda-admission-56f9798bb4-b4jjq" (UID: "144d2ac6-30a3-4cb7-a851-719df0c46fc0") : secret "keda-admission-webhooks-certs" not found
Jul 13 18:56:21.116005 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:21.115974    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxqxz\" (UniqueName: \"kubernetes.io/projected/144d2ac6-30a3-4cb7-a851-719df0c46fc0-kube-api-access-vxqxz\") pod \"keda-admission-56f9798bb4-b4jjq\" (UID: \"144d2ac6-30a3-4cb7-a851-719df0c46fc0\") " pod="openshift-keda/keda-admission-56f9798bb4-b4jjq"
Jul 13 18:56:21.609067 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:21.609035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/144d2ac6-30a3-4cb7-a851-719df0c46fc0-certificates\") pod \"keda-admission-56f9798bb4-b4jjq\" (UID: \"144d2ac6-30a3-4cb7-a851-719df0c46fc0\") " pod="openshift-keda/keda-admission-56f9798bb4-b4jjq"
Jul 13 18:56:21.611502 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:21.611478    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/144d2ac6-30a3-4cb7-a851-719df0c46fc0-certificates\") pod \"keda-admission-56f9798bb4-b4jjq\" (UID: \"144d2ac6-30a3-4cb7-a851-719df0c46fc0\") " pod="openshift-keda/keda-admission-56f9798bb4-b4jjq"
Jul 13 18:56:21.612216 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:21.612190    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-b4jjq"
Jul 13 18:56:21.735568 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:21.735535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck" event={"ID":"d602c8c0-d17c-44cc-ba62-c48b8442679d","Type":"ContainerStarted","Data":"ff57bca755b3d49f907d9f33ebf6b4bbc0b03380c66868e2b21ac69b5c0835d4"}
Jul 13 18:56:21.747412 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:21.747387    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-b4jjq"]
Jul 13 18:56:21.749515 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:56:21.749488    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144d2ac6_30a3_4cb7_a851_719df0c46fc0.slice/crio-aa4b76f2c11ecd34949ada91bfad4d51525e2842dc94129885007cb1d7118c9a WatchSource:0}: Error finding container aa4b76f2c11ecd34949ada91bfad4d51525e2842dc94129885007cb1d7118c9a: Status 404 returned error can't find the container with id aa4b76f2c11ecd34949ada91bfad4d51525e2842dc94129885007cb1d7118c9a
Jul 13 18:56:22.743444 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:22.743370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-b4jjq" event={"ID":"144d2ac6-30a3-4cb7-a851-719df0c46fc0","Type":"ContainerStarted","Data":"aa4b76f2c11ecd34949ada91bfad4d51525e2842dc94129885007cb1d7118c9a"}
Jul 13 18:56:23.749876 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:23.749834    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-b4jjq" event={"ID":"144d2ac6-30a3-4cb7-a851-719df0c46fc0","Type":"ContainerStarted","Data":"df93c423af46285d86ab9d0cd1bad42cf60057142918d7af8f3ea1d35473392f"}
Jul 13 18:56:23.750324 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:23.749991    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-b4jjq"
Jul 13 18:56:23.771484 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:23.771432    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-b4jjq" podStartSLOduration=1.9270144 podStartE2EDuration="3.77141316s" totalImagesPullingTime="1.84439876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:56:23.768920926 +0000 UTC m=+350.009401891" watchObservedRunningTime="2026-07-13 18:56:23.77141316 +0000 UTC m=+350.011894077"
Jul 13 18:56:24.755358 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:24.755236    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck" event={"ID":"d602c8c0-d17c-44cc-ba62-c48b8442679d","Type":"ContainerStarted","Data":"7aa93d363b7c754a53a823e8dacbd2d6b57fe2a2068030c548b9b43cafbe83a0"}
Jul 13 18:56:24.755772 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:24.755551    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:24.776654 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:24.776586    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck" podStartSLOduration=1.37344231 podStartE2EDuration="4.776562778s" totalImagesPullingTime="3.403120468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:56:24.773964181 +0000 UTC m=+351.014445144" watchObservedRunningTime="2026-07-13 18:56:24.776562778 +0000 UTC m=+351.017043718"
Jul 13 18:56:35.764021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:35.763933    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4w8ck"
Jul 13 18:56:41.738049 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:41.738018    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8rpxj"
Jul 13 18:56:44.758198 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:56:44.758161    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-b4jjq"
Jul 13 18:57:25.799896 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.799855    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-kgjg9"]
Jul 13 18:57:25.802350 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.802326    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-kgjg9"
Jul 13 18:57:25.805088 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.805054    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 13 18:57:25.806301 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.806093    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 13 18:57:25.806301 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.806232    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-jfzq6\""
Jul 13 18:57:25.806301 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.806293    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 13 18:57:25.813974 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.813946    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-kgjg9"]
Jul 13 18:57:25.844575 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.844538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e18b555d-e481-4d40-9382-d22bb066a5e8-cert\") pod \"llmisvc-controller-manager-654c557856-kgjg9\" (UID: \"e18b555d-e481-4d40-9382-d22bb066a5e8\") " pod="kserve/llmisvc-controller-manager-654c557856-kgjg9"
Jul 13 18:57:25.844856 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.844830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c676\" (UniqueName: \"kubernetes.io/projected/e18b555d-e481-4d40-9382-d22bb066a5e8-kube-api-access-6c676\") pod \"llmisvc-controller-manager-654c557856-kgjg9\" (UID: \"e18b555d-e481-4d40-9382-d22bb066a5e8\") " pod="kserve/llmisvc-controller-manager-654c557856-kgjg9"
Jul 13 18:57:25.946362 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.946322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e18b555d-e481-4d40-9382-d22bb066a5e8-cert\") pod \"llmisvc-controller-manager-654c557856-kgjg9\" (UID: \"e18b555d-e481-4d40-9382-d22bb066a5e8\") " pod="kserve/llmisvc-controller-manager-654c557856-kgjg9"
Jul 13 18:57:25.946362 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.946369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c676\" (UniqueName: \"kubernetes.io/projected/e18b555d-e481-4d40-9382-d22bb066a5e8-kube-api-access-6c676\") pod \"llmisvc-controller-manager-654c557856-kgjg9\" (UID: \"e18b555d-e481-4d40-9382-d22bb066a5e8\") " pod="kserve/llmisvc-controller-manager-654c557856-kgjg9"
Jul 13 18:57:25.949042 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.949008    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e18b555d-e481-4d40-9382-d22bb066a5e8-cert\") pod \"llmisvc-controller-manager-654c557856-kgjg9\" (UID: \"e18b555d-e481-4d40-9382-d22bb066a5e8\") " pod="kserve/llmisvc-controller-manager-654c557856-kgjg9"
Jul 13 18:57:25.964193 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:25.964161    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c676\" (UniqueName: \"kubernetes.io/projected/e18b555d-e481-4d40-9382-d22bb066a5e8-kube-api-access-6c676\") pod \"llmisvc-controller-manager-654c557856-kgjg9\" (UID: \"e18b555d-e481-4d40-9382-d22bb066a5e8\") " pod="kserve/llmisvc-controller-manager-654c557856-kgjg9"
Jul 13 18:57:26.114492 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:26.114458    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-kgjg9"
Jul 13 18:57:26.245366 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:26.245342    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-kgjg9"]
Jul 13 18:57:26.247487 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:57:26.247454    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode18b555d_e481_4d40_9382_d22bb066a5e8.slice/crio-9379928405e3a3f5648f9474ab662bbcd6fb10de9239bb8cdfcfb77c88d5cc29 WatchSource:0}: Error finding container 9379928405e3a3f5648f9474ab662bbcd6fb10de9239bb8cdfcfb77c88d5cc29: Status 404 returned error can't find the container with id 9379928405e3a3f5648f9474ab662bbcd6fb10de9239bb8cdfcfb77c88d5cc29
Jul 13 18:57:27.010543 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:27.010503    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-kgjg9" event={"ID":"e18b555d-e481-4d40-9382-d22bb066a5e8","Type":"ContainerStarted","Data":"9379928405e3a3f5648f9474ab662bbcd6fb10de9239bb8cdfcfb77c88d5cc29"}
Jul 13 18:57:30.026199 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:30.026162    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-kgjg9" event={"ID":"e18b555d-e481-4d40-9382-d22bb066a5e8","Type":"ContainerStarted","Data":"c789f8ca368bb3d5ce7ce60640e64e7d6651bb80427c403783f8c57100cf6e6a"}
Jul 13 18:57:30.026611 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:30.026289    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-kgjg9"
Jul 13 18:57:30.042954 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:30.042900    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-kgjg9" podStartSLOduration=1.944092549 podStartE2EDuration="5.042883381s" totalImagesPullingTime="3.098790832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:57:30.042025546 +0000 UTC m=+416.282506496" watchObservedRunningTime="2026-07-13 18:57:30.042883381 +0000 UTC m=+416.283364657"
Jul 13 18:57:42.650409 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.650369    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d44d44f8c-x9fdd"]
Jul 13 18:57:42.653952 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.653930    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.665293 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.665259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d44d44f8c-x9fdd"]
Jul 13 18:57:42.786804 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.786769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e1257ed-af6c-4039-9925-d53f89879698-oauth-serving-cert\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.786804 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.786805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1257ed-af6c-4039-9925-d53f89879698-trusted-ca-bundle\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.787014 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.786848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx4x5\" (UniqueName: \"kubernetes.io/projected/9e1257ed-af6c-4039-9925-d53f89879698-kube-api-access-rx4x5\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.787014 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.786869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e1257ed-af6c-4039-9925-d53f89879698-service-ca\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.787014 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.786890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e1257ed-af6c-4039-9925-d53f89879698-console-serving-cert\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.787014 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.786905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e1257ed-af6c-4039-9925-d53f89879698-console-oauth-config\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.787014 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.786967    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e1257ed-af6c-4039-9925-d53f89879698-console-config\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.888128 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.888079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e1257ed-af6c-4039-9925-d53f89879698-oauth-serving-cert\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.888128 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.888132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1257ed-af6c-4039-9925-d53f89879698-trusted-ca-bundle\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.888428 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.888161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx4x5\" (UniqueName: \"kubernetes.io/projected/9e1257ed-af6c-4039-9925-d53f89879698-kube-api-access-rx4x5\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.888428 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.888185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e1257ed-af6c-4039-9925-d53f89879698-service-ca\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.888428 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.888204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e1257ed-af6c-4039-9925-d53f89879698-console-serving-cert\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.888428 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.888219    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e1257ed-af6c-4039-9925-d53f89879698-console-oauth-config\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.888428 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.888235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e1257ed-af6c-4039-9925-d53f89879698-console-config\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.888953 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.888926    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e1257ed-af6c-4039-9925-d53f89879698-oauth-serving-cert\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.889065 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.888978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e1257ed-af6c-4039-9925-d53f89879698-console-config\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.889065 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.888986    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e1257ed-af6c-4039-9925-d53f89879698-service-ca\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.889660 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.889636    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e1257ed-af6c-4039-9925-d53f89879698-trusted-ca-bundle\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.890739 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.890714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e1257ed-af6c-4039-9925-d53f89879698-console-serving-cert\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.890828 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.890764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e1257ed-af6c-4039-9925-d53f89879698-console-oauth-config\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.898321 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.898302    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx4x5\" (UniqueName: \"kubernetes.io/projected/9e1257ed-af6c-4039-9925-d53f89879698-kube-api-access-rx4x5\") pod \"console-d44d44f8c-x9fdd\" (UID: \"9e1257ed-af6c-4039-9925-d53f89879698\") " pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:42.962348 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:42.962241    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:43.091877 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:43.091720    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d44d44f8c-x9fdd"]
Jul 13 18:57:43.094664 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:57:43.094629    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1257ed_af6c_4039_9925_d53f89879698.slice/crio-39925d5ed2a9b8cff133b5961799eb4a3092e852e6a883e398af255c4d0fab4e WatchSource:0}: Error finding container 39925d5ed2a9b8cff133b5961799eb4a3092e852e6a883e398af255c4d0fab4e: Status 404 returned error can't find the container with id 39925d5ed2a9b8cff133b5961799eb4a3092e852e6a883e398af255c4d0fab4e
Jul 13 18:57:44.084414 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:44.084380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d44d44f8c-x9fdd" event={"ID":"9e1257ed-af6c-4039-9925-d53f89879698","Type":"ContainerStarted","Data":"3151b8476bbbc154608e08c8b67fcabd16f277e7d890f8ec301058eec126d357"}
Jul 13 18:57:44.084801 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:44.084431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d44d44f8c-x9fdd" event={"ID":"9e1257ed-af6c-4039-9925-d53f89879698","Type":"ContainerStarted","Data":"39925d5ed2a9b8cff133b5961799eb4a3092e852e6a883e398af255c4d0fab4e"}
Jul 13 18:57:44.105892 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:44.105836    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d44d44f8c-x9fdd" podStartSLOduration=2.105819631 podStartE2EDuration="2.105819631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:57:44.104428144 +0000 UTC m=+430.344909084" watchObservedRunningTime="2026-07-13 18:57:44.105819631 +0000 UTC m=+430.346300570"
Jul 13 18:57:52.962858 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:52.962819    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:52.963366 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:52.962895    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:52.967479 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:52.967461    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:53.123952 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:53.123919    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d44d44f8c-x9fdd"
Jul 13 18:57:53.174081 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:57:53.174039    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f75c8b67f-j5zhm"]
Jul 13 18:58:01.033581 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:01.033504    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-kgjg9"
Jul 13 18:58:18.200219 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.200167    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f75c8b67f-j5zhm" podUID="b552620b-ad8a-41f2-8a65-042360063674" containerName="console" containerID="cri-o://7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605" gracePeriod=15
Jul 13 18:58:18.448758 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.448732    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:58:18.496142 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.496055    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-oauth-serving-cert\") pod \"b552620b-ad8a-41f2-8a65-042360063674\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") "
Jul 13 18:58:18.496142 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.496098    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b552620b-ad8a-41f2-8a65-042360063674-console-serving-cert\") pod \"b552620b-ad8a-41f2-8a65-042360063674\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") "
Jul 13 18:58:18.496410 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.496180    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-service-ca\") pod \"b552620b-ad8a-41f2-8a65-042360063674\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") "
Jul 13 18:58:18.496410 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.496218    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkm59\" (UniqueName: \"kubernetes.io/projected/b552620b-ad8a-41f2-8a65-042360063674-kube-api-access-vkm59\") pod \"b552620b-ad8a-41f2-8a65-042360063674\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") "
Jul 13 18:58:18.496410 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.496271    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-trusted-ca-bundle\") pod \"b552620b-ad8a-41f2-8a65-042360063674\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") "
Jul 13 18:58:18.496410 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.496302    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b552620b-ad8a-41f2-8a65-042360063674-console-oauth-config\") pod \"b552620b-ad8a-41f2-8a65-042360063674\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") "
Jul 13 18:58:18.496410 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.496324    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-console-config\") pod \"b552620b-ad8a-41f2-8a65-042360063674\" (UID: \"b552620b-ad8a-41f2-8a65-042360063674\") "
Jul 13 18:58:18.496588 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.496502    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b552620b-ad8a-41f2-8a65-042360063674" (UID: "b552620b-ad8a-41f2-8a65-042360063674"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:58:18.496588 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.496577    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-oauth-serving-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:58:18.496704 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.496629    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-service-ca" (OuterVolumeSpecName: "service-ca") pod "b552620b-ad8a-41f2-8a65-042360063674" (UID: "b552620b-ad8a-41f2-8a65-042360063674"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:58:18.496853 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.496830    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-console-config" (OuterVolumeSpecName: "console-config") pod "b552620b-ad8a-41f2-8a65-042360063674" (UID: "b552620b-ad8a-41f2-8a65-042360063674"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:58:18.496853 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.496838    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b552620b-ad8a-41f2-8a65-042360063674" (UID: "b552620b-ad8a-41f2-8a65-042360063674"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:58:18.498416 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.498384    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b552620b-ad8a-41f2-8a65-042360063674-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b552620b-ad8a-41f2-8a65-042360063674" (UID: "b552620b-ad8a-41f2-8a65-042360063674"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:58:18.498515 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.498445    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b552620b-ad8a-41f2-8a65-042360063674-kube-api-access-vkm59" (OuterVolumeSpecName: "kube-api-access-vkm59") pod "b552620b-ad8a-41f2-8a65-042360063674" (UID: "b552620b-ad8a-41f2-8a65-042360063674"). InnerVolumeSpecName "kube-api-access-vkm59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:58:18.498515 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.498452    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b552620b-ad8a-41f2-8a65-042360063674-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b552620b-ad8a-41f2-8a65-042360063674" (UID: "b552620b-ad8a-41f2-8a65-042360063674"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:58:18.597304 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.597235    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:58:18.597304 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.597293    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkm59\" (UniqueName: \"kubernetes.io/projected/b552620b-ad8a-41f2-8a65-042360063674-kube-api-access-vkm59\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:58:18.597304 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.597304    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-trusted-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:58:18.597304 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.597313    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b552620b-ad8a-41f2-8a65-042360063674-console-oauth-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:58:18.597562 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.597322    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b552620b-ad8a-41f2-8a65-042360063674-console-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:58:18.597562 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:18.597330    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b552620b-ad8a-41f2-8a65-042360063674-console-serving-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 18:58:19.242429 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:19.242395    2563 generic.go:356] "Generic (PLEG): container finished" podID="b552620b-ad8a-41f2-8a65-042360063674" containerID="7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605" exitCode=0
Jul 13 18:58:19.242880 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:19.242435    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f75c8b67f-j5zhm"
Jul 13 18:58:19.242880 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:19.242482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f75c8b67f-j5zhm" event={"ID":"b552620b-ad8a-41f2-8a65-042360063674","Type":"ContainerDied","Data":"7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605"}
Jul 13 18:58:19.242880 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:19.242531    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f75c8b67f-j5zhm" event={"ID":"b552620b-ad8a-41f2-8a65-042360063674","Type":"ContainerDied","Data":"7579b4145a82defb188e00e26378b11d639638986ad97aa3811142f802dbf481"}
Jul 13 18:58:19.242880 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:19.242554    2563 scope.go:117] "RemoveContainer" containerID="7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605"
Jul 13 18:58:19.250949 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:19.250925    2563 scope.go:117] "RemoveContainer" containerID="7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605"
Jul 13 18:58:19.251195 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:58:19.251168    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605\": container with ID starting with 7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605 not found: ID does not exist" containerID="7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605"
Jul 13 18:58:19.251272 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:19.251208    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605"} err="failed to get container status \"7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605\": rpc error: code = NotFound desc = could not find container \"7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605\": container with ID starting with 7956d0f5f7ba611b6d0682ccf7de7cf7bcc5d764962d7682fa97801f0ce1a605 not found: ID does not exist"
Jul 13 18:58:19.265021 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:19.264993    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f75c8b67f-j5zhm"]
Jul 13 18:58:19.268810 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:19.268786    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f75c8b67f-j5zhm"]
Jul 13 18:58:20.386054 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:20.386018    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b552620b-ad8a-41f2-8a65-042360063674" path="/var/lib/kubelet/pods/b552620b-ad8a-41f2-8a65-042360063674/volumes"
Jul 13 18:58:36.257370 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.257329    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-h5nrs"]
Jul 13 18:58:36.257858 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.257659    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b552620b-ad8a-41f2-8a65-042360063674" containerName="console"
Jul 13 18:58:36.257858 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.257673    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b552620b-ad8a-41f2-8a65-042360063674" containerName="console"
Jul 13 18:58:36.257858 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.257745    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b552620b-ad8a-41f2-8a65-042360063674" containerName="console"
Jul 13 18:58:36.261453 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.261434    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-h5nrs"
Jul 13 18:58:36.264715 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.264691    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Jul 13 18:58:36.264951 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.264793    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-wbd7f\""
Jul 13 18:58:36.270865 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.270833    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-h5nrs"]
Jul 13 18:58:36.348662 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.348617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9d9ffb7-abb0-47a5-bebf-22a28045ce83-cert\") pod \"odh-model-controller-84b54b7f97-h5nrs\" (UID: \"e9d9ffb7-abb0-47a5-bebf-22a28045ce83\") " pod="kserve/odh-model-controller-84b54b7f97-h5nrs"
Jul 13 18:58:36.348863 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.348672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhjv8\" (UniqueName: \"kubernetes.io/projected/e9d9ffb7-abb0-47a5-bebf-22a28045ce83-kube-api-access-jhjv8\") pod \"odh-model-controller-84b54b7f97-h5nrs\" (UID: \"e9d9ffb7-abb0-47a5-bebf-22a28045ce83\") " pod="kserve/odh-model-controller-84b54b7f97-h5nrs"
Jul 13 18:58:36.449662 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.449618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9d9ffb7-abb0-47a5-bebf-22a28045ce83-cert\") pod \"odh-model-controller-84b54b7f97-h5nrs\" (UID: \"e9d9ffb7-abb0-47a5-bebf-22a28045ce83\") " pod="kserve/odh-model-controller-84b54b7f97-h5nrs"
Jul 13 18:58:36.449860 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.449687    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhjv8\" (UniqueName: \"kubernetes.io/projected/e9d9ffb7-abb0-47a5-bebf-22a28045ce83-kube-api-access-jhjv8\") pod \"odh-model-controller-84b54b7f97-h5nrs\" (UID: \"e9d9ffb7-abb0-47a5-bebf-22a28045ce83\") " pod="kserve/odh-model-controller-84b54b7f97-h5nrs"
Jul 13 18:58:36.449860 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:58:36.449781    2563 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 13 18:58:36.449973 ip-10-0-137-93 kubenswrapper[2563]: E0713 18:58:36.449861    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d9ffb7-abb0-47a5-bebf-22a28045ce83-cert podName:e9d9ffb7-abb0-47a5-bebf-22a28045ce83 nodeName:}" failed. No retries permitted until 2026-07-13 18:58:36.949840326 +0000 UTC m=+483.190321246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e9d9ffb7-abb0-47a5-bebf-22a28045ce83-cert") pod "odh-model-controller-84b54b7f97-h5nrs" (UID: "e9d9ffb7-abb0-47a5-bebf-22a28045ce83") : secret "odh-model-controller-webhook-cert" not found
Jul 13 18:58:36.464525 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.464494    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhjv8\" (UniqueName: \"kubernetes.io/projected/e9d9ffb7-abb0-47a5-bebf-22a28045ce83-kube-api-access-jhjv8\") pod \"odh-model-controller-84b54b7f97-h5nrs\" (UID: \"e9d9ffb7-abb0-47a5-bebf-22a28045ce83\") " pod="kserve/odh-model-controller-84b54b7f97-h5nrs"
Jul 13 18:58:36.954641 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.954603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9d9ffb7-abb0-47a5-bebf-22a28045ce83-cert\") pod \"odh-model-controller-84b54b7f97-h5nrs\" (UID: \"e9d9ffb7-abb0-47a5-bebf-22a28045ce83\") " pod="kserve/odh-model-controller-84b54b7f97-h5nrs"
Jul 13 18:58:36.956987 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:36.956963    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9d9ffb7-abb0-47a5-bebf-22a28045ce83-cert\") pod \"odh-model-controller-84b54b7f97-h5nrs\" (UID: \"e9d9ffb7-abb0-47a5-bebf-22a28045ce83\") " pod="kserve/odh-model-controller-84b54b7f97-h5nrs"
Jul 13 18:58:37.172910 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:37.172871    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-h5nrs"
Jul 13 18:58:37.304416 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:37.304312    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-h5nrs"]
Jul 13 18:58:37.307039 ip-10-0-137-93 kubenswrapper[2563]: W0713 18:58:37.307002    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d9ffb7_abb0_47a5_bebf_22a28045ce83.slice/crio-01079ead13cd54a1be7eec07bf32e28545cbd28822b4066409df9750b01c8d66 WatchSource:0}: Error finding container 01079ead13cd54a1be7eec07bf32e28545cbd28822b4066409df9750b01c8d66: Status 404 returned error can't find the container with id 01079ead13cd54a1be7eec07bf32e28545cbd28822b4066409df9750b01c8d66
Jul 13 18:58:37.316505 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:37.316475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-h5nrs" event={"ID":"e9d9ffb7-abb0-47a5-bebf-22a28045ce83","Type":"ContainerStarted","Data":"01079ead13cd54a1be7eec07bf32e28545cbd28822b4066409df9750b01c8d66"}
Jul 13 18:58:41.338173 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:41.338138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-h5nrs" event={"ID":"e9d9ffb7-abb0-47a5-bebf-22a28045ce83","Type":"ContainerStarted","Data":"aa140010bd24ad800aa01be83171b414394b1ac68d141cf8ca89b709f4e5c4aa"}
Jul 13 18:58:41.338534 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:41.338237    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-h5nrs"
Jul 13 18:58:41.358951 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:41.358904    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-h5nrs" podStartSLOduration=1.493374126 podStartE2EDuration="5.35888993s" totalImagesPullingTime="3.865515804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:58:41.358739823 +0000 UTC m=+487.599220761" watchObservedRunningTime="2026-07-13 18:58:41.35888993 +0000 UTC m=+487.599370868"
Jul 13 18:58:52.344903 ip-10-0-137-93 kubenswrapper[2563]: I0713 18:58:52.344864    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-h5nrs"
Jul 13 19:00:24.565588 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.565549    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"]
Jul 13 19:00:24.568834 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.568812    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.574612 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.574588    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 13 19:00:24.574722 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.574669    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-98mz6\""
Jul 13 19:00:24.574815 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.574794    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 13 19:00:24.575753 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.575734    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Jul 13 19:00:24.575753 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.575746    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 13 19:00:24.575886 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.575743    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Jul 13 19:00:24.579220 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.579203    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 13 19:00:24.589675 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.589654    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"]
Jul 13 19:00:24.624673 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.624618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0eaec241-64f4-4967-9032-3b2cde1b7898-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.624855 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.624711    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vjl2\" (UniqueName: \"kubernetes.io/projected/0eaec241-64f4-4967-9032-3b2cde1b7898-kube-api-access-9vjl2\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.624855 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.624744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0eaec241-64f4-4967-9032-3b2cde1b7898-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.624855 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.624773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0eaec241-64f4-4967-9032-3b2cde1b7898-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.624855 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.624800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0eaec241-64f4-4967-9032-3b2cde1b7898-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.726419 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.726377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0eaec241-64f4-4967-9032-3b2cde1b7898-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.726597 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.726451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vjl2\" (UniqueName: \"kubernetes.io/projected/0eaec241-64f4-4967-9032-3b2cde1b7898-kube-api-access-9vjl2\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.726597 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.726491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0eaec241-64f4-4967-9032-3b2cde1b7898-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.726597 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.726520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0eaec241-64f4-4967-9032-3b2cde1b7898-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.726597 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.726545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0eaec241-64f4-4967-9032-3b2cde1b7898-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.727072 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:00:24.726825    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 13 19:00:24.727072 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:00:24.726963    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eaec241-64f4-4967-9032-3b2cde1b7898-proxy-tls podName:0eaec241-64f4-4967-9032-3b2cde1b7898 nodeName:}" failed. No retries permitted until 2026-07-13 19:00:25.22694119 +0000 UTC m=+591.467422113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/0eaec241-64f4-4967-9032-3b2cde1b7898-proxy-tls") pod "isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" (UID: "0eaec241-64f4-4967-9032-3b2cde1b7898") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 13 19:00:24.727205 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.727183    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0eaec241-64f4-4967-9032-3b2cde1b7898-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.727241 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.727212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0eaec241-64f4-4967-9032-3b2cde1b7898-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.727536 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.727511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0eaec241-64f4-4967-9032-3b2cde1b7898-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:24.753528 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:24.753496    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vjl2\" (UniqueName: \"kubernetes.io/projected/0eaec241-64f4-4967-9032-3b2cde1b7898-kube-api-access-9vjl2\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:25.231869 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:25.231817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0eaec241-64f4-4967-9032-3b2cde1b7898-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:25.234509 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:25.234484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0eaec241-64f4-4967-9032-3b2cde1b7898-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:25.479361 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:25.479327    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:25.621033 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:25.620991    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"]
Jul 13 19:00:25.624302 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:00:25.624239    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eaec241_64f4_4967_9032_3b2cde1b7898.slice/crio-d348ff2a3c7cb73e2e4ad27bf5bb9de30dff2d4715d22adb1ca17e8c7d5d00af WatchSource:0}: Error finding container d348ff2a3c7cb73e2e4ad27bf5bb9de30dff2d4715d22adb1ca17e8c7d5d00af: Status 404 returned error can't find the container with id d348ff2a3c7cb73e2e4ad27bf5bb9de30dff2d4715d22adb1ca17e8c7d5d00af
Jul 13 19:00:25.768774 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:25.768686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" event={"ID":"0eaec241-64f4-4967-9032-3b2cde1b7898","Type":"ContainerStarted","Data":"d348ff2a3c7cb73e2e4ad27bf5bb9de30dff2d4715d22adb1ca17e8c7d5d00af"}
Jul 13 19:00:31.799816 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:31.799772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" event={"ID":"0eaec241-64f4-4967-9032-3b2cde1b7898","Type":"ContainerStarted","Data":"24d1724318a611381ef1aff28a80a59d1daf8cd92c7f9e8a22159f4737825918"}
Jul 13 19:00:34.143133 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:34.143107    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:00:34.143133 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:34.143125    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:00:34.814150 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:34.814064    2563 generic.go:356] "Generic (PLEG): container finished" podID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerID="24d1724318a611381ef1aff28a80a59d1daf8cd92c7f9e8a22159f4737825918" exitCode=0
Jul 13 19:00:34.814333 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:34.814142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" event={"ID":"0eaec241-64f4-4967-9032-3b2cde1b7898","Type":"ContainerDied","Data":"24d1724318a611381ef1aff28a80a59d1daf8cd92c7f9e8a22159f4737825918"}
Jul 13 19:00:48.901061 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:48.901020    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" event={"ID":"0eaec241-64f4-4967-9032-3b2cde1b7898","Type":"ContainerStarted","Data":"aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22"}
Jul 13 19:00:50.911508 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:50.911462    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" event={"ID":"0eaec241-64f4-4967-9032-3b2cde1b7898","Type":"ContainerStarted","Data":"5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73"}
Jul 13 19:00:50.911927 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:50.911645    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:50.911927 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:50.911700    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:50.912842 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:50.912818    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 13 19:00:50.932464 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:50.932415    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podStartSLOduration=2.527655213 podStartE2EDuration="26.932400835s" totalImagesPullingTime="20.831526101s" totalInitContainerRuntime="3.573219521s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:00:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:00:50.930983388 +0000 UTC m=+617.171464362" watchObservedRunningTime="2026-07-13 19:00:50.932400835 +0000 UTC m=+617.172881773"
Jul 13 19:00:51.915754 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:51.915715    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 13 19:00:56.921678 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:56.921594    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:00:56.922268 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:00:56.922214    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 13 19:01:06.922714 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:06.922663    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 13 19:01:16.922576 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:16.922537    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 13 19:01:26.923167 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:26.923105    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 13 19:01:36.922500 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:36.922461    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 13 19:01:44.350542 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:44.350508    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"]
Jul 13 19:01:44.352786 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:44.352769    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:01:44.355485 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:44.355463    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-19366-serving-cert\""
Jul 13 19:01:44.355615 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:44.355498    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-19366-kube-rbac-proxy-sar-config\""
Jul 13 19:01:44.363409 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:44.363389    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"]
Jul 13 19:01:44.524220 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:44.524182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c9c69cd-3892-4eb5-bb2c-649d861d9468-openshift-service-ca-bundle\") pod \"switch-graph-19366-84654b9d67-xpxcb\" (UID: \"8c9c69cd-3892-4eb5-bb2c-649d861d9468\") " pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:01:44.524434 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:44.524278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c9c69cd-3892-4eb5-bb2c-649d861d9468-proxy-tls\") pod \"switch-graph-19366-84654b9d67-xpxcb\" (UID: \"8c9c69cd-3892-4eb5-bb2c-649d861d9468\") " pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:01:44.625400 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:44.625299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c9c69cd-3892-4eb5-bb2c-649d861d9468-proxy-tls\") pod \"switch-graph-19366-84654b9d67-xpxcb\" (UID: \"8c9c69cd-3892-4eb5-bb2c-649d861d9468\") " pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:01:44.625400 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:44.625355    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c9c69cd-3892-4eb5-bb2c-649d861d9468-openshift-service-ca-bundle\") pod \"switch-graph-19366-84654b9d67-xpxcb\" (UID: \"8c9c69cd-3892-4eb5-bb2c-649d861d9468\") " pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:01:44.625616 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:01:44.625465    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-19366-serving-cert: secret "switch-graph-19366-serving-cert" not found
Jul 13 19:01:44.625616 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:01:44.625555    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c9c69cd-3892-4eb5-bb2c-649d861d9468-proxy-tls podName:8c9c69cd-3892-4eb5-bb2c-649d861d9468 nodeName:}" failed. No retries permitted until 2026-07-13 19:01:45.125534429 +0000 UTC m=+671.366015350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/8c9c69cd-3892-4eb5-bb2c-649d861d9468-proxy-tls") pod "switch-graph-19366-84654b9d67-xpxcb" (UID: "8c9c69cd-3892-4eb5-bb2c-649d861d9468") : secret "switch-graph-19366-serving-cert" not found
Jul 13 19:01:44.625935 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:44.625914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c9c69cd-3892-4eb5-bb2c-649d861d9468-openshift-service-ca-bundle\") pod \"switch-graph-19366-84654b9d67-xpxcb\" (UID: \"8c9c69cd-3892-4eb5-bb2c-649d861d9468\") " pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:01:45.130305 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:45.130267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c9c69cd-3892-4eb5-bb2c-649d861d9468-proxy-tls\") pod \"switch-graph-19366-84654b9d67-xpxcb\" (UID: \"8c9c69cd-3892-4eb5-bb2c-649d861d9468\") " pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:01:45.130472 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:01:45.130402    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-19366-serving-cert: secret "switch-graph-19366-serving-cert" not found
Jul 13 19:01:45.130472 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:01:45.130471    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c9c69cd-3892-4eb5-bb2c-649d861d9468-proxy-tls podName:8c9c69cd-3892-4eb5-bb2c-649d861d9468 nodeName:}" failed. No retries permitted until 2026-07-13 19:01:46.130456403 +0000 UTC m=+672.370937320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/8c9c69cd-3892-4eb5-bb2c-649d861d9468-proxy-tls") pod "switch-graph-19366-84654b9d67-xpxcb" (UID: "8c9c69cd-3892-4eb5-bb2c-649d861d9468") : secret "switch-graph-19366-serving-cert" not found
Jul 13 19:01:46.138105 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:46.138063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c9c69cd-3892-4eb5-bb2c-649d861d9468-proxy-tls\") pod \"switch-graph-19366-84654b9d67-xpxcb\" (UID: \"8c9c69cd-3892-4eb5-bb2c-649d861d9468\") " pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:01:46.140395 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:46.140365    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c9c69cd-3892-4eb5-bb2c-649d861d9468-proxy-tls\") pod \"switch-graph-19366-84654b9d67-xpxcb\" (UID: \"8c9c69cd-3892-4eb5-bb2c-649d861d9468\") " pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:01:46.164072 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:46.164048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:01:46.289727 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:46.289698    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"]
Jul 13 19:01:46.291732 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:01:46.291706    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c9c69cd_3892_4eb5_bb2c_649d861d9468.slice/crio-0ce4e52bb03778a6803f7457f9b4c66e8b6f9276a7366123d4d17f4264af629a WatchSource:0}: Error finding container 0ce4e52bb03778a6803f7457f9b4c66e8b6f9276a7366123d4d17f4264af629a: Status 404 returned error can't find the container with id 0ce4e52bb03778a6803f7457f9b4c66e8b6f9276a7366123d4d17f4264af629a
Jul 13 19:01:46.293492 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:46.293474    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 19:01:46.923047 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:46.923007    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 13 19:01:47.159027 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:47.158982    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb" event={"ID":"8c9c69cd-3892-4eb5-bb2c-649d861d9468","Type":"ContainerStarted","Data":"0ce4e52bb03778a6803f7457f9b4c66e8b6f9276a7366123d4d17f4264af629a"}
Jul 13 19:01:49.168994 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:49.168907    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb" event={"ID":"8c9c69cd-3892-4eb5-bb2c-649d861d9468","Type":"ContainerStarted","Data":"0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff"}
Jul 13 19:01:49.169400 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:49.169042    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:01:49.192045 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:49.191993    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb" podStartSLOduration=2.666229339 podStartE2EDuration="5.191978253s" totalImagesPullingTime="2.525748914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:01:49.190537358 +0000 UTC m=+675.431018292" watchObservedRunningTime="2026-07-13 19:01:49.191978253 +0000 UTC m=+675.432459191"
Jul 13 19:01:55.178827 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:55.178794    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:01:56.922871 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:56.922826    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 13 19:01:58.481653 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:58.481622    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"]
Jul 13 19:01:58.482220 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:01:58.481852    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb" podUID="8c9c69cd-3892-4eb5-bb2c-649d861d9468" containerName="switch-graph-19366" containerID="cri-o://0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff" gracePeriod=30
Jul 13 19:02:00.177168 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:00.177129    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb" podUID="8c9c69cd-3892-4eb5-bb2c-649d861d9468" containerName="switch-graph-19366" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:02:05.177139 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:05.177102    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb" podUID="8c9c69cd-3892-4eb5-bb2c-649d861d9468" containerName="switch-graph-19366" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:02:06.923152 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:06.923119    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:02:10.177341 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:10.177300    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb" podUID="8c9c69cd-3892-4eb5-bb2c-649d861d9468" containerName="switch-graph-19366" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:02:10.177713 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:10.177433    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:02:15.177709 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:15.177667    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb" podUID="8c9c69cd-3892-4eb5-bb2c-649d861d9468" containerName="switch-graph-19366" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:02:20.177390 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:20.177346    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb" podUID="8c9c69cd-3892-4eb5-bb2c-649d861d9468" containerName="switch-graph-19366" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:02:25.177076 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:25.177036    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb" podUID="8c9c69cd-3892-4eb5-bb2c-649d861d9468" containerName="switch-graph-19366" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:02:29.130049 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.130021    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:02:29.298858 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.298769    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c9c69cd-3892-4eb5-bb2c-649d861d9468-proxy-tls\") pod \"8c9c69cd-3892-4eb5-bb2c-649d861d9468\" (UID: \"8c9c69cd-3892-4eb5-bb2c-649d861d9468\") "
Jul 13 19:02:29.298858 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.298844    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c9c69cd-3892-4eb5-bb2c-649d861d9468-openshift-service-ca-bundle\") pod \"8c9c69cd-3892-4eb5-bb2c-649d861d9468\" (UID: \"8c9c69cd-3892-4eb5-bb2c-649d861d9468\") "
Jul 13 19:02:29.299214 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.299190    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c9c69cd-3892-4eb5-bb2c-649d861d9468-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "8c9c69cd-3892-4eb5-bb2c-649d861d9468" (UID: "8c9c69cd-3892-4eb5-bb2c-649d861d9468"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:02:29.300973 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.300957    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c9c69cd-3892-4eb5-bb2c-649d861d9468-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8c9c69cd-3892-4eb5-bb2c-649d861d9468" (UID: "8c9c69cd-3892-4eb5-bb2c-649d861d9468"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:02:29.335269 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.335217    2563 generic.go:356] "Generic (PLEG): container finished" podID="8c9c69cd-3892-4eb5-bb2c-649d861d9468" containerID="0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff" exitCode=0
Jul 13 19:02:29.335404 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.335277    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"
Jul 13 19:02:29.335404 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.335285    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb" event={"ID":"8c9c69cd-3892-4eb5-bb2c-649d861d9468","Type":"ContainerDied","Data":"0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff"}
Jul 13 19:02:29.335404 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.335347    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb" event={"ID":"8c9c69cd-3892-4eb5-bb2c-649d861d9468","Type":"ContainerDied","Data":"0ce4e52bb03778a6803f7457f9b4c66e8b6f9276a7366123d4d17f4264af629a"}
Jul 13 19:02:29.335404 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.335376    2563 scope.go:117] "RemoveContainer" containerID="0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff"
Jul 13 19:02:29.343858 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.343841    2563 scope.go:117] "RemoveContainer" containerID="0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff"
Jul 13 19:02:29.344118 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:02:29.344097    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff\": container with ID starting with 0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff not found: ID does not exist" containerID="0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff"
Jul 13 19:02:29.344173 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.344128    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff"} err="failed to get container status \"0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff\": rpc error: code = NotFound desc = could not find container \"0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff\": container with ID starting with 0b415bf60bc4a75bee53083eb981bb0d9be6fbbb857cfe7912037c4ac2e5f4ff not found: ID does not exist"
Jul 13 19:02:29.355986 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.355962    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"]
Jul 13 19:02:29.359512 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.359490    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-19366-84654b9d67-xpxcb"]
Jul 13 19:02:29.400091 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.400063    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c9c69cd-3892-4eb5-bb2c-649d861d9468-proxy-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:02:29.400091 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:29.400093    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c9c69cd-3892-4eb5-bb2c-649d861d9468-openshift-service-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:02:30.386063 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:30.386028    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c9c69cd-3892-4eb5-bb2c-649d861d9468" path="/var/lib/kubelet/pods/8c9c69cd-3892-4eb5-bb2c-649d861d9468/volumes"
Jul 13 19:02:34.391983 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.391951    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"]
Jul 13 19:02:34.392362 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.392275    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c9c69cd-3892-4eb5-bb2c-649d861d9468" containerName="switch-graph-19366"
Jul 13 19:02:34.392362 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.392288    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c9c69cd-3892-4eb5-bb2c-649d861d9468" containerName="switch-graph-19366"
Jul 13 19:02:34.392362 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.392345    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c9c69cd-3892-4eb5-bb2c-649d861d9468" containerName="switch-graph-19366"
Jul 13 19:02:34.396318 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.396301    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:02:34.398790 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.398769    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Jul 13 19:02:34.398918 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.398771    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Jul 13 19:02:34.404210 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.404185    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"]
Jul 13 19:02:34.544112 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.544022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/02a034a2-9bd0-4a84-bc95-7b4465fceb03-proxy-tls\") pod \"model-chainer-667d9bc9cf-wnctj\" (UID: \"02a034a2-9bd0-4a84-bc95-7b4465fceb03\") " pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:02:34.544112 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.544074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02a034a2-9bd0-4a84-bc95-7b4465fceb03-openshift-service-ca-bundle\") pod \"model-chainer-667d9bc9cf-wnctj\" (UID: \"02a034a2-9bd0-4a84-bc95-7b4465fceb03\") " pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:02:34.644687 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.644634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/02a034a2-9bd0-4a84-bc95-7b4465fceb03-proxy-tls\") pod \"model-chainer-667d9bc9cf-wnctj\" (UID: \"02a034a2-9bd0-4a84-bc95-7b4465fceb03\") " pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:02:34.644860 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.644715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02a034a2-9bd0-4a84-bc95-7b4465fceb03-openshift-service-ca-bundle\") pod \"model-chainer-667d9bc9cf-wnctj\" (UID: \"02a034a2-9bd0-4a84-bc95-7b4465fceb03\") " pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:02:34.644860 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:02:34.644798    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-serving-cert: secret "model-chainer-serving-cert" not found
Jul 13 19:02:34.644932 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:02:34.644891    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02a034a2-9bd0-4a84-bc95-7b4465fceb03-proxy-tls podName:02a034a2-9bd0-4a84-bc95-7b4465fceb03 nodeName:}" failed. No retries permitted until 2026-07-13 19:02:35.144875821 +0000 UTC m=+721.385356744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/02a034a2-9bd0-4a84-bc95-7b4465fceb03-proxy-tls") pod "model-chainer-667d9bc9cf-wnctj" (UID: "02a034a2-9bd0-4a84-bc95-7b4465fceb03") : secret "model-chainer-serving-cert" not found
Jul 13 19:02:34.645492 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:34.645470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02a034a2-9bd0-4a84-bc95-7b4465fceb03-openshift-service-ca-bundle\") pod \"model-chainer-667d9bc9cf-wnctj\" (UID: \"02a034a2-9bd0-4a84-bc95-7b4465fceb03\") " pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:02:35.149164 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:35.149122    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/02a034a2-9bd0-4a84-bc95-7b4465fceb03-proxy-tls\") pod \"model-chainer-667d9bc9cf-wnctj\" (UID: \"02a034a2-9bd0-4a84-bc95-7b4465fceb03\") " pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:02:35.151496 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:35.151465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/02a034a2-9bd0-4a84-bc95-7b4465fceb03-proxy-tls\") pod \"model-chainer-667d9bc9cf-wnctj\" (UID: \"02a034a2-9bd0-4a84-bc95-7b4465fceb03\") " pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:02:35.307593 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:35.307556    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:02:35.433274 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:35.433234    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"]
Jul 13 19:02:35.435326 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:02:35.435299    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a034a2_9bd0_4a84_bc95_7b4465fceb03.slice/crio-6f377d4f22db8f530be4d409ecc238bc594f9e846a3766a39c859a50863fa61d WatchSource:0}: Error finding container 6f377d4f22db8f530be4d409ecc238bc594f9e846a3766a39c859a50863fa61d: Status 404 returned error can't find the container with id 6f377d4f22db8f530be4d409ecc238bc594f9e846a3766a39c859a50863fa61d
Jul 13 19:02:36.368759 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:36.368721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj" event={"ID":"02a034a2-9bd0-4a84-bc95-7b4465fceb03","Type":"ContainerStarted","Data":"bcd3076b6e6fb8f71922c47209a2d2cf5c38f1e78d2f488953a548bbe5922f67"}
Jul 13 19:02:36.368967 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:36.368784    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj" event={"ID":"02a034a2-9bd0-4a84-bc95-7b4465fceb03","Type":"ContainerStarted","Data":"6f377d4f22db8f530be4d409ecc238bc594f9e846a3766a39c859a50863fa61d"}
Jul 13 19:02:36.368967 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:36.368815    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:02:36.386462 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:36.386416    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj" podStartSLOduration=2.386401143 podStartE2EDuration="2.386401143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:02:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:02:36.38507161 +0000 UTC m=+722.625552570" watchObservedRunningTime="2026-07-13 19:02:36.386401143 +0000 UTC m=+722.626882082"
Jul 13 19:02:42.380093 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:42.380063    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:02:44.505448 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:44.505417    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"]
Jul 13 19:02:44.505825 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:44.505593    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj" podUID="02a034a2-9bd0-4a84-bc95-7b4465fceb03" containerName="model-chainer" containerID="cri-o://bcd3076b6e6fb8f71922c47209a2d2cf5c38f1e78d2f488953a548bbe5922f67" gracePeriod=30
Jul 13 19:02:44.637012 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:44.636980    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"]
Jul 13 19:02:44.637336 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:44.637309    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container" containerID="cri-o://aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22" gracePeriod=30
Jul 13 19:02:44.637443 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:44.637394    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kube-rbac-proxy" containerID="cri-o://5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73" gracePeriod=30
Jul 13 19:02:45.408619 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:45.408587    2563 generic.go:356] "Generic (PLEG): container finished" podID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerID="5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73" exitCode=2
Jul 13 19:02:45.408792 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:45.408647    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" event={"ID":"0eaec241-64f4-4967-9032-3b2cde1b7898","Type":"ContainerDied","Data":"5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73"}
Jul 13 19:02:46.916004 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:46.915959    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.27:8643/healthz\": dial tcp 10.133.0.27:8643: connect: connection refused"
Jul 13 19:02:46.922495 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:46.922463    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 13 19:02:47.377419 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:47.377385    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj" podUID="02a034a2-9bd0-4a84-bc95-7b4465fceb03" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:02:49.388295 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.388269    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:02:49.428950 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.428915    2563 generic.go:356] "Generic (PLEG): container finished" podID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerID="aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22" exitCode=0
Jul 13 19:02:49.429101 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.428967    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"
Jul 13 19:02:49.429101 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.428968    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" event={"ID":"0eaec241-64f4-4967-9032-3b2cde1b7898","Type":"ContainerDied","Data":"aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22"}
Jul 13 19:02:49.429101 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.429086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs" event={"ID":"0eaec241-64f4-4967-9032-3b2cde1b7898","Type":"ContainerDied","Data":"d348ff2a3c7cb73e2e4ad27bf5bb9de30dff2d4715d22adb1ca17e8c7d5d00af"}
Jul 13 19:02:49.429217 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.429113    2563 scope.go:117] "RemoveContainer" containerID="5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73"
Jul 13 19:02:49.438794 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.438772    2563 scope.go:117] "RemoveContainer" containerID="aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22"
Jul 13 19:02:49.447150 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.447124    2563 scope.go:117] "RemoveContainer" containerID="24d1724318a611381ef1aff28a80a59d1daf8cd92c7f9e8a22159f4737825918"
Jul 13 19:02:49.454272 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.454238    2563 scope.go:117] "RemoveContainer" containerID="5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73"
Jul 13 19:02:49.454513 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:02:49.454494    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73\": container with ID starting with 5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73 not found: ID does not exist" containerID="5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73"
Jul 13 19:02:49.454559 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.454523    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73"} err="failed to get container status \"5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73\": rpc error: code = NotFound desc = could not find container \"5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73\": container with ID starting with 5e5c91775be17fe48a8f1ab0d42770d0448dd1b3f4e74a01f9c93ab211a3cb73 not found: ID does not exist"
Jul 13 19:02:49.454559 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.454542    2563 scope.go:117] "RemoveContainer" containerID="aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22"
Jul 13 19:02:49.454754 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:02:49.454736    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22\": container with ID starting with aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22 not found: ID does not exist" containerID="aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22"
Jul 13 19:02:49.454790 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.454763    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22"} err="failed to get container status \"aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22\": rpc error: code = NotFound desc = could not find container \"aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22\": container with ID starting with aca50e8030eb13ec7240c0b9557d37dd1a4209a503fa392a3ca0c1b63b610b22 not found: ID does not exist"
Jul 13 19:02:49.454790 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.454785    2563 scope.go:117] "RemoveContainer" containerID="24d1724318a611381ef1aff28a80a59d1daf8cd92c7f9e8a22159f4737825918"
Jul 13 19:02:49.455006 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:02:49.454989    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24d1724318a611381ef1aff28a80a59d1daf8cd92c7f9e8a22159f4737825918\": container with ID starting with 24d1724318a611381ef1aff28a80a59d1daf8cd92c7f9e8a22159f4737825918 not found: ID does not exist" containerID="24d1724318a611381ef1aff28a80a59d1daf8cd92c7f9e8a22159f4737825918"
Jul 13 19:02:49.455045 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.455010    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24d1724318a611381ef1aff28a80a59d1daf8cd92c7f9e8a22159f4737825918"} err="failed to get container status \"24d1724318a611381ef1aff28a80a59d1daf8cd92c7f9e8a22159f4737825918\": rpc error: code = NotFound desc = could not find container \"24d1724318a611381ef1aff28a80a59d1daf8cd92c7f9e8a22159f4737825918\": container with ID starting with 24d1724318a611381ef1aff28a80a59d1daf8cd92c7f9e8a22159f4737825918 not found: ID does not exist"
Jul 13 19:02:49.463313 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.463296    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0eaec241-64f4-4967-9032-3b2cde1b7898-kserve-provision-location\") pod \"0eaec241-64f4-4967-9032-3b2cde1b7898\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") "
Jul 13 19:02:49.463381 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.463326    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0eaec241-64f4-4967-9032-3b2cde1b7898-kube-rbac-proxy-sar-config\") pod \"0eaec241-64f4-4967-9032-3b2cde1b7898\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") "
Jul 13 19:02:49.463381 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.463348    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0eaec241-64f4-4967-9032-3b2cde1b7898-proxy-tls\") pod \"0eaec241-64f4-4967-9032-3b2cde1b7898\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") "
Jul 13 19:02:49.463445 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.463385    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0eaec241-64f4-4967-9032-3b2cde1b7898-cabundle-cert\") pod \"0eaec241-64f4-4967-9032-3b2cde1b7898\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") "
Jul 13 19:02:49.463445 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.463413    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vjl2\" (UniqueName: \"kubernetes.io/projected/0eaec241-64f4-4967-9032-3b2cde1b7898-kube-api-access-9vjl2\") pod \"0eaec241-64f4-4967-9032-3b2cde1b7898\" (UID: \"0eaec241-64f4-4967-9032-3b2cde1b7898\") "
Jul 13 19:02:49.463681 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.463650    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eaec241-64f4-4967-9032-3b2cde1b7898-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "0eaec241-64f4-4967-9032-3b2cde1b7898" (UID: "0eaec241-64f4-4967-9032-3b2cde1b7898"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:02:49.463726 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.463677    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eaec241-64f4-4967-9032-3b2cde1b7898-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "0eaec241-64f4-4967-9032-3b2cde1b7898" (UID: "0eaec241-64f4-4967-9032-3b2cde1b7898"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:02:49.463793 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.463766    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eaec241-64f4-4967-9032-3b2cde1b7898-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "0eaec241-64f4-4967-9032-3b2cde1b7898" (UID: "0eaec241-64f4-4967-9032-3b2cde1b7898"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:02:49.465408 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.465373    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eaec241-64f4-4967-9032-3b2cde1b7898-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0eaec241-64f4-4967-9032-3b2cde1b7898" (UID: "0eaec241-64f4-4967-9032-3b2cde1b7898"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:02:49.465484 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.465469    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eaec241-64f4-4967-9032-3b2cde1b7898-kube-api-access-9vjl2" (OuterVolumeSpecName: "kube-api-access-9vjl2") pod "0eaec241-64f4-4967-9032-3b2cde1b7898" (UID: "0eaec241-64f4-4967-9032-3b2cde1b7898"). InnerVolumeSpecName "kube-api-access-9vjl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:02:49.564134 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.564097    2563 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0eaec241-64f4-4967-9032-3b2cde1b7898-kserve-provision-location\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:02:49.564134 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.564126    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0eaec241-64f4-4967-9032-3b2cde1b7898-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:02:49.564134 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.564138    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0eaec241-64f4-4967-9032-3b2cde1b7898-proxy-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:02:49.564382 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.564147    2563 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0eaec241-64f4-4967-9032-3b2cde1b7898-cabundle-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:02:49.564382 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.564156    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vjl2\" (UniqueName: \"kubernetes.io/projected/0eaec241-64f4-4967-9032-3b2cde1b7898-kube-api-access-9vjl2\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:02:49.751259 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.751221    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"]
Jul 13 19:02:49.757779 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:49.757755    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-858b494f9b-fn5bs"]
Jul 13 19:02:50.391684 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:50.391645    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" path="/var/lib/kubelet/pods/0eaec241-64f4-4967-9032-3b2cde1b7898/volumes"
Jul 13 19:02:52.377520 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:52.377482    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj" podUID="02a034a2-9bd0-4a84-bc95-7b4465fceb03" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:02:57.377116 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:57.377079    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj" podUID="02a034a2-9bd0-4a84-bc95-7b4465fceb03" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:02:57.377496 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:02:57.377183    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:03:02.377234 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:02.377192    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj" podUID="02a034a2-9bd0-4a84-bc95-7b4465fceb03" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:03:07.377787 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:07.377746    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj" podUID="02a034a2-9bd0-4a84-bc95-7b4465fceb03" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:03:08.762628 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.762590    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"]
Jul 13 19:03:08.762995 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.762922    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="storage-initializer"
Jul 13 19:03:08.762995 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.762933    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="storage-initializer"
Jul 13 19:03:08.762995 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.762942    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kube-rbac-proxy"
Jul 13 19:03:08.762995 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.762948    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kube-rbac-proxy"
Jul 13 19:03:08.762995 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.762962    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container"
Jul 13 19:03:08.762995 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.762968    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container"
Jul 13 19:03:08.763178 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.763024    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kube-rbac-proxy"
Jul 13 19:03:08.763178 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.763034    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eaec241-64f4-4967-9032-3b2cde1b7898" containerName="kserve-container"
Jul 13 19:03:08.766057 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.766039    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:03:08.768936 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.768910    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-91c3d-serving-cert\""
Jul 13 19:03:08.769044 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.768960    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-91c3d-kube-rbac-proxy-sar-config\""
Jul 13 19:03:08.777821 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.777794    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"]
Jul 13 19:03:08.820809 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.820766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edceb472-9edf-4aec-950f-ce7da19b2822-openshift-service-ca-bundle\") pod \"switch-graph-91c3d-58989656cf-jcztv\" (UID: \"edceb472-9edf-4aec-950f-ce7da19b2822\") " pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:03:08.820809 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.820812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edceb472-9edf-4aec-950f-ce7da19b2822-proxy-tls\") pod \"switch-graph-91c3d-58989656cf-jcztv\" (UID: \"edceb472-9edf-4aec-950f-ce7da19b2822\") " pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:03:08.922080 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.922036    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edceb472-9edf-4aec-950f-ce7da19b2822-openshift-service-ca-bundle\") pod \"switch-graph-91c3d-58989656cf-jcztv\" (UID: \"edceb472-9edf-4aec-950f-ce7da19b2822\") " pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:03:08.922307 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.922089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edceb472-9edf-4aec-950f-ce7da19b2822-proxy-tls\") pod \"switch-graph-91c3d-58989656cf-jcztv\" (UID: \"edceb472-9edf-4aec-950f-ce7da19b2822\") " pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:03:08.922307 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:03:08.922271    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-91c3d-serving-cert: secret "switch-graph-91c3d-serving-cert" not found
Jul 13 19:03:08.922435 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:03:08.922348    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edceb472-9edf-4aec-950f-ce7da19b2822-proxy-tls podName:edceb472-9edf-4aec-950f-ce7da19b2822 nodeName:}" failed. No retries permitted until 2026-07-13 19:03:09.422323032 +0000 UTC m=+755.662803950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/edceb472-9edf-4aec-950f-ce7da19b2822-proxy-tls") pod "switch-graph-91c3d-58989656cf-jcztv" (UID: "edceb472-9edf-4aec-950f-ce7da19b2822") : secret "switch-graph-91c3d-serving-cert" not found
Jul 13 19:03:08.922707 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:08.922685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edceb472-9edf-4aec-950f-ce7da19b2822-openshift-service-ca-bundle\") pod \"switch-graph-91c3d-58989656cf-jcztv\" (UID: \"edceb472-9edf-4aec-950f-ce7da19b2822\") " pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:03:09.426826 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:09.426779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edceb472-9edf-4aec-950f-ce7da19b2822-proxy-tls\") pod \"switch-graph-91c3d-58989656cf-jcztv\" (UID: \"edceb472-9edf-4aec-950f-ce7da19b2822\") " pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:03:09.429311 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:09.429289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edceb472-9edf-4aec-950f-ce7da19b2822-proxy-tls\") pod \"switch-graph-91c3d-58989656cf-jcztv\" (UID: \"edceb472-9edf-4aec-950f-ce7da19b2822\") " pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:03:09.677298 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:09.677177    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:03:09.812399 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:09.812365    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"]
Jul 13 19:03:09.815542 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:03:09.815516    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedceb472_9edf_4aec_950f_ce7da19b2822.slice/crio-f7cd075ccf112e393b77c04d64ea82dcc35eac10775b6f42b228a315637901b6 WatchSource:0}: Error finding container f7cd075ccf112e393b77c04d64ea82dcc35eac10775b6f42b228a315637901b6: Status 404 returned error can't find the container with id f7cd075ccf112e393b77c04d64ea82dcc35eac10775b6f42b228a315637901b6
Jul 13 19:03:10.523173 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:10.523134    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv" event={"ID":"edceb472-9edf-4aec-950f-ce7da19b2822","Type":"ContainerStarted","Data":"96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138"}
Jul 13 19:03:10.523371 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:10.523190    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv" event={"ID":"edceb472-9edf-4aec-950f-ce7da19b2822","Type":"ContainerStarted","Data":"f7cd075ccf112e393b77c04d64ea82dcc35eac10775b6f42b228a315637901b6"}
Jul 13 19:03:10.523371 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:10.523269    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:03:10.543890 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:10.543845    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv" podStartSLOduration=2.543830634 podStartE2EDuration="2.543830634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:03:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:03:10.542118009 +0000 UTC m=+756.782598967" watchObservedRunningTime="2026-07-13 19:03:10.543830634 +0000 UTC m=+756.784311572"
Jul 13 19:03:12.377840 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:12.377802    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj" podUID="02a034a2-9bd0-4a84-bc95-7b4465fceb03" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:03:14.544105 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:14.544064    2563 generic.go:356] "Generic (PLEG): container finished" podID="02a034a2-9bd0-4a84-bc95-7b4465fceb03" containerID="bcd3076b6e6fb8f71922c47209a2d2cf5c38f1e78d2f488953a548bbe5922f67" exitCode=0
Jul 13 19:03:14.544463 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:14.544133    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj" event={"ID":"02a034a2-9bd0-4a84-bc95-7b4465fceb03","Type":"ContainerDied","Data":"bcd3076b6e6fb8f71922c47209a2d2cf5c38f1e78d2f488953a548bbe5922f67"}
Jul 13 19:03:14.650158 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:14.650134    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:03:14.776270 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:14.776170    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/02a034a2-9bd0-4a84-bc95-7b4465fceb03-proxy-tls\") pod \"02a034a2-9bd0-4a84-bc95-7b4465fceb03\" (UID: \"02a034a2-9bd0-4a84-bc95-7b4465fceb03\") "
Jul 13 19:03:14.776417 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:14.776280    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02a034a2-9bd0-4a84-bc95-7b4465fceb03-openshift-service-ca-bundle\") pod \"02a034a2-9bd0-4a84-bc95-7b4465fceb03\" (UID: \"02a034a2-9bd0-4a84-bc95-7b4465fceb03\") "
Jul 13 19:03:14.776659 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:14.776629    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02a034a2-9bd0-4a84-bc95-7b4465fceb03-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "02a034a2-9bd0-4a84-bc95-7b4465fceb03" (UID: "02a034a2-9bd0-4a84-bc95-7b4465fceb03"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:03:14.778151 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:14.778134    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02a034a2-9bd0-4a84-bc95-7b4465fceb03-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "02a034a2-9bd0-4a84-bc95-7b4465fceb03" (UID: "02a034a2-9bd0-4a84-bc95-7b4465fceb03"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:03:14.877663 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:14.877627    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/02a034a2-9bd0-4a84-bc95-7b4465fceb03-proxy-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:03:14.877663 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:14.877657    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02a034a2-9bd0-4a84-bc95-7b4465fceb03-openshift-service-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:03:15.549522 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:15.549492    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"
Jul 13 19:03:15.549522 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:15.549508    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj" event={"ID":"02a034a2-9bd0-4a84-bc95-7b4465fceb03","Type":"ContainerDied","Data":"6f377d4f22db8f530be4d409ecc238bc594f9e846a3766a39c859a50863fa61d"}
Jul 13 19:03:15.550109 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:15.549572    2563 scope.go:117] "RemoveContainer" containerID="bcd3076b6e6fb8f71922c47209a2d2cf5c38f1e78d2f488953a548bbe5922f67"
Jul 13 19:03:15.571140 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:15.571107    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"]
Jul 13 19:03:15.575344 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:15.575309    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-667d9bc9cf-wnctj"]
Jul 13 19:03:16.386848 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:16.386812    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02a034a2-9bd0-4a84-bc95-7b4465fceb03" path="/var/lib/kubelet/pods/02a034a2-9bd0-4a84-bc95-7b4465fceb03/volumes"
Jul 13 19:03:16.533975 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:16.533948    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:03:44.723790 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.723754    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"]
Jul 13 19:03:44.724191 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.724068    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02a034a2-9bd0-4a84-bc95-7b4465fceb03" containerName="model-chainer"
Jul 13 19:03:44.724191 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.724079    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="02a034a2-9bd0-4a84-bc95-7b4465fceb03" containerName="model-chainer"
Jul 13 19:03:44.724191 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.724129    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="02a034a2-9bd0-4a84-bc95-7b4465fceb03" containerName="model-chainer"
Jul 13 19:03:44.728352 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.728334    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:03:44.731346 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.731325    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-3a16a-kube-rbac-proxy-sar-config\""
Jul 13 19:03:44.731602 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.731586    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-3a16a-serving-cert\""
Jul 13 19:03:44.738306 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.738284    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"]
Jul 13 19:03:44.817926 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.817887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-proxy-tls\") pod \"sequence-graph-3a16a-8677b985dd-w6wzw\" (UID: \"9a9a8421-cbda-4fe6-ab1f-7caae57d3179\") " pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:03:44.817926 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.817922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-openshift-service-ca-bundle\") pod \"sequence-graph-3a16a-8677b985dd-w6wzw\" (UID: \"9a9a8421-cbda-4fe6-ab1f-7caae57d3179\") " pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:03:44.918770 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.918582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-proxy-tls\") pod \"sequence-graph-3a16a-8677b985dd-w6wzw\" (UID: \"9a9a8421-cbda-4fe6-ab1f-7caae57d3179\") " pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:03:44.922283 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.919030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-openshift-service-ca-bundle\") pod \"sequence-graph-3a16a-8677b985dd-w6wzw\" (UID: \"9a9a8421-cbda-4fe6-ab1f-7caae57d3179\") " pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:03:44.922283 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:44.919795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-openshift-service-ca-bundle\") pod \"sequence-graph-3a16a-8677b985dd-w6wzw\" (UID: \"9a9a8421-cbda-4fe6-ab1f-7caae57d3179\") " pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:03:44.925009 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:03:44.924977    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-3a16a-serving-cert: secret "sequence-graph-3a16a-serving-cert" not found
Jul 13 19:03:44.925222 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:03:44.925205    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-proxy-tls podName:9a9a8421-cbda-4fe6-ab1f-7caae57d3179 nodeName:}" failed. No retries permitted until 2026-07-13 19:03:45.425054922 +0000 UTC m=+791.665535842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-proxy-tls") pod "sequence-graph-3a16a-8677b985dd-w6wzw" (UID: "9a9a8421-cbda-4fe6-ab1f-7caae57d3179") : secret "sequence-graph-3a16a-serving-cert" not found
Jul 13 19:03:45.523464 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:45.523427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-proxy-tls\") pod \"sequence-graph-3a16a-8677b985dd-w6wzw\" (UID: \"9a9a8421-cbda-4fe6-ab1f-7caae57d3179\") " pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:03:45.525942 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:45.525903    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-proxy-tls\") pod \"sequence-graph-3a16a-8677b985dd-w6wzw\" (UID: \"9a9a8421-cbda-4fe6-ab1f-7caae57d3179\") " pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:03:45.639856 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:45.639804    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:03:45.765057 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:45.765034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"]
Jul 13 19:03:45.767590 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:03:45.767561    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9a8421_cbda_4fe6_ab1f_7caae57d3179.slice/crio-e3abc0e2812308f5bfa591d1dfb1cc8d5ea0a0d76e65957205bfb9324877528a WatchSource:0}: Error finding container e3abc0e2812308f5bfa591d1dfb1cc8d5ea0a0d76e65957205bfb9324877528a: Status 404 returned error can't find the container with id e3abc0e2812308f5bfa591d1dfb1cc8d5ea0a0d76e65957205bfb9324877528a
Jul 13 19:03:46.683142 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:46.683102    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw" event={"ID":"9a9a8421-cbda-4fe6-ab1f-7caae57d3179","Type":"ContainerStarted","Data":"c8e9325e5f1754d089611995b7bb96730aceba20860171eaf2e52c30a7e3ed6e"}
Jul 13 19:03:46.683368 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:46.683160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw" event={"ID":"9a9a8421-cbda-4fe6-ab1f-7caae57d3179","Type":"ContainerStarted","Data":"e3abc0e2812308f5bfa591d1dfb1cc8d5ea0a0d76e65957205bfb9324877528a"}
Jul 13 19:03:46.683368 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:46.683215    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:03:46.702987 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:46.702941    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw" podStartSLOduration=2.70292601 podStartE2EDuration="2.70292601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:03:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:03:46.701570385 +0000 UTC m=+792.942051335" watchObservedRunningTime="2026-07-13 19:03:46.70292601 +0000 UTC m=+792.943406949"
Jul 13 19:03:52.694529 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:03:52.694499    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:05:34.169706 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:05:34.169627    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:05:34.171126 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:05:34.171104    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:10:34.193414 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:10:34.193374    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:10:34.195660 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:10:34.195636    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:11:23.428067 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:23.428028    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"]
Jul 13 19:11:23.428559 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:23.428273    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv" podUID="edceb472-9edf-4aec-950f-ce7da19b2822" containerName="switch-graph-91c3d" containerID="cri-o://96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138" gracePeriod=30
Jul 13 19:11:26.531659 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:26.531574    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv" podUID="edceb472-9edf-4aec-950f-ce7da19b2822" containerName="switch-graph-91c3d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:11:31.531542 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:31.531493    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv" podUID="edceb472-9edf-4aec-950f-ce7da19b2822" containerName="switch-graph-91c3d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:11:36.531216 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:36.531175    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv" podUID="edceb472-9edf-4aec-950f-ce7da19b2822" containerName="switch-graph-91c3d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:11:36.531612 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:36.531304    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:11:41.531308 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:41.531263    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv" podUID="edceb472-9edf-4aec-950f-ce7da19b2822" containerName="switch-graph-91c3d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:11:46.531512 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:46.531475    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv" podUID="edceb472-9edf-4aec-950f-ce7da19b2822" containerName="switch-graph-91c3d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:11:51.531761 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:51.531721    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv" podUID="edceb472-9edf-4aec-950f-ce7da19b2822" containerName="switch-graph-91c3d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:11:53.582368 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.582343    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:11:53.675160 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.675116    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edceb472-9edf-4aec-950f-ce7da19b2822-proxy-tls\") pod \"edceb472-9edf-4aec-950f-ce7da19b2822\" (UID: \"edceb472-9edf-4aec-950f-ce7da19b2822\") "
Jul 13 19:11:53.675384 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.675178    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edceb472-9edf-4aec-950f-ce7da19b2822-openshift-service-ca-bundle\") pod \"edceb472-9edf-4aec-950f-ce7da19b2822\" (UID: \"edceb472-9edf-4aec-950f-ce7da19b2822\") "
Jul 13 19:11:53.675585 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.675558    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edceb472-9edf-4aec-950f-ce7da19b2822-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "edceb472-9edf-4aec-950f-ce7da19b2822" (UID: "edceb472-9edf-4aec-950f-ce7da19b2822"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:11:53.677264 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.677231    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edceb472-9edf-4aec-950f-ce7da19b2822-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "edceb472-9edf-4aec-950f-ce7da19b2822" (UID: "edceb472-9edf-4aec-950f-ce7da19b2822"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:11:53.723817 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.723736    2563 generic.go:356] "Generic (PLEG): container finished" podID="edceb472-9edf-4aec-950f-ce7da19b2822" containerID="96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138" exitCode=0
Jul 13 19:11:53.723817 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.723781    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"
Jul 13 19:11:53.724025 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.723785    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv" event={"ID":"edceb472-9edf-4aec-950f-ce7da19b2822","Type":"ContainerDied","Data":"96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138"}
Jul 13 19:11:53.724025 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.723926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv" event={"ID":"edceb472-9edf-4aec-950f-ce7da19b2822","Type":"ContainerDied","Data":"f7cd075ccf112e393b77c04d64ea82dcc35eac10775b6f42b228a315637901b6"}
Jul 13 19:11:53.724025 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.723966    2563 scope.go:117] "RemoveContainer" containerID="96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138"
Jul 13 19:11:53.732949 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.732932    2563 scope.go:117] "RemoveContainer" containerID="96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138"
Jul 13 19:11:53.733190 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:11:53.733171    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138\": container with ID starting with 96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138 not found: ID does not exist" containerID="96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138"
Jul 13 19:11:53.733265 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.733202    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138"} err="failed to get container status \"96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138\": rpc error: code = NotFound desc = could not find container \"96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138\": container with ID starting with 96ca799eaab820e0639d353c2f816d4871c97b5891c6483eb130e991a246e138 not found: ID does not exist"
Jul 13 19:11:53.750598 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.750566    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"]
Jul 13 19:11:53.757731 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.757711    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-91c3d-58989656cf-jcztv"]
Jul 13 19:11:53.776109 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.776077    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edceb472-9edf-4aec-950f-ce7da19b2822-proxy-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:11:53.776109 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:53.776107    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edceb472-9edf-4aec-950f-ce7da19b2822-openshift-service-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:11:54.385476 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:54.385443    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edceb472-9edf-4aec-950f-ce7da19b2822" path="/var/lib/kubelet/pods/edceb472-9edf-4aec-950f-ce7da19b2822/volumes"
Jul 13 19:11:59.428579 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:59.428538    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"]
Jul 13 19:11:59.429026 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:11:59.428757    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw" podUID="9a9a8421-cbda-4fe6-ab1f-7caae57d3179" containerName="sequence-graph-3a16a" containerID="cri-o://c8e9325e5f1754d089611995b7bb96730aceba20860171eaf2e52c30a7e3ed6e" gracePeriod=30
Jul 13 19:12:02.692305 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:02.692264    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw" podUID="9a9a8421-cbda-4fe6-ab1f-7caae57d3179" containerName="sequence-graph-3a16a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:12:07.691853 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:07.691808    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw" podUID="9a9a8421-cbda-4fe6-ab1f-7caae57d3179" containerName="sequence-graph-3a16a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:12:12.691818 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:12.691777    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw" podUID="9a9a8421-cbda-4fe6-ab1f-7caae57d3179" containerName="sequence-graph-3a16a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:12:12.692288 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:12.691884    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:12:17.692164 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:17.692125    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw" podUID="9a9a8421-cbda-4fe6-ab1f-7caae57d3179" containerName="sequence-graph-3a16a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:12:22.691460 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:22.691419    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw" podUID="9a9a8421-cbda-4fe6-ab1f-7caae57d3179" containerName="sequence-graph-3a16a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:12:27.692448 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:27.692404    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw" podUID="9a9a8421-cbda-4fe6-ab1f-7caae57d3179" containerName="sequence-graph-3a16a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:12:29.889469 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:29.889438    2563 generic.go:356] "Generic (PLEG): container finished" podID="9a9a8421-cbda-4fe6-ab1f-7caae57d3179" containerID="c8e9325e5f1754d089611995b7bb96730aceba20860171eaf2e52c30a7e3ed6e" exitCode=0
Jul 13 19:12:29.889830 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:29.889486    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw" event={"ID":"9a9a8421-cbda-4fe6-ab1f-7caae57d3179","Type":"ContainerDied","Data":"c8e9325e5f1754d089611995b7bb96730aceba20860171eaf2e52c30a7e3ed6e"}
Jul 13 19:12:30.081280 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:30.081237    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:12:30.183093 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:30.183009    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-openshift-service-ca-bundle\") pod \"9a9a8421-cbda-4fe6-ab1f-7caae57d3179\" (UID: \"9a9a8421-cbda-4fe6-ab1f-7caae57d3179\") "
Jul 13 19:12:30.183240 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:30.183120    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-proxy-tls\") pod \"9a9a8421-cbda-4fe6-ab1f-7caae57d3179\" (UID: \"9a9a8421-cbda-4fe6-ab1f-7caae57d3179\") "
Jul 13 19:12:30.183493 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:30.183464    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "9a9a8421-cbda-4fe6-ab1f-7caae57d3179" (UID: "9a9a8421-cbda-4fe6-ab1f-7caae57d3179"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:12:30.185206 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:30.185182    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9a9a8421-cbda-4fe6-ab1f-7caae57d3179" (UID: "9a9a8421-cbda-4fe6-ab1f-7caae57d3179"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:12:30.283893 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:30.283840    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-proxy-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:12:30.283893 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:30.283888    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9a8421-cbda-4fe6-ab1f-7caae57d3179-openshift-service-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:12:30.895442 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:30.895404    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw" event={"ID":"9a9a8421-cbda-4fe6-ab1f-7caae57d3179","Type":"ContainerDied","Data":"e3abc0e2812308f5bfa591d1dfb1cc8d5ea0a0d76e65957205bfb9324877528a"}
Jul 13 19:12:30.895442 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:30.895442    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"
Jul 13 19:12:30.895932 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:30.895494    2563 scope.go:117] "RemoveContainer" containerID="c8e9325e5f1754d089611995b7bb96730aceba20860171eaf2e52c30a7e3ed6e"
Jul 13 19:12:30.911222 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:30.911197    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"]
Jul 13 19:12:30.914979 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:30.914957    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-3a16a-8677b985dd-w6wzw"]
Jul 13 19:12:32.386937 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:32.386902    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a9a8421-cbda-4fe6-ab1f-7caae57d3179" path="/var/lib/kubelet/pods/9a9a8421-cbda-4fe6-ab1f-7caae57d3179/volumes"
Jul 13 19:12:33.695354 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.695274    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"]
Jul 13 19:12:33.695691 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.695575    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9a8421-cbda-4fe6-ab1f-7caae57d3179" containerName="sequence-graph-3a16a"
Jul 13 19:12:33.695691 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.695586    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9a8421-cbda-4fe6-ab1f-7caae57d3179" containerName="sequence-graph-3a16a"
Jul 13 19:12:33.695691 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.695599    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edceb472-9edf-4aec-950f-ce7da19b2822" containerName="switch-graph-91c3d"
Jul 13 19:12:33.695691 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.695605    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="edceb472-9edf-4aec-950f-ce7da19b2822" containerName="switch-graph-91c3d"
Jul 13 19:12:33.695691 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.695669    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="edceb472-9edf-4aec-950f-ce7da19b2822" containerName="switch-graph-91c3d"
Jul 13 19:12:33.695691 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.695676    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9a8421-cbda-4fe6-ab1f-7caae57d3179" containerName="sequence-graph-3a16a"
Jul 13 19:12:33.698406 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.698387    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:12:33.701214 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.701192    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-68f71-kube-rbac-proxy-sar-config\""
Jul 13 19:12:33.701359 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.701192    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 13 19:12:33.701359 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.701272    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-68f71-serving-cert\""
Jul 13 19:12:33.702422 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.702395    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-98mz6\""
Jul 13 19:12:33.707807 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.707785    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"]
Jul 13 19:12:33.812524 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.812480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb-openshift-service-ca-bundle\") pod \"ensemble-graph-68f71-7fd665b646-ccjl8\" (UID: \"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb\") " pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:12:33.812524 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.812532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb-proxy-tls\") pod \"ensemble-graph-68f71-7fd665b646-ccjl8\" (UID: \"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb\") " pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:12:33.913628 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.913589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb-openshift-service-ca-bundle\") pod \"ensemble-graph-68f71-7fd665b646-ccjl8\" (UID: \"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb\") " pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:12:33.913628 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.913634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb-proxy-tls\") pod \"ensemble-graph-68f71-7fd665b646-ccjl8\" (UID: \"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb\") " pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:12:33.914308 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.914278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb-openshift-service-ca-bundle\") pod \"ensemble-graph-68f71-7fd665b646-ccjl8\" (UID: \"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb\") " pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:12:33.916149 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:33.916126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb-proxy-tls\") pod \"ensemble-graph-68f71-7fd665b646-ccjl8\" (UID: \"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb\") " pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:12:34.009810 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:34.009737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:12:34.143920 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:34.143871    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"]
Jul 13 19:12:34.146197 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:12:34.146171    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7baffbb_1ff1_4105_8ab8_5a9b7464f0cb.slice/crio-7f33709237452d75e8cd69d4ae56489bec2262c069f9b336ce13c24b49bf929c WatchSource:0}: Error finding container 7f33709237452d75e8cd69d4ae56489bec2262c069f9b336ce13c24b49bf929c: Status 404 returned error can't find the container with id 7f33709237452d75e8cd69d4ae56489bec2262c069f9b336ce13c24b49bf929c
Jul 13 19:12:34.913709 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:34.913674    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8" event={"ID":"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb","Type":"ContainerStarted","Data":"34e041a5f2a0944ff89d997fbf03377596888d16306ff4bfe245ff7aa1b1e8e9"}
Jul 13 19:12:34.914088 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:34.913727    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8" event={"ID":"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb","Type":"ContainerStarted","Data":"7f33709237452d75e8cd69d4ae56489bec2262c069f9b336ce13c24b49bf929c"}
Jul 13 19:12:34.914088 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:34.913780    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:12:34.930897 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:34.930845    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8" podStartSLOduration=1.930830751 podStartE2EDuration="1.930830751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:12:34.929720141 +0000 UTC m=+1321.170201079" watchObservedRunningTime="2026-07-13 19:12:34.930830751 +0000 UTC m=+1321.171311690"
Jul 13 19:12:40.924424 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:40.924390    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:12:43.759139 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:43.759107    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"]
Jul 13 19:12:43.759513 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:43.759322    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8" podUID="e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" containerName="ensemble-graph-68f71" containerID="cri-o://34e041a5f2a0944ff89d997fbf03377596888d16306ff4bfe245ff7aa1b1e8e9" gracePeriod=30
Jul 13 19:12:45.921764 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:45.921725    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8" podUID="e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" containerName="ensemble-graph-68f71" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:12:50.922069 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:50.922022    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8" podUID="e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" containerName="ensemble-graph-68f71" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:12:55.921319 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:55.921277    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8" podUID="e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" containerName="ensemble-graph-68f71" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:12:55.921712 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:12:55.921399    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:13:00.921654 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:00.921566    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8" podUID="e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" containerName="ensemble-graph-68f71" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:13:05.921859 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:05.921814    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8" podUID="e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" containerName="ensemble-graph-68f71" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:13:09.683548 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:09.683518    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"]
Jul 13 19:13:09.686436 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:09.686419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:09.689437 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:09.689414    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-e56dd-serving-cert\""
Jul 13 19:13:09.689969 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:09.689954    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-e56dd-kube-rbac-proxy-sar-config\""
Jul 13 19:13:09.703461 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:09.703440    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"]
Jul 13 19:13:09.814200 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:09.814158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/163b5bef-4979-4cf4-bf62-a69a29e99a80-openshift-service-ca-bundle\") pod \"sequence-graph-e56dd-5454f86ccd-qjtd2\" (UID: \"163b5bef-4979-4cf4-bf62-a69a29e99a80\") " pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:09.814395 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:09.814309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/163b5bef-4979-4cf4-bf62-a69a29e99a80-proxy-tls\") pod \"sequence-graph-e56dd-5454f86ccd-qjtd2\" (UID: \"163b5bef-4979-4cf4-bf62-a69a29e99a80\") " pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:09.915508 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:09.915473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/163b5bef-4979-4cf4-bf62-a69a29e99a80-proxy-tls\") pod \"sequence-graph-e56dd-5454f86ccd-qjtd2\" (UID: \"163b5bef-4979-4cf4-bf62-a69a29e99a80\") " pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:09.915676 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:09.915529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/163b5bef-4979-4cf4-bf62-a69a29e99a80-openshift-service-ca-bundle\") pod \"sequence-graph-e56dd-5454f86ccd-qjtd2\" (UID: \"163b5bef-4979-4cf4-bf62-a69a29e99a80\") " pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:09.916117 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:09.916089    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/163b5bef-4979-4cf4-bf62-a69a29e99a80-openshift-service-ca-bundle\") pod \"sequence-graph-e56dd-5454f86ccd-qjtd2\" (UID: \"163b5bef-4979-4cf4-bf62-a69a29e99a80\") " pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:09.918003 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:09.917979    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/163b5bef-4979-4cf4-bf62-a69a29e99a80-proxy-tls\") pod \"sequence-graph-e56dd-5454f86ccd-qjtd2\" (UID: \"163b5bef-4979-4cf4-bf62-a69a29e99a80\") " pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:09.996044 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:09.995945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:10.128240 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:10.128201    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"]
Jul 13 19:13:10.130460 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:13:10.130433    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163b5bef_4979_4cf4_bf62_a69a29e99a80.slice/crio-a1102c757cae3e9d1a76dae7eabcb1de48a206b83d6cc95580c831b8ec925756 WatchSource:0}: Error finding container a1102c757cae3e9d1a76dae7eabcb1de48a206b83d6cc95580c831b8ec925756: Status 404 returned error can't find the container with id a1102c757cae3e9d1a76dae7eabcb1de48a206b83d6cc95580c831b8ec925756
Jul 13 19:13:10.921867 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:10.921822    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8" podUID="e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" containerName="ensemble-graph-68f71" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:13:11.063164 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:11.063126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2" event={"ID":"163b5bef-4979-4cf4-bf62-a69a29e99a80","Type":"ContainerStarted","Data":"bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe"}
Jul 13 19:13:11.063344 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:11.063187    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2" event={"ID":"163b5bef-4979-4cf4-bf62-a69a29e99a80","Type":"ContainerStarted","Data":"a1102c757cae3e9d1a76dae7eabcb1de48a206b83d6cc95580c831b8ec925756"}
Jul 13 19:13:11.063344 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:11.063229    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:11.081600 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:11.081556    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2" podStartSLOduration=2.08154345 podStartE2EDuration="2.08154345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:13:11.080288721 +0000 UTC m=+1357.320769676" watchObservedRunningTime="2026-07-13 19:13:11.08154345 +0000 UTC m=+1357.322024388"
Jul 13 19:13:14.078363 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:14.078331    2563 generic.go:356] "Generic (PLEG): container finished" podID="e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" containerID="34e041a5f2a0944ff89d997fbf03377596888d16306ff4bfe245ff7aa1b1e8e9" exitCode=0
Jul 13 19:13:14.078722 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:14.078404    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8" event={"ID":"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb","Type":"ContainerDied","Data":"34e041a5f2a0944ff89d997fbf03377596888d16306ff4bfe245ff7aa1b1e8e9"}
Jul 13 19:13:14.402188 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:14.402165    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:13:14.557055 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:14.557017    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb-proxy-tls\") pod \"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb\" (UID: \"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb\") "
Jul 13 19:13:14.557221 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:14.557110    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb-openshift-service-ca-bundle\") pod \"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb\" (UID: \"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb\") "
Jul 13 19:13:14.557482 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:14.557459    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" (UID: "e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:13:14.559083 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:14.559061    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" (UID: "e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:13:14.658819 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:14.658735    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb-proxy-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:13:14.658819 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:14.658766    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb-openshift-service-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:13:15.082916 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:15.082888    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"
Jul 13 19:13:15.083316 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:15.082928    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8" event={"ID":"e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb","Type":"ContainerDied","Data":"7f33709237452d75e8cd69d4ae56489bec2262c069f9b336ce13c24b49bf929c"}
Jul 13 19:13:15.083316 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:15.082987    2563 scope.go:117] "RemoveContainer" containerID="34e041a5f2a0944ff89d997fbf03377596888d16306ff4bfe245ff7aa1b1e8e9"
Jul 13 19:13:15.103692 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:15.103662    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"]
Jul 13 19:13:15.107799 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:15.107774    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-68f71-7fd665b646-ccjl8"]
Jul 13 19:13:16.386267 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:16.386217    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" path="/var/lib/kubelet/pods/e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb/volumes"
Jul 13 19:13:17.074099 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:17.074067    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:19.765001 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:19.764971    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"]
Jul 13 19:13:19.765371 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:19.765139    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2" podUID="163b5bef-4979-4cf4-bf62-a69a29e99a80" containerName="sequence-graph-e56dd" containerID="cri-o://bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe" gracePeriod=30
Jul 13 19:13:22.073348 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:22.073306    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2" podUID="163b5bef-4979-4cf4-bf62-a69a29e99a80" containerName="sequence-graph-e56dd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:13:27.072673 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:27.072624    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2" podUID="163b5bef-4979-4cf4-bf62-a69a29e99a80" containerName="sequence-graph-e56dd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:13:32.072378 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:32.072341    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2" podUID="163b5bef-4979-4cf4-bf62-a69a29e99a80" containerName="sequence-graph-e56dd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:13:32.072933 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:32.072438    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:37.072259 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:37.072218    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2" podUID="163b5bef-4979-4cf4-bf62-a69a29e99a80" containerName="sequence-graph-e56dd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:13:42.071948 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:42.071905    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2" podUID="163b5bef-4979-4cf4-bf62-a69a29e99a80" containerName="sequence-graph-e56dd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:13:47.072503 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:47.072460    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2" podUID="163b5bef-4979-4cf4-bf62-a69a29e99a80" containerName="sequence-graph-e56dd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:13:49.908833 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:49.908806    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:49.943500 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:49.943464    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/163b5bef-4979-4cf4-bf62-a69a29e99a80-openshift-service-ca-bundle\") pod \"163b5bef-4979-4cf4-bf62-a69a29e99a80\" (UID: \"163b5bef-4979-4cf4-bf62-a69a29e99a80\") "
Jul 13 19:13:49.943653 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:49.943518    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/163b5bef-4979-4cf4-bf62-a69a29e99a80-proxy-tls\") pod \"163b5bef-4979-4cf4-bf62-a69a29e99a80\" (UID: \"163b5bef-4979-4cf4-bf62-a69a29e99a80\") "
Jul 13 19:13:49.943857 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:49.943835    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/163b5bef-4979-4cf4-bf62-a69a29e99a80-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "163b5bef-4979-4cf4-bf62-a69a29e99a80" (UID: "163b5bef-4979-4cf4-bf62-a69a29e99a80"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:13:49.945514 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:49.945488    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/163b5bef-4979-4cf4-bf62-a69a29e99a80-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "163b5bef-4979-4cf4-bf62-a69a29e99a80" (UID: "163b5bef-4979-4cf4-bf62-a69a29e99a80"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:13:50.044138 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:50.044059    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/163b5bef-4979-4cf4-bf62-a69a29e99a80-openshift-service-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:13:50.044138 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:50.044090    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/163b5bef-4979-4cf4-bf62-a69a29e99a80-proxy-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:13:50.238768 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:50.238739    2563 generic.go:356] "Generic (PLEG): container finished" podID="163b5bef-4979-4cf4-bf62-a69a29e99a80" containerID="bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe" exitCode=137
Jul 13 19:13:50.238931 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:50.238780    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"
Jul 13 19:13:50.238931 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:50.238815    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2" event={"ID":"163b5bef-4979-4cf4-bf62-a69a29e99a80","Type":"ContainerDied","Data":"bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe"}
Jul 13 19:13:50.238931 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:50.238868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2" event={"ID":"163b5bef-4979-4cf4-bf62-a69a29e99a80","Type":"ContainerDied","Data":"a1102c757cae3e9d1a76dae7eabcb1de48a206b83d6cc95580c831b8ec925756"}
Jul 13 19:13:50.238931 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:50.238891    2563 scope.go:117] "RemoveContainer" containerID="bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe"
Jul 13 19:13:50.247352 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:50.247337    2563 scope.go:117] "RemoveContainer" containerID="bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe"
Jul 13 19:13:50.247598 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:13:50.247578    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe\": container with ID starting with bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe not found: ID does not exist" containerID="bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe"
Jul 13 19:13:50.247663 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:50.247604    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe"} err="failed to get container status \"bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe\": rpc error: code = NotFound desc = could not find container \"bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe\": container with ID starting with bc6c6205055f3c659ccfac2a98dcd873d1d6472b329d677fe93345b15a1638fe not found: ID does not exist"
Jul 13 19:13:50.259024 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:50.259001    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"]
Jul 13 19:13:50.262521 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:50.262501    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e56dd-5454f86ccd-qjtd2"]
Jul 13 19:13:50.386395 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:50.386366    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="163b5bef-4979-4cf4-bf62-a69a29e99a80" path="/var/lib/kubelet/pods/163b5bef-4979-4cf4-bf62-a69a29e99a80/volumes"
Jul 13 19:13:54.024179 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.024139    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"]
Jul 13 19:13:54.024655 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.024629    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" containerName="ensemble-graph-68f71"
Jul 13 19:13:54.024726 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.024655    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" containerName="ensemble-graph-68f71"
Jul 13 19:13:54.024726 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.024701    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="163b5bef-4979-4cf4-bf62-a69a29e99a80" containerName="sequence-graph-e56dd"
Jul 13 19:13:54.024726 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.024710    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="163b5bef-4979-4cf4-bf62-a69a29e99a80" containerName="sequence-graph-e56dd"
Jul 13 19:13:54.024872 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.024790    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7baffbb-1ff1-4105-8ab8-5a9b7464f0cb" containerName="ensemble-graph-68f71"
Jul 13 19:13:54.024872 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.024802    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="163b5bef-4979-4cf4-bf62-a69a29e99a80" containerName="sequence-graph-e56dd"
Jul 13 19:13:54.029000 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.028978    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:13:54.031750 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.031724    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-ef1db-kube-rbac-proxy-sar-config\""
Jul 13 19:13:54.031864 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.031746    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-ef1db-serving-cert\""
Jul 13 19:13:54.031864 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.031729    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 13 19:13:54.032083 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.032069    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-98mz6\""
Jul 13 19:13:54.036189 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.035905    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"]
Jul 13 19:13:54.075588 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.075558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5366557b-9c65-4f41-baf7-3180fa856108-proxy-tls\") pod \"ensemble-graph-ef1db-6b8465b4f9-cdj45\" (UID: \"5366557b-9c65-4f41-baf7-3180fa856108\") " pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:13:54.075746 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.075642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5366557b-9c65-4f41-baf7-3180fa856108-openshift-service-ca-bundle\") pod \"ensemble-graph-ef1db-6b8465b4f9-cdj45\" (UID: \"5366557b-9c65-4f41-baf7-3180fa856108\") " pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:13:54.176940 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.176898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5366557b-9c65-4f41-baf7-3180fa856108-openshift-service-ca-bundle\") pod \"ensemble-graph-ef1db-6b8465b4f9-cdj45\" (UID: \"5366557b-9c65-4f41-baf7-3180fa856108\") " pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:13:54.176940 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.176950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5366557b-9c65-4f41-baf7-3180fa856108-proxy-tls\") pod \"ensemble-graph-ef1db-6b8465b4f9-cdj45\" (UID: \"5366557b-9c65-4f41-baf7-3180fa856108\") " pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:13:54.177648 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.177623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5366557b-9c65-4f41-baf7-3180fa856108-openshift-service-ca-bundle\") pod \"ensemble-graph-ef1db-6b8465b4f9-cdj45\" (UID: \"5366557b-9c65-4f41-baf7-3180fa856108\") " pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:13:54.179352 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.179321    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5366557b-9c65-4f41-baf7-3180fa856108-proxy-tls\") pod \"ensemble-graph-ef1db-6b8465b4f9-cdj45\" (UID: \"5366557b-9c65-4f41-baf7-3180fa856108\") " pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:13:54.340544 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.340516    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:13:54.473664 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:54.473640    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"]
Jul 13 19:13:54.475703 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:13:54.475673    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5366557b_9c65_4f41_baf7_3180fa856108.slice/crio-9ce1b7752c3228f019b69082d45db7f3226951aa45b5d4319e17b689d8098027 WatchSource:0}: Error finding container 9ce1b7752c3228f019b69082d45db7f3226951aa45b5d4319e17b689d8098027: Status 404 returned error can't find the container with id 9ce1b7752c3228f019b69082d45db7f3226951aa45b5d4319e17b689d8098027
Jul 13 19:13:55.261551 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:55.261515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45" event={"ID":"5366557b-9c65-4f41-baf7-3180fa856108","Type":"ContainerStarted","Data":"6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa"}
Jul 13 19:13:55.261914 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:55.261568    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45" event={"ID":"5366557b-9c65-4f41-baf7-3180fa856108","Type":"ContainerStarted","Data":"9ce1b7752c3228f019b69082d45db7f3226951aa45b5d4319e17b689d8098027"}
Jul 13 19:13:55.261914 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:55.261645    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:13:55.280883 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:13:55.280838    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45" podStartSLOduration=1.280824707 podStartE2EDuration="1.280824707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:13:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:13:55.278635513 +0000 UTC m=+1401.519116452" watchObservedRunningTime="2026-07-13 19:13:55.280824707 +0000 UTC m=+1401.521305646"
Jul 13 19:14:01.271448 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:01.271419    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:14:30.012911 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.012832    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"]
Jul 13 19:14:30.016554 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.016530    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:14:30.019529 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.019507    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-a68dc-serving-cert\""
Jul 13 19:14:30.019529 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.019517    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-a68dc-kube-rbac-proxy-sar-config\""
Jul 13 19:14:30.025673 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.025650    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"]
Jul 13 19:14:30.193810 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.193772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8-proxy-tls\") pod \"sequence-graph-a68dc-67db58c45f-v9xr8\" (UID: \"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8\") " pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:14:30.193982 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.193859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8-openshift-service-ca-bundle\") pod \"sequence-graph-a68dc-67db58c45f-v9xr8\" (UID: \"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8\") " pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:14:30.294883 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.294797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8-proxy-tls\") pod \"sequence-graph-a68dc-67db58c45f-v9xr8\" (UID: \"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8\") " pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:14:30.295021 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.294892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8-openshift-service-ca-bundle\") pod \"sequence-graph-a68dc-67db58c45f-v9xr8\" (UID: \"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8\") " pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:14:30.295534 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.295514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8-openshift-service-ca-bundle\") pod \"sequence-graph-a68dc-67db58c45f-v9xr8\" (UID: \"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8\") " pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:14:30.297206 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.297186    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8-proxy-tls\") pod \"sequence-graph-a68dc-67db58c45f-v9xr8\" (UID: \"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8\") " pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:14:30.327291 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.327238    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:14:30.463807 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:30.463779    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"]
Jul 13 19:14:30.466494 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:14:30.466468    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f763e5_4ef5_4fc3_bb39_73c0a36cb3e8.slice/crio-ecb1ce5759693a27e1a070077b977d772814a685119a112a4ac2bd424ced194e WatchSource:0}: Error finding container ecb1ce5759693a27e1a070077b977d772814a685119a112a4ac2bd424ced194e: Status 404 returned error can't find the container with id ecb1ce5759693a27e1a070077b977d772814a685119a112a4ac2bd424ced194e
Jul 13 19:14:31.412152 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:31.412117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8" event={"ID":"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8","Type":"ContainerStarted","Data":"231fab49642fd0755649544236c6fc77c7cbb1d73b5c2e75f86046de64890ca0"}
Jul 13 19:14:31.412542 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:31.412177    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8" event={"ID":"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8","Type":"ContainerStarted","Data":"ecb1ce5759693a27e1a070077b977d772814a685119a112a4ac2bd424ced194e"}
Jul 13 19:14:31.412542 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:31.412222    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:14:31.432274 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:31.432214    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8" podStartSLOduration=2.432200663 podStartE2EDuration="2.432200663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:14:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:14:31.431111209 +0000 UTC m=+1437.671592149" watchObservedRunningTime="2026-07-13 19:14:31.432200663 +0000 UTC m=+1437.672681601"
Jul 13 19:14:37.422055 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:14:37.422025    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:15:34.219065 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:15:34.219030    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:15:34.220456 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:15:34.220432    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:20:34.243663 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:20:34.243635    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:20:34.246317 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:20:34.246296    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:22:08.711591 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:08.711514    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"]
Jul 13 19:22:08.712054 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:08.711702    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45" podUID="5366557b-9c65-4f41-baf7-3180fa856108" containerName="ensemble-graph-ef1db" containerID="cri-o://6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa" gracePeriod=30
Jul 13 19:22:11.269845 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:11.269803    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45" podUID="5366557b-9c65-4f41-baf7-3180fa856108" containerName="ensemble-graph-ef1db" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:22:16.269840 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:16.269801    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45" podUID="5366557b-9c65-4f41-baf7-3180fa856108" containerName="ensemble-graph-ef1db" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:22:21.269512 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:21.269464    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45" podUID="5366557b-9c65-4f41-baf7-3180fa856108" containerName="ensemble-graph-ef1db" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:22:21.269985 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:21.269565    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:22:26.270047 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:26.270000    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45" podUID="5366557b-9c65-4f41-baf7-3180fa856108" containerName="ensemble-graph-ef1db" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:22:31.269728 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:31.269686    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45" podUID="5366557b-9c65-4f41-baf7-3180fa856108" containerName="ensemble-graph-ef1db" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:22:36.270088 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:36.270045    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45" podUID="5366557b-9c65-4f41-baf7-3180fa856108" containerName="ensemble-graph-ef1db" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:22:38.902864 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:38.902835    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:22:39.002563 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.002473    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5366557b-9c65-4f41-baf7-3180fa856108-proxy-tls\") pod \"5366557b-9c65-4f41-baf7-3180fa856108\" (UID: \"5366557b-9c65-4f41-baf7-3180fa856108\") "
Jul 13 19:22:39.002563 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.002544    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5366557b-9c65-4f41-baf7-3180fa856108-openshift-service-ca-bundle\") pod \"5366557b-9c65-4f41-baf7-3180fa856108\" (UID: \"5366557b-9c65-4f41-baf7-3180fa856108\") "
Jul 13 19:22:39.002929 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.002897    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5366557b-9c65-4f41-baf7-3180fa856108-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "5366557b-9c65-4f41-baf7-3180fa856108" (UID: "5366557b-9c65-4f41-baf7-3180fa856108"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:22:39.004552 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.004524    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5366557b-9c65-4f41-baf7-3180fa856108-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5366557b-9c65-4f41-baf7-3180fa856108" (UID: "5366557b-9c65-4f41-baf7-3180fa856108"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:22:39.103883 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.103848    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5366557b-9c65-4f41-baf7-3180fa856108-proxy-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:22:39.103883 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.103879    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5366557b-9c65-4f41-baf7-3180fa856108-openshift-service-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:22:39.442622 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.442589    2563 generic.go:356] "Generic (PLEG): container finished" podID="5366557b-9c65-4f41-baf7-3180fa856108" containerID="6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa" exitCode=0
Jul 13 19:22:39.442780 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.442635    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"
Jul 13 19:22:39.442780 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.442637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45" event={"ID":"5366557b-9c65-4f41-baf7-3180fa856108","Type":"ContainerDied","Data":"6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa"}
Jul 13 19:22:39.442780 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.442765    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45" event={"ID":"5366557b-9c65-4f41-baf7-3180fa856108","Type":"ContainerDied","Data":"9ce1b7752c3228f019b69082d45db7f3226951aa45b5d4319e17b689d8098027"}
Jul 13 19:22:39.442902 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.442797    2563 scope.go:117] "RemoveContainer" containerID="6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa"
Jul 13 19:22:39.451292 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.451268    2563 scope.go:117] "RemoveContainer" containerID="6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa"
Jul 13 19:22:39.451534 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:22:39.451515    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa\": container with ID starting with 6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa not found: ID does not exist" containerID="6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa"
Jul 13 19:22:39.451585 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.451541    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa"} err="failed to get container status \"6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa\": rpc error: code = NotFound desc = could not find container \"6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa\": container with ID starting with 6589d2a64fa1a3bee45dddc578fac798aad5e8be20787e9ea7ff946c1532e5aa not found: ID does not exist"
Jul 13 19:22:39.464329 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.464301    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"]
Jul 13 19:22:39.470361 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:39.470337    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ef1db-6b8465b4f9-cdj45"]
Jul 13 19:22:40.385875 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:40.385837    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5366557b-9c65-4f41-baf7-3180fa856108" path="/var/lib/kubelet/pods/5366557b-9c65-4f41-baf7-3180fa856108/volumes"
Jul 13 19:22:44.552935 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:44.552902    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"]
Jul 13 19:22:44.553405 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:44.553152    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8" podUID="78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" containerName="sequence-graph-a68dc" containerID="cri-o://231fab49642fd0755649544236c6fc77c7cbb1d73b5c2e75f86046de64890ca0" gracePeriod=30
Jul 13 19:22:47.420326 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:47.420288    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8" podUID="78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" containerName="sequence-graph-a68dc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:22:52.420175 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:52.420137    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8" podUID="78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" containerName="sequence-graph-a68dc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:22:57.420806 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:57.420764    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8" podUID="78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" containerName="sequence-graph-a68dc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:22:57.421271 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:22:57.420877    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:23:02.421127 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:02.421087    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8" podUID="78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" containerName="sequence-graph-a68dc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:23:07.421217 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:07.421175    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8" podUID="78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" containerName="sequence-graph-a68dc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:23:12.420882 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:12.420843    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8" podUID="78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" containerName="sequence-graph-a68dc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:23:14.592403 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:14.592370    2563 generic.go:356] "Generic (PLEG): container finished" podID="78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" containerID="231fab49642fd0755649544236c6fc77c7cbb1d73b5c2e75f86046de64890ca0" exitCode=0
Jul 13 19:23:14.592403 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:14.592410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8" event={"ID":"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8","Type":"ContainerDied","Data":"231fab49642fd0755649544236c6fc77c7cbb1d73b5c2e75f86046de64890ca0"}
Jul 13 19:23:14.703129 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:14.703101    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:23:14.804424 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:14.804390    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8-proxy-tls\") pod \"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8\" (UID: \"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8\") "
Jul 13 19:23:14.804591 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:14.804479    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8-openshift-service-ca-bundle\") pod \"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8\" (UID: \"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8\") "
Jul 13 19:23:14.804869 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:14.804841    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" (UID: "78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:23:14.806464 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:14.806409    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" (UID: "78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:23:14.905429 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:14.905390    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8-openshift-service-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:23:14.905429 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:14.905421    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8-proxy-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:23:15.598136 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:15.598102    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8" event={"ID":"78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8","Type":"ContainerDied","Data":"ecb1ce5759693a27e1a070077b977d772814a685119a112a4ac2bd424ced194e"}
Jul 13 19:23:15.598136 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:15.598136    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"
Jul 13 19:23:15.598659 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:15.598165    2563 scope.go:117] "RemoveContainer" containerID="231fab49642fd0755649544236c6fc77c7cbb1d73b5c2e75f86046de64890ca0"
Jul 13 19:23:15.624134 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:15.624091    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"]
Jul 13 19:23:15.625901 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:15.625875    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-a68dc-67db58c45f-v9xr8"]
Jul 13 19:23:16.385816 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:16.385776    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" path="/var/lib/kubelet/pods/78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8/volumes"
Jul 13 19:23:18.982323 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.982235    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"]
Jul 13 19:23:18.982689 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.982576    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5366557b-9c65-4f41-baf7-3180fa856108" containerName="ensemble-graph-ef1db"
Jul 13 19:23:18.982689 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.982587    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5366557b-9c65-4f41-baf7-3180fa856108" containerName="ensemble-graph-ef1db"
Jul 13 19:23:18.982689 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.982596    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" containerName="sequence-graph-a68dc"
Jul 13 19:23:18.982689 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.982602    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" containerName="sequence-graph-a68dc"
Jul 13 19:23:18.982689 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.982651    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="78f763e5-4ef5-4fc3-bb39-73c0a36cb3e8" containerName="sequence-graph-a68dc"
Jul 13 19:23:18.982689 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.982660    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5366557b-9c65-4f41-baf7-3180fa856108" containerName="ensemble-graph-ef1db"
Jul 13 19:23:18.986878 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.986861    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:18.989556 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.989535    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-b5afb-serving-cert\""
Jul 13 19:23:18.989776 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.989756    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-98mz6\""
Jul 13 19:23:18.989859 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.989805    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 13 19:23:18.990664 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.990646    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-b5afb-kube-rbac-proxy-sar-config\""
Jul 13 19:23:18.994122 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:18.993731    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"]
Jul 13 19:23:19.141661 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:19.141619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be353345-69fa-4cb7-a619-a0c29ba18c16-proxy-tls\") pod \"splitter-graph-b5afb-57fdcdd6c9-bwbw4\" (UID: \"be353345-69fa-4cb7-a619-a0c29ba18c16\") " pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:19.141835 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:19.141748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be353345-69fa-4cb7-a619-a0c29ba18c16-openshift-service-ca-bundle\") pod \"splitter-graph-b5afb-57fdcdd6c9-bwbw4\" (UID: \"be353345-69fa-4cb7-a619-a0c29ba18c16\") " pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:19.242327 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:19.242205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be353345-69fa-4cb7-a619-a0c29ba18c16-proxy-tls\") pod \"splitter-graph-b5afb-57fdcdd6c9-bwbw4\" (UID: \"be353345-69fa-4cb7-a619-a0c29ba18c16\") " pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:19.242673 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:19.242334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be353345-69fa-4cb7-a619-a0c29ba18c16-openshift-service-ca-bundle\") pod \"splitter-graph-b5afb-57fdcdd6c9-bwbw4\" (UID: \"be353345-69fa-4cb7-a619-a0c29ba18c16\") " pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:19.242937 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:19.242916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be353345-69fa-4cb7-a619-a0c29ba18c16-openshift-service-ca-bundle\") pod \"splitter-graph-b5afb-57fdcdd6c9-bwbw4\" (UID: \"be353345-69fa-4cb7-a619-a0c29ba18c16\") " pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:19.244692 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:19.244670    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be353345-69fa-4cb7-a619-a0c29ba18c16-proxy-tls\") pod \"splitter-graph-b5afb-57fdcdd6c9-bwbw4\" (UID: \"be353345-69fa-4cb7-a619-a0c29ba18c16\") " pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:19.298268 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:19.298219    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:19.427719 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:19.427690    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"]
Jul 13 19:23:19.430197 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:23:19.430171    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe353345_69fa_4cb7_a619_a0c29ba18c16.slice/crio-05a70d7a15087a6c61cfe9c5fcd1c0032d23944364f09778b4b0a050f10d8a21 WatchSource:0}: Error finding container 05a70d7a15087a6c61cfe9c5fcd1c0032d23944364f09778b4b0a050f10d8a21: Status 404 returned error can't find the container with id 05a70d7a15087a6c61cfe9c5fcd1c0032d23944364f09778b4b0a050f10d8a21
Jul 13 19:23:19.617988 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:19.617955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4" event={"ID":"be353345-69fa-4cb7-a619-a0c29ba18c16","Type":"ContainerStarted","Data":"f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1"}
Jul 13 19:23:19.618174 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:19.618004    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4" event={"ID":"be353345-69fa-4cb7-a619-a0c29ba18c16","Type":"ContainerStarted","Data":"05a70d7a15087a6c61cfe9c5fcd1c0032d23944364f09778b4b0a050f10d8a21"}
Jul 13 19:23:19.618174 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:19.618048    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:19.635454 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:19.635410    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4" podStartSLOduration=1.635396632 podStartE2EDuration="1.635396632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:23:19.634364991 +0000 UTC m=+1965.874845929" watchObservedRunningTime="2026-07-13 19:23:19.635396632 +0000 UTC m=+1965.875877570"
Jul 13 19:23:25.627635 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:25.627597    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:29.042679 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:29.042604    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"]
Jul 13 19:23:29.043095 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:29.042801    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4" podUID="be353345-69fa-4cb7-a619-a0c29ba18c16" containerName="splitter-graph-b5afb" containerID="cri-o://f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1" gracePeriod=30
Jul 13 19:23:30.626689 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:30.626637    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4" podUID="be353345-69fa-4cb7-a619-a0c29ba18c16" containerName="splitter-graph-b5afb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:23:35.625961 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:35.625917    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4" podUID="be353345-69fa-4cb7-a619-a0c29ba18c16" containerName="splitter-graph-b5afb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:23:40.626271 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:40.626201    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4" podUID="be353345-69fa-4cb7-a619-a0c29ba18c16" containerName="splitter-graph-b5afb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:23:40.626658 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:40.626336    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:45.626373 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:45.626330    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4" podUID="be353345-69fa-4cb7-a619-a0c29ba18c16" containerName="splitter-graph-b5afb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:23:50.626185 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:50.626140    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4" podUID="be353345-69fa-4cb7-a619-a0c29ba18c16" containerName="splitter-graph-b5afb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:23:54.804559 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:54.804518    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"]
Jul 13 19:23:54.807795 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:54.807772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:23:54.810226 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:54.810200    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-4dc86-serving-cert\""
Jul 13 19:23:54.810368 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:54.810232    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-4dc86-kube-rbac-proxy-sar-config\""
Jul 13 19:23:54.819540 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:54.819517    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"]
Jul 13 19:23:54.942335 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:54.942296    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf1ff38f-cd03-4bff-9c98-884d594241ae-openshift-service-ca-bundle\") pod \"switch-graph-4dc86-84fd9855bd-pgkxz\" (UID: \"bf1ff38f-cd03-4bff-9c98-884d594241ae\") " pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:23:54.942536 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:54.942401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bf1ff38f-cd03-4bff-9c98-884d594241ae-proxy-tls\") pod \"switch-graph-4dc86-84fd9855bd-pgkxz\" (UID: \"bf1ff38f-cd03-4bff-9c98-884d594241ae\") " pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:23:55.043579 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:55.043539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bf1ff38f-cd03-4bff-9c98-884d594241ae-proxy-tls\") pod \"switch-graph-4dc86-84fd9855bd-pgkxz\" (UID: \"bf1ff38f-cd03-4bff-9c98-884d594241ae\") " pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:23:55.043772 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:55.043607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf1ff38f-cd03-4bff-9c98-884d594241ae-openshift-service-ca-bundle\") pod \"switch-graph-4dc86-84fd9855bd-pgkxz\" (UID: \"bf1ff38f-cd03-4bff-9c98-884d594241ae\") " pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:23:55.043772 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:23:55.043709    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-4dc86-serving-cert: secret "switch-graph-4dc86-serving-cert" not found
Jul 13 19:23:55.043885 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:23:55.043788    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf1ff38f-cd03-4bff-9c98-884d594241ae-proxy-tls podName:bf1ff38f-cd03-4bff-9c98-884d594241ae nodeName:}" failed. No retries permitted until 2026-07-13 19:23:55.543764714 +0000 UTC m=+2001.784245631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/bf1ff38f-cd03-4bff-9c98-884d594241ae-proxy-tls") pod "switch-graph-4dc86-84fd9855bd-pgkxz" (UID: "bf1ff38f-cd03-4bff-9c98-884d594241ae") : secret "switch-graph-4dc86-serving-cert" not found
Jul 13 19:23:55.044228 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:55.044209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf1ff38f-cd03-4bff-9c98-884d594241ae-openshift-service-ca-bundle\") pod \"switch-graph-4dc86-84fd9855bd-pgkxz\" (UID: \"bf1ff38f-cd03-4bff-9c98-884d594241ae\") " pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:23:55.548401 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:55.548364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bf1ff38f-cd03-4bff-9c98-884d594241ae-proxy-tls\") pod \"switch-graph-4dc86-84fd9855bd-pgkxz\" (UID: \"bf1ff38f-cd03-4bff-9c98-884d594241ae\") " pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:23:55.550877 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:55.550842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bf1ff38f-cd03-4bff-9c98-884d594241ae-proxy-tls\") pod \"switch-graph-4dc86-84fd9855bd-pgkxz\" (UID: \"bf1ff38f-cd03-4bff-9c98-884d594241ae\") " pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:23:55.626500 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:55.626460    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4" podUID="be353345-69fa-4cb7-a619-a0c29ba18c16" containerName="splitter-graph-b5afb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:23:55.717612 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:55.717578    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:23:55.842478 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:55.842445    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"]
Jul 13 19:23:55.845296 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:23:55.845269    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf1ff38f_cd03_4bff_9c98_884d594241ae.slice/crio-c17feffd12465177f1d29954995dbd80243d52e14a0d5e7fbf5be17b3c6f2120 WatchSource:0}: Error finding container c17feffd12465177f1d29954995dbd80243d52e14a0d5e7fbf5be17b3c6f2120: Status 404 returned error can't find the container with id c17feffd12465177f1d29954995dbd80243d52e14a0d5e7fbf5be17b3c6f2120
Jul 13 19:23:56.773652 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:56.773612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz" event={"ID":"bf1ff38f-cd03-4bff-9c98-884d594241ae","Type":"ContainerStarted","Data":"2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17"}
Jul 13 19:23:56.773911 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:56.773664    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz" event={"ID":"bf1ff38f-cd03-4bff-9c98-884d594241ae","Type":"ContainerStarted","Data":"c17feffd12465177f1d29954995dbd80243d52e14a0d5e7fbf5be17b3c6f2120"}
Jul 13 19:23:56.773911 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:56.773733    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:23:56.793017 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:56.792945    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz" podStartSLOduration=2.792930864 podStartE2EDuration="2.792930864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:23:56.791692504 +0000 UTC m=+2003.032173443" watchObservedRunningTime="2026-07-13 19:23:56.792930864 +0000 UTC m=+2003.033411802"
Jul 13 19:23:59.187206 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.187177    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:59.279828 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.279789    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be353345-69fa-4cb7-a619-a0c29ba18c16-proxy-tls\") pod \"be353345-69fa-4cb7-a619-a0c29ba18c16\" (UID: \"be353345-69fa-4cb7-a619-a0c29ba18c16\") "
Jul 13 19:23:59.279828 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.279830    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be353345-69fa-4cb7-a619-a0c29ba18c16-openshift-service-ca-bundle\") pod \"be353345-69fa-4cb7-a619-a0c29ba18c16\" (UID: \"be353345-69fa-4cb7-a619-a0c29ba18c16\") "
Jul 13 19:23:59.280254 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.280219    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be353345-69fa-4cb7-a619-a0c29ba18c16-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "be353345-69fa-4cb7-a619-a0c29ba18c16" (UID: "be353345-69fa-4cb7-a619-a0c29ba18c16"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:23:59.281858 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.281839    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be353345-69fa-4cb7-a619-a0c29ba18c16-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "be353345-69fa-4cb7-a619-a0c29ba18c16" (UID: "be353345-69fa-4cb7-a619-a0c29ba18c16"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:23:59.381151 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.381122    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be353345-69fa-4cb7-a619-a0c29ba18c16-proxy-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:23:59.381151 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.381146    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be353345-69fa-4cb7-a619-a0c29ba18c16-openshift-service-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:23:59.788484 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.788393    2563 generic.go:356] "Generic (PLEG): container finished" podID="be353345-69fa-4cb7-a619-a0c29ba18c16" containerID="f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1" exitCode=0
Jul 13 19:23:59.788484 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.788437    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"
Jul 13 19:23:59.788484 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.788464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4" event={"ID":"be353345-69fa-4cb7-a619-a0c29ba18c16","Type":"ContainerDied","Data":"f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1"}
Jul 13 19:23:59.788764 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.788514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4" event={"ID":"be353345-69fa-4cb7-a619-a0c29ba18c16","Type":"ContainerDied","Data":"05a70d7a15087a6c61cfe9c5fcd1c0032d23944364f09778b4b0a050f10d8a21"}
Jul 13 19:23:59.788764 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.788542    2563 scope.go:117] "RemoveContainer" containerID="f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1"
Jul 13 19:23:59.796758 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.796741    2563 scope.go:117] "RemoveContainer" containerID="f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1"
Jul 13 19:23:59.797029 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:23:59.797010    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1\": container with ID starting with f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1 not found: ID does not exist" containerID="f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1"
Jul 13 19:23:59.797076 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.797035    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1"} err="failed to get container status \"f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1\": rpc error: code = NotFound desc = could not find container \"f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1\": container with ID starting with f1100f25d97a1c9d88a20dd67b055b57e7965d4aff0b2faeedeefc2d3eca62b1 not found: ID does not exist"
Jul 13 19:23:59.810167 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.810140    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"]
Jul 13 19:23:59.814270 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:23:59.814236    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b5afb-57fdcdd6c9-bwbw4"]
Jul 13 19:24:00.385834 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:00.385804    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be353345-69fa-4cb7-a619-a0c29ba18c16" path="/var/lib/kubelet/pods/be353345-69fa-4cb7-a619-a0c29ba18c16/volumes"
Jul 13 19:24:02.784459 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:02.784430    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:24:39.317904 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.317866    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"]
Jul 13 19:24:39.318515 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.318178    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be353345-69fa-4cb7-a619-a0c29ba18c16" containerName="splitter-graph-b5afb"
Jul 13 19:24:39.318515 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.318190    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="be353345-69fa-4cb7-a619-a0c29ba18c16" containerName="splitter-graph-b5afb"
Jul 13 19:24:39.318515 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.318274    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="be353345-69fa-4cb7-a619-a0c29ba18c16" containerName="splitter-graph-b5afb"
Jul 13 19:24:39.321047 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.321028    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:24:39.323719 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.323692    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-08823-serving-cert\""
Jul 13 19:24:39.324063 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.324047    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-08823-kube-rbac-proxy-sar-config\""
Jul 13 19:24:39.330917 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.330893    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"]
Jul 13 19:24:39.399036 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.399000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40973dff-2d0b-4bf8-98f2-5d680018d5cd-openshift-service-ca-bundle\") pod \"splitter-graph-08823-79fbf9cdc-w6qzn\" (UID: \"40973dff-2d0b-4bf8-98f2-5d680018d5cd\") " pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:24:39.399036 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.399041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/40973dff-2d0b-4bf8-98f2-5d680018d5cd-proxy-tls\") pod \"splitter-graph-08823-79fbf9cdc-w6qzn\" (UID: \"40973dff-2d0b-4bf8-98f2-5d680018d5cd\") " pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:24:39.499751 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.499718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40973dff-2d0b-4bf8-98f2-5d680018d5cd-openshift-service-ca-bundle\") pod \"splitter-graph-08823-79fbf9cdc-w6qzn\" (UID: \"40973dff-2d0b-4bf8-98f2-5d680018d5cd\") " pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:24:39.499751 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.499756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/40973dff-2d0b-4bf8-98f2-5d680018d5cd-proxy-tls\") pod \"splitter-graph-08823-79fbf9cdc-w6qzn\" (UID: \"40973dff-2d0b-4bf8-98f2-5d680018d5cd\") " pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:24:39.500369 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.500348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40973dff-2d0b-4bf8-98f2-5d680018d5cd-openshift-service-ca-bundle\") pod \"splitter-graph-08823-79fbf9cdc-w6qzn\" (UID: \"40973dff-2d0b-4bf8-98f2-5d680018d5cd\") " pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:24:39.502228 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.502206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/40973dff-2d0b-4bf8-98f2-5d680018d5cd-proxy-tls\") pod \"splitter-graph-08823-79fbf9cdc-w6qzn\" (UID: \"40973dff-2d0b-4bf8-98f2-5d680018d5cd\") " pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:24:39.632438 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.632331    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:24:39.761235 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.761171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"]
Jul 13 19:24:39.763493 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:24:39.763462    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40973dff_2d0b_4bf8_98f2_5d680018d5cd.slice/crio-27bef71b237eb5c48526465d5952cbfcf746ab72e901c2b592f5a2c3ca0dc052 WatchSource:0}: Error finding container 27bef71b237eb5c48526465d5952cbfcf746ab72e901c2b592f5a2c3ca0dc052: Status 404 returned error can't find the container with id 27bef71b237eb5c48526465d5952cbfcf746ab72e901c2b592f5a2c3ca0dc052
Jul 13 19:24:39.964367 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.964272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn" event={"ID":"40973dff-2d0b-4bf8-98f2-5d680018d5cd","Type":"ContainerStarted","Data":"fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce"}
Jul 13 19:24:39.964367 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.964327    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn" event={"ID":"40973dff-2d0b-4bf8-98f2-5d680018d5cd","Type":"ContainerStarted","Data":"27bef71b237eb5c48526465d5952cbfcf746ab72e901c2b592f5a2c3ca0dc052"}
Jul 13 19:24:39.964552 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.964367    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:24:39.982768 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:39.982720    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn" podStartSLOduration=0.982705315 podStartE2EDuration="982.705315ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:24:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:24:39.982339407 +0000 UTC m=+2046.222820346" watchObservedRunningTime="2026-07-13 19:24:39.982705315 +0000 UTC m=+2046.223186254"
Jul 13 19:24:45.975327 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:24:45.975298    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:25:34.276744 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:25:34.276714    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:25:34.280263 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:25:34.280232    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:30:34.301472 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:30:34.301440    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:30:34.305569 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:30:34.305545    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:32:53.958605 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:32:53.958533    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"]
Jul 13 19:32:53.959086 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:32:53.958765    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn" podUID="40973dff-2d0b-4bf8-98f2-5d680018d5cd" containerName="splitter-graph-08823" containerID="cri-o://fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce" gracePeriod=30
Jul 13 19:32:55.973213 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:32:55.973176    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn" podUID="40973dff-2d0b-4bf8-98f2-5d680018d5cd" containerName="splitter-graph-08823" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:33:00.973133 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:00.973093    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn" podUID="40973dff-2d0b-4bf8-98f2-5d680018d5cd" containerName="splitter-graph-08823" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:33:05.973572 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:05.973527    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn" podUID="40973dff-2d0b-4bf8-98f2-5d680018d5cd" containerName="splitter-graph-08823" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:33:05.974028 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:05.973648    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:33:10.973073 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:10.973030    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn" podUID="40973dff-2d0b-4bf8-98f2-5d680018d5cd" containerName="splitter-graph-08823" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:33:15.973150 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:15.973110    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn" podUID="40973dff-2d0b-4bf8-98f2-5d680018d5cd" containerName="splitter-graph-08823" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:33:20.973682 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:20.973631    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn" podUID="40973dff-2d0b-4bf8-98f2-5d680018d5cd" containerName="splitter-graph-08823" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:33:24.114283 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.114238    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:33:24.153427 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.153390    2563 generic.go:356] "Generic (PLEG): container finished" podID="40973dff-2d0b-4bf8-98f2-5d680018d5cd" containerID="fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce" exitCode=0
Jul 13 19:33:24.153619 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.153441    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"
Jul 13 19:33:24.153619 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.153472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn" event={"ID":"40973dff-2d0b-4bf8-98f2-5d680018d5cd","Type":"ContainerDied","Data":"fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce"}
Jul 13 19:33:24.153619 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.153533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn" event={"ID":"40973dff-2d0b-4bf8-98f2-5d680018d5cd","Type":"ContainerDied","Data":"27bef71b237eb5c48526465d5952cbfcf746ab72e901c2b592f5a2c3ca0dc052"}
Jul 13 19:33:24.153619 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.153561    2563 scope.go:117] "RemoveContainer" containerID="fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce"
Jul 13 19:33:24.161726 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.161709    2563 scope.go:117] "RemoveContainer" containerID="fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce"
Jul 13 19:33:24.161985 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:33:24.161966    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce\": container with ID starting with fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce not found: ID does not exist" containerID="fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce"
Jul 13 19:33:24.162050 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.161995    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce"} err="failed to get container status \"fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce\": rpc error: code = NotFound desc = could not find container \"fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce\": container with ID starting with fd2a2206870dea595486c70d1947badf2318fb417c8452154d19e20ff0494dce not found: ID does not exist"
Jul 13 19:33:24.234825 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.234743    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/40973dff-2d0b-4bf8-98f2-5d680018d5cd-proxy-tls\") pod \"40973dff-2d0b-4bf8-98f2-5d680018d5cd\" (UID: \"40973dff-2d0b-4bf8-98f2-5d680018d5cd\") "
Jul 13 19:33:24.234825 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.234810    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40973dff-2d0b-4bf8-98f2-5d680018d5cd-openshift-service-ca-bundle\") pod \"40973dff-2d0b-4bf8-98f2-5d680018d5cd\" (UID: \"40973dff-2d0b-4bf8-98f2-5d680018d5cd\") "
Jul 13 19:33:24.235142 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.235117    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40973dff-2d0b-4bf8-98f2-5d680018d5cd-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "40973dff-2d0b-4bf8-98f2-5d680018d5cd" (UID: "40973dff-2d0b-4bf8-98f2-5d680018d5cd"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:33:24.236813 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.236787    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40973dff-2d0b-4bf8-98f2-5d680018d5cd-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "40973dff-2d0b-4bf8-98f2-5d680018d5cd" (UID: "40973dff-2d0b-4bf8-98f2-5d680018d5cd"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:33:24.336400 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.336363    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/40973dff-2d0b-4bf8-98f2-5d680018d5cd-proxy-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:33:24.336400 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.336394    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40973dff-2d0b-4bf8-98f2-5d680018d5cd-openshift-service-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:33:24.468903 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.468872    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"]
Jul 13 19:33:24.475101 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:24.475074    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-08823-79fbf9cdc-w6qzn"]
Jul 13 19:33:26.386114 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:33:26.386071    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40973dff-2d0b-4bf8-98f2-5d680018d5cd" path="/var/lib/kubelet/pods/40973dff-2d0b-4bf8-98f2-5d680018d5cd/volumes"
Jul 13 19:35:34.325135 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:35:34.325104    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:35:34.336446 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:35:34.336419    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:40:14.233612 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:14.233535    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"]
Jul 13 19:40:14.234123 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:14.233783    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz" podUID="bf1ff38f-cd03-4bff-9c98-884d594241ae" containerName="switch-graph-4dc86" containerID="cri-o://2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17" gracePeriod=30
Jul 13 19:40:17.782555 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:17.782514    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz" podUID="bf1ff38f-cd03-4bff-9c98-884d594241ae" containerName="switch-graph-4dc86" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:40:22.782564 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:22.782525    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz" podUID="bf1ff38f-cd03-4bff-9c98-884d594241ae" containerName="switch-graph-4dc86" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:40:27.783195 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:27.783152    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz" podUID="bf1ff38f-cd03-4bff-9c98-884d594241ae" containerName="switch-graph-4dc86" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:40:27.783622 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:27.783266    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:40:30.663894 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:30.663861    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:31.517861 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:31.517822    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:32.357231 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:32.357203    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:32.782494 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:32.782403    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz" podUID="bf1ff38f-cd03-4bff-9c98-884d594241ae" containerName="switch-graph-4dc86" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:40:33.145316 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:33.145285    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:33.932640 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:33.932610    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:34.354444 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:34.354329    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:40:34.361393 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:34.360875    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:40:34.729659 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:34.729585    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:35.538288 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:35.538238    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:36.319543 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:36.319512    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:37.127420 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:37.127392    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:37.782396 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:37.782355    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz" podUID="bf1ff38f-cd03-4bff-9c98-884d594241ae" containerName="switch-graph-4dc86" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:40:37.920545 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:37.920511    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:38.732599 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:38.732568    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:39.535841 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:39.535809    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:40.344410 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:40.344377    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:41.145881 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:41.145851    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-4dc86-84fd9855bd-pgkxz_bf1ff38f-cd03-4bff-9c98-884d594241ae/switch-graph-4dc86/0.log"
Jul 13 19:40:42.782747 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:42.782704    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz" podUID="bf1ff38f-cd03-4bff-9c98-884d594241ae" containerName="switch-graph-4dc86" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:40:44.378818 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.378793    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:40:44.499678 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.499589    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bf1ff38f-cd03-4bff-9c98-884d594241ae-proxy-tls\") pod \"bf1ff38f-cd03-4bff-9c98-884d594241ae\" (UID: \"bf1ff38f-cd03-4bff-9c98-884d594241ae\") "
Jul 13 19:40:44.499678 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.499653    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf1ff38f-cd03-4bff-9c98-884d594241ae-openshift-service-ca-bundle\") pod \"bf1ff38f-cd03-4bff-9c98-884d594241ae\" (UID: \"bf1ff38f-cd03-4bff-9c98-884d594241ae\") "
Jul 13 19:40:44.499995 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.499968    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf1ff38f-cd03-4bff-9c98-884d594241ae-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "bf1ff38f-cd03-4bff-9c98-884d594241ae" (UID: "bf1ff38f-cd03-4bff-9c98-884d594241ae"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:40:44.501742 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.501716    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf1ff38f-cd03-4bff-9c98-884d594241ae-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bf1ff38f-cd03-4bff-9c98-884d594241ae" (UID: "bf1ff38f-cd03-4bff-9c98-884d594241ae"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:40:44.600628 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.600586    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf1ff38f-cd03-4bff-9c98-884d594241ae-openshift-service-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:40:44.600628 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.600620    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bf1ff38f-cd03-4bff-9c98-884d594241ae-proxy-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 19:40:44.973504 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.973468    2563 generic.go:356] "Generic (PLEG): container finished" podID="bf1ff38f-cd03-4bff-9c98-884d594241ae" containerID="2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17" exitCode=0
Jul 13 19:40:44.973736 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.973516    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz" event={"ID":"bf1ff38f-cd03-4bff-9c98-884d594241ae","Type":"ContainerDied","Data":"2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17"}
Jul 13 19:40:44.973736 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.973528    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"
Jul 13 19:40:44.973736 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.973573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz" event={"ID":"bf1ff38f-cd03-4bff-9c98-884d594241ae","Type":"ContainerDied","Data":"c17feffd12465177f1d29954995dbd80243d52e14a0d5e7fbf5be17b3c6f2120"}
Jul 13 19:40:44.973736 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.973602    2563 scope.go:117] "RemoveContainer" containerID="2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17"
Jul 13 19:40:44.982022 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.982005    2563 scope.go:117] "RemoveContainer" containerID="2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17"
Jul 13 19:40:44.982302 ip-10-0-137-93 kubenswrapper[2563]: E0713 19:40:44.982283    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17\": container with ID starting with 2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17 not found: ID does not exist" containerID="2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17"
Jul 13 19:40:44.982351 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.982311    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17"} err="failed to get container status \"2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17\": rpc error: code = NotFound desc = could not find container \"2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17\": container with ID starting with 2152c4a405e6087a8ecb1122f0131a5c3a0f707847e2d8f97336bdb8beb80e17 not found: ID does not exist"
Jul 13 19:40:44.993787 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.993765    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"]
Jul 13 19:40:44.999494 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:44.999468    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4dc86-84fd9855bd-pgkxz"]
Jul 13 19:40:46.385656 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:46.385626    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf1ff38f-cd03-4bff-9c98-884d594241ae" path="/var/lib/kubelet/pods/bf1ff38f-cd03-4bff-9c98-884d594241ae/volumes"
Jul 13 19:40:49.036584 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:49.036552    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jk8fj_d737860c-a9d2-4449-8efd-0e657689675d/global-pull-secret-syncer/0.log"
Jul 13 19:40:49.162505 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:49.162472    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q9p6z_7e8ac0fb-625e-4dfc-9d02-04b7b6a6bd42/konnectivity-agent/0.log"
Jul 13 19:40:49.260894 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:49.260858    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-93.ec2.internal_eda63208df358e0e9bf9d712ad8f74a0/haproxy/0.log"
Jul 13 19:40:53.659526 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:53.659493    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e61fc0c5-d0c8-4712-8432-95cbe36fe2f2/alertmanager/0.log"
Jul 13 19:40:53.690371 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:53.690349    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e61fc0c5-d0c8-4712-8432-95cbe36fe2f2/config-reloader/0.log"
Jul 13 19:40:53.715966 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:53.715942    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e61fc0c5-d0c8-4712-8432-95cbe36fe2f2/kube-rbac-proxy-web/0.log"
Jul 13 19:40:53.738880 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:53.738858    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e61fc0c5-d0c8-4712-8432-95cbe36fe2f2/kube-rbac-proxy/0.log"
Jul 13 19:40:53.761624 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:53.761600    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e61fc0c5-d0c8-4712-8432-95cbe36fe2f2/kube-rbac-proxy-metric/0.log"
Jul 13 19:40:53.784742 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:53.784722    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e61fc0c5-d0c8-4712-8432-95cbe36fe2f2/prom-label-proxy/0.log"
Jul 13 19:40:53.809676 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:53.809656    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e61fc0c5-d0c8-4712-8432-95cbe36fe2f2/init-config-reloader/0.log"
Jul 13 19:40:54.224686 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:54.224660    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kblj_df044b2e-c67e-4113-a84c-30d111af07fe/node-exporter/0.log"
Jul 13 19:40:54.247622 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:54.247595    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kblj_df044b2e-c67e-4113-a84c-30d111af07fe/kube-rbac-proxy/0.log"
Jul 13 19:40:54.268909 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:54.268887    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kblj_df044b2e-c67e-4113-a84c-30d111af07fe/init-textfile/0.log"
Jul 13 19:40:54.737907 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:54.737878    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-frxh5_fece8507-e2e2-4fba-8ae7-c045824593ac/prometheus-operator/0.log"
Jul 13 19:40:54.757231 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:54.757211    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-frxh5_fece8507-e2e2-4fba-8ae7-c045824593ac/kube-rbac-proxy/0.log"
Jul 13 19:40:57.123912 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.123884    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"]
Jul 13 19:40:57.124308 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.124177    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf1ff38f-cd03-4bff-9c98-884d594241ae" containerName="switch-graph-4dc86"
Jul 13 19:40:57.124308 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.124187    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf1ff38f-cd03-4bff-9c98-884d594241ae" containerName="switch-graph-4dc86"
Jul 13 19:40:57.124308 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.124201    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40973dff-2d0b-4bf8-98f2-5d680018d5cd" containerName="splitter-graph-08823"
Jul 13 19:40:57.124308 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.124207    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="40973dff-2d0b-4bf8-98f2-5d680018d5cd" containerName="splitter-graph-08823"
Jul 13 19:40:57.124308 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.124276    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="40973dff-2d0b-4bf8-98f2-5d680018d5cd" containerName="splitter-graph-08823"
Jul 13 19:40:57.124308 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.124290    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf1ff38f-cd03-4bff-9c98-884d594241ae" containerName="switch-graph-4dc86"
Jul 13 19:40:57.127414 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.127395    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.130087 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.130049    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qwzz7\"/\"openshift-service-ca.crt\""
Jul 13 19:40:57.130220 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.130100    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qwzz7\"/\"kube-root-ca.crt\""
Jul 13 19:40:57.131376 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.131357    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qwzz7\"/\"default-dockercfg-6c7xb\""
Jul 13 19:40:57.138388 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.138361    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"]
Jul 13 19:40:57.199892 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.199869    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d44d44f8c-x9fdd_9e1257ed-af6c-4039-9925-d53f89879698/console/0.log"
Jul 13 19:40:57.206226 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.206203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e8a0380-b22b-4e96-978a-d37c14f6e10e-sys\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.206351 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.206241    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4e8a0380-b22b-4e96-978a-d37c14f6e10e-podres\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.206351 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.206276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4e8a0380-b22b-4e96-978a-d37c14f6e10e-proc\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.206351 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.206322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e8a0380-b22b-4e96-978a-d37c14f6e10e-lib-modules\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.206453 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.206388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4sxw\" (UniqueName: \"kubernetes.io/projected/4e8a0380-b22b-4e96-978a-d37c14f6e10e-kube-api-access-f4sxw\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.307178 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.307145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e8a0380-b22b-4e96-978a-d37c14f6e10e-sys\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.307376 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.307187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4e8a0380-b22b-4e96-978a-d37c14f6e10e-podres\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.307376 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.307215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4e8a0380-b22b-4e96-978a-d37c14f6e10e-proc\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.307376 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.307266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e8a0380-b22b-4e96-978a-d37c14f6e10e-lib-modules\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.307376 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.307290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e8a0380-b22b-4e96-978a-d37c14f6e10e-sys\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.307376 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.307340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4sxw\" (UniqueName: \"kubernetes.io/projected/4e8a0380-b22b-4e96-978a-d37c14f6e10e-kube-api-access-f4sxw\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.307376 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.307348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4e8a0380-b22b-4e96-978a-d37c14f6e10e-proc\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.307635 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.307339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4e8a0380-b22b-4e96-978a-d37c14f6e10e-podres\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.307635 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.307406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e8a0380-b22b-4e96-978a-d37c14f6e10e-lib-modules\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.315336 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.315313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4sxw\" (UniqueName: \"kubernetes.io/projected/4e8a0380-b22b-4e96-978a-d37c14f6e10e-kube-api-access-f4sxw\") pod \"perf-node-gather-daemonset-xpn67\" (UID: \"4e8a0380-b22b-4e96-978a-d37c14f6e10e\") " pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.443160 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.443062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:57.570073 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.570045    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"]
Jul 13 19:40:57.572148 ip-10-0-137-93 kubenswrapper[2563]: W0713 19:40:57.572118    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4e8a0380_b22b_4e96_978a_d37c14f6e10e.slice/crio-124c477a2ead15a84c52965378effff05da5bfd52a970ab238eddef6ad583e9c WatchSource:0}: Error finding container 124c477a2ead15a84c52965378effff05da5bfd52a970ab238eddef6ad583e9c: Status 404 returned error can't find the container with id 124c477a2ead15a84c52965378effff05da5bfd52a970ab238eddef6ad583e9c
Jul 13 19:40:57.748158 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:57.748079    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-rs6pz_0a434a2d-125b-48eb-8ba5-ed46293e594e/volume-data-source-validator/0.log"
Jul 13 19:40:58.032709 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:58.032604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67" event={"ID":"4e8a0380-b22b-4e96-978a-d37c14f6e10e","Type":"ContainerStarted","Data":"9b683211e9cc4505f93784a462ac3be46bce799a2a89514c32650a8b71937931"}
Jul 13 19:40:58.032709 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:58.032686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67" event={"ID":"4e8a0380-b22b-4e96-978a-d37c14f6e10e","Type":"ContainerStarted","Data":"124c477a2ead15a84c52965378effff05da5bfd52a970ab238eddef6ad583e9c"}
Jul 13 19:40:58.032890 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:58.032731    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:40:58.049434 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:58.049389    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67" podStartSLOduration=1.049369925 podStartE2EDuration="1.049369925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:58.047871238 +0000 UTC m=+3024.288352205" watchObservedRunningTime="2026-07-13 19:40:58.049369925 +0000 UTC m=+3024.289850863"
Jul 13 19:40:58.639926 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:58.639874    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gc897_53e87220-710d-4fda-a1b2-a87c09fa99b8/dns/0.log"
Jul 13 19:40:58.660429 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:58.660399    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gc897_53e87220-710d-4fda-a1b2-a87c09fa99b8/kube-rbac-proxy/0.log"
Jul 13 19:40:58.828991 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:58.828960    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x96gs_96b30717-80d6-4db4-b93d-e6a8851547ac/dns-node-resolver/0.log"
Jul 13 19:40:59.281071 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:59.281028    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-969f9595c-9fjvb_caa5e9f2-7e63-4430-bb2a-fb9e040dd6fa/registry/0.log"
Jul 13 19:40:59.300158 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:40:59.300132    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qlzx_e4c17dfc-0204-4039-89ff-97908d34bc39/node-ca/0.log"
Jul 13 19:41:00.488586 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:00.488555    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5clww_6c434c9f-c8cb-4b4e-8506-46e98ff06e76/serve-healthcheck-canary/0.log"
Jul 13 19:41:01.033649 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:01.033618    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dp9pw_eaa9e8c7-6a76-4029-9f5e-841291f6b695/kube-rbac-proxy/0.log"
Jul 13 19:41:01.055028 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:01.055005    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dp9pw_eaa9e8c7-6a76-4029-9f5e-841291f6b695/exporter/0.log"
Jul 13 19:41:01.078704 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:01.078684    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dp9pw_eaa9e8c7-6a76-4029-9f5e-841291f6b695/extractor/0.log"
Jul 13 19:41:03.359591 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:03.359564    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-kgjg9_e18b555d-e481-4d40-9382-d22bb066a5e8/manager/0.log"
Jul 13 19:41:03.478296 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:03.478242    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-h5nrs_e9d9ffb7-abb0-47a5-bebf-22a28045ce83/manager/0.log"
Jul 13 19:41:04.046642 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:04.046615    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qwzz7/perf-node-gather-daemonset-xpn67"
Jul 13 19:41:08.042221 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:08.042190    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-d2wjl_9898ab75-3992-4a0e-a632-068a30b6c83f/kube-storage-version-migrator-operator/1.log"
Jul 13 19:41:08.043192 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:08.043174    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-d2wjl_9898ab75-3992-4a0e-a632-068a30b6c83f/kube-storage-version-migrator-operator/0.log"
Jul 13 19:41:09.283802 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:09.283767    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zv8ht_4d48252d-f661-4f65-83a0-21de770514c6/kube-multus-additional-cni-plugins/0.log"
Jul 13 19:41:09.304508 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:09.304468    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zv8ht_4d48252d-f661-4f65-83a0-21de770514c6/egress-router-binary-copy/0.log"
Jul 13 19:41:09.325605 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:09.325570    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zv8ht_4d48252d-f661-4f65-83a0-21de770514c6/cni-plugins/0.log"
Jul 13 19:41:09.347388 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:09.347359    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zv8ht_4d48252d-f661-4f65-83a0-21de770514c6/bond-cni-plugin/0.log"
Jul 13 19:41:09.367074 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:09.367044    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zv8ht_4d48252d-f661-4f65-83a0-21de770514c6/routeoverride-cni/0.log"
Jul 13 19:41:09.386349 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:09.386317    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zv8ht_4d48252d-f661-4f65-83a0-21de770514c6/whereabouts-cni-bincopy/0.log"
Jul 13 19:41:09.405935 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:09.405897    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zv8ht_4d48252d-f661-4f65-83a0-21de770514c6/whereabouts-cni/0.log"
Jul 13 19:41:09.476169 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:09.476139    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zqxzx_67048f8b-9f47-401c-899c-a5cfb8bb2743/kube-multus/0.log"
Jul 13 19:41:09.560225 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:09.560149    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hfp2m_b7e0b486-78b0-47b8-a1c6-191368ae0913/network-metrics-daemon/0.log"
Jul 13 19:41:09.578550 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:09.578528    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hfp2m_b7e0b486-78b0-47b8-a1c6-191368ae0913/kube-rbac-proxy/0.log"
Jul 13 19:41:10.796332 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:10.796303    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-controller/0.log"
Jul 13 19:41:10.814189 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:10.814159    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/1.log"
Jul 13 19:41:10.814375 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:10.814359    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovn-acl-logging/0.log"
Jul 13 19:41:10.833540 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:10.833515    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/kube-rbac-proxy-node/0.log"
Jul 13 19:41:10.852885 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:10.852866    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/kube-rbac-proxy-ovn-metrics/0.log"
Jul 13 19:41:10.871571 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:10.871551    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/northd/0.log"
Jul 13 19:41:10.892602 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:10.892581    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/nbdb/0.log"
Jul 13 19:41:10.912726 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:10.912708    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/sbdb/0.log"
Jul 13 19:41:10.958366 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:10.958341    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv7rg_1314aee4-22f1-483d-a144-4df45468fb5d/ovnkube-controller/0.log"
Jul 13 19:41:11.941429 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:11.941389    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vw9qv_b56462b4-a20f-4b98-8ee8-c482da1e19e3/network-check-target-container/0.log"
Jul 13 19:41:12.919089 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:12.919062    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vzc4p_89172f0d-6dea-4555-8d41-e50e2b851fea/iptables-alerter/0.log"
Jul 13 19:41:13.520646 ip-10-0-137-93 kubenswrapper[2563]: I0713 19:41:13.520616    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-26hxg_77d65125-686b-44c9-a11b-1d76c422750a/tuned/0.log"